title: Subsurface Thermophysical Properties of Europa's Leading and Trailing Hemispheres as Revealed by ALM

abstract: We present best-fit values of porosity -- and the corresponding effective thermal inertiae -- determined from three different depths in Europa's near-subsurface (~1-20 cm). The porosity of the upper ~20 cm of Europa's subsurface varies between 75-50% ($\Gamma_{eff}\approx50-140$ J m$^{-2}$ K$^{-1}$ s$^{-1/2}$) on the leading hemisphere and 50-40% ($\Gamma_{eff}\approx140-180$ J m$^{-2}$ K$^{-1}$ s$^{-1/2}$) on the trailing hemisphere. Residual maps produced by comparison with these models reveal thermally anomalous features that cannot be reproduced by globally homogeneous porosity models. These regions are compared to Europa's surface terrain and known compositional variations. We find that some instances of warm thermal anomalies are co-located with known geographical or compositional features on both the leading and trailing hemisphere; cool temperature anomalies are well correlated with surfaces previously observed to contain pure, crystalline water ice and the expansive rays of Pwyll crater. Anomalous regions correspond to locations with subsurface properties different from those of our best-fit models, such as potentially elevated thermal inertia, decreased emissivity, or more porous regolith. We also find that ALMA observations at ~3 mm sound below the thermal skin depth of Europa (~10-15 cm) for a range of porosity values, and thus do not exhibit features indicative of diurnal variability or residuals similar to other frequency bands. Future observations of Europa at higher angular resolution may reveal additional locations of variable subsurface thermophysical properties, while those at other wavelengths will inform our understanding of the regolith compaction length and the effects of external processes on the shallow subsurface.


title: Whether $p$-conductive homogeneity holds depends on $p$

abstract: We introduce two fractals, in Euclidean spaces of dimension two and three respectively, such the $2$-conductive homogeneity holds but there is some $\eps \in (0, 1)$ so that the $p$-conductive homogeneity fails for every $p\in (1, 1+\eps)$. In addition, these two fractals have Ahlfors regular conformal dimension within the interval $(1, 2)$ and $(2, 3)$, respectively.


title: Angular Integral Autocorrelation for Speed Estimation in Shear Wave Elastography

abstract: The utilization of a reverberant shear wave field in shear wave elastography has emerged as a promising technique for achieving robust shear wave speed (SWS) estimation. However, accurately measuring SWS within such a complex wave field remains challenging. This study introduces an advanced autocorrelation estimator based on angular integration known as the angular integral autocorrelation (AIA) approach to address this issue. The AIA approach incorporates all the au-tocorrelation data from various angles during measurements, resulting in enhanced robustness to both noise and imperfect distributions in SWS estimation. The effectiveness of the AIA estimator for SWS estimation is first validated using a k-Wave simulation of a stiff branching tube in a uniform background. Furthermore, the AIA estimator is applied to ultrasound elastography experiments, MRI experiments, and OCT studies across a range of different excitation frequencies on tissues and phantoms, including in vivo scans. The results verify the capacity of the AIA approach to enhance the accuracy of SWS estimation and SNR, even within an imperfect reverberant shear wave field. Compared to simple autocorrelation approaches, the AIA approach can also successfully visualize and define lesions while significantly improving the estimated SWS and SNR in homogeneous background materials, thus providing improved elastic contrast between structures within the scans. These findings demonstrate the robustness and effectiveness of the AIA approach across a wide range of applications, including ultrasound elastography, MRE, and OCE, for accurately identifying the elastic properties of biological tissues in diverse excitation scenarios.


title: OPSurv: Orthogonal Polynomials Quadrature Algorithm for Survival Analysis

abstract: This paper introduces the Orthogonal Polynomials Quadrature Algorithm for Survival Analysis (OPSurv), a new method providing time-continuous functional outputs for both single and competing risks scenarios in survival analysis. OPSurv utilizes the initial zero condition of the Cumulative Incidence function and a unique decomposition of probability densities using orthogonal polynomials, allowing it to learn functional approximation coefficients for each risk event and construct Cumulative Incidence Function estimates via Gauss--Legendre quadrature. This approach effectively counters overfitting, particularly in competing risks scenarios, enhancing model expressiveness and control. The paper further details empirical validations and theoretical justifications of OPSurv, highlighting its robust performance as an advancement in survival analysis with competing risks.


title: Optimal Shrinkage for Distributed Second-Order Optimization

abstract: In this work, we address the problem of Hessian inversion bias in distributed second-order optimization algorithms. We introduce a novel shrinkage-based estimator for the resolvent of gram matrices which is asymptotically unbiased, and characterize its non-asymptotic convergence rate in the isotropic case. We apply this estimator to bias correction of Newton steps in distributed second-order optimization algorithms, as well as randomized sketching based methods. We examine the bias present in the naive averaging-based distributed Newton's method using analytical expressions and contrast it with our proposed bias-free approach. Our approach leads to significant improvements in convergence rate compared to standard baselines and recent proposals, as shown through experiments on both real and synthetic datasets.


title: Variability in Titan's Mesospheric HCN and Temperature Structure as Observed by ALMA

abstract: The temperature structure of Titan's upper atmosphere exhibits large variability resulting from numerous spatially and temporally irregular external energy sources, seasonal changes, and the influence of molecular species produced via photochemistry. In particular, Titan's relatively abundant HCN is thought to provide substantial cooling to the upper atmosphere through rotational emission, balancing UV/EUV heating and thermal conduction. Here, we present the analysis of ALMA observations of Titan from 2012, 2014, 2015, and 2017, corresponding to planetocentric solar longitudes of ~34-89$^{\circ}$, including vertical HCN and temperature profiles retrieved from the lower mesosphere through the thermosphere (~350-1200 km; $3\times10^{-2}$-$2\times10^{-8}$ mbar). Throughout the atmosphere, temperature profiles differ by 10 to 30 K between observations approximately one Earth year apart, particularly from 600-900 km. We find evidence for a large imbalance in Titan's upper atmospheric energy budget between 2014 and 2015, where the mesospheric thermal structure changes significantly and marks the transition between a mesopause located at ~600 km ($2\times10^{-4}$ mbar) and at ~800 km ($3\times10^{-6}$ mbar). The retrieved HCN abundances vary dramatically during the 2012 to 2017 time period as well, showing close to 2 orders of magnitude difference in abundance at 1000 km. However, the change in HCN abundance does not appear to fully account for the variation in mesospheric temperatures over the $L_S\sim$34-89$^{\circ}$ period. These measurements provide additional insight into the variability of Titan's mesospheric composition and thermal structure following its 2009 vernal equinox, and motivate continued investigation of the origins of such rapid changes in Titan's atmosphere throughout its seasonal cycle.


title: Synchronization and averaging in dynamical systems with fast/slow variables

abstract: We study a family of dynamical systems obtained by coupling a chaotic (Anosov) map on the two-dimensional torus -- the chaotic system -- with the identity map on the one-dimensional torus -- the neutral system -- through a dissipative interaction. We show that the two systems synchronize: the trajectories evolve toward an attracting invariant manifold, and the full dynamics is conjugated to its linearization around the invariant manifold. When the interaction is small, the evolution of the neutral variable, that is the variable which describes the neutral system, is very close to the identity; hence the neutral variable appears as a slow variable with respect to variable which describes the chaotic system, and which is wherefore named the fast variable. We demonstrate that, seen on a suitably long time scale, the slow variable effectively follows the solution of a deterministic differential equation obtained by averaging over the fast variable.


title: Seamless Capture and Stabilization of Spinning Satellites By Space Robots with Spinning Base

abstract: This paper introduces an innovative guidance and control method for simultaneously capturing and stabilizing a fast-spinning target satellite, such as a spin-stabilized satellite, using a spinning-base servicing satellite equipped with a robotic manipulator, joint locks, and reaction wheels (RWs). The method involves controlling the RWs of the servicing satellite to replicate the spinning motion of the target satellite, while locking the manipulator's joints to achieve spin-matching. This maneuver makes the target stationary with respect to the rotating frame of the servicing satellite located at its center-of-mass (CoM), simplifying the robot capture trajectory planning and eliminating post-capture trajectory planning entirely. In the next phase, the joints are unlocked, and a coordination controller drives the robotic manipulator to capture the target satellite while maintaining zero relative rotation between the servicing and target satellites. The spin stabilization phase begins after completing the capture phase, where the joints are locked to form a single tumbling rigid body consisting of the rigidly connected servicing and target satellites. An optimal controller applies negative control torques to the RWs to dampen out the tumbling motion of the interconnected satellites as quickly as possible, subject to the actuation torque limit of the RWs and the maximum torque exerted by the manipulator's end-effector.


title: Calibrated Uncertainty Quantification for Operator Learning via Conformal Prediction

abstract: Operator learning has been increasingly adopted in scientific and engineering applications, many of which require calibrated uncertainty quantification. Since the output of operator learning is a continuous function, quantifying uncertainty simultaneously at all points in the domain is challenging. Current methods consider calibration at a single point or over one scalar function or make strong assumptions such as Gaussianity. We propose a risk-controlling quantile neural operator, a distribution-free, finite-sample functional calibration conformal prediction method. We provide a theoretical calibration guarantee on the coverage rate, defined as the expected percentage of points on the function domain whose true value lies within the predicted uncertainty ball. Empirical results on a 2D Darcy flow and a 3D car surface pressure prediction task validate our theoretical results, demonstrating calibrated coverage and efficient uncertainty bands outperforming baseline methods. In particular, on the 3D problem, our method is the only one that meets the target calibration percentage (percentage of test samples for which the uncertainty estimates are calibrated) of 98%.


title: Anytime Multi-Agent Path Finding using Operation Parallelism in Large Neighborhood Search

abstract: Multi-Agent Path Finding (MAPF) is the problem of finding a set of collision-free paths for multiple agents in a shared environment while minimizing the sum of travel time. Since solving the MAPF problem optimally is NP-hard, anytime algorithms based on Large Neighborhood Search (LNS) are promising to find good-quality solutions in a scalable way by iteratively destroying and repairing the paths. We propose Destroy-Repair Operation Parallelism for LNS (DROP-LNS), a parallel framework that performs multiple destroy and repair operations concurrently to explore more regions of the search space within a limited time budget. Unlike classic MAPF approaches, DROP-LNS can exploit parallelized hardware to improve the solution quality. We also formulate two variants of parallelism and conduct experimental evaluations. The results show that DROP-LNS significantly outperforms the state-of-the-art and the variants.


title: NEOWISE Observations of Distant Active Long-period Comets C/2014 B1 (Schwartz), C/2017 K2 (Pan-STARRS), and C/2010 U3 (Boattini)

abstract: Hyperactive comet activity typically becomes evident beyond the frost line (3 to 4 au) where it becomes too cold for water-ice to sublimate. If carbon monoxide (CO) and carbon dioxide (CO2) are the species that drive activity at sufficiently large distances, then detailed studies on the production rates of these species are extremely valuable to examine the formation of the solar system because these two species (beyond water) are next culpable for driving cometary activity. The NEOWISE reactivated mission operates at two imaging bandpasses, W1 and W2 at 3.4 and 4.6 microns, respectively, with the W2 channel being fully capable of detecting CO and CO2 at 4.67 and 4.23 microns in the same bandpass. It is extremely difficult to study CO2 from the ground due to contamination in Earth's atmosphere. We present our W1 and W2 photometry, dust measurements, and findings for comets C/2014 B1 (Schwartz), C/2017 K2 (Pan-STARRS), and C/2010 U3 (Boattini), hereafter, B1, K2, and U3, respectively. Our results assess CO and CO2 gas production rates observed by NEOWISE. We have determined: (1) comets B1 and K2 have CO2 and CO gas production rates of 1e27 and 1e29 molecules per second, respectively, if one assumes the excess emission is attributed to either all CO or all CO2; (2) B1 and K2 are considered hyperactive in that their measured AfRho dust production values are on the order of greater than or equal to 1e3 cm; and (3) the CO and CO2 production rates do not always follow the expected convention of increasing with decreased heliocentric distance, while B1 and K2 exhibit noticeable dust activity on their inbound leg orbits.


title: Improving Large-Scale k-Nearest Neighbor Text Categorization with Label Autoencoders

abstract: In this paper, we introduce a multi-label lazy learning approach to deal with automatic semantic indexing in large document collections in the presence of complex and structured label vocabularies with high inter-label correlation. The proposed method is an evolution of the traditional k-Nearest Neighbors algorithm which uses a large autoencoder trained to map the large label space to a reduced size latent space and to regenerate the predicted labels from this latent space. We have evaluated our proposal in a large portion of the MEDLINE biomedical document collection which uses the Medical Subject Headings (MeSH) thesaurus as a controlled vocabulary. In our experiments we propose and evaluate several document representation approaches and different label autoencoder configurations.


title: No Need to Look Back: An Efficient and Scalable Approach for Temporal Network Representation Learning

abstract: Temporal graph representation learning (TGRL) is crucial for modeling complex, dynamic systems in real-world networks. Traditional TGRL methods, though effective, suffer from high computational demands and inference latency. This is mainly induced by their inefficient sampling of temporal neighbors by backtracking the interaction history of each node when making model inference. This paper introduces a novel efficient TGRL framework, No-Looking-Back (NLB). NLB employs a "forward recent sampling" strategy, which bypasses the need for backtracking historical interactions. This strategy is implemented using a GPU-executable size-constrained hash table for each node, recording down-sampled recent interactions, which enables rapid response to queries with minimal inference latency. The maintenance of this hash table is highly efficient, with $O(1)$ complexity. NLB is fully compatible with GPU processing, maximizing programmability, parallelism, and power efficiency. Empirical evaluations demonstrate that NLB matches or surpasses state-of-the-art methods in accuracy for link prediction and node classification across six real-world datasets. Significantly, it is 1.32-4.40 $\times$ faster in training, 1.2-7.94 $\times$ more energy efficient, and 1.97-5.02 $\times$ more effective in reducing inference latency compared to the most competitive baselines. The link to the code: https://github.com/Graph-COM/NLB.


title: Analyzing Neural Network-Based Generative Diffusion Models through Convex Optimization

abstract: Diffusion models are gaining widespread use in cutting-edge image, video, and audio generation. Score-based diffusion models stand out among these methods, necessitating the estimation of score function of the input data distribution. In this study, we present a theoretical framework to analyze two-layer neural network-based diffusion models by reframing score matching and denoising score matching as convex optimization. We prove that training shallow neural networks for score prediction can be done by solving a single convex program. Although most analyses of diffusion models operate in the asymptotic setting or rely on approximations, we characterize the exact predicted score function and establish convergence results for neural network-based diffusion models with finite data. Our results provide a precise characterization of what neural network-based diffusion models learn in non-asymptotic settings.


title: The general solution to an autoregressive law of motion

abstract: In this article we provide a complete description of the set of all solutions to an autoregressive law of motion in a finite-dimensional complex vector space. Every solution is shown to be the sum of three parts, each corresponding to a directed flow of time. One part flows forward from the arbitrarily distant past; one flows backward from the arbitrarily distant future; and one flows outward from time zero. The three parts are obtained by applying three complementary spectral projections to the solution, these corresponding to a separation of the eigenvalues of the autoregressive operator according to whether they are inside, outside or on the unit circle. We provide a finite-dimensional parametrization of the set of all solutions.


title: MasonPerplexity at Multimodal Hate Speech Event Detection 2024: Hate Speech and Target Detection Using Transformer Ensembles

abstract: The automatic identification of offensive language such as hate speech is important to keep discussions civil in online communities. Identifying hate speech in multimodal content is a particularly challenging task because offensiveness can be manifested in either words or images or a juxtaposition of the two. This paper presents the MasonPerplexity submission for the Shared Task on Multimodal Hate Speech Event Detection at CASE 2024 at EACL 2024. The task is divided into two sub-tasks: sub-task A focuses on the identification of hate speech and sub-task B focuses on the identification of targets in text-embedded images during political events. We use an XLM-roBERTa-large model for sub-task A and an ensemble approach combining XLM-roBERTa-base, BERTweet-large, and BERT-base for sub-task B. Our approach obtained 0.8347 F1-score in sub-task A and 0.6741 F1-score in sub-task B ranking 3rd on both sub-tasks.


title: A Survey on Context-Aware Multi-Agent Systems: Techniques, Challenges and Future Directions

abstract: Research interest in autonomous agents is on the rise as an emerging topic. The notable achievements of Large Language Models (LLMs) have demonstrated the considerable potential to attain human-like intelligence in autonomous agents. However, the challenge lies in enabling these agents to learn, reason, and navigate uncertainties in dynamic environments. Context awareness emerges as a pivotal element in fortifying multi-agent systems when dealing with dynamic situations. Despite existing research focusing on both context-aware systems and multi-agent systems, there is a lack of comprehensive surveys outlining techniques for integrating context-aware systems with multi-agent systems. To address this gap, this survey provides a comprehensive overview of state-of-the-art context-aware multi-agent systems. First, we outline the properties of both context-aware systems and multi-agent systems that facilitate integration between these systems. Subsequently, we propose a general process for context-aware systems, with each phase of the process encompassing diverse approaches drawn from various application domains such as collision avoidance in autonomous driving, disaster relief management, utility management, supply chain management, human-AI interaction, and others. Finally, we discuss the existing challenges of context-aware multi-agent systems and provide future research directions in this field.


title: Simulation-Enhanced Data Augmentation for Machine Learning Pathloss Prediction

abstract: Machine learning (ML) offers a promising solution to pathloss prediction. However, its effectiveness can be degraded by the limited availability of data. To alleviate these challenges, this paper introduces a novel simulation-enhanced data augmentation method for ML pathloss prediction. Our method integrates synthetic data generated from a cellular coverage simulator and independently collected real-world datasets. These datasets were collected through an extensive measurement campaign in different environments, including farms, hilly terrains, and residential areas. This comprehensive data collection provides vital ground truth for model training. A set of channel features was engineered, including geographical attributes derived from LiDAR datasets. These features were then used to train our prediction model, incorporating the highly efficient and robust gradient boosting ML algorithm, CatBoost. The integration of synthetic data, as demonstrated in our study, significantly improves the generalizability of the model in different environments, achieving a remarkable improvement of approximately 12dB in terms of mean absolute error for the best-case scenario. Moreover, our analysis reveals that even a small fraction of measurements added to the simulation training set, with proper data balance, can significantly enhance the model's performance.


title: BVI-Lowlight: Fully Registered Benchmark Dataset for Low-Light Video Enhancement

abstract: Low-light videos often exhibit spatiotemporal incoherent noise, leading to poor visibility and compromised performance across various computer vision applications. One significant challenge in enhancing such content using modern technologies is the scarcity of training data. This paper introduces a novel low-light video dataset, consisting of 40 scenes captured in various motion scenarios under two distinct low-lighting conditions, incorporating genuine noise and temporal artifacts. We provide fully registered ground truth data captured in normal light using a programmable motorized dolly, and subsequently, refine them via image-based post-processing to ensure the pixel-wise alignment of frames in different light levels. This paper also presents an exhaustive analysis of the low-light dataset, and demonstrates the extensive and representative nature of our dataset in the context of supervised learning. Our experimental results demonstrate the significance of fully registered video pairs in the development of low-light video enhancement methods and the need for comprehensive evaluation. Our dataset is available at DOI:10.21227/mzny-8c77.


title: Octofitter: Fast, Flexible, and Accurate Orbit Modelling to Detect Exoplanets

abstract: As next-generation imaging instruments and interferometers search for planets closer to their stars, they must contend with increasing orbital motion and longer integration times. These compounding effects make it difficult to detect faint planets but also present an opportunity. Increased orbital motion makes it possible to move the search for planets into the orbital domain, where direct images can be freely combined with the radial velocity and proper motion anomaly, even without a confirmed detection in any single epoch. In this paper, we present a fast and differentiable multimethod orbit-modeling and planet detection code called Octofitter. This code is designed to be highly modular and allows users to easily adjust priors, change parameterizations, and specify arbitrary function relations between the parameters of one or more planets. Octofitter further supplies tools for examining model outputs including prior and posterior predictive checks and simulation-based calibration. We demonstrate the capabilities of Octofitter on real and simulated data from different instruments and methods, including HD 91312, simulated JWST/NIRISS aperture masking interferometry observations, radial velocity curves, and grids of images from the Gemini Planet Imager. We show that Octofitter can reliably recover faint planets in long sequences of images with arbitrary orbital motion. This publicly available tool will enable the broad application of multiepoch and multimethod exoplanet detection, which could improve how future targeted ground- and space-based surveys are performed. Finally, its rapid convergence makes it a useful addition to the existing ecosystem of tools for modeling the orbits of directly imaged planets.


title: Combining T-learning and DR-learning: a framework for oracle-efficient estimation of causal contrasts

abstract: We introduce efficient plug-in (EP) learning, a novel framework for the estimation of heterogeneous causal contrasts, such as the conditional average treatment effect and conditional relative risk. The EP-learning framework enjoys the same oracle-efficiency as Neyman-orthogonal learning strategies, such as DR-learning and R-learning, while addressing some of their primary drawbacks, including that (i) their practical applicability can be hindered by loss function non-convexity; and (ii) they may suffer from poor performance and instability due to inverse probability weighting and pseudo-outcomes that violate bounds. To avoid these drawbacks, EP-learner constructs an efficient plug-in estimator of the population risk function for the causal contrast, thereby inheriting the stability and robustness properties of plug-in estimation strategies like T-learning. Under reasonable conditions, EP-learners based on empirical risk minimization are oracle-efficient, exhibiting asymptotic equivalence to the minimizer of an oracle-efficient one-step debiased estimator of the population risk function. In simulation experiments, we illustrate that EP-learners of the conditional average treatment effect and conditional relative risk outperform state-of-the-art competitors, including T-learner, R-learner, and DR-learner. Open-source implementations of the proposed methods are available in our R package hte3.


title: Refined bounds on energy harvesting from anisotropic fluctuations

abstract: We consider overdamped Brownian particles with two degrees of freedom (DoF) that are confined in a time-varying quadratic potential and are in simultaneous contact with heat baths of different temperatures along the respective DoF. The anisotropy in thermal fluctuations can be used to extract work by suitably manipulating the confining potential. The question of what the maximal amount of work that can be extracted is has been raised in recent work, and has been computed under the simplifying assumption that the entropy of the distribution of particles (thermodynamic states) remains constant throughout a thermodynamic cycle. Indeed, it was shown that the maximal amount of work that can be extracted amounts to solving an isoperimetric problem, where the 2-Wasserstein length traversed by thermodynamic states quantifies dissipation that can be traded off against an area integral that quantifies work drawn out of the thermal anisotropy. Here, we remove the simplifying assumption on constancy of entropy. We show that the work drawn can be computed similarly to the case where the entropy is kept constant while the dissipation can be reduced by suitably tilting the thermodynamic cycle in a thermodynamic space with one additional dimension. Optimal cycles can be locally approximated by solutions to an isoperimetric problem in a tilted lower-dimensional subspace.


title: Hypergraph-Transformer (HGT) for Interactive Event Prediction in Laparoscopic and Robotic Surgery

abstract: Understanding and anticipating intraoperative events and actions is critical for intraoperative assistance and decision-making during minimally invasive surgery. Automated prediction of events, actions, and the following consequences is addressed through various computational approaches with the objective of augmenting surgeons' perception and decision-making capabilities. We propose a predictive neural network that is capable of understanding and predicting critical interactive aspects of surgical workflow from intra-abdominal video, while flexibly leveraging surgical knowledge graphs. The approach incorporates a hypergraph-transformer (HGT) structure that encodes expert knowledge into the network design and predicts the hidden embedding of the graph. We verify our approach on established surgical datasets and applications, including the detection and prediction of action triplets, and the achievement of the Critical View of Safety (CVS). Moreover, we address specific, safety-related tasks, such as predicting the clipping of cystic duct or artery without prior achievement of the CVS. Our results demonstrate the superiority of our approach compared to unstructured alternatives.


title: Structure-Aware E(3)-Invariant Molecular Conformer Aggregation Networks

abstract: A molecule's 2D representation consists of its atoms, their attributes, and the molecule's covalent bonds. A 3D (geometric) representation of a molecule is called a conformer and consists of its atom types and Cartesian coordinates. Every conformer has a potential energy, and the lower this energy, the more likely it occurs in nature. Most existing machine learning methods for molecular property prediction consider either 2D molecular graphs or 3D conformer structure representations in isolation. Inspired by recent work on using ensembles of conformers in conjunction with 2D graph representations, we propose $\mathrm{E}$(3)-invariant molecular conformer aggregation networks. The method integrates a molecule's 2D representation with that of multiple of its conformers. Contrary to prior work, we propose a novel 2D-3D aggregation mechanism based on a differentiable solver for the \emph{Fused Gromov-Wasserstein Barycenter} problem and the use of an efficient conformer generation method based on distance geometry. We show that the proposed aggregation mechanism is $\mathrm{E}$(3) invariant and propose an efficient GPU implementation. Moreover, we demonstrate that the aggregation mechanism helps to significantly outperform state-of-the-art molecule property prediction methods on established datasets.


title: MasonPerplexity at ClimateActivism 2024: Integrating Advanced Ensemble Techniques and Data Augmentation for Climate Activism Stance and Hate Event Identification

abstract: The task of identifying public opinions on social media, particularly regarding climate activism and the detection of hate events, has emerged as a critical area of research in our rapidly changing world. With a growing number of people voicing either to support or oppose to climate-related issues - understanding these diverse viewpoints has become increasingly vital. Our team, MasonPerplexity, participates in a significant research initiative focused on this subject. We extensively test various models and methods, discovering that our most effective results are achieved through ensemble modeling, enhanced by data augmentation techniques like back-translation. In the specific components of this research task, our team achieved notable positions, ranking 5th, 1st, and 6th in the respective sub-tasks, thereby illustrating the effectiveness of our approach in this important field of study.


title: Spintronic devices and applications using noncollinear anti-chiral antiferromagnets

abstract: Antiferromagnetic materials have a vanishingly small net magnetization, which generates weak dipolar fields and makes them robust against external magnetic perturbation and rapid magnetization dynamics, as dictated by the geometric mean of their exchange and anisotropy energies. However, experimental and theoretical techniques to detect and manipulate the antiferromagnetic order in a fully electrical manner must be developed to enable advanced spintronic devices with antiferromagnets (AFMs) as their active spin-dependent elements. Among the various AFMs, conducting AFMs offer high electrical and thermal conductivities and strong electron-spin-phonon interactions. Noncollinear metallic AFMs with negative chirality, including Mn3Sn, Mn3Ge, and Mn3GaN, offer rich physics that arises from their topology. In this review article, we introduce the crystal structure and the physical phenomena observed in negative chirality AFMs. Experimental and theoretical advances related to current-induced dynamics on the spin structure of Mn3Sn are discussed. We then present a potential AFM spintronic device that can serve as a non-volatile memory, high-frequency signal generator, neuron emulator, and even a probabilistic bit, depending on the design parameters and the input stimuli, i.e., amplitude and pulse width of the injected spin current and the external magnetic field. In this device, spin-orbit torques can be used to manipulate the order parameter, while the device state can be read via tunneling magnetoresistance. We also present analytic models that relate the performance characteristics of the device with its design parameters, thus enabling a rapid technology-device assessment. Effects of Joule heating and thermal noise on the device characteristics are briefly discussed. We close the paper by summarizing the status of research and present our outlook in this rapidly evolving research field.


title: Magnetosheath ion field-aligned anisotropy and implications for ion leakage to the foreshock

abstract: The ion foreshock is highly dynamic, disturbing the bow shock and the magnetosphere-ionosphere system. To forecast foreshock-driven space weather effects, it is necessary to model foreshock ions as a function of upstream shock parameters. Case studies in the accompanying paper show that magnetosheath ions sometimes exhibit strong field-aligned anisotropy towards the upstream direction, which may be responsible for enhancing magnetosheath leakage and therefore foreshock ion density. To understand the conditions leading to such an anisotropy and the potential for enhanced leakage, we perform case studies and a statistical study of magnetosheath and foreshock region data surrounding ~500 THEMIS bow shock crossings. We quantify the anisotropy using the heat flux along the field-aligned direction. We show that the strong field-aligned heat flux persists across the entire magnetosheath from the magnetopause to the bow shock. Ion distribution functions reveal that the strong heat flux is caused by a secondary thermal population. We find that stronger anisotropy events exhibit heat flux preferentially towards the upstream direction near the bow shock and occur under larger IMF strength and larger solar wind dynamic pressure and/or energy flux. Additionally, we show that near the bow shock, magnetosheath leakage is a significant contributor to foreshock ions, and through enhancing the leakage the magnetosheath ion anisotropy can modulate the foreshock ion velocity and density. Our results imply that likely due to field line draping and compression against the magnetopause that leads to a directional mirror force, modeling the foreshock ions necessitates a more global accounting of downstream conditions.


title: Observation of nonlinear fractal higher-order topological insulator

abstract: Higher-order topological insulators (HOTIs) are unique materials hosting topologically protected states, whose dimensionality is at least by a factor of 2 lower than that of the bulk. Topological states in such insulators may be strongly confined in their corners that leads to considerable enhancement of nonlinear processes involving such states. However, all nonlinear HOTIs demonstrated so far were built on periodic bulk lattice materials. Here we demonstrate first \textit{nonlinear photonic} HOTI with the fractal origin. Despite their fractional effective dimensionality, the HOTIs constructed here on two different types of the Sierpi\'nski gasket waveguide arrays, may support topological corner states for unexpectedly wide range of coupling strengths, even in parameter regions where conventional HOTIs become trivial. We demonstrate thresholdless solitons bifurcating from corner states in nonlinear fractal HOTIs and show that their localization can be efficiently controlled by the input beam power. We observe sharp differences in nonlinear light localization on outer and multiple inner corners and edges representative for these fractal materials. Our findings not only represent a new paradigm for nonlinear topological insulators, but also open new avenues for potential applications of fractal materials to control the light flow.


title: SOCIALITE-LLAMA: An Instruction-Tuned Model for Social Scientific Tasks

abstract: Social science NLP tasks, such as emotion or humor detection, are required to capture the semantics along with the implicit pragmatics from text, often with limited amounts of training data. Instruction tuning has been shown to improve the many capabilities of large language models (LLMs) such as commonsense reasoning, reading comprehension, and computer programming. However, little is known about the effectiveness of instruction tuning on the social domain where implicit pragmatic cues are often needed to be captured. We explore the use of instruction tuning for social science NLP tasks and introduce Socialite-Llama -- an open-source, instruction-tuned Llama. On a suite of 20 social science tasks, Socialite-Llama improves upon the performance of Llama as well as matches or improves upon the performance of a state-of-the-art, multi-task finetuned model on a majority of them. Further, Socialite-Llama also leads to improvement on 5 out of 6 related social tasks as compared to Llama, suggesting instruction tuning can lead to generalized social understanding. All resources including our code, model and dataset can be found through bit.ly/socialitellama.


title: Self-Debiasing Large Language Models: Zero-Shot Recognition and Reduction of Stereotypes

abstract: Large language models (LLMs) have shown remarkable advances in language generation and understanding but are also prone to exhibiting harmful social biases. While recognition of these behaviors has generated an abundance of bias mitigation techniques, most require modifications to the training data, model parameters, or decoding strategy, which may be infeasible without access to a trainable model. In this work, we leverage the zero-shot capabilities of LLMs to reduce stereotyping in a technique we introduce as zero-shot self-debiasing. With two approaches, self-debiasing via explanation and self-debiasing via reprompting, we show that self-debiasing can significantly reduce the degree of stereotyping across nine different social groups while relying only on the LLM itself and a simple prompt, with explanations correctly identifying invalid assumptions and reprompting delivering the greatest reductions in bias. We hope this work opens inquiry into other zero-shot techniques for bias mitigation.


title: A Proof-theoretic Semantics for Intuitionistic Linear Logic

abstract: The approach taken by Gheorghiu, Gu and Pym in their paper on giving a Base-extension Semantics for Intuitionistic Multiplicative Linear Logic is an interesting adaptation of the work of Sandqvist for IPL to the substructural setting. What is particularly interesting is how naturally the move to the substructural setting provided a semantics for the multiplicative fragment of intuitionistic linear logic. Whilst ultimately the Gheorghiu, Gu and Pym used their foundations to provide a semantics for bunched implication logic, it begs the question, what of the rest of intuitionistic linear logic? In this paper, I present just such a semantics. This is particularly of interest as this logic has as a connective the bang, a modal connective. Capturing the inferentialist content of formulas marked with this connective is particularly challenging and a discussion is dedicated to this at the end of the paper.


title: Searching for cosmological variation of the proton-to-electron mass ratio using a single $H_2$ system

abstract: Exploring physics beyond General Relativity and the Standard Model of Particle Physics involves investigating spacetime variations in natural constants. This study employs an $H_2$-single of QSO 0347-383 observational spectrum to propose a unique approach for detecting potential changes in the proton-to-electron mass ratio. By comparing the ratio from observational and laboratory data in the Lyman-Alpha transition line, we derive a cosmological variation of $\Delta\mu / \mu = (0.120 \pm 0.144) \times 10^{-8}$ at $z_{abs}=3.025$. This approach not only advances fundamental physics understanding but also introduces innovative techniques for analyzing high-redshift QSO systems.


title: A Schur's type volume comparison theorem

abstract: In this paper, inspired by Schur's comparison theorem about curves in Euclidean space, we mainly provide a Schur's type volume comparison theorem, which is about the volumes of the boundaries of open balls in a complete $n$-dimensional Riemannian manifold with Ricci$\geq (n-1)k$.


title: A Discrete-time Dynamical Model for Optimal Dispatching and Rebalancing of Autonomous Mobility-on-Demand Systems

abstract: Autonomous vehicles are rapidly evolving and will soon enable the application of large-scale mobility-on-demand (MoD) systems. Managing the fleets of available vehicles, commonly known as "rebalancing," is crucial to ensure that vehicles are distributed properly to meet customer demands. This paper presents an optimal control approach to optimize vehicle scheduling and rebalancing in an autonomous mobility-on-demand (AMoD) system. We use graph theory to model a city partitioned into virtual zones. Zones represent small areas of the city where vehicles can stop and pick up/drop off customers, whereas links denote corridors of the city along which autonomous vehicles can move. They are considered vertices and edges in the graph. Vehicles employed in the AMoD scheme are autonomous, and rebalancing can be executed by dispatching available empty vehicles to areas undersupplied. Rebalancing is performed on the graph's vertices, i.e., between city areas. We propose a linear, discrete-time model of an AMoD system using a transformed network. After acquiring the model, the desired number of rebalancing vehicles for the AMoD model is derived through an optimization problem. Moreover, the well-posedness of the model is illustrated. To leverage the proposed model, we implemented the model predictive control (MPC) framework to find the optimal rebalancing and scheduling policy. We show the MPC's effectiveness and how the MPC framework can be implemented in real-time for a real-world case study. The numerical results show that the MPC with a linear cost function and linear reference, which it tracks, is effective, outperforming other MPC-based and state-of-the-art algorithms across all evaluation criteria.


title: On $(1,2)$-step competition graphs of multipartite tournaments II

abstract: A multipartite tournament is an orientation of a complete $k$-partite graph for some positive integer $k\geq 3$. We say that a multipartite tournament $D$ is tight if every partite set forms a clique in the $(1,2)$-step competition graph, denoted by $C_{1,2}(D)$, of $D$. In the previous paper titled "On $(1,2)$-step competition graphs of multipartite tournaments" \cite{choi202412step} we completely characterize $C_{1,2}(D)$ for a tight multipartite tournament $D$. As an extension, in this paper, we study $(1,2)$-step competition graphs of multipartite tournaments that are not tight, which will be called loose. For a loose multipartite tournament $D$, various meaningful results are obtained in terms of $C_{1,2}(D)$ being interval and $C_{1,2}(D)$ being connected.


title: Online Transfer Learning for RSV Case Detection

abstract: Transfer learning has become a pivotal technique in machine learning and has proven to be effective in various real-world applications. However, utilizing this technique for classification tasks with sequential data often faces challenges, primarily attributed to the scarcity of class labels. To address this challenge, we introduce Multi-Source Adaptive Weighting (MSAW), an online multi-source transfer learning method. MSAW integrates a dynamic weighting mechanism into an ensemble framework, enabling automatic adjustment of weights based on the relevance and contribution of each source (representing historical knowledge) and target model (learning from newly acquired data). We demonstrate the effectiveness of MSAW by applying it to detect Respiratory Syncytial Virus cases within Emergency Department visits, utilizing multiple years of electronic health records from the University of Pittsburgh Medical Center. Our method demonstrates performance improvements over many baselines, including refining pre-trained models with online learning as well as three static weighting approaches, showing MSAW's capacity to integrate historical knowledge with progressively accumulated new data. This study indicates the potential of online transfer learning in healthcare, particularly for developing machine learning models that dynamically adapt to evolving situations where new data is incrementally accumulated.


title: Low-power scalable multilayer optoelectronic neural networks enabled with incoherent light

abstract: Optical approaches have made great strides towards the goal of high-speed, energy-efficient computing necessary for modern deep learning and AI applications. Read-in and read-out of data, however, limit the overall performance of existing approaches. This study introduces a multilayer optoelectronic computing framework that alternates between optical and optoelectronic layers to implement matrix-vector multiplications and rectified linear functions, respectively. Our framework is designed for real-time, parallelized operations, leveraging 2D arrays of LEDs and photodetectors connected via independent analog electronics. We experimentally demonstrate this approach using a system with a three-layer network with two hidden layers and operate it to recognize images from the MNIST database with a recognition accuracy of 92% and classify classes from a nonlinear spiral data with 86% accuracy. By implementing multiple layers of a deep neural network simultaneously, our approach significantly reduces the number of read-ins and read-outs required and paves the way for scalable optical accelerators requiring ultra low energy.


title: Optimal Planning of PV and Battery Resources in Remote Microgrids Considering Degradation Costs: An Iterative Post-Optimization Correction-based Approach

abstract: The benefits of shifting to renewable energy sources have granted microgrids considerable attention, especially photovoltaic (PV) systems. However, given the inherent variable and intermittent nature of solar power, battery energy storage systems (BESS) are pivotal for a reliable and cost-effective microgrid. The optimal sizing and energy scheduling of PV and BESS pose significant importance for minimal investment and operational cost. The associated costs of degradation for both these sources further add complexity to the overall planning problem. This paper proposes a microgrid resource planning model for determining the optimal PV and BESS sizes in combination with natural gas generators, considering their technical and financial characteristics as well as the degradation costs of both PV and BESS. Its objective is to minimize the microgrid-wide total operational and capital cost. The optimization model is formulated using mixed-integer linear programming to ensure the resource sizing problem converges with a reasonably small optimality gap. In addition, an iterative post-optimization BESS degradation cost correction algorithm is proposed for enhanced accuracy. The results showcase the savings in the overall objective cost and reductions in solar energy curtailment upon BESS's inclusion.


title: Solutions to a generalized Chern-Simons Higgs model on finite graphs by topological degree

abstract: Consider a finite connected graph denoted as $G=(V, E)$. This study explores a generalized Chern-Simons Higgs model, characterized by the equation: $$ \Delta u = \lambda e^u (e^u - 1)^{2p+1} + f,$$ where $\Delta$ denotes the graph Laplacian, $\lambda$ is a real number, $p$ is a non-negative integer, and $f$ is a function on $V$. Through the computation of the topological degree, this paper demonstrates the existence of a single solution for the model. Further analysis of the interplay between the topological degree and the critical group of an associated functional reveals the presence of multiple solutions. These findings extend the work of Li, Sun, Yang (arXiv:2309.12024) and Chao, Hou (J. Math. Anal. Appl. (2023) 126787).


title: An Exposure Meter of Lijiang Fiber-fed High-Resolution Spectrograph

abstract: In 2016, an exposure meter was installed on the Lijiang Fiber-fed High-Resolution Spectrograph to monitor the coupling of starlight to the science fiber during observations. Based on it, we investigated a method to estimate the exposure flux of the CCD in real time by using the counts of the photomultiplier tubes (PMT) of the exposure meter, and developed a piece of software to optimize the control of the exposure time. First, by using flat-field lamp observations, we determined that there is a linear and proportional relationship between the total counts of the PMT and the exposure flux of the CCD. Second, using historical observations of different spectral types, the corresponding relational conversion factors were determined and obtained separately. Third, the method was validated using actual observation data, which showed that all values of the coefficient of determination were greater than 0.92. Finally, software was developed to display the counts of the PMT and the estimated exposure flux of the CCD in real-time during the observation, providing a visual reference for optimizing the exposure time control.


title: Second Response to the critique of "Cotton Gravity''

abstract: Clement and Noiucer submitted a note {\tt arXiv:2401.16008 [gr-qc]} replying to our criticism {\tt arXiv:2401.10479 [gr-qc]} of their previous submission. We reply to the contents of this note and remark that these authors have not addressed our arguments. This will be our last response to them. Readers are advised to look at all material and judge by themselves


title: Measurement of the Electromagnetic Transition Form-factors in the decays $\eta'\rightarrow\pi^+\pi^-l^+l^-$

abstract: With a sample of $(10087\pm44)\times10^{6}$ $J/\psi$ events accumulated with the BESIII detector, we analyze the decays $\eta'\rightarrow\pi^+\pi^-l^+l^-(l=e,$ $\mu)$ via the process $J/\psi\rightarrow\gamma\eta'$. The branching fractions are measured to be $\mathcal{B}(\eta'\rightarrow\pi^+\pi^-e^+e^-)=(2.45\pm0.02(\rm{stat.})\pm0.08(\rm{syst.})) \times10^{-3}$ and $\mathcal{B}(\eta'\rightarrow\pi^+\pi^-\mu^+\mu^-)=(2.16\pm0.12(\rm{stat.})\pm0.06(\rm{syst.}))\times10^{-5}$, and the ratio is $\frac{\mathcal{B}(\eta'\rightarrow\pi^{+}\pi^{-}e^{+}e^{-})}{\mathcal{B}(\eta'\rightarrow\pi^{+}\pi^{-}\mu^{+}\mu^{-})} = 113.4\pm0.9(\rm{stat.})\pm3.7(\rm{syst.})$. In addition, by combining the $\eta'\rightarrow\pi^+\pi^-e^+e^-$ and $\eta'\rightarrow\pi^+\pi^-\mu^+\mu^-$ decays, the slope parameter of the electromagnetic transition form factor is measured to be $b_{\eta'}=1.30\pm0.19\ (\mathrm{GeV}/c^{2})^{-2}$, which is consistent with previous measurements from BESIII and theoretical predictions from the VMD model. The asymmetry in the angle between the $\pi^+\pi^-$ and $l^+l^-$ decay planes, which has the potential to reveal the $CP$-violation originating from an unconventional electric dipole transition, is also investigated. The asymmetry parameters are determined to be $\mathcal{A}_{CP}(\eta'\rightarrow\pi^+\pi^-e^+e^-)=(-0.21\pm0.73(\rm{stat.})\pm0.01(\rm{syst.}))\%$ and $\mathcal{A}_{CP}(\eta'\rightarrow\pi^+\pi^-\mu^+\mu^-)=(0.62\pm4.71(\rm{stat.})\pm0.08(\rm{syst.}))\%$, implying that no evidence of $CP$-violation is observed at the present statistics. Finally, an axion-like particle is searched for via the decay $\eta'\rightarrow\pi^+\pi^-a, a\rightarrow e^+e^-$, and upper limits of the branching fractions are presented for the mass assumptions of the axion-like particle in the range of $0-500\ \mathrm{MeV}/c^{2}$.


title: Human-Centered Privacy Research in the Age of Large Language Models

abstract: The emergence of large language models (LLMs), and their increased use in user-facing systems, has led to substantial privacy concerns. To date, research on these privacy concerns has been model-centered: exploring how LLMs lead to privacy risks like memorization, or can be used to infer personal characteristics about people from their content. We argue that there is a need for more research focusing on the human aspect of these privacy issues: e.g., research on how design paradigms for LLMs affect users' disclosure behaviors, users' mental models and preferences for privacy controls, and the design of tools, systems, and artifacts that empower end-users to reclaim ownership over their personal data. To build usable, efficient, and privacy-friendly systems powered by these models with imperfect privacy properties, our goal is to initiate discussions to outline an agenda for conducting human-centered research on privacy issues in LLM-powered systems. This Special Interest Group (SIG) aims to bring together researchers with backgrounds in usable security and privacy, human-AI collaboration, NLP, or any other related domains to share their perspectives and experiences on this problem, to help our community establish a collective understanding of the challenges, research opportunities, research methods, and strategies to collaborate with researchers outside of HCI.


title: Online Uniform Allocation:Randomized Learning-Augmented Approximation Algorithms with Application to Digital Health

abstract: Motivated by applications in digital health, this work studies the novel problem of online uniform allocation (OUA), where the goal is to distribute a budget uniformly across unknown decision times. In the OUA problem, the algorithm is given a budget $b$ and a time horizon $T$, and an adversary then chooses a value $\tau^* \in [b,T]$, which is revealed to the algorithm online. At each decision time $i \in [\tau^*]$, the algorithm must determine a probability that maximizes the budget spent throughout the horizon, respecting budget constraint $b$, while achieving as uniform a distribution as possible over $\tau^*$. We present the first randomized algorithm designed for this problem and subsequently extend it to incorporate learning augmentation. We provide worst-case approximation guarantees for both algorithms, and illustrate the utility of the algorithms through both synthetic experiments and a real-world case study involving the HeartSteps mobile application. Our numerical results show strong empirical average performance of our proposed randomized algorithms against previously proposed heuristic solutions.


title: A self-induced mechanism of large-scale helical structures in compressible turbulent flows

abstract: A novel self-sustaining mechanism is proposed for large-scale helical structures in compressible turbulent flows. The existence of two channels of subgrid-scale and viscosity terms for large-scale helicity evolution is confirmed for the first time, through selecting a physical definition of the large-scale helicity in compressible turbulence. Under the influence of the fluid element expansion, it is found that the helicity is generated at small scales via the second-channel viscosity, and the inverse cross-scale helicity transfers at inertial scales through the second-channel helicity flux. Together, they form a self-induced mechanism, which provides a physical insight into the long-period characteristic of large-scale helical structures in the evolution of compressible flow systems.


title: Integral formulas for slice Cauchy-Riemann operator and applications

abstract: The theory of slice regular functions has been developed rapidly in the past few years, and most properties are given in slices at the early stage. In 2013, Colombo et al. introduced a non-constant coefficients differential operator to describe slice regular functions globally, and this brought the study of slice regular functions in a global sense. In this article, we introduce a slice Cauchy-Riemann operator, which is motivated by the non-constant coefficients differential operator mentioned above. Then, A Borel-Pompeiu formula for this slice Cauchy-Riemann operator is discovered, which leads to a Cauchy integral formula for slice regular functions. A Plemelj integral formula for the slice Cauchy-Riemann operator is introduced, which gives rise to results on slice regular extension at the end.


title: Temperature Measurement of Quark-Gluon Plasma at Different Stages

abstract: In a Quark-Gluon Plasma (QGP), the fundamental building blocks of matter, quarks and gluons, are under extreme conditions of temperature and density. A QGP could exist in the early stages of the Universe, and in various objects and events in the cosmos. The thermodynamic and hydrodynamic properties of the QGP are described by Quantum Chromodynamics (QCD) and can be studied in heavy-ion collisions. Despite being a key thermodynamic parameter, the QGP temperature is still poorly known. Thermal lepton pairs ($e^+e^-$ and $\mu^+\mu^-$) are ideal penetrating probes of the true temperature of the emitting source, since their invariant-mass spectra suffer neither from strong final-state interactions nor from blue-shift effects due to rapid expansion. Here we measure the QGP temperature using thermal $e^+e^-$ production at the Relativistic Heavy Ion Collider (RHIC). The average temperature from the low-mass region (in-medium $\rho^0$ vector-meson dominant) is $(1.99 \pm 0.24) \times 10^{12}$ K, consistent with the chemical freeze-out temperature from statistical models and the phase transition temperature from LQCD. The average temperature from the intermediate mass region (above the $\rho^0$ mass, QGP dominant) is significantly higher at $(3.40 \pm 0.55)\times 10^{12}$ K. This work provides essential experimental thermodynamic measurements to map out the QCD phase diagram and understand the properties of matter under extreme conditions.


title: A Novel Hyperdimensional Computing Framework for Online Time Series Forecasting on the Edge

abstract: In recent years, both online and offline deep learning models have been developed for time series forecasting. However, offline deep forecasting models fail to adapt effectively to changes in time-series data, while online deep forecasting models are often expensive and have complex training procedures. In this paper, we reframe the online nonlinear time-series forecasting problem as one of linear hyperdimensional time-series forecasting. Nonlinear low-dimensional time-series data is mapped to high-dimensional (hyperdimensional) spaces for linear hyperdimensional prediction, allowing fast, efficient and lightweight online time-series forecasting. Our framework, TSF-HD, adapts to time-series distribution shifts using a novel co-training framework for its hyperdimensional mapping and its linear hyperdimensional predictor. TSF-HD is shown to outperform the state of the art, while having reduced inference latency, for both short-term and long-term time series forecasting. Our code is publicly available at http://github.com/tsfhd2024/tsf-hd.git


title: A Survey on Graph Condensation

abstract: Analytics on large-scale graphs have posed significant challenges to computational efficiency and resource requirements. Recently, Graph condensation (GC) has emerged as a solution to address challenges arising from the escalating volume of graph data. The motivation of GC is to reduce the scale of large graphs to smaller ones while preserving essential information for downstream tasks. For a better understanding of GC and to distinguish it from other related topics, we present a formal definition of GC and establish a taxonomy that systematically categorizes existing methods into three types based on its objective, and classify the formulations to generate the condensed graphs into two categories as modifying the original graphs or synthetic completely new ones. Moreover, our survey includes a comprehensive analysis of datasets and evaluation metrics in this field. Finally, we conclude by addressing challenges and limitations, outlining future directions, and offering concise guidelines to inspire future research in this field.


title: PANDA: Query Evaluation in Submodular Width

abstract: In recent years, several information-theoretic upper bounds have been introduced on the output size and evaluation cost of database join queries. These bounds vary in their power depending on both the type of statistics on input relations and the query plans that they support. This motivated the search for algorithms that can compute the output of a join query in times that are bounded by the corresponding information-theoretic bounds. In this paper, we describe PANDA, an algorithm that takes a Shannon-inequality that underlies the bound, and translates each proof step into an algorithmic step corresponding to some database operation. PANDA computes answers to a conjunctive query in time given by the the submodular width plus the output size of the query. The version in this paper represents a significant simplification of the original version [ANS, PODS'17].


title: Bulk Photovoltaics in Nanoscale Systems -- Origin of Shift Currents in the Many-Body Picture

abstract: The shift current in bulk photovoltaics is commonly attributed to a shift in non-interacting charge centres. We show that the origin of shift currents in the many-body picture is fundamentally different. Here the shift current arises largely from a many-body shift vector that also involves shifts in charge centres, but these are associated with pairs of nearly-degenerate excitons overlapping in k-space. The shift current can thus be enhanced by nearly-degenerate, optically-active and tightly-bound excitons, spread out in k-space. Ab initio results are presented for BaTiO$_3$, NbOCl$_2$ and MoS$_2$.


title: GenFace: A Large-Scale Fine-Grained Face Forgery Benchmark and Cross Appearance-Edge Learning

abstract: The rapid advancement of photorealistic generators has reached a critical juncture where the discrepancy between authentic and manipulated images is increasingly indistinguishable. Thus, benchmarking and advancing techniques detecting digital manipulation become an urgent issue. Although there have been a number of publicly available face forgery datasets, the forgery faces are mostly generated using GAN-based synthesis technology, which does not involve the most recent technologies like diffusion. The diversity and quality of images generated by diffusion models have been significantly improved and thus a much more challenging face forgery dataset shall be used to evaluate SOTA forgery detection literature. In this paper, we propose a large-scale, diverse, and fine-grained high-fidelity dataset, namely GenFace, to facilitate the advancement of deepfake detection, which contains a large number of forgery faces generated by advanced generators such as the diffusion-based model and more detailed labels about the manipulation approaches and adopted generators. In addition to evaluating SOTA approaches on our benchmark, we design an innovative cross appearance-edge learning (CAEL) detector to capture multi-grained appearance and edge global representations, and detect discriminative and general forgery traces. Moreover, we devise an appearance-edge cross-attention (AECA) module to explore the various integrations across two domains. Extensive experiment results and visualizations show that our detection model outperforms the state of the arts on different settings like cross-generator, cross-forgery, and cross-dataset evaluations. Code and datasets will be available at \url{https://github.com/Jenine-321/GenFace


title: Enhancing the efficiency of protein language models with minimal wet-lab data through few-shot learning

abstract: Accurately modeling the protein fitness landscapes holds great importance for protein engineering. Recently, due to their capacity and representation ability, pre-trained protein language models have achieved state-of-the-art performance in predicting protein fitness without experimental data. However, their predictions are limited in accuracy as well as interpretability. Furthermore, such deep learning models require abundant labeled training examples for performance improvements, posing a practical barrier. In this work, we introduce FSFP, a training strategy that can effectively optimize protein language models under extreme data scarcity. By combining the techniques of meta-transfer learning, learning to rank, and parameter-efficient fine-tuning, FSFP can significantly boost the performance of various protein language models using merely tens of labeled single-site mutants from the target protein. The experiments across 87 deep mutational scanning datasets underscore its superiority over both unsupervised and supervised approaches, revealing its potential in facilitating AI-guided protein design.


title: Topology-Informed Graph Transformer

abstract: Transformers have revolutionized performance in Natural Language Processing and Vision, paving the way for their integration with Graph Neural Networks (GNNs). One key challenge in enhancing graph transformers is strengthening the discriminative power of distinguishing isomorphisms of graphs, which plays a crucial role in boosting their predictive performances. To address this challenge, we introduce 'Topology-Informed Graph Transformer (TIGT)', a novel transformer enhancing both discriminative power in detecting graph isomorphisms and the overall performance of Graph Transformers. TIGT consists of four components: A topological positional embedding layer using non-isomorphic universal covers based on cyclic subgraphs of graphs to ensure unique graph representation: A dual-path message-passing layer to explicitly encode topological characteristics throughout the encoder layers: A global attention mechanism: And a graph information layer to recalibrate channel-wise graph features for better feature representation. TIGT outperforms previous Graph Transformers in classifying synthetic dataset aimed at distinguishing isomorphism classes of graphs. Additionally, mathematical analysis and empirical evaluations highlight our model's competitive edge over state-of-the-art Graph Transformers across various benchmark datasets.


title: PresAIse, A Prescriptive AI Solution for Enterprises

abstract: Prescriptive AI represents a transformative shift in decision-making, offering causal insights and actionable recommendations. Despite its huge potential, enterprise adoption often faces several challenges. The first challenge is caused by the limitations of observational data for accurate causal inference which is typically a prerequisite for good decision-making. The second pertains to the interpretability of recommendations, which is crucial for enterprise decision-making settings. The third challenge is the silos between data scientists and business users, hindering effective collaboration. This paper outlines an initiative from IBM Research, aiming to address some of these challenges by offering a suite of prescriptive AI solutions. Leveraging insights from various research papers, the solution suite includes scalable causal inference methods, interpretable decision-making approaches, and the integration of large language models (LLMs) to bridge communication gaps via a conversation agent. A proof-of-concept, PresAIse, demonstrates the solutions' potential by enabling non-ML experts to interact with prescriptive AI models via a natural language interface, democratizing advanced analytics for strategic decision-making.


title: Understanding Time Series Anomaly State Detection through One-Class Classification

abstract: For a long time, research on time series anomaly detection has mainly focused on finding outliers within a given time series. Admittedly, this is consistent with some practical problems, but in other practical application scenarios, people are concerned about: assuming a standard time series is given, how to judge whether another test time series deviates from the standard time series, which is more similar to the problem discussed in one-class classification (OCC). Therefore, in this article, we try to re-understand and define the time series anomaly detection problem through OCC, which we call 'time series anomaly state detection problem'. We first use stochastic processes and hypothesis testing to strictly define the 'time series anomaly state detection problem', and its corresponding anomalies. Then, we use the time series classification dataset to construct an artificial dataset corresponding to the problem. We compile 38 anomaly detection algorithms and correct some of the algorithms to adapt to handle this problem. Finally, through a large number of experiments, we fairly compare the actual performance of various time series anomaly detection algorithms, providing insights and directions for future research by researchers.


title: How well do LLMs cite relevant medical references? An evaluation framework and analyses

abstract: Large language models (LLMs) are currently being used to answer medical questions across a variety of clinical domains. Recent top-performing commercial LLMs, in particular, are also capable of citing sources to support their responses. In this paper, we ask: do the sources that LLMs generate actually support the claims that they make? To answer this, we propose three contributions. First, as expert medical annotations are an expensive and time-consuming bottleneck for scalable evaluation, we demonstrate that GPT-4 is highly accurate in validating source relevance, agreeing 88% of the time with a panel of medical doctors. Second, we develop an end-to-end, automated pipeline called \textit{SourceCheckup} and use it to evaluate five top-performing LLMs on a dataset of 1200 generated questions, totaling over 40K pairs of statements and sources. Interestingly, we find that between ~50% to 90% of LLM responses are not fully supported by the sources they provide. We also evaluate GPT-4 with retrieval augmented generation (RAG) and find that, even still, around 30\% of individual statements are unsupported, while nearly half of its responses are not fully supported. Third, we open-source our curated dataset of medical questions and expert annotations for future evaluations. Given the rapid pace of LLM development and the potential harms of incorrect or outdated medical information, it is crucial to also understand and quantify their capability to produce relevant, trustworthy medical references.


title: Robust Multi-Task Learning with Excess Risks

abstract: Multi-task learning (MTL) considers learning a joint model for multiple tasks by optimizing a convex combination of all task losses. To solve the optimization problem, existing methods use an adaptive weight updating scheme, where task weights are dynamically adjusted based on their respective losses to prioritize difficult tasks. However, these algorithms face a great challenge whenever label noise is present, in which case excessive weights tend to be assigned to noisy tasks that have relatively large Bayes optimal errors, thereby overshadowing other tasks and causing performance to drop across the board. To overcome this limitation, we propose Multi-Task Learning with Excess Risks (ExcessMTL), an excess risk-based task balancing method that updates the task weights by their distances to convergence instead. Intuitively, ExcessMTL assigns higher weights to worse-trained tasks that are further from convergence. To estimate the excess risks, we develop an efficient and accurate method with Taylor approximation. Theoretically, we show that our proposed algorithm achieves convergence guarantees and Pareto stationarity. Empirically, we evaluate our algorithm on various MTL benchmarks and demonstrate its superior performance over existing methods in the presence of label noise.


title: GenFormer: A Deep-Learning-Based Approach for Generating Multivariate Stochastic Processes

abstract: Stochastic generators are essential to produce synthetic realizations that preserve target statistical properties. We propose GenFormer, a stochastic generator for spatio-temporal multivariate stochastic processes. It is constructed using a Transformer-based deep learning model that learns a mapping between a Markov state sequence and time series values. The synthetic data generated by the GenFormer model preserves the target marginal distributions and approximately captures other desired statistical properties even in challenging applications involving a large number of spatial locations and a long simulation horizon. The GenFormer model is applied to simulate synthetic wind speed data at various stations in Florida to calculate exceedance probabilities for risk management.


title: Bosonic Laplacians in higher spin Clifford analysis

abstract: In this article, we firstly introduce higher spin Clifford analysis, which are considered as generalizations of classical Clifford analysis by considering functions taking values in irreducible representations of the spin group. Then, we introduce a type of second order conformally invariant differential operators, named as bosonic Laplacians, in the higher spin Clifford analysis. In particular, we will show their close connections to classical Maxwell equations. At the end, we will introduce a new perspective to define bosonic Laplacians, which simplifies the connection between bosonic Laplacians and Rarita-Schwinger type operators obtained before. Moreover, a matrix type Rarita-Schwinger operator is obtained and some results related to this new first order matrix type operator are provided.


title: Precise Knowledge Transfer via Flow Matching

abstract: In this paper, we propose a novel knowledge transfer framework that introduces continuous normalizing flows for progressive knowledge transformation and leverages multi-step sampling strategies to achieve precision knowledge transfer. We name this framework Knowledge Transfer with Flow Matching (FM-KT), which can be integrated with a metric-based distillation method with any form (\textit{e.g.} vanilla KD, DKD, PKD and DIST) and a meta-encoder with any available architecture (\textit{e.g.} CNN, MLP and Transformer). By introducing stochastic interpolants, FM-KD is readily amenable to arbitrary noise schedules (\textit{e.g.}, VP-ODE, VE-ODE, Rectified flow) for normalized flow path estimation. We theoretically demonstrate that the training objective of FM-KT is equivalent to minimizing the upper bound of the teacher feature map or logit negative log-likelihood. Besides, FM-KT can be viewed as a unique implicit ensemble method that leads to performance gains. By slightly modifying the FM-KT framework, FM-KT can also be transformed into an online distillation framework OFM-KT with desirable performance gains. Through extensive experiments on CIFAR-100, ImageNet-1k, and MS-COCO datasets, we empirically validate the scalability and state-of-the-art performance of our proposed methods among relevant comparison approaches.


title: Simulating Lateral H/He Flame Propagation in Type I X-ray Bursts

abstract: X-ray bursts are the thermonuclear runaway of a mixed H/He layer on the surface of a neutron star. Observations suggest that the burning begins locally and spreads across the surface of the star as a flame. Recent multidimensional work has looked in detail at pure He flames spreading across a neutron star. Here we report on progress in multidimensional modeling of mixed H/He flames and discuss the challenges.


title: Drivers of Magnetic Field Amplification at Oblique Shocks: In-Situ Observations

abstract: Collisionless shocks are ubiquitous structures throughout the universe. Shock waves in space and astrophysical plasmas convert the energy of a fast-flowing plasma to other forms of energy, including thermal and magnetic energies. Plasma turbulence and high-amplitude electric and magnetic fluctuations are necessary for effective energy conversion and particle acceleration. We survey and characterize in-situ observations of reflected ions and magnetic field amplification rates at quasi-perpendicular shocks under a wide range of upstream conditions. We report magnetic amplification factors as high as 25 times the upstream magnetic field in our current dataset. Reflected ions interacting with the incoming plasma create magnetic perturbations which cause magnetic amplification in upstream and downstream regions of quasi-perpendicular shocks. Our observations show that in general magnetic amplification increases with the fraction of reflected ions, which itself increases with Mach number. Both parameters plateau once full reflection is reached. Magnetic amplification continuously increases with the inverse of the magnetization parameter of the upstream plasma. We find that the extended foot region upstream of shocks and nonlinear processes within that region are key factors for intense magnetic amplification. Our observations at non-relativistic shocks provide the first experimental evidence that below a certain magnetization threshold, the magnetic amplification efficiency at quasi-perpendicular shocks becomes comparable to that at the quasi-parallel shocks.


title: SkyMapper Southern Survey: Data Release 4

abstract: We present the fourth data release (DR4) of the SkyMapper Southern Survey (SMSS), the last major step in our hemispheric survey with six optical filters: u, v, g, r, i, z. SMSS DR4 covers 26,000 sq.deg from over 400,000 images acquired by the 1.3m SkyMapper telescope between 2014-03 and 2021-09. The 6-band sky coverage extends from the South Celestial Pole to Dec = +16deg, with some images reaching Dec ~ +28deg. In contrast to previous DRs, we include all good-quality images from the facility taken during that time span, not only those explicitly taken for the public Survey. From the image dataset, we produce a catalogue of nearly 13 billion detections made from ~700 million unique astrophysical objects. The typical 10sigma depths for each field range between 18.5 and 20.5 mag, depending on the filter, but certain sky regions include longer exposures that reach as deep as 22 mag in some filters. As with previous SMSS catalogues, we have cross-matched with a host of other imaging and spectroscopic datasets to facilitate additional science outcomes. SMSS DR4 is now available to the worldwide astronomical community.

categories: astro-ph.CO astro-ph.GA astro-ph.IM astro-ph.SR


title: Applying different methods to model dry and wet spells at daily scale in a large range of rainfall regimes across Europe

abstract: The modelling of the occurrence of rainfall dry and wet spells (ds and ws, respectively) can be jointly conveyed using the inter-arrival times (it). While the modelling of it has the advantage of requiring a single fitting for the description of all rainfall time characteristics (including wet and dry chains, an extension of the concept of spells), the assumption on the independence and identical distribution of the renewal times it implicitly imposes a memoryless property on the derived ws, which may not be true in some cases. In this study, two different methods for the modelling of rainfall time characteristics at station scale have been applied: i) a direct method (DM) that fits the discrete Lerch distribution to it records, and then derives ws and ds (as well as the corresponding chains) from the it distribution; and ii) an indirect method (IM) that fits the Lerch distribution to the ws and ds records separately, relaxing the assumptions of the renewal process. The results of this application over six stations in Europe, characterized by a wide range of rainfall regimes, highlight how the geometric distribution does not always reasonably reproduce the ws frequencies, even when it are modelled by the Lerch distribution well. Improved performances are obtained with the IM, thanks to the relaxation of the assumption on the independence and identical distribution of the renewal times. A further improvement on the fittings is obtained when the datasets are separated into two periods, suggesting that the inferences may benefit for accounting for the local seasonality.


title: Value-Aided Conditional Supervised Learning for Offline RL

abstract: Offline reinforcement learning (RL) has seen notable advancements through return-conditioned supervised learning (RCSL) and value-based methods, yet each approach comes with its own set of practical challenges. Addressing these, we propose Value-Aided Conditional Supervised Learning (VCS), a method that effectively synergizes the stability of RCSL with the stitching ability of value-based methods. Based on the Neural Tangent Kernel analysis to discern instances where value function may not lead to stable stitching, VCS injects the value aid into the RCSL's loss function dynamically according to the trajectory return. Our empirical studies reveal that VCS not only significantly outperforms both RCSL and value-based methods but also consistently achieves, or often surpasses, the highest trajectory returns across diverse offline RL benchmarks. This breakthrough in VCS paves new paths in offline RL, pushing the limits of what can be achieved and fostering further innovations.


title: The Landscape and Challenges of HPC Research and LLMs

abstract: Recently, language models (LMs), especially large language models (LLMs), have revolutionized the field of deep learning. Both encoder-decoder models and prompt-based techniques have shown immense potential for natural language processing and code-based tasks. Over the past several years, many research labs and institutions have invested heavily in high-performance computing, approaching or breaching exascale performance levels. In this paper, we posit that adapting and utilizing such language model-based techniques for tasks in high-performance computing (HPC) would be very beneficial. This study presents our reasoning behind the aforementioned position and highlights how existing ideas can be improved and adapted for HPC tasks.


title: Riemannian Bilevel Optimization

abstract: In this work, we consider the bilevel optimization problem on Riemannian manifolds. We inspect the calculation of the hypergradient of such problems on general manifolds and thus enable the utilization of gradient-based algorithms to solve such problems. The calculation of the hypergradient requires utilizing the notion of Riemannian cross-derivative and we inspect the properties and the numerical calculations of Riemannian cross-derivatives. Algorithms in both deterministic and stochastic settings, named respectively RieBO and RieSBO, are proposed that include the existing Euclidean bilevel optimization algorithms as special cases. Numerical experiments on robust optimization on Riemannian manifolds are presented to show the applicability and efficiency of the proposed methods.


title: NeuV-SLAM: Fast Neural Multiresolution Voxel Optimization for RGBD Dense SLAM

abstract: We introduce NeuV-SLAM, a novel dense simultaneous localization and mapping pipeline based on neural multiresolution voxels, characterized by ultra-fast convergence and incremental expansion capabilities. This pipeline utilizes RGBD images as input to construct multiresolution neural voxels, achieving rapid convergence while maintaining robust incremental scene reconstruction and camera tracking. Central to our methodology is to propose a novel implicit representation, termed VDF that combines the implementation of neural signed distance field (SDF) voxels with an SDF activation strategy. This approach entails the direct optimization of color features and SDF values anchored within the voxels, substantially enhancing the rate of scene convergence. To ensure the acquisition of clear edge delineation, SDF activation is designed, which maintains exemplary scene representation fidelity even under constraints of voxel resolution. Furthermore, in pursuit of advancing rapid incremental expansion with low computational overhead, we developed hashMV, a novel hash-based multiresolution voxel management structure. This architecture is complemented by a strategically designed voxel generation technique that synergizes with a two-dimensional scene prior. Our empirical evaluations, conducted on the Replica and ScanNet Datasets, substantiate NeuV-SLAM's exceptional efficacy in terms of convergence speed, tracking accuracy, scene reconstruction, and rendering quality.


title: Transfer Learning in ECG Diagnosis: Is It Effective?

abstract: The adoption of deep learning in ECG diagnosis is often hindered by the scarcity of large, well-labeled datasets in real-world scenarios, leading to the use of transfer learning to leverage features learned from larger datasets. Yet the prevailing assumption that transfer learning consistently outperforms training from scratch has never been systematically validated. In this study, we conduct the first extensive empirical study on the effectiveness of transfer learning in multi-label ECG classification, by investigating comparing the fine-tuning performance with that of training from scratch, covering a variety of ECG datasets and deep neural networks. We confirm that fine-tuning is the preferable choice for small downstream datasets; however, when the dataset is sufficiently large, training from scratch can achieve comparable performance, albeit requiring a longer training time to catch up. Furthermore, we find that transfer learning exhibits better compatibility with convolutional neural networks than with recurrent neural networks, which are the two most prevalent architectures for time-series ECG applications. Our results underscore the importance of transfer learning in ECG diagnosis, yet depending on the amount of available data, researchers may opt not to use it, considering the non-negligible cost associated with pre-training.


title: Dust enrichment in the circum-galactic medium

abstract: To understand the origin of dust in the circum-galactic medium (CGM), we develop a dust enrichment model. We describe each of the central galaxy and its CGM as a single zone, and consider the mass exchange between them through galactic inflows and outflows. We calculate the evolution of the gas, metal, and dust masses in the galaxy and the CGM. In the galaxy, we include stellar dust production and interstellar dust processing following our previous models. The dust in the galaxy is transported to the CGM via galactic outflows, and it is further processed by dust destruction (sputtering) in the CGM. We parameterize the time-scale or efficiency of each process and investigate the effect on the dust abundance in the CGM. We find that the resulting dust mass is sensitive to the dust destruction in the CGM, and the dust supply from galactic outflows, both of which directly regulate the dust abundance in the CGM. The inflow time-scale also affects the dust abundance in the CGM because it determines the gas mass evolution (thus, the star formation history) in the galaxy. The dust abundance in the CGM, however, is insensitive to stellar dust formation in the galaxy at later epochs because the dust production is dominated by dust growth in the interstellar medium. We also find that the resulting dust mass in the CGM is consistent with the value derived from a large sample of SDSS galaxies.


title: Self-Supervised Contrastive Learning for Long-term Forecasting

abstract: Long-term forecasting presents unique challenges due to the time and memory complexity of handling long sequences. Existing methods, which rely on sliding windows to process long sequences, struggle to effectively capture long-term variations that are partially caught within the short window (i.e., outer-window variations). In this paper, we introduce a novel approach that overcomes this limitation by employing contrastive learning and enhanced decomposition architecture, specifically designed to focus on long-term variations. To this end, our contrastive loss incorporates global autocorrelation held in the whole time series, which facilitates the construction of positive and negative pairs in a self-supervised manner. When combined with our decomposition networks, our contrastive learning significantly improves long-term forecasting performance. Extensive experiments demonstrate that our approach outperforms 14 baseline models in multiple experiments over nine long-term benchmarks, especially in challenging scenarios that require a significantly long output for forecasting. Source code is available at https://github.com/junwoopark92/Self-Supervised-Contrastive-Forecsating.


title: An analogue of Kida's formula for elliptic curves with additive reduction

abstract: We study the Iwasawa theory of $p$-primary Selmer groups of elliptic curves $E$ over a number field $K$. Assume that $E$ has additive reduction at the primes of $K$ above $p$. In this context, we prove that the Iwasawa invariants satisfy an analogue of the Riemann--Hurwitz formula. This generalizes a result of Hachimori and Matsuno. We apply our results to study rank stability questions for elliptic curves in prime cyclic extensions of $\mathbb{Q}$. These extensions are ordered by their absolute discriminant and we prove an asymptotic lower bound for the density of extensions in which the Iwasawa invariants as well as the rank of the elliptic curve is stable.


title: A Survey of Constraint Formulations in Safe Reinforcement Learning

abstract: Safety is critical when applying reinforcement learning (RL) to real-world problems. As a result, safe RL has emerged as a fundamental and powerful paradigm for optimizing an agent's policy while incorporating notions of safety. A prevalent safe RL approach is based on a constrained criterion, which seeks to maximize the expected cumulative reward subject to specific safety constraints. Despite recent effort to enhance safety in RL, a systematic understanding of the field remains difficult. This challenge stems from the diversity of constraint representations and little exploration of their interrelations. To bridge this knowledge gap, we present a comprehensive review of representative constraint formulations, along with a curated selection of algorithms designed specifically for each formulation. In addition, we elucidate the theoretical underpinnings that reveal the mathematical mutual relations among common problem formulations. We conclude with a discussion of the current state and future directions of safe reinforcement learning research.


title: Multimodal-Enhanced Objectness Learner for Corner Case Detection in Autonomous Driving

abstract: Previous works on object detection have achieved high accuracy in closed-set scenarios, but their performance in open-world scenarios is not satisfactory. One of the challenging open-world problems is corner case detection in autonomous driving. Existing detectors struggle with these cases, relying heavily on visual appearance and exhibiting poor generalization ability. In this paper, we propose a solution by reducing the discrepancy between known and unknown classes and introduce a multimodal-enhanced objectness notion learner. Leveraging both vision-centric and image-text modalities, our semi-supervised learning framework imparts objectness knowledge to the student model, enabling class-aware detection. Our approach, Multimodal-Enhanced Objectness Learner (MENOL) for Corner Case Detection, significantly improves recall for novel classes with lower training costs. By achieving a 76.6% mAR-corner and 79.8% mAR-agnostic on the CODA-val dataset with just 5100 labeled training images, MENOL outperforms the baseline ORE by 71.3% and 60.6%, respectively. The code will be available at https://github.com/tryhiseyyysum/MENOL.


title: Quasinormal modes of gravitational perturbation for uniformly accelerated black holes

abstract: We first show that the master equations for massless perturbations of accelerating rotating black holes can be transformed into the Heun's equation. The quasinormal modes of the black holes can be easily calculated in the framework of the Heun's equation. We identify three modes for the tensor perturbations: the photon sphere modes, which reduce to the quasinormal modes of Kerr black holes when the acceleration parameter vanishes; the near-extremal modes, which branch from the first set and become dominant when the spin is near extremal; and the acceleration modes, which are closely related to the acceleration horizon. We calculate the frequency spectrum of the QNMs in various spin and acceleration parameters. We choose an angular boundary condition that keeps the angular function regular at $ \theta = 0 $ and $\pi$, which is consistent with the boundary condition of the Kerr black hole. The conical singularity caused by the acceleration influences this boundary condition. We find that the $m_0 = 1$ modes have an anomalous behavior at particular accelerations.


title: Unlearnable Examples For Time Series

abstract: Unlearnable examples (UEs) refer to training samples modified to be unlearnable to Deep Neural Networks (DNNs). These examples are usually generated by adding error-minimizing noises that can fool a DNN model into believing that there is nothing (no error) to learn from the data. The concept of UE has been proposed as a countermeasure against unauthorized data exploitation on personal data. While UE has been extensively studied on images, it is unclear how to craft effective UEs for time series data. In this work, we introduce the first UE generation method to protect time series data from unauthorized training by deep learning models. To this end, we propose a new form of error-minimizing noise that can be \emph{selectively} applied to specific segments of time series, rendering them unlearnable to DNN models while remaining imperceptible to human observers. Through extensive experiments on a wide range of time series datasets, we demonstrate that the proposed UE generation method is effective in both classification and generation tasks. It can protect time series data against unauthorized exploitation, while preserving their utility for legitimate usage, thereby contributing to the development of secure and trustworthy machine learning systems.


title: ScribFormer: Transformer Makes CNN Work Better for Scribble-based Medical Image Segmentation

abstract: Most recent scribble-supervised segmentation methods commonly adopt a CNN framework with an encoder-decoder architecture. Despite its multiple benefits, this framework generally can only capture small-range feature dependency for the convolutional layer with the local receptive field, which makes it difficult to learn global shape information from the limited information provided by scribble annotations. To address this issue, this paper proposes a new CNN-Transformer hybrid solution for scribble-supervised medical image segmentation called ScribFormer. The proposed ScribFormer model has a triple-branch structure, i.e., the hybrid of a CNN branch, a Transformer branch, and an attention-guided class activation map (ACAM) branch. Specifically, the CNN branch collaborates with the Transformer branch to fuse the local features learned from CNN with the global representations obtained from Transformer, which can effectively overcome limitations of existing scribble-supervised segmentation methods. Furthermore, the ACAM branch assists in unifying the shallow convolution features and the deep convolution features to improve model's performance further. Extensive experiments on two public datasets and one private dataset show that our ScribFormer has superior performance over the state-of-the-art scribble-supervised segmentation methods, and achieves even better results than the fully-supervised segmentation methods. The code is released at https://github.com/HUANGLIZI/ScribFormer.


title: Panacea: Pareto Alignment via Preference Adaptation for LLMs

abstract: Current methods for large language model alignment typically use scalar human preference labels. However, this convention tends to oversimplify the multi-dimensional and heterogeneous nature of human preferences, leading to reduced expressivity and even misalignment. This paper presents Panacea, an innovative approach that reframes alignment as a multi-dimensional preference optimization problem. Panacea trains a single model capable of adapting online and Pareto-optimally to diverse sets of preferences without the need for further tuning. A major challenge here is using a low-dimensional preference vector to guide the model's behavior, despite it being governed by an overwhelmingly large number of parameters. To address this, Panacea is designed to use singular value decomposition (SVD)-based low-rank adaptation, which allows the preference vector to be simply injected online as singular values. Theoretically, we prove that Panacea recovers the entire Pareto front with common loss aggregation methods under mild conditions. Moreover, our experiments demonstrate, for the first time, the feasibility of aligning a single LLM to represent an exponentially vast spectrum of human preferences through various optimization methods. Our work marks a step forward in effectively and efficiently aligning models to diverse and intricate human preferences in a controllable and Pareto-optimal manner.