title: Real-time Level-of-Detail Strand-based Hair Rendering

abstract: Strand-based hair rendering has become increasingly popular in production for its realistic appearance. However, the prevailing level-of-detail solution employing hair cards for distant hair models introduces a significant discontinuity in dynamics and appearance during the transition from strands to cards. We introduce an innovative real-time framework for strand-based hair rendering that ensures seamless transitions between different levels of detail (LOD) while maintaining a consistent hair appearance. Our method uses elliptical thick hairs that contain multiple hair strands at each LOD to maintain the shapes of hair clusters. In addition to geometric fitting, we formulate an elliptical Bidirectional Curve Scattering Distribution Functions (BCSDF) model for a thick hair, accurately capturing single scattering and multiple scattering within the hair cluster, accommodating a spectrum from sparse to dense hair distributions. Our framework, tested on various hairstyles with dynamics as well as knits, shows that it can produce highly similar appearances to full hair geometries at different viewing distances with seamless LOD transitions, while achieving up to a 3x speedup.


title: Grain boundary solute segregation across the 5D space of crystallographic character

abstract: Solute segregation in materials with grain boundaries (GBs) has emerged as a popular method to thermodynamically stabilize nanocrystalline structures. However, the impact of varied GB crystallographic character on solute segregation has never been thoroughly examined. This work examines Co solute segregation in a dataset of 7272 Al bicrystal GBs that span the 5D space of GB crystallographic character. Considerable attention is paid to verification of the calculations in the diverse and large set of GBs. In addition, the results of this work are favorably validated against similar bicrystal and polycrystal simulations. As with other work, we show that Co atoms exhibit strong segregation to sites in Al GBs and that segregation correlates strongly with GB energy and GB excess volume. Segregation varies smoothly in the 5D crystallographic space but has a complex landscape without an obvious functional form.


title: Team Samsung-RAL: Technical Report for 2024 RoboDrive Challenge-Robust Map Segmentation Track

abstract: In this report, we describe the technical details of our submission to the 2024 RoboDrive Challenge Robust Map Segmentation Track. The Robust Map Segmentation track focuses on the segmentation of complex driving scene elements in BEV maps under varied driving conditions. Semantic map segmentation provides abundant and precise static environmental information crucial for autonomous driving systems' planning and navigation. While current methods excel in ideal circumstances, e.g., clear daytime conditions and fully functional sensors, their resilience to real-world challenges like adverse weather and sensor failures remains unclear, raising concerns about system safety. In this paper, we explored several methods to improve the robustness of the map segmentation task. The details are as follows: 1) Robustness analysis of utilizing temporal information; 2) Robustness analysis of utilizing different backbones; and 3) Data Augmentation to boost corruption robustness. Based on the evaluation results, we draw several important findings including 1) The temporal fusion module is effective in improving the robustness of the map segmentation model; 2) A strong backbone is effective for improving the corruption robustness; and 3) Some data augmentation methods are effective in improving the robustness of map segmentation models. These novel findings allowed us to achieve promising results in the 2024 RoboDrive Challenge-Robust Map Segmentation Track.


title: Linear gyrokinetic simulation of kinetic infernal mode

abstract: Kinetic infernal mode (KIM) is an electromagnetic instability driven by thermal ions in weak magnetic shear region with a frequency similar to the kinetic ballooning mode (KBM). Gyrokinetic simulations of KIM using Gyrokinetic Toroidal Code (GTC) found that the electromagnetic instability shows a smooth transition from KBM to KIM in both frequency and growth rate when magnetic shear varies from strong to weak, which suggests that KIM and KBM may belong to the same mode physically. The mode structure analysis reveals that the mode transition is induced by the change in distance between adjacent mode rational surfaces. The magnetic shear and driving source effects are investigated in detail. The simulation results show that KIM prefers to grow on the mode rational surface nearest to the minimum magnetic shear, i.e., where the shear stabilizing effect is weakest, instead of at the maximum of density gradient or temperature gradient. However, the magnitude of the growth rate is determined by magnetic shear and temperature gradient simultaneously. These findings suggest that KIM can be effectively regulated by modifying the strength and position of magnetic shear, as well as pressure gradients.


title: An optimal design problem for a charge qubit

abstract: In this paper we introduce a simple variational model describing the ground state of a superconducting charge qubit. The model gives rise to a shape optimization problem that aims at maximizing the number of qubit states at a given gating voltage. We show that for small values of the charge optimal shapes exist and are $C^{2,\alpha}$-nearly spherical sets. In contrast, for large values of the charge the optimal shape does not exist, with the energy favoring disjoint collections of sets.


title: Simultaneous Deep Learning of Myocardium Segmentation and T2 Quantification for Acute Myocardial Infarction MRI

abstract: In cardiac Magnetic Resonance Imaging (MRI) analysis, simultaneous myocardial segmentation and T2 quantification are crucial for assessing myocardial pathologies. Existing methods often address these tasks separately, limiting their synergistic potential. To address this, we propose SQNet, a dual-task network integrating Transformer and Convolutional Neural Network (CNN) components. SQNet features a T2-refine fusion decoder for quantitative analysis, leveraging global features from the Transformer, and a segmentation decoder with multiple local region supervision for enhanced accuracy. A tight coupling module aligns and fuses CNN and Transformer branch features, enabling SQNet to focus on myocardium regions. Evaluation on healthy controls (HC) and acute myocardial infarction patients (AMI) demonstrates superior segmentation dice scores (89.3/89.2) compared to state-of-the-art methods (87.7/87.9). T2 quantification yields strong linear correlations (Pearson coefficients: 0.84/0.93) with label values for HC/AMI, indicating accurate mapping. Radiologist evaluations confirm SQNet's superior image quality scores (4.60/4.58 for segmentation, 4.32/4.42 for T2 quantification) over state-of-the-art methods (4.50/4.44 for segmentation, 3.59/4.37 for T2 quantification). SQNet thus offers accurate simultaneous segmentation and quantification, enhancing cardiac disease diagnosis, such as AMI.


title: Stability and dynamics of magnetic skyrmions in FM/AFM heterostructures

abstract: Magnetic skyrmions have garnered attention for their potential roles in spintronic applications, such as information carriers in computation, data storage, and nano-oscillators due to their small size, topological stability, and the requirement of small electric currents to manipulate them. Two key challenges in harnessing skyrmions are the stabilization requirement through a strong out-of-plane field, and the skyrmion Hall effect (SkHE). Here, we present a systematic model study of skyrmions in FM/AFM multi-layer structures by employing both atomistic Monte Carlo and atomistic spin dynamics simulations. We demonstrate that skyrmions stabilized by exchange bias have superior stability than field-stabilized skyrmions due to the formation of a magnetic imprint within the AFM layer. Additionally, stacking two skyrmion hosting FM layers between two antiferromagnetic (AFM) layers suppresses the SkHE and enables the transport of AFM-coupled skyrmions with high velocity in the order of a few Km/s. This proposed multi-layer configuration could serve as a pathway to overcome existing limitations in the development of skyrmion-based devices, and the insights obtained through this study contribute significantly to the broader understanding of topological spin textures in magnetic materials.


title: Resonances as a computational tool

abstract: A large toolbox of numerical schemes for dispersive equations has been established, based on different discretization techniques such as discretizing the variation-of-constants formula (e.g., exponential integrators) or splitting the full equation into a series of simpler subproblems (e.g., splitting methods). In many situations these classical schemes allow a precise and efficient approximation. This, however, drastically changes whenever non-smooth phenomena enter the scene such as for problems at low regularity and high oscillations. Classical schemes fail to capture the oscillatory nature of the solution, and this may lead to severe instabilities and loss of convergence. In this article we review a new class of resonance-based schemes. The key idea in the construction of the new schemes is to tackle and deeply embed the underlying nonlinear structure of resonances into the numerical discretization. As in the continuous case, these terms are central to structure preservation and offer the new schemes strong properties at low regularity.


title: A method for reversing the laser modulation in a Storage ring

abstract: The pursuit of coherent radiation generation remains a central focus in advancing storage ring light sources. Despite the promise of laser modulation in achieving this goal, it brings about a noticeable decline in beam quality. Efforts to mitigate this decline have resulted in the proposal of demodulation schemes. However, implementing modulation and demodulation within the storage ring presents significant challenges due to dynamical and spatial constraints within straight sections. In this study, we propose a straightforward and easily implementable method for achieving reversible laser modulation in a storage ring. Notably, our approach circumvents the need for special storage ring requirements, such as lengthy straight sections or bypass section. Simulation results demonstrate a substantial restoration of beam quality following demodulation. This innovative scheme holds great promise for the realization of high repetition rate coherent storage ring light sources.


title: Partial Derivatives on Causal Sets

abstract: We will discuss two approaches to estimating partial derivatives and the metric components; one utilizing past work describing a causal set $\Box$ operator, and one using a construction from linear algebra called the Moore-Penrose inverse. After running numerical tests on a causal diamond in $\mathbb{M}^2$, we find that the approach using the Moore-Penrose inverse is significantly more accurate. Despite the large variances in the method using the $\Box$ operator, there is reason to believe both approaches should become more accurate at higher densities.


title: Accurate Training Data for Occupancy Map Prediction in Automated Driving Using Evidence Theory

abstract: Automated driving fundamentally requires knowledge about the surrounding geometry of the scene. Modern approaches use only captured images to predict occupancy maps that represent the geometry. Training these approaches requires accurate data that may be acquired with the help of LiDAR scanners. We show that the techniques used for current benchmarks and training datasets to convert LiDAR scans into occupancy grid maps yield very low quality, and subsequently present a novel approach using evidence theory that yields more accurate reconstructions. We demonstrate that these are superior by a large margin, both qualitatively and quantitatively, and that we additionally obtain meaningful uncertainty estimates. When converting the occupancy maps back to depth estimates and comparing them with the raw LiDAR measurements, our method yields a MAE improvement of 30% to 52% on nuScenes and 53% on Waymo over other occupancy ground-truth data. Finally, we use the improved occupancy maps to train a state-of-the-art occupancy prediction method and demonstrate that it improves the MAE by 25% on nuScenes.


title: An Efficient Learning Control Framework With Sim-to-Real for String-Type Artificial Muscle-Driven Robotic Systems

abstract: Robotic systems driven by artificial muscles present unique challenges due to the nonlinear dynamics of actuators and the complex designs of mechanical structures. Traditional model-based controllers often struggle to achieve desired control performance in such systems. Deep reinforcement learning (DRL), a trending machine learning technique widely adopted in robot control, offers a promising alternative. However, integrating DRL into these robotic systems faces significant challenges, including the requirement for large amounts of training data and the inevitable sim-to-real gap when deployed to real-world robots. This paper proposes an efficient reinforcement learning control framework with sim-to-real transfer to address these challenges. Bootstrap and augmentation enhancements are designed to improve the data efficiency of baseline DRL algorithms, while a sim-to-real transfer technique, namely randomization of muscle dynamics, is adopted to bridge the gap between simulation and real-world deployment. Extensive experiments and ablation studies are conducted utilizing two string-type artificial muscle-driven robotic systems including a two degree-of-freedom robotic eye and a parallel robotic wrist, the results of which demonstrate the effectiveness of the proposed learning control strategy.


title: DuoSpaceNet: Leveraging Both Bird's-Eye-View and Perspective View Representations for 3D Object Detection

abstract: Recent advances in multi-view camera-only 3D object detection either rely on an accurate reconstruction of bird's-eye-view (BEV) 3D features or on traditional 2D perspective view (PV) image features. While both have their own pros and cons, few have found a way to stitch them together in order to benefit from "the best of both worlds". To this end, we explore a duo space (i.e., BEV and PV) 3D perception framework, in conjunction with some useful duo space fusion strategies that allow effective aggregation of the two feature representations. To the best of our knowledge, our proposed method, DuoSpaceNet, is the first to leverage two distinct feature spaces and achieves the state-of-the-art 3D object detection and BEV map segmentation results on nuScenes dataset.


title: Jacobi Stability Analysis for Systems of ODEs Using Symbolic Computation

abstract: The classical theory of Kosambi-Cartan-Chern (KCC) developed in differential geometry provides a powerful method for analyzing the behaviors of dynamical systems. In the KCC theory, the properties of a dynamical system are described in terms of five geometrical invariants, of which the second corresponds to the so-called Jacobi stability of the system. Different from that of the Lyapunov stability that has been studied extensively in the literature, the analysis of the Jacobi stability has been investigated more recently using geometrical concepts and tools. It turns out that the existing work on the Jacobi stability analysis remains theoretical and the problem of algorithmic and symbolic treatment of Jacobi stability analysis has yet to be addressed. In this paper, we initiate our study on the problem for a class of ODE systems of arbitrary dimension and propose two algorithmic schemes using symbolic computation to check whether a nonlinear dynamical system may exhibit Jacobi stability. The first scheme, based on the construction of the complex root structure of a characteristic polynomial and on the method of quantifier elimination, is capable of detecting the existence of the Jacobi stability of the given dynamical system. The second algorithmic scheme exploits the method of semi-algebraic system solving and allows one to determine conditions on the parameters for a given dynamical system to have a prescribed number of Jacobi stable fixed points. Several examples are presented to demonstrate the effectiveness of the proposed algorithmic schemes.


title: A Hard Nut to Crack: Idiom Detection with Conversational Large Language Models

abstract: In this work, we explore idiomatic language processing with Large Language Models (LLMs). We introduce the Idiomatic language Test Suite IdioTS, a new dataset of difficult examples specifically designed by language experts to assess the capabilities of LLMs to process figurative language at sentence level. We propose a comprehensive evaluation methodology based on an idiom detection task, where LLMs are prompted with detecting an idiomatic expression in a given English sentence. We present a thorough automatic and manual evaluation of the results and an extensive error analysis.


title: A stochastic version of the Hopfield-Ninio kinetic proofreading model

abstract: In this paper we study a simple stochastic version of the Hopfield-Ninio kinetic proofreading model. The model is characterized by means of two parameters, the unbinding time, which depends on the binding energy between a ligand and a receptor, and the number of times $M \geq 1$ that a ligand attaches to a receptor. We prove that, under suitable assumptions on M, our model has an extreme specificity, i.e. it is capable to discriminate between different ligands, and a high sensitivity, i.e. the response of the system does not change in a significant manner for ranges of ligands varying within several orders of magnitude. Additional quantities like the amount of energy used by the network or the time required to yield a response will be also computed. We also show that our results are robust, i.e., they do not depend on the specific choice of parameters that we make in this paper.


title: Future Aware Safe Active Learning of Time Varying Systems using Gaussian Processes

abstract: Experimental exploration of high-cost systems with safety constraints, common in engineering applications, is a challenging endeavor. Data-driven models offer a promising solution, but acquiring the requisite data remains expensive and is potentially unsafe. Safe active learning techniques prove essential, enabling the learning of high-quality models with minimal expensive data points and high safety. This paper introduces a safe active learning framework tailored for time-varying systems, addressing drift, seasonal changes, and complexities due to dynamic behavior. The proposed Time-aware Integrated Mean Squared Prediction Error (T-IMSPE) method minimizes posterior variance over current and future states, optimizing information gathering also in the time domain. Empirical results highlight T-IMSPE's advantages in model quality through toy and real-world examples. State of the art Gaussian processes are compatible with T-IMSPE. Our theoretical contributions include a clear delineation which Gaussian process kernels, domains, and weighting measures are suitable for T-IMSPE and even beyond for its non-time aware predecessor IMSPE.


title: General oracle inequalities for a penalized log-likelihood criterion based on non-stationary data

abstract: We prove oracle inequalities for a penalized log-likelihood criterion that hold even if the data are not independent and not stationary, based on a martingale approach. The assumptions are checked for various contexts: density estimation with independent and identically distributed (i.i.d) data, hidden Markov models, spiking neural networks, adversarial bandits. In each case, we compare our results to the literature, showing that, although we lose some logarithmic factors in the most classical case (i.i.d.), these results are comparable or more general than the existing results in the more dependent cases.


title: Large Fermi surface in pristine kagome metal CsV$_3$Sb$_5$ and enhanced quasiparticle effective masses

abstract: The kagome metal CsV$_3$Sb$_5$ is an ideal platform to study the interplay between topology and electron correlation. To understand the fermiology of CsV$_3$Sb$_5$, intensive quantum oscillation (QO) studies at ambient pressure have been conducted. However, due to the Fermi surface reconstruction by the complicated charge density wave (CDW) order, the QO spectrum is exceedingly complex, hindering a complete understanding of the fermiology. Here, we directly map the Fermi surface of the pristine CsV$_3$Sb$_5$ by measuring Shubnikov-de Haas QOs up to 29 T under pressure, where the CDW order is completely suppressed. The QO spectrum of the pristine CsV$_3$Sb$_5$ is significantly simpler than the one in the CDW phase, and the detected oscillation frequencies agree well with our density functional theory calculations. In particular, a frequency as large as 8,200 T is detected. Pressure-dependent QO studies further reveal a weak but noticeable enhancement of the quasiparticle effective masses on approaching the critical pressure where the CDW order disappears, hinting at the presence of quantum fluctuations. Our high-pressure QO results reveal the large, unreconstructed Fermi surface of CsV$_3$Sb$_5$, paving the way to understanding the parent state of this intriguing metal in which the electrons can be organized into different ordered states.


title: A Hybrid Deep Learning Framework for Stock Price Prediction Considering the Investor Sentiment of Online Forum Enhanced by Popularity

abstract: Stock price prediction has always been a difficult task for forecasters. Using cutting-edge deep learning techniques, stock price prediction based on investor sentiment extracted from online forums has become feasible. We propose a novel hybrid deep learning framework for predicting stock prices. The framework leverages the XLNET model to analyze the sentiment conveyed in user posts on online forums, combines these sentiments with the post popularity factor to compute daily group sentiments, and integrates this information with stock technical indicators into an improved BiLSTM-highway model for stock price prediction. Through a series of comparative experiments involving four stocks on the Chinese stock market, it is demonstrated that the hybrid framework effectively predicts stock prices. This study reveals the necessity of analyzing investors' textual views for stock price prediction.


title: KG-oscillators in Som-Raychaudhuri rotating cosmic string spacetime in a mixed magnetic field

abstract: We investigate Klein-Gordon (KG) oscillators in a G\"{o}% del-type Som-Raychaudhuri spacetime in a mixed magnetic field (given by the vector potential $A_{\mu }=\left( 0,0,A_{\varphi },0\right) $, with $% A_{\varphi }=B_{1}r^{2}/2+B_{2}r$). The resulting KG equation takes a Schr% \"{o}dinger-like form (with an oscillator plus a linear plus a Coulomb-like interactions potential) that admits a solution in the form of biconfluent Heun functions/series $H_{B}\left( \alpha ,\beta ,\gamma ,\delta ,z\right) $% . The usual power series expansion of which is truncated to a polynomial of \ order $n_{r}+1=n\geq 1$ through the usual condition $\gamma =2\left( n_{r}+1\right) +\alpha $. However, we use the very recent recipe suggested by Mustafa \cite{1.29} as an alternative parametric condition/correlation. i.e., $\delta =-\beta \left( 2n_{r}+\alpha +3\right) $, to facilitate conditional exact solvability of the problem. We discuss and report the effects of the mixed magnetic field as well as the effects of the G\"{o}del-type SR-spacetime background on the KG-oscillators' spectroscopic structure.


title: Exploring Neutrino Phenomenology and $0\nu\beta\beta$ Decay in a Left-Right Asymmetric Model with A4 Modular Symmetry

abstract: In this study, we explore the application of the $\Gamma(3)$ modular group, which is isomorphic to the $A_{4}$ symmetric group, in developing a model for neutrino mass. We construct a left-right asymmetric model using modular symmetry, which offers the advantage of eliminating the need for additional particles known as "flavons." The Yukawa coupling term is expressed in terms of modular forms denoted as $Y_{1}$, $Y_{2}$, and $Y_{3}$. To effectively implement the extended see-saw process in this model, we introduce one fermion singlet for each generation. We compute the effective mass and the associated half-life of $0\nu\beta\beta$ by accounting for both standard and non-standard contributions. Additionally, our study investigates the non-unitary effects and CP-violation arising from non-unitarity in this context. The model predicts values for the sum of neutrino masses and neutrino oscillation parameters are constraints with experiments. Furthermore, it yields satisfactory results in calculating the effective mass and half-life of $0\nu\beta\beta$ decay. These findings underscore the viability and utility of employing modular symmetry in neutrino mass model construction.


title: RDRec: Rationale Distillation for LLM-based Recommendation

abstract: Large language model (LLM)-based recommender models that bridge users and items through textual prompts for effective semantic reasoning have gained considerable attention. However, few methods consider the underlying rationales behind interactions, such as user preferences and item attributes, limiting the reasoning capability of LLMs for recommendations. This paper proposes a rationale distillation recommender (RDRec), a compact model designed to learn rationales generated by a larger language model (LM). By leveraging rationales from reviews related to users and items, RDRec remarkably specifies their profiles for recommendations. Experiments show that RDRec achieves state-of-the-art (SOTA) performance in both top-N and sequential recommendations. Our source code is released at https://github.com/WangXFng/RDRec.


title: Decompounding with unknown noise through several independents channels

abstract: In this article, we consider two different statistical models. First, we focus on the estimation of the jump intensity of a compound Poisson process in the presence of unknown noise. This problem combines both the deconvolution problem and the decompounding problem. More specifically, we observe several independent compound Poisson processes but we assume that all these observations are noisy due to measurement noise. We construct an Fourier estimator of the jump density and we study its mean integrated squared error. Then, we propose an adaptive method to correctly select the cutoff of the estimator and we illustrate the efficiency of the method with numerical results. Secondly, we introduce in this paper the multiplicative decompounding problem. We study this problem with Mellin density estimators. We develop an adaptive procedure to select the optimal cutoff parameter.


title: Improving Point-based Crowd Counting and Localization Based on Auxiliary Point Guidance

abstract: Crowd counting and localization have become increasingly important in computer vision due to their wide-ranging applications. While point-based strategies have been widely used in crowd counting methods, they face a significant challenge, i.e., the lack of an effective learning strategy to guide the matching process. This deficiency leads to instability in matching point proposals to target points, adversely affecting overall performance. To address this issue, we introduce an effective approach to stabilize the proposal-target matching in point-based methods. We propose Auxiliary Point Guidance (APG) to provide clear and effective guidance for proposal selection and optimization, addressing the core issue of matching uncertainty. Additionally, we develop Implicit Feature Interpolation (IFI) to enable adaptive feature extraction in diverse crowd scenarios, further enhancing the model's robustness and accuracy. Extensive experiments demonstrate the effectiveness of our approach, showing significant improvements in crowd counting and localization performance, particularly under challenging conditions. The source codes and trained models will be made publicly available.


title: Emergence of cosmic space and horizon thermodynamics in the context of the quantum-deformed entropy

abstract: According to the quantum deformation approach to quantum gravity, the thermodynamical entropy of a quantum-deformed (q-deformed) black hole with horizon area $A$ established by Jalalzadeh is expressed as $S_q = \pi\sin \left( \frac{A}{8G\mathcal N} \right) /\sin\left(\frac{\pi}{2\mathcal N}\right)$, where $\mathcal N=L_q^2/L_{p}^2$ is the q-deformation parameter, $L_{p}$ denotes the Planck length, and $L_q$ denotes the quantum-deformed cosmic apparent horizon distance. In this paper, assuming that the q-deformed entropy is associated with the apparent horizon of the Friedmann-Robertson-Walker (FRW) universe, we derive the Friedmann equation from the unified first law of thermodynamics, ${dE = T_q dS_q + WdV}$. And this one obtained is in line with the Friedmann equation derived from the law of emergence proposed by Padmanabhan. It clearly shows the connection between the law of emergence and the unified first law of thermodynamics. Subsequently, in the context of the q-deformed horizon entropy, we investigate the constraints of entropy maximization, and result demonstrates the consistency of the law of emergence with the maximization of the q-deformed horizon entropy. Hence, the law of emergence can be understood as a tendency to maximize the q-deformed horizon entropy.


title: GEOcc: Geometrically Enhanced 3D Occupancy Network with Implicit-Explicit Depth Fusion and Contextual Self-Supervision

abstract: 3D occupancy perception holds a pivotal role in recent vision-centric autonomous driving systems by converting surround-view images into integrated geometric and semantic representations within dense 3D grids. Nevertheless, current models still encounter two main challenges: modeling depth accurately in the 2D-3D view transformation stage, and overcoming the lack of generalizability issues due to sparse LiDAR supervision. To address these issues, this paper presents GEOcc, a Geometric-Enhanced Occupancy network tailored for vision-only surround-view perception. Our approach is three-fold: 1) Integration of explicit lift-based depth prediction and implicit projection-based transformers for depth modeling, enhancing the density and robustness of view transformation. 2) Utilization of mask-based encoder-decoder architecture for fine-grained semantic predictions; 3) Adoption of context-aware self-training loss functions in the pertaining stage to complement LiDAR supervision, involving the re-rendering of 2D depth maps from 3D occupancy features and leveraging image reconstruction loss to obtain denser depth supervision besides sparse LiDAR ground-truths. Our approach achieves State-Of-The-Art performance on the Occ3D-nuScenes dataset with the least image resolution needed and the most weightless image backbone compared with current models, marking an improvement of 3.3% due to our proposed contributions. Comprehensive experimentation also demonstrates the consistent superiority of our method over baselines and alternative approaches.


title: Secondary spectrum after shieldings in x-ray rooms

abstract: Background: Calculating the characteristics of radiation emerging from radiation shielding to determine the level of safety in protected areas has been a widely studied topic in Radiation Protection due to its importance for the protection of the public and professionals. Methods: This work provides spatial distributions of energy spectra of emergent photons after shielding barriers. These distributions are obtained through Monte Carlo simulations using monoenergetic pencil photon beams incident on shielding barriers of different materials and thicknesses. The obtained results are applied to calculate the spectra of transmitted radiation in cases of polyenergetic beams similar to those encountered in clinical practice. Results: The significant contribution of secondary radiation in the radiation found behind shields is demonstrated across a wide range of energies, barrier thicknesses and barrier materials. Conclusion: It is shown that characterizing shields using their response to monoenergetic pencil beams provides a useful tool for characterizing radiation behind shields in a wide range of practical situations.


title: Variational minimization scheme for the one-particle reduced density matrix functional theory in the ensemble N-representability domain

abstract: The one-particle reduced density-matrix (1-RDM) functional theory is a promising alternative to density-functional theory (DFT) that uses the 1-RDM rather than the electronic density as a basic variable. However, long-standing challenges such as the lack of Kohn--Sham scheme and the complexity of the pure $N$-representability conditions are still impeding its wild utilization. Fortunately, ensemble $N$-representability conditions derived in the natural orbital basis are known and trivial, such that almost every functionals of the 1-RDM are actually natural orbital functionals which do not perform well for all the correlation regimes. In this work, we propose a variational minimization scheme in the ensemble $N$-representable domain that is not restricted to the natural orbital representation of the 1-RDM. We show that splitting the minimization into the diagonal and off-diagonal part of the 1-RDM can open the way toward the development of functionals of the orbital occupations, which remains a challenge for the generalization of site-occupation functional theory in chemistry. Our approach is tested on the uniform Hubbard model using the M\"uller and the T\"ows--Pastor functionals, as well as on the dihydrogen molecule using the M\"uller functional.


title: Combinatorics of generic 5-degree polynomials

abstract: We consider the space $P$ of generic complex 5-degree polynomials. Critical values of such polynomial, i.e. four points in the complex plane, either are vertices of a convex quadrangle $Q$, or vertices of a triangle $T$ with one point inside $T$. The inverse image of $Q$ is a tree-like connected structure of five ovals (a cactus). The inverse image of $T$ is also a cactus, but of four ovals. Transformations of cacti of the first type into cacti of the second type and vice versa allow one to represent the space $P$ as a ribbon bipartite graph of genus 3.


title: The first low-mass eclipsing binary within the fully convective zone from TMTS

abstract: We present a comprehensive photometric and spectroscopic analysis of the short-period ($\sim$5.32 hours) and low-mass eclipsing binary TMTSJ0803 discovered by Tsinghua-Ma Huateng Telescope for Survey (TMTS). By fitting the light curves and radial velocity data with the Wilson--Devinney code, we find that the binary is composed of two late spotted active M dwarfs below the fully convective boundary. This is supported by the discovery of a significant Balmer emission lines in the LAMOST spectrum and prominent coronal X-ray emission. In comparison with the typical luminosity of rapidly rotating fully convective stars, the much brighter X-ray luminosity ($L_{X}/L_{\rm{bol}} = 0.0159 \pm 0.0059$) suggests the stellar magnetic activity of fully convective stars could be enhanced in such a close binary system. Given the metallicity of [M/H] = $-$ 0.35 dex as inferred from the LAMOST spectrum, we measure the masses and radii of both stars to be $M_{1} = 0.169 \pm 0.010~M_{\odot}$, $M_{2} = 0.162 \pm 0.016~M_{\odot}$, $R_{1} = 0.170 \pm 0.006~R_{\odot}$, and $R_{2} = 0.156 \pm 0.006~R_{\odot}$, respectively. Based on the luminosity ratio from the light curve modeling, the effective temperatures of two components are also estimated. In comparison with the stellar evolution models, the radii and effective temperatures of two components are all below the isochrones. The radius deflation might be mainly biased by a small radial velocity (RV) data or (and) a simple correction on RVs, while the discrepancy in effective temperature might be due to the enhanced magnetic activity in this binary.


title: CELA: Cost-Efficient Language Model Alignment for CTR Prediction

abstract: Click-Through Rate (CTR) prediction holds a paramount position in recommender systems. The prevailing ID-based paradigm underperforms in cold-start scenarios due to the skewed distribution of feature frequency. Additionally, the utilization of a single modality fails to exploit the knowledge contained within textual features. Recent efforts have sought to mitigate these challenges by integrating Pre-trained Language Models (PLMs). They design hard prompts to structure raw features into text for each interaction and then apply PLMs for text processing. With external knowledge and reasoning capabilities, PLMs extract valuable information even in cases of sparse interactions. Nevertheless, compared to ID-based models, pure text modeling degrades the efficacy of collaborative filtering, as well as feature scalability and efficiency during both training and inference. To address these issues, we propose \textbf{C}ost-\textbf{E}fficient \textbf{L}anguage Model \textbf{A}lignment (\textbf{CELA}) for CTR prediction. CELA incorporates textual features and language models while preserving the collaborative filtering capabilities of ID-based models. This model-agnostic framework can be equipped with plug-and-play textual features, with item-level alignment enhancing the utilization of external information while maintaining training and inference efficiency. Through extensive offline experiments, CELA demonstrates superior performance compared to state-of-the-art methods. Furthermore, an online A/B test conducted on an industrial App recommender system showcases its practical effectiveness, solidifying the potential for real-world applications of CELA.


title: UniCL: A Universal Contrastive Learning Framework for Large Time Series Models

abstract: Time-series analysis plays a pivotal role across a range of critical applications, from finance to healthcare, which involves various tasks, such as forecasting and classification. To handle the inherent complexities of time-series data, such as high dimensionality and noise, traditional supervised learning methods first annotate extensive labels for time-series data in each task, which is very costly and impractical in real-world applications. In contrast, pre-trained foundation models offer a promising alternative by leveraging unlabeled data to capture general time series patterns, which can then be fine-tuned for specific tasks. However, existing approaches to pre-training such models typically suffer from high-bias and low-generality issues due to the use of predefined and rigid augmentation operations and domain-specific data training. To overcome these limitations, this paper introduces UniCL, a universal and scalable contrastive learning framework designed for pretraining time-series foundation models across cross-domain datasets. Specifically, we propose a unified and trainable time-series augmentation operation to generate pattern-preserved, diverse, and low-bias time-series data by leveraging spectral information. Besides, we introduce a scalable augmentation algorithm capable of handling datasets with varying lengths, facilitating cross-domain pretraining. Extensive experiments on two benchmark datasets across eleven domains validate the effectiveness of UniCL, demonstrating its high generalization on time-series analysis across various fields.


title: Learning Object-Centric Representation via Reverse Hierarchy Guidance

abstract: Object-Centric Learning (OCL) seeks to enable Neural Networks to identify individual objects in visual scenes, which is crucial for interpretable visual comprehension and reasoning. Most existing OCL models adopt auto-encoding structures and learn to decompose visual scenes through specially designed inductive bias, which causes the model to miss small objects during reconstruction. Reverse hierarchy theory proposes that human vision corrects perception errors through a top-down visual pathway that returns to bottom-level neurons and acquires more detailed information, inspired by which we propose Reverse Hierarchy Guided Network (RHGNet) that introduces a top-down pathway that works in different ways in the training and inference processes. This pathway allows for guiding bottom-level features with top-level object representations during training, as well as encompassing information from bottom-level features into perception during inference. Our model achieves SOTA performance on several commonly used datasets including CLEVR, CLEVRTex and MOVi-C. We demonstrate with experiments that our method promotes the discovery of small objects and also generalizes well on complex real-world scenes. Code will be available at https://anonymous.4open.science/r/RHGNet-6CEF.


title: Second Law of Entanglement Manipulation with Entanglement Battery

abstract: A central question since the beginning of quantum information science is how two distant parties can convert one entangled state into another. Answers to these questions enable us to optimize the performance of tasks such as quantum key distribution and quantum teleportation, since certain entangled states are more useful than others for these applications. It has been conjectured that entangled state transformations could be executed reversibly in an asymptotic regime, mirroring the reversible nature of Carnot cycles in classical thermodynamics. While a conclusive proof of this conjecture has been missing so far, earlier studies excluded reversible entanglement manipulation in various settings. In this work, we investigate the concept of an entanglement battery, an auxiliary quantum system that facilitates quantum state transformations without a net loss of entanglement. We establish that reversible manipulation of entangled states is achievable through local operations when augmented with an entanglement battery. In this setting, two distant parties can convert any entangled state into another of equivalent entanglement. The rate of asymptotic transformation is quantitatively expressed as a ratio of the entanglement present within the quantum states involved. Different entanglement quantifiers give rise to unique principles governing state transformations, effectively constituting diverse manifestations of a "second law" of entanglement manipulation. Our methods provide a solution to the long-standing open question regarding the reversible manipulation of entangled states and are also applicable to entangled systems involving more than two parties, and to other quantum resource theories, including quantum thermodynamics.


title: Dirichlet problem for a class of nonlinear degenerate elliptic operators with critical growth and logarithmic perturbation

abstract: In this paper, we investigate the existence of weak solutions for a class of degenerate elliptic Dirichlet problems with critical nonlinearity and a logarithmic perturbation


title: Positive Geometries, Corolla Polynomial and Gauge Theory Amplitudes

abstract: Arkani-Hamed, Bai, He, and Yan (ABHY) discovered a convex realisation of the associahedron whose combinatorial and geometric structure generates tree-level amplitudes in bi-adjoint scalar theory. In this paper, we identify S-matrix of Yang-Mills theory with a scalar obtained by contracting the canonical form of ABHY associahedron with a multi-vector field (MVF) in the kinematic space. Components of this MVF are determined by the combinatorial structures that underlie the associahedron and Corolla polynomial that was introduced by Kreimer, Sars, and van Suijlekom (KSVS) in [2]. KSVS used the Corolla polynomial to obtain (at all orders in the loop expansion) the parametric representation of gauge theory Feynman integral from the corresponding Feynman integral in $\phi^{3}$ theory. Using the full power of Corolla polynomial, we then extend these results to obtain Yang-Mills one loop planar integrand by contracting the Corolla generated MVF with the canonical form defined by $\hat{D}_{n}$ polytope discovered by Arkani-Hamed, Frost, Plamondon, Salvatori, Thomas. We also demonstrate that KSVS representation of Corolla graph differential in the parametric space can be readily extended to "spin up" the curve integral formulae for $\textrm{Tr}\phi^{3}$ amplitude discovered in [3,4] and give an explicit construction of such formulae for tree-level and planar one loop gluon amplitudes.


title: Isomorphism classes and stably isomorphisms of double Danielewski varieties

abstract: The interest in Danielewski varieties arose from the study of the Cancellation Problem. In this paper, we study the isomorphism classes and stably isomorphisms of double Danielewski varieties, and show that they are counterexamples of the Cancellation Problem.


title: Observation of Noise Suppression during High-Efficiency Wavelength Doubling of Intense Quasi-Monochromatic Laser Light

abstract: Ultra-stable, quasi-monochromatic laser light forms the basis for high-precision interferometric measurements, e.g. for observing gravitational waves and for time keeping with optical clocks. Optical frequency conversion enables access to wavelengths at which optical materials have the lowest absorption and the lowest mechanical loss. Here we report a 25 % reduction in relative intensity noise (of technical origin) when converting 1064 nm to 2128 nm for powers far above parametric oscillation threshold. The new wavelength has high potential for improving gravitational wave detection and other ultra-high-precision experiments as well. Our results provide a better understanding of the dynamics of nonlinear optical processes and have great potential for the stabilisation of laser sources in optical sensing and metrology.


title: Interacting dark sector: a dynamical system perspective

abstract: We investigate the interaction between the dark sectors from a dynamical systems perspective. A general setup for interacting dark energy models that incorporates both quintessence and phantom fields through a switch parameter, allowing an interaction in the dark sectors has been considered. In the first part of our analysis, we have not assumed any specific form of the interaction and in the second part, we invoked examples in general framework of the interaction. The potentials of the scalar field are classified into two broad classes of potentials: exponential and non-exponential. We identify the potential late-time attractors of the system which have a complete dark energy domination. From our analysis, it is evident there could be an interaction between the dark sector. The interaction, if any, weakens over time. We find for the quintessence field the transfer of energy from dark matter to dark energy can flip the direction and on the contrary, for the phantom field, it is only from dark matter to dark energy.


title: Characterization of carbon dioxide on Ganymede and Europa supported by experiments: Effects of temperature, porosity, and mixing with water

abstract: The surfaces of icy moons are primarily composed of water ice that can be mixed with other compounds, such as carbon dioxide. The carbon dioxide (CO$_2)$ stretching fundamental band observed on Europa and Ganymede appears to be a combination of several bands that are shifting location from one moon to another. We investigate the cause of the observed shift in the CO$_2$ stretching absorption band experimentally. We also explore the spectral behaviour of CO$_2$ ice by varying the temperature and concentration.} %H$_2$O:CO$_2$ deposition ratios. We analyzed pure CO$_2$ ice and ice mixtures deposited at 10 K under ultra-high vacuum conditions using Fourier-transform infrared (FTIR) spectroscopy and temperature programmed desorption (TPD) experiments. Laboratory ice spectra were compared to JWST observation of Europa's and Ganymede's leading hemispheres. The simulated IR spectra were calculated using density functional theory (DFT) methods, exploring the effect of porosity in CO$_2$ ice. Pure CO$_2$ and CO$_2$-water ice show distinct spectral changes and desorption behaviours at different temperatures, revealing intricate CO$_2$ and H$_2$O interactions. The number of discernible peaks increases from two in pure CO$_2$ to three in CO$_2$-water mixtures.


title: Carrier Aggregation Enabled MIMO-OFDM Integrated Sensing and Communication

abstract: In the evolution towards the forthcoming era of sixth-generation (6G) mobile communication systems characterized by ubiquitous intelligence, integrated sensing and communication (ISAC) is in a phase of burgeoning development. However, the capabilities of communication and sensing within single frequency band fall short of meeting the escalating demands. To this end, this paper introduces a carrier aggregation (CA)- enabled multi-input multi-output orthogonal frequency division multiplexing (MIMO-OFDM) ISAC system fusing the sensing data on high and low-frequency bands by symbol-level fusion for ultimate communication experience and high-accuracy sensing. The challenges in sensing signal processing introduced by CA include the initial phase misalignment of the echo signals on high and low-frequency bands due to attenuation and radar cross section, and the fusion of the sensing data on high and lowfrequency bands with different physical-layer parameters. To this end, the sensing signal processing is decomposed into two stages. In the first stage, the problem of initial phase misalignment of the echo signals on high and low-frequency bands is solved by the angle compensation, space-domain diversity and vector crosscorrelation operations. In the second stage, this paper realizes symbol-level fusion of the sensing data on high and low-frequency bands through sensing vector rearrangement and cyclic prefix adjustment operations, thereby obtaining high-precision sensing performance. Then, the closed-form communication mutual information (MI) and sensing Cramer-Rao lower bound (CRLB) for the proposed ISAC system are derived to explore the theoretical performance bound with CA. Simulation results validate the feasibility and superiority of the proposed ISAC system.


title: On the existence and estimates of nested spherical designs

abstract: In this paper, we prove the existence of a spherical $t$-design formed by adding extra points to an arbitrarily given point set on the sphere and, subsequently, deduce the existence of nested spherical designs. Estimates on the number of required points are also given. For the case that the given point set is a spherical $t_1$-design such that $t_1 < t$ and the number of points is of optimal order $t_1^d$, we show that the upper bound of the total number of extra points and given points for forming nested spherical $t$-design is of order $t^{2d+1}$. A brief discussion concerning the optimal order in nested spherical designs is also given.


title: ECATS: Explainable-by-design concept-based anomaly detection for time series

abstract: Deep learning methods for time series have already reached excellent performances in both prediction and classification tasks, including anomaly detection. However, the complexity inherent in Cyber Physical Systems (CPS) creates a challenge when it comes to explainability methods. To overcome this inherent lack of interpretability, we propose ECATS, a concept-based neuro-symbolic architecture where concepts are represented as Signal Temporal Logic (STL) formulae. Leveraging kernel-based methods for STL, concept embeddings are learnt in an unsupervised manner through a cross-attention mechanism. The network makes class predictions through these concept embeddings, allowing for a meaningful explanation to be naturally extracted for each input. Our preliminary experiments with a simple CPS-based dataset show that our model is able to achieve great classification performance while ensuring local interpretability.


title: Quasi-polynomial extensions of nonsymmetric Macdonald-Koornwinder polynomials

abstract: In a recent preprint of the author with Sahi and Venkateswaran families of actions of the double affine Hecke algebra on spaces of quasi-polynomials were introduced. These so-called quasi-polynomial representations led to the introduction of quasi-polynomial extensions of the nonsymmetric Macdonald polynomials which reduce to metaplectic Iwahori-Whittaker functions in the $\mathfrak{p}$-adic limit. In this paper we extend the quasi-polynomial representations to Sahi's 5-parameter double affine Hecke algebra and introduce the quasi-polynomial extensions of the nonsymmetric Koornwinder polynomials.


title: Driving Referring Video Object Segmentation with Vision-Language Pre-trained Models

abstract: The crux of Referring Video Object Segmentation (RVOS) lies in modeling dense text-video relations to associate abstract linguistic concepts with dynamic visual contents at pixel-level. Current RVOS methods typically use vision and language models pre-trained independently as backbones. As images and texts are mapped to uncoupled feature spaces, they face the arduous task of learning Vision-Language~(VL) relation modeling from scratch. Witnessing the success of Vision-Language Pre-trained (VLP) models, we propose to learn relation modeling for RVOS based on their aligned VL feature space. Nevertheless, transferring VLP models to RVOS is a deceptively challenging task due to the substantial gap between the pre-training task (image/region-level prediction) and the RVOS task (pixel-level prediction in videos). In this work, we introduce a framework named VLP-RVOS to address this transfer challenge. We first propose a temporal-aware prompt-tuning method, which not only adapts pre-trained representations for pixel-level prediction but also empowers the vision encoder to model temporal clues. We further propose to perform multi-stage VL relation modeling while and after feature extraction for comprehensive VL understanding. Besides, we customize a cube-frame attention mechanism for spatial-temporal reasoning. Extensive experiments demonstrate that our method outperforms state-of-the-art algorithms and exhibits strong generalization abilities.


title: A Certified Proof Checker for Deep Neural Network Verification

abstract: Recent advances in the verification of deep neural networks (DNNs) have opened the way for broader usage of DNN verification technology in many application areas, including safety-critical ones. DNN verifiers are themselves complex programs that have been shown to be susceptible to errors and imprecisions; this in turn has raised the question of trust in DNN verifiers. One prominent attempt to address this issue is enhancing DNN verifiers with the capability of producing proofs of their results that are subject to independent algorithmic certification (proof checking). Formulations of proof production and proof checking already exist on top of the state-of-the-art Marabou DNN verifier. The native implementation of the proof checking algorithm for Marabou was done in C++ and itself raised the question of trust in the code (e.g., in the precision of floating point calculations or guarantees for implementation soundness). Here, we present an alternative implementation of the Marabou proof checking algorithm in Imandra -- an industrial functional programming language and prover -- that allows us to obtain an implementation with formal guarantees, including proofs of mathematical results underlying the algorithm, such as the use of the Farkas lemma.


title: Not All Prompts Are Secure: A Switchable Backdoor Attack Against Pre-trained Vision Transformers

abstract: Given the power of vision transformers, a new learning paradigm, pre-training and then prompting, makes it more efficient and effective to address downstream visual recognition tasks. In this paper, we identify a novel security threat towards such a paradigm from the perspective of backdoor attacks. Specifically, an extra prompt token, called the switch token in this work, can turn the backdoor mode on, i.e., converting a benign model into a backdoored one. Once under the backdoor mode, a specific trigger can force the model to predict a target class. It poses a severe risk to the users of cloud API, since the malicious behavior can not be activated and detected under the benign mode, thus making the attack very stealthy. To attack a pre-trained model, our proposed attack, named SWARM, learns a trigger and prompt tokens including a switch token. They are optimized with the clean loss which encourages the model always behaves normally even the trigger presents, and the backdoor loss that ensures the backdoor can be activated by the trigger when the switch is on. Besides, we utilize the cross-mode feature distillation to reduce the effect of the switch token on clean samples. The experiments on diverse visual recognition tasks confirm the success of our switchable backdoor attack, i.e., achieving 95%+ attack success rate, and also being hard to be detected and removed. Our code is available at https://github.com/20000yshust/SWARM.


title: Progress Towards Two-loop QCD Corrections to $pp\to t\bar{t} j$

abstract: We present the status of on-going efforts to compute the two-loop virtual corrections to $pp\to t\bar{t} j$ in the leading colour approximation. We review the recent study of the master integrals and their differential equations and present some ideas on modern techniques that can be applied to provide complete evaluation of helicity amplitudes containing information on top quark decays in the narrow width approximation.


title: A study of nine extreme low mass ratio contact binary systems

abstract: Low mass ratio systems (LMR) are a very interesting class of contact eclipsing binaries challenging the theoretical models of stability. These systems are also considered possible progenitors of the rare low-mass optical transients called red novae. In this study, we present the identification of 7 new totally eclipsing LMR systems from Catalina Sky Surveys (CSS) and 77 LMR candidates from the All Sky Automated Survey (ASAS$-$3). Using the available CSS light curves and new multiband observations for CSS$\_$J210228.3$-$031048 and CSS$\_$J231513.$+$345335 with the 2.3 m Aristarchos telescope at Helmos Observatory, we estimate their physical and absolute parameters and investigate their stability and their progenitors. The light curves are analyzed by performing a 2$-$dimension scan on the mass ratio $-$ inclination plane with Phoebe$-$0.31 scripter while the errors are estimated using Monte-Carlo simulations and heuristic scanning of the parameter space. Our analysis revealed that all 9 CSS systems have extreme mass ratios from 0.09 to 0.16. Our statistical analysis of well$-$studied LMR contact binaries shows that LMR systems tend to have warmer and more massive primaries. The investigation of the progenitors of both low and higher-mass ratio systems reveals a trend for the former to originate from higher-mass ancestors. Finally, we investigate the stability condition by calculating the ratio of spin angular momentum to orbital angular momentum and other stability indicators in the context of the reliability of the solutions.


title: Cannibals in PARADISE: The effect of merging interplanetary shocks on solar energetic particle events

abstract: Gradual solar energetic particle (SEP) events are associated with shocks driven by coronal mass ejections (CMEs). The merging of two CMEs (so-called Cannibalistic CMEs) and the interaction of their associated shocks, has been linked to some of the most powerful solar storms ever recorded. Multiple studies have focused on the observational aspects of these SEP events, yet only a handful have focused on modeling similar CME-CME interactions in the heliosphere using advanced magnetohydrodynamic (MHD) models. This work presents, to our knowledge, the first modeling results of a fully time-dependent 3D simulation that captures both the interaction of two CMEs and its effect on the acceleration and transport of SEPs. This is achieved by using an MHD model for the solar wind and CME propagation together with an integrated SEP model. We perform different simulations and compare the behavior of the energetic protons in three different solar wind environments, where a combination of two SEP-accelerating CMEs are modeled. We find that particle acceleration is significantly affected by the presence of both CMEs in the simulation. Initially, less efficient acceleration results in lower energy particles. However, as the CMEs converge and their shocks eventually merge, particle acceleration is significantly enhanced through multiple acceleration processes between CME-driven shocks, resulting in higher particle intensities and energy levels.


title: Feature-based Low-Rank Compression of Large Language Models via Bayesian Optimization

abstract: In recent years, large language models (LLMs) have driven advances in natural language processing. Still, their growing scale has increased the computational burden, necessitating a balance between efficiency and performance. Low-rank compression, a promising technique, reduces non-essential parameters by decomposing weight matrices into products of two low-rank matrices. Yet, its application in LLMs has not been extensively studied. The key to low-rank compression lies in low-rank factorization and low-rank dimensions allocation. To address the challenges of low-rank compression in LLMs, we conduct empirical research on the low-rank characteristics of large models. We propose a low-rank compression method suitable for LLMs. This approach involves precise estimation of feature distributions through pooled covariance matrices and a Bayesian optimization strategy for allocating low-rank dimensions. Experiments on the LLaMA-2 models demonstrate that our method outperforms existing strong structured pruning and low-rank compression techniques in maintaining model performance at the same compression ratio.


title: On Growth Functions of Coxeter Groups

abstract: Let $(W, S)$ be a Coxeter system of rank $n$ and let $p_{(W, S)}(t)$ be its growth function. It is known that $p_{(W, S)}(q^{-1}) < \infty$ holds for all $n \leq q \in \mathbb{N}$. In this paper we will show that this still holds for $q = n-1$, if $(W, S)$ is $2$-spherical. Moreover, we will prove that $p_{(W, S)}(q^{-1}) = \infty$ holds for $q = n-2$, if the Coxeter diagram of $(W, S)$ is the complete graph. These two results provide a complete characterization of the finiteness of the growth function in the case of $2$-spherical Coxeter systems with complete Coxeter diagram.


title: Distributed Event-Based Learning via ADMM

abstract: We consider a distributed learning problem, where agents minimize a global objective function by exchanging information over a network. Our approach has two distinct features: (i) It substantially reduces communication by triggering communication only when necessary, and (ii) it is agnostic to the data-distribution among the different agents. We can therefore guarantee convergence even if the local data-distributions of the agents are arbitrarily distinct. We analyze the convergence rate of the algorithm and derive accelerated convergence rates in a convex setting. We also characterize the effect of communication drops and demonstrate that our algorithm is robust to communication failures. The article concludes by presenting numerical results from a distributed LASSO problem, and distributed learning tasks on MNIST and CIFAR-10 datasets. The experiments underline communication savings of 50% or more due to the event-based communication strategy, show resilience towards heterogeneous data-distributions, and highlight that our approach outperforms common baselines such as FedAvg, FedProx, and FedADMM.


title: La structure des courbes analytiques

abstract: This is a work in progress, far from being in its final form whose purpose is to investigate thoroughly the structure of Berkovich analytic curves and its relation with the semi-stable reduction theorem (of which a new proof is given here, starting from the local study of Berkovich curves) through the formalism of "triangulations". It has been already on the author's webpage for years, but it seems better to make it available on a public preprint server.


title: MC-GPT: Empowering Vision-and-Language Navigation with Memory Map and Reasoning Chains

abstract: In the Vision-and-Language Navigation (VLN) task, the agent is required to navigate to a destination following a natural language instruction. While learning-based approaches have been a major solution to the task, they suffer from high training costs and lack of interpretability. Recently, Large Language Models (LLMs) have emerged as a promising tool for VLN due to their strong generalization capabilities. However, existing LLM-based methods face limitations in memory construction and diversity of navigation strategies. To address these challenges, we propose a suite of techniques. Firstly, we introduce a method to maintain a topological map that stores navigation history, retaining information about viewpoints, objects, and their spatial relationships. This map also serves as a global action space. Additionally, we present a Navigation Chain of Thoughts module, leveraging human navigation examples to enrich navigation strategy diversity. Finally, we establish a pipeline that integrates navigational memory and strategies with perception and action prediction modules. Experimental results on the REVERIE and R2R datasets show that our method effectively enhances the navigation ability of the LLM and improves the interpretability of navigation reasoning.


title: Historically Relevant Event Structuring for Temporal Knowledge Graph Reasoning

abstract: Temporal Knowledge Graph (TKG) reasoning focuses on predicting events through historical information within snapshots distributed on a timeline. Existing studies mainly concentrate on two perspectives of leveraging the history of TKGs, including capturing evolution of each recent snapshot or correlations among global historical facts. Despite the achieved significant accomplishments, these models still fall short of (1) investigating the influences of multi-granularity interactions across recent snapshots and (2) harnessing the expressive semantics of significant links accorded with queries throughout the entire history, especially events exerting a profound impact on the future. These inadequacies restrict representation ability to reflect historical dependencies and future trends thoroughly. To overcome these drawbacks, we propose an innovative TKG reasoning approach towards \textbf{His}torically \textbf{R}elevant \textbf{E}vents \textbf{S}tructuring ($\mathsf{HisRES}$). Concretely, $\mathsf{HisRES}$ comprises two distinctive modules excelling in structuring historically relevant events within TKGs, including a multi-granularity evolutionary encoder that captures structural and temporal dependencies of the most recent snapshots, and a global relevance encoder that concentrates on crucial correlations among events relevant to queries from the entire history. Furthermore, $\mathsf{HisRES}$ incorporates a self-gating mechanism for adaptively merging multi-granularity recent and historically relevant structuring representations. Extensive experiments on four event-based benchmarks demonstrate the state-of-the-art performance of $\mathsf{HisRES}$ and indicate the superiority and effectiveness of structuring historical relevance for TKG reasoning.


title: Differentially Private Machine Learning-powered Combinatorial Auction Design

abstract: We present a new approach to machine learning-powered combinatorial auctions, which is based on the principles of Differential Privacy. Our methodology guarantees that the auction mechanism is truthful, meaning that rational bidders have the incentive to reveal their true valuation functions. We achieve this by inducing truthfulness in the auction dynamics, ensuring that bidders consistently provide accurate information about their valuation functions. Our method not only ensures truthfulness but also preserves the efficiency of the original auction. This means that if the initial auction outputs an allocation with high social welfare, our modified truthful version of the auction will also achieve high social welfare. We use techniques from Differential Privacy, such as the Exponential Mechanism, to achieve these results. Additionally, we examine the application of differential privacy in auctions across both asymptotic and non-asymptotic regimes.


title: Model-free fast charging of lithium-ion batteries by online gradient descent

abstract: A data-driven solution is provided for the fast-charging problem of lithium-ion batteries with multiple safety and aging constraints. The proposed method optimizes the charging current based on the observed history of measurable battery quantities, such as the input current, terminal voltage, and temperature. The proposed method does not need any detailed battery model or full-charging training episodes. The theoretical convergence is proven under mild conditions and is validated numerically on several linear and nonlinear battery models, including single-particle and equivalent-circuit models.


title: Sample-Efficient Constrained Reinforcement Learning with General Parameterization

abstract: We consider a constrained Markov Decision Problem (CMDP) where the goal of an agent is to maximize the expected discounted sum of rewards over an infinite horizon while ensuring that the expected discounted sum of costs exceeds a certain threshold. Building on the idea of momentum-based acceleration, we develop the Primal-Dual Accelerated Natural Policy Gradient (PD-ANPG) algorithm that guarantees an $\epsilon$ global optimality gap and $\epsilon$ constraint violation with $\mathcal{O}(\epsilon^{-3})$ sample complexity. This improves the state-of-the-art sample complexity in CMDP by a factor of $\mathcal{O}(\epsilon^{-1})$.


title: Specialising and Analysing Instruction-Tuned and Byte-Level Language Models for Organic Reaction Prediction

abstract: Transformer-based encoder-decoder models have demonstrated impressive results in chemical reaction prediction tasks. However, these models typically rely on pretraining using tens of millions of unlabelled molecules, which can be time-consuming and GPU-intensive. One of the central questions we aim to answer in this work is: Can FlanT5 and ByT5, the encode-decoder models pretrained solely on language data, be effectively specialised for organic reaction prediction through task-specific fine-tuning? We conduct a systematic empirical study on several key issues of the process, including tokenisation, the impact of (SMILES-oriented) pretraining, fine-tuning sample efficiency, and decoding algorithms at inference. Our key findings indicate that although being pretrained only on language tasks, FlanT5 and ByT5 provide a solid foundation to fine-tune for reaction prediction, and thus become `chemistry domain compatible' in the process. This suggests that GPU-intensive and expensive pretraining on a large dataset of unlabelled molecules may be useful yet not essential to leverage the power of language models for chemistry. All our models achieve comparable Top-1 and Top-5 accuracy although some variation across different models does exist. Notably, tokenisation and vocabulary trimming slightly affect final performance but can speed up training and inference; The most efficient greedy decoding strategy is very competitive while only marginal gains can be achieved from more sophisticated decoding algorithms. In summary, we evaluate FlanT5 and ByT5 across several dimensions and benchmark their impact on organic reaction prediction, which may guide more effective use of these state-of-the-art language models for chemistry-related tasks in the future.


title: Dynamic data sampler for cross-language transfer learning in large language models

abstract: Large Language Models (LLMs) have gained significant attention in the field of natural language processing (NLP) due to their wide range of applications. However, training LLMs for languages other than English poses significant challenges, due to the difficulty in acquiring large-scale corpus and the requisite computing resources. In this paper, we propose ChatFlow, a cross-language transfer-based LLM, to address these challenges and train large Chinese language models in a cost-effective manner. We employ a mix of Chinese, English, and parallel corpus to continuously train the LLaMA2 model, aiming to align cross-language representations and facilitate the knowledge transfer specifically to the Chinese language model. In addition, we use a dynamic data sampler to progressively transition the model from unsupervised pre-training to supervised fine-tuning. Experimental results demonstrate that our approach accelerates model convergence and achieves superior performance. We evaluate ChatFlow on popular Chinese and English benchmarks, the results indicate that it outperforms other Chinese models post-trained on LLaMA-2-7B.


title: First principles simulations of dense hydrogen

abstract: Accurate knowledge of the properties of hydrogen at high compression is crucial for astrophysics (e.g. planetary and stellar interiors, brown dwarfs, atmosphere of compact stars) and laboratory experiments, including inertial confinement fusion. There exists experimental data for the equation of state, conductivity, and Thomson scattering spectra. However, the analysis of the measurements at extreme pressures and temperatures typically involves additional model assumptions, which makes it difficult to assess the accuracy of the experimental data. rigorously. On the other hand, theory and modeling have produced extensive collections of data. They originate from a very large variety of models and simulations including path integral Monte Carlo (PIMC) simulations, density functional theory (DFT), chemical models, machine-learned models, and combinations thereof. At the same time, each of these methods has fundamental limitations (fermion sign problem in PIMC, approximate exchange-correlation functionals of DFT, inconsistent interaction energy contributions in chemical models, etc.), so for some parameter ranges accurate predictions are difficult. Recently, a number of breakthroughs in first principle PIMC and DFT simulations were achieved which are discussed in this review. Here we use these results to benchmark different simulation methods. We present an update of the hydrogen phase diagram at high pressures, the expected phase transitions, and thermodynamic properties including the equation of state and momentum distribution. Furthermore, we discuss available dynamic results for warm dense hydrogen, including the conductivity, dynamic structure factor, plasmon dispersion, imaginary-time structure, and density response functions. We conclude by outlining strategies to combine different simulations to achieve accurate theoretical predictions.


title: Spectral functions with infinite projected entangled-pair states

abstract: Infinite projected entangled-pair states (iPEPS) provide a powerful tool to study two-dimensional strongly correlated systems directly in the thermodynamic limit. In this work, we extend the iPEPS toolbox by a method to efficiently evaluate non-equal time two-point correlators, enabling the computation of spectral functions. It is based on an iPEPS ansatz of the ground state in a large unit cell, with an operator applied in the center of the cell, which is evolved in real-time using the fast-full update method. At every time step, the two-point correlators within a cell are computed based on the corner transfer matrix renormalization group method. Benchmark results for the 2D transverse field Ising model show that the main features of the dynamical structure factor can already be reproduced at relatively small bond dimensions and unit cell sizes. The results for the magnon dispersion are found to be in good agreement with previous data obtained with the iPEPS excitation ansatz.


title: DeepPavlov at SemEval-2024 Task 8: Leveraging Transfer Learning for Detecting Boundaries of Machine-Generated Texts

abstract: The Multigenerator, Multidomain, and Multilingual Black-Box Machine-Generated Text Detection shared task in the SemEval-2024 competition aims to tackle the problem of misusing collaborative human-AI writing. Although there are a lot of existing detectors of AI content, they are often designed to give a binary answer and thus may not be suitable for more nuanced problem of finding the boundaries between human-written and machine-generated texts, while hybrid human-AI writing becomes more and more popular. In this paper, we address the boundary detection problem. Particularly, we present a pipeline for augmenting data for supervised fine-tuning of DeBERTaV3. We receive new best MAE score, according to the leaderboard of the competition, with this pipeline.


title: Medical Dialogue: A Survey of Categories, Methods, Evaluation and Challenges

abstract: This paper surveys and organizes research works on medical dialog systems, which is an important yet challenging task. Although these systems have been surveyed in the medical community from an application perspective, a systematic review from a rigorous technical perspective has to date remained noticeably absent. As a result, an overview of the categories, methods, and evaluation of medical dialogue systems remain limited and underspecified, hindering the further improvement of this area. To fill this gap, we investigate an initial pool of 325 papers from well-known computer science, and natural language processing conferences and journals, and make an overview. Recently, large language models have shown strong model capacity on downstream tasks, which also reshaped medical dialog systems' foundation. Despite the alluring practical application value, current medical dialogue systems still suffer from problems. To this end, this paper lists the grand challenges of medical dialog systems, especially of large language models.


title: A $\Gamma$-convergence of level-two large deviation for metastable systems: The case of zero-range processes

abstract: This study explores the relationship between the precise asymptotics of the level-two large deviation rate function and the behavior of metastable stochastic systems. Initially identified for overdamped Langevin dynamics (Ges{\`u} et al., SIAM J Math Anal 49(4), 3048-3072, 2017), this connection has been validated across various models, including random walks in a potential field. We extend this connection to condensing zero-range processes, a complex interacting particle system. Specifically, we investigate a certain class of zero-range processes on a fixed graph $G$ with $N > 0$ particles and interaction parameter $\alpha > 1$. On the time scale $N^2$, this process behaves like an absorbing-type diffusion and converges to a condensed state where all particles occupy a single vertex of $G$ as $N$ approaches infinity. Once condensed, on the time scale $N^{1+\alpha}$, the condensed site moves according to a Markov chain on $G$, showing metastable behavior among condensed states. The time scales $N^2$ and $N^{1+\alpha}$ are called the pre-metastable and metastable time scales. It is conjectured that this behavior is encapsulated in the level-two large deviation rate function $\mathcal{I}_N$ of the zero-range process. Specifically, it is expected that the $\Gamma$-expansion of $\mathcal{I}_N$ can be expressed as:$$\mathcal{I}_N = \frac{1}{N^2} \mathcal{K} + \frac{1}{N^{1+\alpha}} \mathcal{J},$$ where $\mathcal{K}$ and $\mathcal{J}$ are the level-two large deviation rate functions of the absorbing diffusion processes and the Markov chain on $G$. We rigorously prove this $\Gamma$-expansion by developing a methodology for $\Gamma$-convergence in the pre-metastable time scale and establishing a link between the resolvent approach to metastability (Landim et al., J Eur Math Soc, 2023. arXiv:2102.00998) and the $\Gamma$-expansion in the metastable time scale.


title: Beyond static AI evaluations: advancing human interaction evaluations for LLM harms and risks

abstract: Model evaluations are central to understanding the safety, risks, and societal impacts of AI systems. While most real-world AI applications involve human-AI interaction, most current evaluations (e.g., common benchmarks) of AI models do not. Instead, they incorporate human factors in limited ways, assessing the safety of models in isolation, thereby falling short of capturing the complexity of human-model interactions. In this paper, we discuss and operationalize a definition of an emerging category of evaluations -- "human interaction evaluations" (HIEs) -- which focus on the assessment of human-model interactions or the process and the outcomes of humans using models. First, we argue that HIEs can be used to increase the validity of safety evaluations, assess direct human impact and interaction-specific harms, and guide future assessments of models' societal impact. Second, we propose a safety-focused HIE design framework -- containing a human-LLM interaction taxonomy -- with three stages: (1) identifying the risk or harm area, (2) characterizing the use context, and (3) choosing the evaluation parameters. Third, we apply our framework to two potential evaluations for overreliance and persuasion risks. Finally, we conclude with tangible recommendations for addressing concerns over costs, replicability, and unrepresentativeness of HIEs.


title: Harnessing Collective Structure Knowledge in Data Augmentation for Graph Neural Networks

abstract: Graph neural networks (GNNs) have achieved state-of-the-art performance in graph representation learning. Message passing neural networks, which learn representations through recursively aggregating information from each node and its neighbors, are among the most commonly-used GNNs. However, a wealth of structural information of individual nodes and full graphs is often ignored in such process, which restricts the expressive power of GNNs. Various graph data augmentation methods that enable the message passing with richer structure knowledge have been introduced as one main way to tackle this issue, but they are often focused on individual structure features and difficult to scale up with more structure features. In this work we propose a novel approach, namely collective structure knowledge-augmented graph neural network (CoS-GNN), in which a new message passing method is introduced to allow GNNs to harness a diverse set of node- and graph-level structure features, together with original node features/attributes, in augmented graphs. In doing so, our approach largely improves the structural knowledge modeling of GNNs in both node and graph levels, resulting in substantially improved graph representations. This is justified by extensive empirical results where CoS-GNN outperforms state-of-the-art models in various graph-level learning tasks, including graph classification, anomaly detection, and out-of-distribution generalization.


title: Metasurface-enabled non-orthogonal four-output polarization splitter for non-redundant full-Stokes imaging

abstract: Imaging polarimetry plays an essential role in various fields since it imparts rich information that cannot be obtained through mere intensity and spectral measurements. To retrieve full Stokes parameters, at least four sensor pixels are required, each of which projects incident light to a different polarization state in the Stokes space. Conventional full-Stokes division-of-focal-plane (DoFP) cameras realize this function by integrating angled polarizers and retarders on top of image sensors. Due to the inevitable absorption at the polarizers, however, the maximum efficiency of these schemes is limited to 50% in theory. Instead of polarizers, three sets of lossless polarization beam splitters can be used to achieve higher-efficiency polarimetry, however, at the cost of reduced spatial resolution due to the need for six redundant sensor pixels. In this paper, we reveal, for the first time to our knowledge, that low-loss four-output polarization splitting (without filtering) is possible using a single-layer dielectric metasurface. Although these four states are not orthogonal to each other, our metasurface enables simultaneous sorting and focusing onto four sensor pixels with an efficiency exceeding 50\%, which is not feasible by a simple combination of space-optic components. The designed metasurface composed of silicon nanoposts is fabricated to experimentally demonstrate complete retrieval of full Stokes parameters at the near-infrared wavelength range from 1500 to 1600 nm with $-$2.28-dB efficiency. Finally, simple imaging polarimetry is demonstrated using a 3$\times$4 superpixel array.


title: Implementation of OpenAPI Wireshark Dissectors to Validate SBI Messages of 5G Core Networks

abstract: This paper introduces a novel Wireshark dissector designed to facilitate the analysis of Service-Based Interface (SBI) communication in 5G Core Networks. Our approach involves parsing the OpenAPI schemes provided by the 5G specification to automatically generate the dissector code. Our tool enables the validation of 5G Core Network traces to ensure compliance with the specifications. Through testing against three open-source 5G Core Network projects, we identified several issues where messages deviate from specification standards, highlighting the significance of our implementation in ensuring protocol conformity and network reliability.


title: Localization and unique continuation for non-stationary Schr\"odinger operators on the 2D lattice

abstract: We extend methods of Ding and Smart from their breakthrough paper in 2020 which showed Anderson localization for certain random Schr\"odinger operators on $\ell^2(\mathbb{Z}^2)$ via a quantitative unique continuation principle and Wegner estimate. We replace the requirement of identical distribution with the requirement of a uniform bound on the essential range of potential and a uniform positive lower bound on the variance of the variables giving the potential. Under those assumptions, we recover the unique continuation and Wegner lemma results, using Bernoulli decompositions and modifications of the arguments therein. This leads to a localization result at the bottom of the spectrum.


title: Layer-Condensed KV Cache for Efficient Inference of Large Language Models

abstract: Huge memory consumption has been a major bottleneck for deploying high-throughput large language models in real-world applications. In addition to the large number of parameters, the key-value (KV) cache for the attention mechanism in the transformer architecture consumes a significant amount of memory, especially when the number of layers is large for deep language models. In this paper, we propose a novel method that only computes and caches the KVs of a small number of layers, thus significantly saving memory consumption and improving inference throughput. Our experiments on large language models show that our method achieves up to 26$\times$ higher throughput than standard transformers and competitive performance in language modeling and downstream tasks. In addition, our method is orthogonal to existing transformer memory-saving techniques, so it is straightforward to integrate them with our model, achieving further improvement in inference efficiency. Our code is available at https://github.com/whyNLP/LCKV.


title: Deterministic computation of quantiles in a Lipschitz framework

abstract: In this article, our focus lies on computing the quantiles of a random variable $f(X)$, where $X$ is a $[0,1]^d$-valued random variable, $d \in \mathbb{N}^{\ast}$, and $f:[0,1]^d\to \mathbb{R}$ is a deterministic Lipschitz function. We are particularly interested in scenarios where the cost of a single function call is high, while assuming the law of $X$ is known. In this context, we propose a deterministic algorithm to obtain exact deterministic lower and upper bounds for the quantile of $f(X)$ at a given level $\alpha \in (0,1)$. With a fixed budget of $N$ function calls, we demonstrate that our algorithm achieves exponential convergence rate for $d=1$ ($\sim \rho^N$ with $\rho \in (0,1)$) and polynomial convergence rate for $d>1$ ($\sim N^{-\frac{1}{d-1}}$) and show the optimality of those rates within the class of deterministic algorithms. Furthermore, we design two algorithms based on whether the Lipschitz constant of $f$ is known or unknown.


title: Note on the union-closed sets conjecture and Reimer's average set size theorem

abstract: The Union-Closed Sets Conjecture, often attributed to P\'eter Frankl in 1979, remains an open problem in discrete mathematics. It posits that for any finite family of sets $S\neq\{\emptyset\}$, if the union of any two sets in the family is also in the family, then $\underline{\text{there must exist an element that belongs to at least half of the member sets}}$. We will refer to the underlined text as the abundance condition. In 2001, David Reimer proved that the average set size of a union-closed family $S$ must be at least $\frac{1}{2}\log_{2}|S|$. When proving this result, he showed that a family being union-closed implies that the family satisfies certain conditions, which we will refer to as the Reimer's conditions. Therefore, as seen in the context of Tim Gowers' polymath project on the Union-Closed Sets Conjecture, it is natural to ask if all families that satisfy Reimer's conditions meet the abundance condition. A minimal counterexample to this question was offered by Raz in 2017. In this paper, we will discuss a general method to construct infinitely many such counterexamples with any fixed lower bound on the size of the member sets. Furthermore, we will discuss some properties related to these counterexamples, especially those focusing on how far these counterexamples are from being union-closed.


title: COMET: NFT Price Prediction with Wallet Profiling

abstract: As the non-fungible token (NFT) market flourishes, price prediction emerges as a pivotal direction for investors gaining valuable insight to maximize returns. However, existing works suffer from a lack of practical definitions and standardized evaluations, limiting their practical application. Moreover, the influence of users' multi-behaviour transactions that are publicly accessible on NFT price is still not explored and exhibits challenges. In this paper, we address these gaps by presenting a practical and hierarchical problem definition. This approach unifies both collection-level and token-level task and evaluation methods, which cater to varied practical requirements of investors. To further understand the impact of user behaviours on the variation of NFT price, we propose a general wallet profiling framework and develop a COmmunity enhanced Multi-bEhavior Transaction graph model, named COMET. COMET profiles wallets with a comprehensive view and considers the impact of diverse relations and interactions within the NFT ecosystem on NFT price variations, thereby improving prediction performance. Extensive experiments conducted in our deployed system demonstrate the superiority of COMET, underscoring its potential in the insight toolkit for NFT investors.


title: Stellar wind impact on early atmospheres around unmagnetized Earth-like planets

abstract: Stellar rotation at early ages plays a crucial role in the survival of primordial atmospheres around Earth-mass exoplanets. Earth-like planets orbiting fast-rotating stars may undergo complete photoevaporation within the first few hundred Myr driven by the enhanced stellar XUV radiation, while planets orbiting slow-rotating stars are expected to experience difficulty to lose their primordial envelopes. Besides the action of stellar radiation, stellar winds induce additional erosion on these primordial atmospheres, altering their morphology, extent, and causing supplementary atmospheric losses. In this paper, we study the impact of activity-dependent stellar winds on primordial atmospheres to evaluate the extent at which the action of these winds can be significant in the whole planetary evolution at early evolutionary stages. We performed 3D magnetohydrodynamical (MHD) simulations of the interaction of photoevaporating atmospheres around unmagnetized Earth-mass planets in the time-span between 50 and 500 Myr, analyzing the joint evolution of stellar winds and atmospheres for both fast- and slow-rotating stars. Our results reveal substantial changes in the evolution of primordial atmospheres when influenced by fast-rotating stars, with a significant reduction in extent at early ages. In contrast, atmospheres embedded in the stellar winds from slow-rotating stars remain largely unaltered. The interaction of the magnetized stellar winds with the ionized upper atmospheres of these planets allows to evaluate the formation and evolution of different MHD structures, such as double-bow shocks and induced magnetospheres. This work will shed light to the first evolutionary stages of Earth-like exoplanets, that are of crucial relevance in terms of planet habitability.


title: Hi-GMAE: Hierarchical Graph Masked Autoencoders

abstract: Graph Masked Autoencoders (GMAEs) have emerged as a notable self-supervised learning approach for graph-structured data. Existing GMAE models primarily focus on reconstructing node-level information, categorizing them as single-scale GMAEs. This methodology, while effective in certain contexts, tends to overlook the complex hierarchical structures inherent in many real-world graphs. For instance, molecular graphs exhibit a clear hierarchical organization in the form of the atoms-functional groups-molecules structure. Hence, the inability of single-scale GMAE models to incorporate these hierarchical relationships often leads to their inadequate capture of crucial high-level graph information, resulting in a noticeable decline in performance. To address this limitation, we propose Hierarchical Graph Masked AutoEncoders (Hi-GMAE), a novel multi-scale GMAE framework designed to handle the hierarchical structures within graphs. First, Hi-GMAE constructs a multi-scale graph hierarchy through graph pooling, enabling the exploration of graph structures across different granularity levels. To ensure masking uniformity of subgraphs across these scales, we propose a novel coarse-to-fine strategy that initiates masking at the coarsest scale and progressively back-projects the mask to the finer scales. Furthermore, we integrate a gradual recovery strategy with the masking process to mitigate the learning challenges posed by completely masked subgraphs. Diverging from the standard graph neural network (GNN) used in GMAE models, Hi-GMAE modifies its encoder and decoder into hierarchical structures. This entails using GNN at the finer scales for detailed local graph analysis and employing a graph transformer at coarser scales to capture global information. Our experiments on 15 graph datasets consistently demonstrate that Hi-GMAE outperforms 17 state-of-the-art self-supervised competitors.


title: Quantum Synchronization and Dissipative Quantum Sensing

abstract: We study the phenomenon of quantum synchronization from the viewpoint of quantum metrology. By interpreting quantum self-sustained oscillators as dissipative quantum sensors, we develop a framework to characterize several aspects of quantum synchronization. We show that the quantum Fisher information (QFI) serves as a system-agnostic measure of quantum synchronization that also carries a clear operational meaning, viz., it quantifies the precision with which the amplitude of a weak synchronizing drive can be measured. We extend our analysis to study many-body oscillators subjected to multiple drives. We show how the QFI matrix can be used to determine the optimal drive that maximizes quantum synchronization, and also to quantitatively differentiate the synchronization responses induced by different drives. Our work highlights multiple connections between quantum synchronization and quantum metrology, paving a route towards finding quantum technological applications of quantum synchronization.


title: Freestanding perovskite and infinite-layer nickelate membranes

abstract: Following the discovery of superconductivity in hole-doped NdNiO$_2$ infinite-layer thin films, extensive research has been conducted particularly to compare these materials with cuprates. Superconductivity has also been observed in nickelate thin films with other rare-earth elements like Pr and La, but not in their bulk forms, suggesting a critical role for substrate-induced strain/interface or dimensionality effects. In this study, we use water-soluble (Ca,Sr)$_3$Al$_2$O$_6$ sacrificial layers to fabricate freestanding perovskite nickelate membranes and explore topotactic reduction without the SrTiO$_3$ substrate as a template. NdNiO$_3$-based heterostructure membranes transferred from a LaAlO$_3$ substrate exhibit better metallic behavior and higher hysteresis than those transferred from SrTiO$_3$, owing to the different strain states that the NdNiO$_3$ layer experience when grown on these two substrates. Despite the expected X-ray diffraction shifts, membranes reduced with CaH$_2$ display insulating characteristics, similar to bulk infinite-layer nickelates. Our findings strongly indicate that a template is necessary to stabilize a coherent and robust infinite-layer phase with optimal transport properties.