title: Nonstandard interactions of neutrinos with dense matter

abstract: Nonstandard interaction is expected to be a crucial hint to explain the experimental data of neutrino scattering off electrons. In this context, the nonstandard interaction vector and axial-vector couplings are needed to be extracted from recent experiments and a few of them are now available in the literature. With these coupling bounds, in this paper, I explore their impacts on the neutrinos interacting with the free electron gas in dense matter. To this end, I compute and predict the neutrino differential cross section and mean free path in dense matter for all those experimental bounds. Interesting behavior in the neutrino cross sections and mean free path is found for the different nonstandard interaction couplings from different experiment constraints. I also found that the neutrino cross-section and mean free path in the dense matter are very sensitive to values and signs of the nonstandard interaction couplings, leading to different prediction results to the Standard Model cross-section and mean free path.

categories: hep-ph astro-ph.HE astro-ph.SR hep-ex nucl-th


title: Holography inspired self-controlled reconfigurable intelligent surface

abstract: Among various promising candidate technologies for the sixth-generation (6G) wireless communications, recent advances in microwave metasurfaces have sparked a new research area of reconfigurable intelligent surfaces (RISs). By controllably reprogramming the wireless propagation channel, RISs are envisioned to achieve low-cost wireless capacity boosting, coverage extension, and enhanced energy efficiency. To reprogram the channel, each meta-atom on RIS needs an external control signal, which is usually generated by base station (BS). However, BS-controlled RISs require complicated control cables, which hamper their massive deployments. Here, we eliminate the need for BS control by proposing a self-controlled RIS (SC-RIS), which is inspired by the optical holography principle. Different from the existing BS-controlled RISs, each meta-atom of SC-RIS is integrated with an additional power detector for holographic recording. By applying the classical Fourier-transform processing to the measured hologram, SC-RIS is capable of retrieving the user's channel state information required for beamforming, thus enabling autonomous RIS beamforming without control cables. Owing to this WiFi-like plug-and-play capability without the BS control, SC-RISs are expected to enable easy and massive deployments in the future 6G systems.


title: Explainable Port Mapping Inference with Sparse Performance Counters for AMD's Zen Architectures

abstract: Performance models are instrumental for optimizing performance-sensitive code. When modeling the use of functional units of out-of-order x86-64 CPUs, data availability varies by the manufacturer: Instruction-to-port mappings for Intel's processors are available, whereas information for AMD's designs are lacking. The reason for this disparity is that standard techniques to infer exact port mappings require hardware performance counters that AMD does not provide. In this work, we modify the port mapping inference algorithm of the widely used uops.info project to not rely on Intel's performance counters. The modifications are based on a formal port mapping model with a counter-example-guided algorithm powered by an SMT solver. We investigate in how far AMD's processors comply with this model and where unexpected performance characteristics prevent an accurate port mapping. Our results provide valuable insights for creators of CPU performance models as well as for software developers who want to achieve peak performance on recent AMD CPUs.


title: Axion production in the $\eta\to \pi\pi a$ decay within $SU(3)$ chiral perturbation theory

abstract: We study the axion and axion-like particle production from the $\eta\to\pi\pi a$ decay within the $SU(3)$ chiral perturbation theory up to the one-loop level. The conventional $SU(3)$ chiral low energy constants are found to be able to reabsorb all the divergences from the chiral loops in the $\eta\to\pi\pi a$ decay amplitude, and hence render the amplitude independent of the renormalization scale. The unitarized $\eta\to\pi\pi a$ decay amplitudes are constructed to take into account the $\pi\pi$ final-state interactions and also properly reproduce the perturbative results from the chiral perturbation theory. Detailed analyses between the perturbative amplitudes and the unitarized ones are given in the phenomenological discussions. By taking the values of the chiral low energy constants in literature, we predict the Dalitz distributions, the spectra of the $\pi\pi$ and $a\pi$ systems, and also the branching ratios of the $\eta\to\pi\pi a$ process by varying $m_a$ from 0 to $m_\eta-2m_{\pi}$.


title: Markovian dynamics for a quantum/classical system and quantum trajectories

abstract: Quantum trajectory techniques have been used in the theory of open systems as a starting point for numerical computations and to describe the monitoring of a quantum system in continuous time. Here we extend this technique and use it to develop a general approach to the dynamics of quantum/classical hybrid systems. By using two coupled stochastic differential equations, we can describe a classical component and a quantum one which have their own intrinsic dynamics and which interact with each other. A mathematically rigorous construction is given, under the restriction of having a Markovian joint dynamics and of involving only bounded operators on the Hilbert space of the quantum component. An important feature is that, if the interaction allows for a flow of information from the quantum component to the classical one, necessarily the dynamics is dissipative. We show also how this theory is connected to a suitable hybrid dynamical semigroup, which reduces to a quantum dynamical semigroup in the purely quantum case and includes Liouville and Kolmogorov-Fokker-Plank equations in the purely classical case. Moreover, this semigroup allows to compare the proposed stochastic dynamics with various other proposals based on hybrid master equations. Some simple examples are constructed in order to show the variety of physical behaviours which can be described; in particular, a model presenting hidden entanglement is introduced.


title: A Temporal Graph Network Framework for Dynamic Recommendation

abstract: Recommender systems, crucial for user engagement on platforms like e-commerce and streaming services, often lag behind users' evolving preferences due to static data reliance. After Temporal Graph Networks (TGNs) were proposed, various studies have shown that TGN can significantly improve situations where the features of nodes and edges dynamically change over time. However, despite its promising capabilities, it has not been directly applied in recommender systems to date. Our study bridges this gap by directly implementing Temporal Graph Networks (TGN) in recommender systems, a first in this field. Using real-world datasets and a range of graph and history embedding methods, we show TGN's adaptability, confirming its effectiveness in dynamic recommendation scenarios.


title: Robust Diffusion Models for Adversarial Purification

abstract: Diffusion models (DMs) based adversarial purification (AP) has shown to be the most powerful alternative to adversarial training (AT). However, these methods neglect the fact that pre-trained diffusion models themselves are not robust to adversarial attacks as well. Additionally, the diffusion process can easily destroy semantic information and generate a high quality image but totally different from the original input image after the reverse process, leading to degraded standard accuracy. To overcome these issues, a natural idea is to harness adversarial training strategy to retrain or fine-tune the pre-trained diffusion model, which is computationally prohibitive. We propose a novel robust reverse process with adversarial guidance, which is independent of given pre-trained DMs and avoids retraining or fine-tuning the DMs. This robust guidance can not only ensure to generate purified examples retaining more semantic content but also mitigate the accuracy-robustness trade-off of DMs for the first time, which also provides DM-based AP an efficient adaptive ability to new attacks. Extensive experiments are conducted on CIFAR-10, CIFAR-100 and ImageNet to demonstrate that our method achieves the state-of-the-art results and exhibits generalization against different attacks.


title: The seeding of cosmic ray electrons by cluster radio galaxies: a review

abstract: Radio galaxies in clusters of galaxies are prominent reservoirs of magnetic fields and of non-thermal particles, which get mixed with the intracluster medium. We review the observational and theoretical knowledge of the role of these crucial ingredients for the formation of diffuse radio emission in clusters (radio halos, relics, mini halos) and outline the open questions in this field.


title: The mass-metallicity and fundamental metallicity relations in non-AGN and AGN-host galaxies

abstract: Galaxies' stellar masses, gas-phase oxygen abundances (metallicity), and star formation rates (SFRs) obey a series of empirical correlations, most notably the mass-metallicity relation (MZR) and fundamental metallicity relation (FZR), which relates oxygen abundance to a combination of stellar mass and SFR. However, due to the difficulty of measuring oxygen abundances and SFRs in galaxies that host powerful active galactic nuclei (AGN), to date it is unknown to what extent AGN-host galaxies also follow these correlations. In this work, we apply Bayesian methods to the MaNGA integral field spectrographic (IFS) survey that allow us to measure oxygen abundances and SFRs in AGN hosts, and use these measurements to explore how the MZR and FZR differ between galaxies that do and do not host AGN. We find similar MZRs at stellar masses above $10^{10.5} \mathrm{M}_\odot$, but that at lower stellar masses AGN hosts show up to $\sim 0.2$ dex higher oxygen abundances. The offset in the FZR is significantly smaller, suggesting that the larger deviation in the MZR is a result of AGN-host galaxies having systematically lower SFRs at fixed stellar mass. However, within the AGN-host sample there is little correlation between SFR and oxygen abundance. These findings support a scenario in which an AGN can halt efficient gas accretion, which drives non-AGN host galaxies to both higher SFR and lower oxygen abundance, resulting in the galaxy evolving off the star-forming main sequence (SFMS). As a consequence, as the SFR declines for an individual system its metallicity remains mostly unchanged.


title: Towards a MATLAB Toolbox to compute backstepping kernels using the power series method

abstract: In this paper, we extend our previous work on the power series method for computing backstepping kernels. Our first contribution is the development of initial steps towards a MATLAB toolbox dedicated to backstepping kernel computation. This toolbox would exploit MATLAB's linear algebra and sparse matrix manipulation features for enhanced efficiency; our initial findings show considerable improvements in computational speed with respect to the use of symbolical software without loss of precision at high orders. Additionally, we tackle limitations observed in our earlier work, such as slow convergence (due to oscillatory behaviors) and non-converging series (due to loss of analiticity at some singular points). To overcome these challenges, we introduce a technique that mitigates this behaviour by computing the expansion at different points, denoted as localized power series. This approach effectively navigates around singularities, and can also accelerates convergence by using more local approximations. Basic examples are provided to demonstrate these enhancements. Although this research is still ongoing, the significant potential and simplicity of the method already establish the power series approach as a viable and versatile solution for solving backstepping kernel equations, benefiting both novel and experienced practitioners in the field. We anticipate that these developments will be particularly beneficial in training the recently introduced neural operators that approximate backstepping kernels and gains.


title: Landmark-Guided Cross-Speaker Lip Reading with Mutual Information Regularization

abstract: Lip reading, the process of interpreting silent speech from visual lip movements, has gained rising attention for its wide range of realistic applications. Deep learning approaches greatly improve current lip reading systems. However, lip reading in cross-speaker scenarios where the speaker identity changes, poses a challenging problem due to inter-speaker variability. A well-trained lip reading system may perform poorly when handling a brand new speaker. To learn a speaker-robust lip reading model, a key insight is to reduce visual variations across speakers, avoiding the model overfitting to specific speakers. In this work, in view of both input visual clues and latent representations based on a hybrid CTC/attention architecture, we propose to exploit the lip landmark-guided fine-grained visual clues instead of frequently-used mouth-cropped images as input features, diminishing speaker-specific appearance characteristics. Furthermore, a max-min mutual information regularization approach is proposed to capture speaker-insensitive latent representations. Experimental evaluations on public lip reading datasets demonstrate the effectiveness of the proposed approach under the intra-speaker and inter-speaker conditions.


title: On the Secrecy Enhancement of an Integrated Ground-Aerial Network with a Hybrid FSO/THz Feeder Link

abstract: High altitude platforms (HAPs)-aided terrestrial-aerial communication technology based on free-space optical (FSO) and Terahertz (THz) feeder links has been attracting notable interest recently due to its great potential in reaching a higher data rate and connectivity. Nonetheless, the presence of harsh vertical propagation environments and potential aerial eavesdroppers are two of the main challenges limiting the reliability and security of such a technology. In this work, a secrecy-enhancing scheme for HAP-aided ground-aerial communication is proposed. The considered network consists of HAP-assisted communication between a ground station and a legitimate user under the threat of an aerial and ground eavesdropper. Thus, the proposed scheme leverages (i) HAP diversity by exploiting the presence of multiple flying HAPs and (ii) the use of a hybrid FSO/THz transmission scheme to offer better resilience against eavesdropping attacks. An analytical secrecy outage probability (SOP) expression is derived for the scheme in consideration. Results manifest the notable gain in security of the proposed scheme with respect to both (i) the single-HAP and (ii) THz feeder-based benchmark ones, where the proposed scheme's SOP is decreased by four orders of magnitude using $4$ HAPs with respect to the first benchmark scheme, while a $5$-dB secrecy gain is manifested with respect to the second benchmark one.


title: Combining Fine-Tuning and LLM-based Agents for Intuitive Smart Contract Auditing with Justifications

abstract: Smart contracts are decentralized applications built atop blockchains like Ethereum. Recent research has shown that large language models (LLMs) have potential in auditing smart contracts, but the state-of-the-art indicates that even GPT-4 can achieve only 30% precision (when both decision and justification are correct). This is likely because off-the-shelf LLMs were primarily pre-trained on a general text/code corpus and not fine-tuned on the specific domain of Solidity smart contract auditing. In this paper, we propose TrustLLM, a general framework that combines fine-tuning and LLM-based agents for intuitive smart contract auditing with justifications. Specifically, TrustLLM is inspired by the observation that expert human auditors first perceive what could be wrong and then perform a detailed analysis of the code to identify the cause. As such, TrustLLM employs a two-stage fine-tuning approach: it first tunes a Detector model to make decisions and then tunes a Reasoner model to generate causes of vulnerabilities. However, fine-tuning alone faces challenges in accurately identifying the optimal cause of a vulnerability. Therefore, we introduce two LLM-based agents, the Ranker and Critic, to iteratively select and debate the most suitable cause of vulnerability based on the output of the fine-tuned Reasoner model. To evaluate TrustLLM, we collected a balanced dataset with 1,734 positive and 1,810 negative samples to fine-tune TrustLLM. We then compared it with traditional fine-tuned models (CodeBERT, GraphCodeBERT, CodeT5, and UnixCoder) as well as prompt learning-based LLMs (GPT4, GPT-3.5, and CodeLlama-13b/34b). On a dataset of 263 real smart contract vulnerabilities, TrustLLM achieves an F1 score of 91.21% and an accuracy of 91.11%. The causes generated by TrustLLM achieved a consistency of about 38% compared to the ground truth causes.


title: Finding Candidate TeV Halos among Very-High Energy Sources

abstract: We search for possible pulsar TeV halos among the very-high-energy (VHE) sources reported in different VHE surveys, among which in particular we use the results from the first Large High Altitude Air Shower Observatory (LHAASO) catalog of $\gamma$-ray sources. Six candidates are found. They share similar properties of containing a middle-aged, gamma-ray--bright pulsar in their positional error circles (the respective pulsars are J0248+6021, J0359+5414, J0622+3749, J0633+0632, J2006+3102, and J2238+5903), being in a rather clean field without any common Galactic VHE-emitting supernova remnants or (bright) pulsar wind nebulae (PWNe), and showing an absence of any gamma-ray emissions in 0.1--500\,GeV after removing the pulsars' emissions. Combining these candidates with several reported (candidate) TeV halos, we obtain the relationships between their luminosity at 50\,TeV ($L_{\rm 50TeV}$) and the corresponding pulsars' spin-down energy ($\dot{E}$), which are $L_{\rm 50TeV}\sim \dot{E}^{0.9}$ and $L_{\rm 50TeV}/\dot{E}\sim 6.4\times 10^{-4}$. The relationships are nearly identical to previously reported ones. We probe possible connections between the extension sizes of the VHE sources and the pulsars' ages, and find a weak older-and-smaller trend. By comparing to the VHE detection results for PWNe, it is clear that the (candidate) TeV halos have hard emissions by either having their power-law indices be smaller than 2 in 1--25\,TeV or by only being detected in 25--100\,TeV. In addition, we also consider seven other VHE sources as possible TeV halos based on the results from different studies of them, but they do not fit cleanly with the properties listed above, indicating their potentially complex nature.


title: IBCB: Efficient Inverse Batched Contextual Bandit for Behavioral Evolution History

abstract: Traditional imitation learning focuses on modeling the behavioral mechanisms of experts, which requires a large amount of interaction history generated by some fixed expert. However, in many streaming applications, such as streaming recommender systems, online decision-makers typically engage in online learning during the decision-making process, meaning that the interaction history generated by online decision-makers includes their behavioral evolution from novice expert to experienced expert. This poses a new challenge for existing imitation learning approaches that can only utilize data from experienced experts. To address this issue, this paper proposes an inverse batched contextual bandit (IBCB) framework that can efficiently perform estimations of environment reward parameters and learned policy based on the expert's behavioral evolution history. Specifically, IBCB formulates the inverse problem into a simple quadratic programming problem by utilizing the behavioral evolution history of the batched contextual bandit with inaccessible rewards. We demonstrate that IBCB is a unified framework for both deterministic and randomized bandit policies. The experimental results indicate that IBCB outperforms several existing imitation learning algorithms on synthetic and real-world data and significantly reduces running time. Additionally, empirical analyses reveal that IBCB exhibits better out-of-distribution generalization and is highly effective in learning the bandit policy from the interaction history of novice experts.


title: Arithmetic of critical $p$-adic $L$-functions

abstract: Our objective in the present work is to develop a fairly complete arithmetic theory of critical $p$-adic $L$-functions on the eigencurve. To this end, we carry out the following tasks: a) We give an "\'etale" construction of Bella\"iche's $p$-adic $L$-functions at a $\theta$-critical point on the cuspidal eigencurve. b) We introduce the algebraic counterparts of these objects (which arise as appropriately defined Selmer complexes) and develop Iwasawa theory in this context, including a definition of an Iwasawa theoretic $\mathscr L$-invariant $\mathscr{L}^{\rm cr}_{\rm Iw}$. c) We formulate the (punctual) critical main conjecture and study its relationship with its slope-zero counterparts. Along the way, we also develop descent theory (paralleling Perrin-Riou's work). d) We introduce what we call thick (Iwasawa theoretic) fundamental line and the thick Selmer complex to counter Bella\"iche's secondary $p$-adic $L$-functions. This allows us to formulate an infinitesimal thickening of the Iwasawa main conjecture, and we observe that it implies both slope-zero and punctual critical main conjectures, but it seems stronger than both. e) We establish an $\mathcal{O}_{\mathcal{X}}$-adic leading term formula for the two-variable $p$-adic $L$-function over the affinoid neighbourhood $\mathcal{X}={\rm Spm}(\mathcal{O}_{\mathcal{X}})$ in the eigencurve about a $\theta$-critical point. Using this formula we prove, when the Hecke $L$-function of $f$ vanishes to order one at the central critical point, that the derivative of the secondary $p$-adic $L$-function can be computed in terms of the second order derivative of an $\mathcal{O}_{\mathcal{X}}$-adic regulator (rather than a regulator itself).


title: On the Bailout Dividend Problem with Periodic Dividend Payments and Fixed Transaction Costs

abstract: We study the optimal bailout dividend problem with transaction costs for an insurance company, where shareholder payouts align with the arrival times of an independent Poisson process. In this scenario, the underlying risk model follows a spectrally negative L\'evy process. Our analysis confirms the optimality of a periodic $(b_{1},b_{2})$-barrier policy with classical reflection at zero. This strategy involves reducing the surplus to $b_1$ when it exceeds $b_{2}$ at the Poisson arrival times and pushes the surplus to 0 whenever it goes below zero.


title: Target Speech Extraction with Pre-trained AV-HuBERT and Mask-And-Recover Strategy

abstract: Audio-visual target speech extraction (AV-TSE) is one of the enabling technologies in robotics and many audio-visual applications. One of the challenges of AV-TSE is how to effectively utilize audio-visual synchronization information in the process. AV-HuBERT can be a useful pre-trained model for lip-reading, which has not been adopted by AV-TSE. In this paper, we would like to explore the way to integrate a pre-trained AV-HuBERT into our AV-TSE system. We have good reasons to expect an improved performance. To benefit from the inter and intra-modality correlations, we also propose a novel Mask-And-Recover (MAR) strategy for self-supervised learning. The experimental results on the VoxCeleb2 dataset show that our proposed model outperforms the baselines both in terms of subjective and objective metrics, suggesting that the pre-trained AV-HuBERT model provides more informative visual cues for target speech extraction. Furthermore, through a comparative study, we confirm that the proposed Mask-And-Recover strategy is significantly effective.


title: The high-density regime of dusty plasma: Coulomb plasma

abstract: It is shown that the dust density regimes in dusty plasma are characterized by two complementary screening processes, (a) the low dust density regime where the Debye screening is the dominant process and (b) the high dust density regime where the Coulomb screening is the dominant process. The Debye regime is characterized by a state where all dust particles carry an equal and constant charge. The high-density regime or the Coulomb plasma regime is characterized by (a) Coulomb screening where the dust charge depends on the spatial location and is screened by other dust particles in the vicinity by charge reduction, (b) quark like asymptotic freedom where dust particles, which on an average carry minimal electric charge (q tends to 0), are asymptotically free, (c) uniform dust charge density and plasma potential, (d) dust charge neutralization by a uniform background of hot ions. Thus, the Coulomb plasma is essentially a one-component plasma (OCP) with screening as opposed to electron plasma which is OCP without screening. Molecular dynamics (MD) simulations verify these properties. The MD simulations are performed, using a recently developed Hamiltonian formalism, to study the dynamics of Yukawa particles carrying variable electric charge. A hydrodynamic model for describing the collective properties of Coulomb plasma and its characteristic acoustic mode called the Coulomb acoustic wave is given.


title: PKU-DyMVHumans: A Multi-View Video Benchmark for High-Fidelity Dynamic Human Modeling

abstract: High-quality human reconstruction and photo-realistic rendering of a dynamic scene is a long-standing problem in computer vision and graphics. Despite considerable efforts invested in developing various capture systems and reconstruction algorithms, recent advancements still struggle with loose or oversized clothing and overly complex poses. In part, this is due to the challenges of acquiring high-quality human datasets. To facilitate the development of these fields, in this paper, we present PKU-DyMVHumans, a versatile human-centric dataset for high-fidelity reconstruction and rendering of dynamic human scenarios from dense multi-view videos. It comprises 8.2 million frames captured by more than 56 synchronized cameras across diverse scenarios. These sequences comprise 32 human subjects across 45 different scenarios, each with a high-detailed appearance and realistic human motion. Inspired by recent advancements in neural radiance field (NeRF)-based scene representations, we carefully set up an off-the-shelf framework that is easy to provide those state-of-the-art NeRF-based implementations and benchmark on PKU-DyMVHumans dataset. It is paving the way for various applications like fine-grained foreground/background decomposition, high-quality human reconstruction and photo-realistic novel view synthesis of a dynamic scene. Extensive studies are performed on the benchmark, demonstrating new observations and challenges that emerge from using such high-fidelity dynamic data.


title: The Interplay of Learning, Analytics, and Artificial Intelligence in Education

abstract: This paper presents a multi-dimensional view of AI's role in learning and education, emphasizing the intricate interplay between AI, analytics, and the learning processes. Here, I challenge the prevalent narrow conceptualization of AI as stochastic tools, as exemplified in generative AI, and argue for the importance of alternative conceptualizations of AI. I highlight the differences between human intelligence and artificial information processing, the cognitive diversity inherent in AI algorithms, and posit that AI can also serve as an instrument for understanding human learning. Early learning sciences and AI in Education research, which saw AI as an analogy for human intelligence, have diverged from this perspective, prompting a need to rekindle this connection. The paper presents three unique conceptualizations of AI in education: the externalization of human cognition, the internalization of AI models to influence human mental models, and the extension of human cognition via tightly integrated human-AI systems. Examples from current research and practice are examined as instances of the three conceptualizations, highlighting the potential value and limitations of each conceptualization for education, as well as the perils of overemphasis on externalizing human cognition. It is argued that AI models can be useful as objects to think about learning, even though some aspects of learning might just come through the slow experience of living those learning moments and cannot be fully explained with AI models to be hacked with predictions. The paper concludes with advocacy for a broader approach to AI in Education that goes beyond considerations on the design and development of AI solutions in education, but also includes educating people about AI and innovating educational systems to remain relevant in an AI-ubiquitous world.


title: SoK: Comprehensive Analysis of Rug Pull Causes, Datasets, and Detection Tools in DeFi

abstract: Rug pulls pose a grave threat to the cryptocurrency ecosystem, leading to substantial financial loss and undermining trust in decentralized finance (DeFi) projects. With the emergence of new rug pull patterns, research on rug pull is out of state. To fill this gap, we first conducted an extensive analysis of the literature review, encompassing both scholarly and industry sources. By examining existing academic articles and industrial discussions on rug pull projects, we present a taxonomy inclusive of 34 root causes, introducing six new categories inspired by industry sources: burn, hidden owner, ownership transfer, unverified contract, external call, and fake LP lock. Based on the developed taxonomy, we evaluated current rug pull datasets and explored the effectiveness and limitations of existing detection mechanisms. Our evaluation indicates that the existing datasets, which document 2,448 instances, address only 7 of the 34 root causes, amounting to a mere 20% coverage. It indicates that existing open-source datasets need to be improved to study rug pulls. In response, we have constructed a more comprehensive dataset containing 2,360 instances, expanding the coverage to 54% with the best effort. In addition, the examination of 14 detection tools showed that they can identify 25 of the 34 root causes, achieving a coverage of 73.5%. There are nine root causes (Fake LP Lock, Hidden Fee, and Destroy Token, Fake Money Transfer, Ownership Transfer, Liquidity Pool Block, Freeze Account, Wash-Trading, Hedge) that the existing tools cannot cover. Our work indicates that there is a significant gap between current research and detection tools, and the actual situation of rug pulls.


title: Quantifying Arbitrage in Automated Market Makers: An Empirical Study of Ethereum ZK Rollups

abstract: Arbitrage can arise from the simultaneous purchase and sale of the same asset in different markets in order to profit from a difference in its price. This work systematically reviews arbitrage opportunities between Automated Market Makers (AMMs) on Ethereum ZK rollups, and Centralised Exchanges (CEXs). First, we propose a theoretical framework to measure such arbitrage opportunities and derive a formula for the related Maximal Arbitrage Value (MAV) that accounts for both price divergences and liquidity available in the trading venues. Then, we empirically measure the historical MAV available between SyncSwap, an AMM on zkSync Era, and Binance, and investigate how quickly misalignments in price are corrected against explicit and implicit market costs. Overall, the cumulative MAV from July to September 2023 on the USDC-ETH SyncSwap pool amounts to $104.96k (0.24% of trading volume).


title: Argument Quality Assessment in the Age of Instruction-Following Large Language Models

abstract: The computational treatment of arguments on controversial issues has been subject to extensive NLP research, due to its envisioned impact on opinion formation, decision making, writing education, and the like. A critical task in any such application is the assessment of an argument's quality - but it is also particularly challenging. In this position paper, we start from a brief survey of argument quality research, where we identify the diversity of quality notions and the subjectiveness of their perception as the main hurdles towards substantial progress on argument quality assessment. We argue that the capabilities of instruction-following large language models (LLMs) to leverage knowledge across contexts enable a much more reliable assessment. Rather than just fine-tuning LLMs towards leaderboard chasing on assessment tasks, they need to be instructed systematically with argumentation theories and scenarios as well as with ways to solve argument-related problems. We discuss the real-world opportunities and ethical issues emerging thereby.


title: RankingSHAP -- Listwise Feature Attribution Explanations for Ranking Models

abstract: Feature attributions are a commonly used explanation type, when we want to posthoc explain the prediction of a trained model. Yet, they are not very well explored in IR. Importantly, feature attribution has rarely been rigorously defined, beyond attributing the most important feature the highest value. What it means for a feature to be more important than others is often left vague. Consequently, most approaches focus on just selecting the most important features and under utilize or even ignore the relative importance within features. In this work, we rigorously define the notion of feature attribution for ranking models, and list essential properties that a valid attribution should have. We then propose RankingSHAP as a concrete instantiation of a list-wise ranking attribution method. Contrary to current explanation evaluation schemes that focus on selections, we propose two novel evaluation paradigms for evaluating attributions over learning-to-rank models. We evaluate RankingSHAP for commonly used learning-to-rank datasets to showcase the more nuanced use of an attribution method while highlighting the limitations of selection-based explanations. In a simulated experiment we design an interpretable model to demonstrate how list-wise ranking attributes can be used to investigate model decisions and evaluate the explanations qualitatively. Because of the contrastive nature of the ranking task, our understanding of ranking model decisions can substantially benefit from feature attribution explanations like RankingSHAP.


title: Geometric-phase signature of a structurally chiral dielectric slab with a central phase defect

abstract: A slab made of a dielectric structurally chiral medium (DSCM) strongly reflects the co-handed circularly polarized plane wave, but not the cross-handed circularly polarized plane wave, in a spectral regime called the circular Bragg regime. The effect of inserting a central phase defect in a DSCM slab with a modest number of structural periods is a spectral reflection hole in the circular Bragg regime, for co-handed incidence only. However, if the incident plane wave is left-circularly polarized, the geometric phase of the transmitted plane wave contains evidence of both the circular Bragg regime and the spectral reflection hole, regardless of the structural handedness of the DSCM. This evidence is indicative of the type of phase defect. The effect of inserting a central phase defect in a DSCM slab with a large number of structural periods is a spectral transmission hole in the circular Bragg regime, for cross-handed incidence only. The spectral transmission hole may be difficult to observe experimentally because of absorption inside the DSCM slab, but it will still be evident in the geometric phase of the transmitted plane wave, if the incident plane wave is left-circularly polarized.


title: LLMs as Compiler for Arabic Programming Language

abstract: In this paper we introduce APL (Arabic Programming Language) that uses Large language models (LLM) as semi-compiler to covert Arabic text code to python code then run the code. Designing a full pipeline from the structure of the APL text then a prompt (using prompt engineering) then running the prodcued python code using PyRunner. This project has a three parts first python library, a playground with simple interface and this research paper.


title: Geochromatic Number when Crossings are Independent

abstract: A geometric graph, $\overline{G}$, is a graph drawn in the plane, with straight line edges and vertices in general position. A geometric homomorphism between two geometric graphs $\overline{G}$, $\overline{H}$ is a vertex map $f:\overline{G}\to\overline{H}$ that preserves vertex adjacency and edge crossings. The geochromatic number of $\overline{G}$, denoted $X(\overline{G})$, is the smallest integer $n$ so that there is a geometric homomorphism from $\overline{G}$ to some geometric realization of $K_n$. Recall that the chromatic number of an abstract graph $G$, denoted $\chi(G)$, is the smallest integer $n$ for which there is a graph homomorphism from $G$ to $K_n$. It is immediately clear that $\chi(G)\leq X(\overline{G})$. This paper establishes some upper bounds on $X(\overline{G})$ in terms of $\chi(G)$. For instance, if all crossings are at distance at least 1 from each other, then $X(\overline{G})\leq 3\chi(G)$. However, there are more precise results. If all crossing are at distance at least 2, then $X(\overline{G})\leq \chi(G)+2$. If all crossings are at distance at least 1, and there is a graph homomorphism $f: G \to K_n$ that maps no pair of edges that cross in $\overline{G}$ to the same edge in $K_n$, then $X(\overline{G})\leq 2n$. Finally, if $\chi(G)\in \{2,3\}$ and all crossings are at distance at least 1, then $X(\overline{G})\leq 2\chi(G)$.


title: Parallax Effect in Microlensing Events due to Free-Floating Planets

abstract: One of most important applications of microlensing observations is detecting free-floating planets(FFPs). The time scale of microlensing due to FFPs ($t_{\rm E}$) is short (a few days). Discerning the annual parallax effect in observations from these short-duration events by one observer is barely possible, though their parallax amplitude is larger than that in common events. In microlensing events due to FFPs, the lens-source relative trajectory alters because of the observer's motion by $\boldsymbol{\delta u}$. This deviation is a straight line if $t_{\rm E} \ll P_{\oplus}$, and its size is $\delta u\propto \pi_{\rm{rel}}$ ($P_{\oplus}$ is the observer's orbital period). So, most of observed microlensing events due to close FFPs have simple Paczy\'nsky lightcurves with indiscernible and valuable parallax. To evaluate destructive effects of invisible parallax in such events, we simulate $\sim9650$ microlensing events due to FFPs with $t_{\rm E}<10$ days that are observed only by The Nancy Grace Roman Space Telescope(\wfirst). We conclude that in half of these microlensing events the missing parallax alters the real lightcurves, changing their shape and derived properties(by $\Delta \chi^{2}\gtrsim100$). By fitting Paczy\'nski lightcurves to these affected events we evaluate the relative and dimensionless deviations in the lensing parameters from their real values ($\delta t_{\rm E}, \delta \rho_{\star}, ...$). We conclude that around $46$ FFPs which are discovered by \wfirst\ have lightcurves highly affected by invisible parallax with $\delta t_{\rm E}>0.1~\rm{and}~\delta \rho_{\star}>0.1$. Our study reveals the importance of simultaneous and dense observations of microlensing events viewed by \wfirst\ by other observers rotating the Sun in different orbits.


title: beSnake: A routing algorithm for scalable spin-qubit architectures

abstract: As quantum computing devices increase in size with respect to the number of qubits, two-qubit interactions become more challenging, necessitating innovative and scalable qubit routing solutions. In this work, we introduce beSnake, a novel algorithm specifically designed to address the intricate qubit routing challenges in scalable spin-qubit architectures. Unlike traditional methods in superconducting architectures that solely rely on SWAP operations, beSnake also incorporates the shuttle operation to optimize the execution time and fidelity of quantum circuits and achieves fast computation times of the routing task itself. Employing a simple breadth-first search approach, beSnake effectively manages the restrictions created by diverse topologies and qubit positions acting as obstacles, for up to 72\% qubit density. It also has the option to adjust the level of optimization and to dynamically tackle parallelized routing tasks, all the while maintaining noise awareness. Our simulations demonstrate beSnake's advantage over an existing routing solution on random circuits and real quantum algorithms with up to $1,000$ qubits, showing an average improvement of up to $80\%$ in gate overhead and $54\%$ in depth overhead, and up to $8.33$ times faster routing times.


title: Uncertainties in Measurements of Bubbly Flows Using Phase-Detection Probes

abstract: The analysis of bubbly two-phase flows is challenging due to their turbulent nature and the need for intrusive phase-detection probes. However, accurately characterizing these flows is crucial for safely designing critical infrastructure such as dams and their appurtenant structures. The combination of dual-tip intrusive phase-detection probes with advanced signal processing algorithms enables the assessment of pseudo-instantaneous 1-D velocity time series; for which the limitations are not fully fathomed. In this investigation, we theoretically define four major sources of error, which we quantify using synthetically generated turbulent time series, coupled with the simulated response of a phase detection probe. Our findings show that typical high-velocity flows in hydraulic structures hold up to 15% error in the mean velocity estimations and up to 35% error in the turbulence intensity estimations for the most critical conditions, typically occurring in the proximity of the wall. Based on thousands of simulations, our study provides a novel data-driven tool for the estimation of these baseline errors (bias and uncertainties) in real-word phase-detection probe measurements.


title: Are NeRFs ready for autonomous driving? Towards closing the real-to-simulation gap

abstract: Neural Radiance Fields (NeRFs) have emerged as promising tools for advancing autonomous driving (AD) research, offering scalable closed-loop simulation and data augmentation capabilities. However, to trust the results achieved in simulation, one needs to ensure that AD systems perceive real and rendered data in the same way. Although the performance of rendering methods is increasing, many scenarios will remain inherently challenging to reconstruct faithfully. To this end, we propose a novel perspective for addressing the real-to-simulated data gap. Rather than solely focusing on improving rendering fidelity, we explore simple yet effective methods to enhance perception model robustness to NeRF artifacts without compromising performance on real data. Moreover, we conduct the first large-scale investigation into the real-to-simulated data gap in an AD setting using a state-of-the-art neural rendering technique. Specifically, we evaluate object detectors and an online mapping model on real and simulated data, and study the effects of different fine-tuning strategies.Our results show notable improvements in model robustness to simulated data, even improving real-world performance in some cases. Last, we delve into the correlation between the real-to-simulated gap and image reconstruction metrics, identifying FID and LPIPS as strong indicators. See https://research.zenseact.com/publications/closing-real2sim-gap for our project page.


title: The cone conjecture for vector-valued Siegel automorphic forms

abstract: We prove that the effective cone of automorphic vector bundles on the Siegel modular variety of rank $n$ in characteristic $p$ at a place of good reduction is encoded by the stack of $G$-zips of Pink--Wedhorn--Ziegler. Specifically, we show that the degree zero cohomology groups of automorphic vector bundles always vanish outside of the zip cone. This result is a special case of a general conjecture formulated by the Goldring and the author for all Hodge-type Shimura varieties of good reduction. In the case $n=3$, we give explicit conditions for the vanishing of the $0$-th cohomology group. Finally, in the course of the proof we define the notion of automorphic forms of trivial-type and study their properties.


title: Unmixedness of generalized Veronese bi-type ideals

abstract: In this paper, some algebraic invariants of generalized Veronese bi-type ideals are computed. We characterize the unmixed generalized Veronese bi-type ideals and we give a description of their associated prime ideals.


title: CG-SLAM: Efficient Dense RGB-D SLAM in a Consistent Uncertainty-aware 3D Gaussian Field

abstract: Recently neural radiance fields (NeRF) have been widely exploited as 3D representations for dense simultaneous localization and mapping (SLAM). Despite their notable successes in surface modeling and novel view synthesis, existing NeRF-based methods are hindered by their computationally intensive and time-consuming volume rendering pipeline. This paper presents an efficient dense RGB-D SLAM system, i.e., CG-SLAM, based on a novel uncertainty-aware 3D Gaussian field with high consistency and geometric stability. Through an in-depth analysis of Gaussian Splatting, we propose several techniques to construct a consistent and stable 3D Gaussian field suitable for tracking and mapping. Additionally, a novel depth uncertainty model is proposed to ensure the selection of valuable Gaussian primitives during optimization, thereby improving tracking efficiency and accuracy. Experiments on various datasets demonstrate that CG-SLAM achieves superior tracking and mapping performance with a notable tracking speed of up to 15 Hz. We will make our source code publicly available. Project page: https://zju3dv.github.io/cg-slam.


title: On Dehn functions for family of polycyclic groups

abstract: In this note, we initiate the concept of Dehn functions for a family of finite groups. We investigate the Dehn function for some specific families of finite polycyclic groups. We also consider related notions of spherical Dehn function and mean Dehn function for family of finite simple cyclic groups.


title: Can Language Models Pretend Solvers? Logic Code Simulation with LLMs

abstract: Transformer-based large language models (LLMs) have demonstrated significant potential in addressing logic problems. capitalizing on the great capabilities of LLMs for code-related activities, several frameworks leveraging logical solvers for logic reasoning have been proposed recently. While existing research predominantly focuses on viewing LLMs as natural language logic solvers or translators, their roles as logic code interpreters and executors have received limited attention. This study delves into a novel aspect, namely logic code simulation, which forces LLMs to emulate logical solvers in predicting the results of logical programs. To further investigate this novel task, we formulate our three research questions: Can LLMs efficiently simulate the outputs of logic codes? What strength arises along with logic code simulation? And what pitfalls? To address these inquiries, we curate three novel datasets tailored for the logic code simulation task and undertake thorough experiments to establish the baseline performance of LLMs in code simulation. Subsequently, we introduce a pioneering LLM-based code simulation technique, Dual Chains of Logic (DCoL). This technique advocates a dual-path thinking approach for LLMs, which has demonstrated state-of-the-art performance compared to other LLM prompt strategies, achieving a notable improvement in accuracy by 7.06% with GPT-4-Turbo.


title: Polymatroidal property of generalized mixed product ideals

abstract: Let L be the generalized mixed product ideal induced by a monomial ideal I. In this paper, we study the polymatroidal property of generalized mixed product ideals. Furthermore, some algebraic invariants of L are computed.


title: A Multi-Label Dataset of French Fake News: Human and Machine Insights

abstract: We present a corpus of 100 documents, OBSINFOX, selected from 17 sources of French press considered unreliable by expert agencies, annotated using 11 labels by 8 annotators. By collecting more labels than usual, by more annotators than is typically done, we can identify features that humans consider as characteristic of fake news, and compare them to the predictions of automated classifiers. We present a topic and genre analysis using Gate Cloud, indicative of the prevalence of satire-like text in the corpus. We then use the subjectivity analyzer VAGO, and a neural version of it, to clarify the link between ascriptions of the label Subjective and ascriptions of the label Fake News. The annotated dataset is available online at the following url: https://github.com/obs-info/obsinfox Keywords: Fake News, Multi-Labels, Subjectivity, Vagueness, Detail, Opinion, Exaggeration, French Press


title: Specifying Agent Ethics (Blue Sky Ideas)

abstract: We consider the question of what properties a Machine Ethics system should have. This question is complicated by the existence of ethical dilemmas with no agreed upon solution. We provide an example to motivate why we do not believe falling back on the elicitation of values from stakeholders is sufficient to guarantee correctness of such systems. We go on to define two broad categories of ethical property that have arisen in our own work and present a challenge to the community to approach this question in a more systematic way.


title: Evaluating Fairness Metrics Across Borders from Human Perceptions

abstract: Which fairness metrics are appropriately applicable in your contexts? There may be instances of discordance regarding the perception of fairness, even when the outcomes comply with established fairness metrics. Several surveys have been conducted to evaluate fairness metrics with human perceptions of fairness. However, these surveys were limited in scope, including only a few hundred participants within a single country. In this study, we conduct an international survey to evaluate the appropriateness of various fairness metrics in decision-making scenarios. We collected responses from 1,000 participants in each of China, France, Japan, and the United States, amassing a total of 4,000 responses, to analyze the preferences of fairness metrics. Our survey consists of three distinct scenarios paired with four fairness metrics, and each participant answers their preference for the fairness metric in each case. This investigation explores the relationship between personal attributes and the choice of fairness metrics, uncovering a significant influence of national context on these preferences.


title: Orders and Fibering

abstract: In 2018, Kielak gave a virtual fibering criterion for RFRS groups. In this paper, we present a simpler proof of this.


title: Quantum Field Theory of Electrons and Nuclei

abstract: We develop a non-relativistic quantum field theory of electrons and nuclei based on the Coulomb Hamiltonian. We derive the exact equations of motion and write these equations in the form of Hedin's equations for all species of identical particles involved. Theory derived allows the computation of exact observables and provides a rigorous starting point to derive approximations in a systematic way.


title: Compositional statistical mechanics, entropy and variational inference

abstract: In this document, we aim to gather various results related to a compositional/categorical approach to rigorous Statistical Mechanics. Rigorous Statistical Mechanics is centered on the mathematical study of statistical systems. Central concepts in this field have a natural expression in terms of diagrams in a category that couples measurable maps and Markov kernels. We showed that statistical systems are particular representations of partially ordered sets (posets), that we call A-specifications, and expressed their phases, i.e., Gibbs measures, as invariants of these representations. It opens the way to the use of homological algebra to compute phases of statistical systems. Two central results of rigorous Statistical Mechanics are, firstly, the characterization of extreme Gibbs measures as it relates to the zero-one law for extreme Gibbs measures, and, secondly, their variational principle which states that for translation invariant Hamiltonians, Gibbs measures are the minima of the Gibbs free energy. We showed how the characterization of extreme Gibbs measures extends to A-specifications; we proposed an Entropy functional for A-specifications and gave a message-passing algorithm, that generalized the belief propagation algorithm of graphical models, to find critical points of the associated variational free energy.


title: Viscoelastic material properties determine contact mechanics of hydrogel spheres

abstract: Granular materials are ubiquitous in nature and industry; their mechanical behavior has been of academic and engineering interest for centuries. One of the reasons for their rather complex mechanical behavior is that stresses exerted on a granular material propagate only through contacts between the grains. These contacts can change as the packing evolves. This makes any deformation and mechanical response from a granular packing a function of the nature of contacts between the grains and the material response of the material the grains are made of. We present a study in which we isolate the role of the grain material in the contact forces acting between two particles sliding past each other. We use hydrogel particles and find that a viscoelastic material model, in which the shear modulus decays with time, coupled with a simple Coulomb friction model captures the experimental results. The results suggest that the particle material evolution itself may play a role in the collective behavior of granular materials.


title: QGSJET-III model of high energy hadronic interactions: II. Particle production and extensive air shower characteristics

abstract: The hadronization procedure of the QGSJET-III Monte Carlo (MC) generator of high energy hadronic interactions is discussed. Selected results of the model, regarding production spectra of secondary particles, are presented in comparison to experimental data and to the corresponding predictions of the QGSJET-II-04 MC generator. The model is applied to calculations of basic characteristics of extensive air showers initiated by cosmic ray interactions in the atmosphere and the results are compared to predictions of other MC generators of cosmic ray interactions.


title: Designing Upper-Body Gesture Interaction with and for People with Spinal Muscular Atrophy in VR

abstract: Recent research proposed gaze-assisted gestures to enhance interaction within virtual reality (VR), providing opportunities for people with motor impairments to experience VR. Compared to people with other motor impairments, those with Spinal Muscular Atrophy (SMA) exhibit enhanced distal limb mobility, providing them with more design space. However, it remains unknown what gaze-assisted upper-body gestures people with SMA would want and be able to perform. We conducted an elicitation study in which 12 VR-experienced people with SMA designed upper-body gestures for 26 VR commands, and collected 312 user-defined gestures. Participants predominantly favored creating gestures with their hands. The type of tasks and participants' abilities influence their choice of body parts for gesture design. Participants tended to enhance their body involvement and preferred gestures that required minimal physical effort, and were aesthetically pleasing. Our research will contribute to creating better gesture-based input methods for people with motor impairments to interact with VR.


title: A Transformer approach for Electricity Price Forecasting

abstract: This paper presents a novel approach to electricity price forecasting (EPF) using a pure Transformer model. As opposed to other alternatives, no other recurrent network is used in combination to the attention mechanism. Hence, showing that the attention layer is enough for capturing the temporal patterns. The paper also provides fair comparison of the models using the open-source EPF toolbox and provide the code to enhance reproducibility and transparency in EPF research. The results show that the Transformer model outperforms traditional methods, offering a promising solution for reliable and sustainable power system operation.


title: Combinatorics of the integral closure of edge ideals of strong quasi-n-partite graphs

abstract: Combinatorial properties of some ideals related to strong quasi-n-partites graphs are examined. We prove that the edge ideal of a strong quasi-n-partite graph is not integrally closed and we give an expression for its integral closure. Moreover, we are able to determine the structure of the ideals of vertex covers for the edge ideals associated to a strong quasi-n-partite graph.


title: ByteCard: Enhancing ByteDance's Data Warehouse with Learned Cardinality Estimation

abstract: Cardinality estimation is a critical component and a longstanding challenge in modern data warehouses. ByteHouse, ByteDance's cloud-native engine for extensive data analysis in exabyte-scale environments, serves numerous internal decision-making business scenarios. With the increasing demand for ByteHouse, cardinality estimation becomes the bottleneck for efficiently processing queries. Specifically, the existing query optimizer of ByteHouse uses the traditional Selinger-like cardinality estimator, which can produce substantial estimation errors, resulting in suboptimal query plans. To improve cardinality estimation accuracy while maintaining a practical inference overhead, we develop a framework ByteCard that enables efficient training and integration of learned cardinality estimators. Furthermore, ByteCard adapts recent advances in cardinality estimation to build models that can balance accuracy and practicality (e.g., inference latency, model size, training overhead). We observe significant query processing speed-up in ByteHouse after replacing the existing cardinality estimator with ByteCard for several optimization scenarios. Evaluations on real-world datasets show the integration of ByteCard leads to an improvement of up to 30% in the 99th quantile of latency. At last, we share our valuable experience in engineering advanced cardinality estimators. This experience can help ByteHouse integrate more learning-based solutions on the critical query execution path in the future.


title: EVA: Zero-shot Accurate Attributes and Multi-Object Video Editing

abstract: Current diffusion-based video editing primarily focuses on local editing (\textit{e.g.,} object/background editing) or global style editing by utilizing various dense correspondences. However, these methods often fail to accurately edit the foreground and background simultaneously while preserving the original layout. We find that the crux of the issue stems from the imprecise distribution of attention weights across designated regions, including inaccurate text-to-attribute control and attention leakage. To tackle this issue, we introduce EVA, a \textbf{zero-shot} and \textbf{multi-attribute} video editing framework tailored for human-centric videos with complex motions. We incorporate a Spatial-Temporal Layout-Guided Attention mechanism that leverages the intrinsic positive and negative correspondences of cross-frame diffusion features. To avoid attention leakage, we utilize these correspondences to boost the attention scores of tokens within the same attribute across all video frames while limiting interactions between tokens of different attributes in the self-attention layer. For precise text-to-attribute manipulation, we use discrete text embeddings focused on specific layout areas within the cross-attention layer. Benefiting from the precise attention weight distribution, EVA can be easily generalized to multi-object editing scenarios and achieves accurate identity mapping. Extensive experiments demonstrate EVA achieves state-of-the-art results in real-world scenarios. Full results are provided at https://knightyxp.github.io/EVA/


title: Opportunities and challenges in the application of large artificial intelligence models in radiology

abstract: Influenced by ChatGPT, artificial intelligence (AI) large models have witnessed a global upsurge in large model research and development. As people enjoy the convenience by this AI large model, more and more large models in subdivided fields are gradually being proposed, especially large models in radiology imaging field. This article first introduces the development history of large models, technical details, workflow, working principles of multimodal large models and working principles of video generation large models. Secondly, we summarize the latest research progress of AI large models in radiology education, radiology report generation, applications of unimodal and multimodal radiology. Finally, this paper also summarizes some of the challenges of large AI models in radiology, with the aim of better promoting the rapid revolution in the field of radiography.


title: Local square mean in the hyperbolic circle problem

abstract: Let $\Gamma\subseteq PSL_2({\bf R})$ be a finite volume Fuchsian group. The hyperbolic circle problem is the estimation of the number of elements of the $\Gamma$-orbit of $z$ in a hyperbolic circle around $w$ of radius $R$, where $z$ and $w$ are given points of the upper half plane and $R$ is a large number. An estimate with error term $e^{{2\over 3}R}$ is known, and this has not been improved for any group. Petridis and Risager proved that in the special case $\Gamma =PSL_2({\bf Z})$ taking $z=w$ and averaging over $z$ locally the error term can be improved to $e^{\left({7\over {12}}+\epsilon\right)R}$. Here we show such an improvement for the local $L^2$-norm of the error term. Our estimate is $e^{\left({9\over {14}}+\epsilon\right)R}$, which is better than the pointwise bound $e^{{2\over 3}R}$ but weaker than the bound of Petridis and Risager for the local average.


title: Combinatorial properties of strong quasi-n-partite graphs

abstract: Monomial ideals corresponding to strong quasi-n-partite graphs are considered. Some algebraic and combinatorial properties of generalized graph ideals of a strong quasi-n-partite graph are studied. Furthermore, we show that the edge ideal of a strong quasi-n-partite graph is Cohen-Macaulay.


title: From Clicks to Conversions: Analysis of Traffic Sources in E-Commerce

abstract: Over the past years, e-commerce platforms have expanded substantially, providing customers with convenient shopping experiences. To enhance e-commerce websites, it's essential to grasp user engagement and factors affecting conversion rates. This optimization is achieved by aligning platforms with user expectations, thereby fostering successful online shopping experiences, and contributing to sustained growth in the dynamic digital marketplace. In this paper, we conduct a comprehensive analysis focusing on user interactions, conversion metrics, and the entire user journey within an e-commerce platform. Our exploration spans exit rates and sessions across different devices and browsers, conversion rates for various traffic sources, and the user journey from product details to checkout. Findings suggest a need for targeted improvements in mobile optimization and browser compatibility, indicated by higher exit rates on mobile devices and varying rates on different browsers. The conversion rate analysis emphasizes the varying effectiveness of traffic sources, highlighting the potential of advertised mediums, while identifying areas for improvement in referral and affiliate traffic. Examining the user journey showed potential bottlenecks in the conversion process, the identified gap was between user interest and completed transactions. Our study suggests improving the checkout process strategically to streamline user transactions. These insights provide actionable guidance for businesses seeking to refine their platforms and optimize performance in the ever-evolving landscape of e-commerce.


title: Self-Supervised Multi-Frame Neural Scene Flow

abstract: Neural Scene Flow Prior (NSFP) and Fast Neural Scene Flow (FNSF) have shown remarkable adaptability in the context of large out-of-distribution autonomous driving. Despite their success, the underlying reasons for their astonishing generalization capabilities remain unclear. Our research addresses this gap by examining the generalization capabilities of NSFP through the lens of uniform stability, revealing that its performance is inversely proportional to the number of input point clouds. This finding sheds light on NSFP's effectiveness in handling large-scale point cloud scene flow estimation tasks. Motivated by such theoretical insights, we further explore the improvement of scene flow estimation by leveraging historical point clouds across multiple frames, which inherently increases the number of point clouds. Consequently, we propose a simple and effective method for multi-frame point cloud scene flow estimation, along with a theoretical evaluation of its generalization abilities. Our analysis confirms that the proposed method maintains a limited generalization error, suggesting that adding multiple frames to the scene flow optimization process does not detract from its generalizability. Extensive experimental results on large-scale autonomous driving Waymo Open and Argoverse lidar datasets demonstrate that the proposed method achieves state-of-the-art performance.


title: Convolution and Knapsack in Higher Dimensions

abstract: In the Knapsack problem, one is given the task of packing a knapsack of a given size with items in order to gain a packing with a high profit value. In recent years, a connection to the $(\max,+)$-convolution problem has been established, where knapsack solutions can be combined by building the convolution of two sequences. This observation has been used to give conditional lower bounds but also parameterized algorithms. In this paper we want to carry these results into higher dimension. We consider Knapsack where items are characterized by multiple properties - given through a vector - and a knapsack that has a capacity vector. The packing must now not exceed any of the given capacity constraints. In order to show a similar sub-quadratic lower bound we introduce a multi-dimensional version of convolution as well. Instead of combining sequences, we will generalize this problem and combine higher dimensional matrices. We will establish a few variants of these problems and prove that they are all equivalent in terms of algorithms that allow for a running time sub-quadratic in the number of entries of the matrix. We further develop a parameterized algorithm to solve higher dimensional Knapsack. The techniques we apply are inspired by an algorithm introduced by Axiotis and Tzamos. In general, we manage not only to extend their result to higher dimension. We will show that even for higher dimensional Knapsack, we can reduce the problem to convolution on one-dimensional sequences, leading to an $\mathcal{O}(d(n + D \cdot \max\{\Pi_{i=1}^d{t_i}, t_{\max}\log t_{\max}\} ))$ algorithm, where $D$ is the number of different weight vectors, $t$ the capacity vector and $d$ is the dimension of the problem. Finally we also modify this algorithm to handle items with negative weights to cross the bridge from solving not only Knapsack but also Integer Linear Programs (ILPs) in general.


title: Dynamical system analysis of LRS-BI Universe with f(Q) gravity theory

abstract: Considering the Universe as a dynamic system, the understanding of its evolution is an interesting aspect of study in cosmology. Here, we investigate the anisotropic locally rotationally symmetric (LRS) Bianchi type-I (LRS-BI) spacetime under the $f(Q)$ gravity of symmetric teleparallel theory equivalent to the GR (STEGR) as a dynamical system and try to understand the role of anisotropy in the evolution of its various phases. For this work, we consider two models, viz., $f(Q) = -\,(Q+ 2\Lambda)$ and $f(Q) = -\, \beta Q^{n}$ to study the critical points and stability of the LRS-BI Universe. In both the models, it is found that the various phases like radiation-dominated, matter-dominated, and dark energy-dominated phases are heteroclinically connected, and there is some role of anisotropy in the evolution of these phases of the Universe. However, for both the models, there are some unphysical solutions too depending upon the values of model parameters $\beta$ and $n$ along with the anisotropic parameter $\alpha$.


title: Pressure-tuning topological phase transitions in Kagome superconductor CsTi$_3$Bi$_5$

abstract: Recently, the Kagome metal CsTi$_3$Bi$_5$ has exhibited several novel quantum properties similar to CsV$_3$Sb$_5$, such as nontrivial topology, double-dome superconductivity, and flat band features. However, CsTi$_3$Bi$_5$ lacks the charge-density wave (CDW) present in CsV$_3$Sb$_5$, making the study of its emergence of double-dome superconductivity a focus of research. In this work, we have identified an order parameter, the three-band Z$_2$ topological index, that can describe the superconducting phase diagram of CsTi$_3$Bi$_5$ under pressure. Its evolution with pressure follows the expected behavior for superconductivity. Furthermore, the results of the Fermi surface under pressure reveal the potential presence of a Lifshitz transition in the vicinity of the vanishing point of the superconducting temperature change with pressure in CsTi$_3$Bi$_5$. These results indicate that the superconducting behavior of CsTi$_3$Bi$_5$ under pressure is caused by changes in the electronic structure leading to alterations in the topological properties, provide new insights and approaches for understanding the superconducting phenomenon in Kagome metals.


title: Bulk universality for deformed GinUEs

abstract: For the deformed complex Ginibre ensemble with a mean normal matrix, under certain assumptions on the mean matrix we prove that the same bulk statistics holds as in the complex Ginibre matrix bulk. This is the continuation of the previous joint papers ``Critical edge statistics for deformed GinUEs Preprint arXiv: 2311.13227v1'' and ``Repeated erfc statistics for deformed GinUEs Preprint arXiv: 2402.14362'', which deal with local eigenvalue statistics at the edge.


title: Log-rank test with coarsened exact matching

abstract: It is of special importance in the clinical trial to compare survival times between the treatment group and the control group. Propensity score methods with a logistic regression model are often used to reduce the effects of confounders. However, the modeling of complex structures between the covariates, the treatment assignment and the survival time is difficult. In this paper, we consider coarsened exact matching (CEM), which does not need any parametric models, and we propose the weighted log-rank statistic based on CEM. We derive asymptotic properties of the weighted log-rank statistic, such as the weak convergence to a Gaussian process in Skorokhod space, in particular the asymptotic normality, under the null hypothesis and the consistency of the log-rank test. Simulation studies show that the log-rank statistic based on CEM is more robust than the log-rank statistic based on the propensity score.


title: Phase-field based lattice Boltzmann method for containerless freezing

abstract: In this paper, a lattice Boltzmann model is proposed to simulate solid-liquid phase change phenomena in multiphase systems. The model couples the thermal properties of the solidification front with the dynamics of the liquid droplet interface, which enables the description of the complex interfacial changes during solid-liquid phase change process. The model treats the interfaces of gas, liquid, and solid phases using the phase field order parameter and the solid fraction. The volume expansion or contraction caused by the change of properties such as density during phase change is represented by adding a mass source term to the continuum equation. The proposed model is first validated by the three-phase Stefan problem and the droplet solidification on a cold surface, and the numerical results are in good agreement with the analytical and experimental results. Then it is used to model the solidification problem with bubbles. The results show that the model is able to accurately capture the effect of bubbles on the solidification process, which is in good agreement with previous work. In addition, a parametric study is carried out to examine the dependence of the sessile droplet solidification on different physical and numerical parameters. The results show that the droplet solidification time increases with increasing droplet volume and contact angle.


title: Embarking on a skyrmion Odyssey

abstract: Optical Skyrmions, as an emergent cutting-edge topic in optics and photonics, extend the concept of non-singular topological defects to topological photonics, providing extra degrees of freedom for light-matter interaction manipulations, optical metrologies, optical communications, etc..


title: Enhancing Visual Continual Learning with Language-Guided Supervision

abstract: Continual learning (CL) aims to empower models to learn new tasks without forgetting previously acquired knowledge. Most prior works concentrate on the techniques of architectures, replay data, regularization, \etc. However, the category name of each class is largely neglected. Existing methods commonly utilize the one-hot labels and randomly initialize the classifier head. We argue that the scarce semantic information conveyed by the one-hot labels hampers the effective knowledge transfer across tasks. In this paper, we revisit the role of the classifier head within the CL paradigm and replace the classifier with semantic knowledge from pretrained language models (PLMs). Specifically, we use PLMs to generate semantic targets for each class, which are frozen and serve as supervision signals during training. Such targets fully consider the semantic correlation between all classes across tasks. Empirical studies show that our approach mitigates forgetting by alleviating representation drifting and facilitating knowledge transfer across tasks. The proposed method is simple to implement and can seamlessly be plugged into existing methods with negligible adjustments. Extensive experiments based on eleven mainstream baselines demonstrate the effectiveness and generalizability of our approach to various protocols. For example, under the class-incremental learning setting on ImageNet-100, our method significantly improves the Top-1 accuracy by 3.2\% to 6.1\% while reducing the forgetting rate by 2.6\% to 13.1\%.


title: A Codesign of Scheduling and Parallelization for Large Model Training in Heterogeneous Clusters

abstract: Joint consideration of scheduling and adaptive parallelism offers great opportunities for improving the training efficiency of large models on heterogeneous GPU clusters. However, integrating adaptive parallelism into a cluster scheduler expands the cluster scheduling space. The new space is the product of the original scheduling space and the parallelism exploration space of adaptive parallelism (also a product of pipeline, data, and tensor parallelism). The exponentially enlarged scheduling space and ever-changing optimal parallelism plan from adaptive parallelism together result in the contradiction between low-overhead and accurate performance data acquisition for efficient cluster scheduling. This paper presents Crius, a training system for efficiently scheduling multiple large models with adaptive parallelism in a heterogeneous cluster. Crius proposes a novel scheduling granularity called Cell. It represents a job with deterministic resources and pipeline stages. The exploration space of Cell is shrunk to the product of only data and tensor parallelism, thus exposing the potential for accurate and low-overhead performance estimation. Crius then accurately estimates Cells and efficiently schedules training jobs. When a Cell is selected as a scheduling choice, its represented job runs with the optimal parallelism plan explored. Experimental results show that Crius reduces job completion time by up to 48.9% and schedules large models with up to 1.49x cluster throughput improvement.


title: The strong coupling in the nonperturbative and near-perturbative regimes

abstract: We use analytic continuation to extend the gauge/gravity duality nonperturbative description of the strong force coupling into the transition, near-perturbative, regime where perturbative effects become important. By excluding the unphysical region in coupling space from the flow of singularities in the complex plane, we derive a specific relation between the scales relevant at large and short distances; this relation is uniquely fixed by requiring maximal analyticity. The unified effective coupling model gives an accurate description of the data in the nonperturbative and the near-perturbative regions.


title: WangchanLion and WangchanX MRC Eval

abstract: This technical report describes the development of WangchanLion, an instruction fine-tuned model focusing on Machine Reading Comprehension (MRC) in the Thai language. Our model is based on SEA-LION and a collection of instruction following datasets. To promote open research and reproducibility, we publicly release all training data, code, and the final model weights under the Apache-2 license. To assess the contextual understanding capability, we conducted extensive experimental studies using two Thai MRC datasets, XQuAD and Iapp_wiki_qa_squad. Experimental results demonstrate the model's ability to comprehend the context and produce an answer faithful to the reference one in 0-shot and 1-shot settings. In addition, our evaluation goes beyond the traditional MRC. We propose a new evaluation scheme assessing the answer's correctness, helpfulness, conciseness, and contextuality. Our code is available publicly at https://github.com/vistec-AI/WangchanLion.


title: Enhancing Video Transformers for Action Understanding with VLM-aided Training

abstract: Owing to their ability to extract relevant spatio-temporal video embeddings, Vision Transformers (ViTs) are currently the best performing models in video action understanding. However, their generalization over domains or datasets is somewhat limited. In contrast, Visual Language Models (VLMs) have demonstrated exceptional generalization performance, but are currently unable to process videos. Consequently, they cannot extract spatio-temporal patterns that are crucial for action understanding. In this paper, we propose the Four-tiered Prompts (FTP) framework that takes advantage of the complementary strengths of ViTs and VLMs. We retain ViTs' strong spatio-temporal representation ability but improve the visual encodings to be more comprehensive and general by aligning them with VLM outputs. The FTP framework adds four feature processors that focus on specific aspects of human action in videos: action category, action components, action description, and context information. The VLMs are only employed during training, and inference incurs a minimal computation cost. Our approach consistently yields state-of-the-art performance. For instance, we achieve remarkable top-1 accuracy of 93.8% on Kinetics-400 and 83.4% on Something-Something V2, surpassing VideoMAEv2 by 2.8% and 2.6%, respectively.


title: A Survey on Lexical Ambiguity Detection and Word Sense Disambiguation

abstract: This paper explores techniques that focus on understanding and resolving ambiguity in language within the field of natural language processing (NLP), highlighting the complexity of linguistic phenomena such as polysemy and homonymy and their implications for computational models. Focusing extensively on Word Sense Disambiguation (WSD), it outlines diverse approaches ranging from deep learning techniques to leveraging lexical resources and knowledge graphs like WordNet. The paper introduces cutting-edge methodologies like word sense extension (WSE) and neuromyotonic approaches, enhancing disambiguation accuracy by predicting new word senses. It examines specific applications in biomedical disambiguation and language specific optimisation and discusses the significance of cognitive metaphors in discourse analysis. The research identifies persistent challenges in the field, such as the scarcity of sense annotated corpora and the complexity of informal clinical texts. It concludes by suggesting future directions, including using large language models, visual WSD, and multilingual WSD systems, emphasising the ongoing evolution in addressing lexical complexities in NLP. This thinking perspective highlights the advancement in this field to enable computers to understand language more accurately.


title: AKBR: Learning Adaptive Kernel-based Representations for Graph Classification

abstract: In this paper, we propose a new model to learn Adaptive Kernel-based Representations (AKBR) for graph classification. Unlike state-of-the-art R-convolution graph kernels that are defined by merely counting any pair of isomorphic substructures between graphs and cannot provide an end-to-end learning mechanism for the classifier, the proposed AKBR approach aims to define an end-to-end representation learning model to construct an adaptive kernel matrix for graphs. To this end, we commence by leveraging a novel feature-channel attention mechanism to capture the interdependencies between different substructure invariants of original graphs. The proposed AKBR model can thus effectively identify the structural importance of different substructures, and compute the R-convolution kernel between pairwise graphs associated with the more significant substructures specified by their structural attentions. Since each row of the resulting kernel matrix can be theoretically seen as the embedding vector of a sample graph, the proposed AKBR model is able to directly employ the resulting kernel matrix as the graph feature matrix and input it into the classifier for classification (i.e., the SoftMax layer), naturally providing an end-to-end learning architecture between the kernel computation as well as the classifier. Experimental results show that the proposed AKBR model outperforms existing state-of-the-art graph kernels and deep learning methods on standard graph benchmarks.


title: Salience DETR: Enhancing Detection Transformer with Hierarchical Salience Filtering Refinement

abstract: DETR-like methods have significantly increased detection performance in an end-to-end manner. The mainstream two-stage frameworks of them perform dense self-attention and select a fraction of queries for sparse cross-attention, which is proven effective for improving performance but also introduces a heavy computational burden and high dependence on stable query selection. This paper demonstrates that suboptimal two-stage selection strategies result in scale bias and redundancy due to the mismatch between selected queries and objects in two-stage initialization. To address these issues, we propose hierarchical salience filtering refinement, which performs transformer encoding only on filtered discriminative queries, for a better trade-off between computational efficiency and precision. The filtering process overcomes scale bias through a novel scale-independent salience supervision. To compensate for the semantic misalignment among queries, we introduce elaborate query refinement modules for stable two-stage initialization. Based on above improvements, the proposed Salience DETR achieves significant improvements of +4.0% AP, +0.2% AP, +4.4% AP on three challenging task-specific detection datasets, as well as 49.2% AP on COCO 2017 with less FLOPs. The code is available at https://github.com/xiuqhou/Salience-DETR.


title: Runtime Monitoring and Fault Detection for Neural Network-Controlled Systems

abstract: There is an emerging trend in applying deep learning methods to control complex nonlinear systems. This paper considers enhancing the runtime safety of nonlinear systems controlled by neural networks in the presence of disturbance and measurement noise. A robustly stable interval observer is designed to generate sound and precise lower and upper bounds for the neural network, nonlinear function, and system state. The obtained interval is utilised to monitor the real-time system safety and detect faults in the system outputs or actuators. An adaptive cruise control vehicular system is simulated to demonstrate effectiveness of the proposed design.


title: SSHPool: The Separated Subgraph-based Hierarchical Pooling

abstract: In this paper, we develop a novel local graph pooling method, namely the Separated Subgraph-based Hierarchical Pooling (SSHPool), for graph classification. To this end, we commence by assigning the nodes of a sample graph into different clusters, resulting in a family of separated subgraphs. We individually employ a local graph convolution units as the local structure to further compress each subgraph into a coarsened node, transforming the original graph into a coarsened graph. Since these subgraphs are separated by different clusters and the structural information cannot be propagated between them, the local convolution operation can significantly avoid the over-smoothing problem arising in most existing Graph Neural Networks (GNNs). By hierarchically performing the proposed procedures on the resulting coarsened graph, the proposed SSHPool can effectively extract the hierarchical global feature of the original graph structure, encapsulating rich intrinsic structural characteristics. Furthermore, we develop an end-to-end GNN framework associated with the proposed SSHPool module for graph classification. Experimental results demonstrate the superior performance of the proposed model on real-world datasets, significantly outperforming state-of-the-art GNN methods in terms of the classification accuracies.


title: Enriching the physics program of the CMS experiment via data scouting and data parking

abstract: Specialized data-taking and data-processing techniques were introduced by the CMS experiment in Run 1 of the CERN LHC to enhance the sensitivity of searches for new physics and the precision of standard model measurements. These techniques, termed data scouting and data parking, extend the data-taking capabilities of CMS beyond the original design specifications. The novel data-scouting strategy trades complete event information for higher event rates, while keeping the data bandwidth within limits. Data parking involves storing a large amount of raw detector data collected by algorithms with low trigger thresholds to be processed when sufficient computational power is available to handle such data. The research program of the CMS Collaboration is greatly expanded with these techniques. The implementation, performance, and physics results obtained with data scouting and data parking in CMS over the last decade are discussed in this Report, along with new developments aimed at further improving low-mass physics sensitivity over the next years of data taking.


title: Complementary Recommendation in E-commerce: Definition, Approaches, and Future Directions

abstract: In recent years, complementary recommendation has received extensive attention in the e-commerce domain. In this paper, we comprehensively summarize and compare 34 representative studies conducted between 2009 and 2024. Firstly, we compare the data and methods used for modeling complementary relationships between products, including simple complementarity and more complex scenarios such as asymmetric complementarity, the coexistence of substitution and complementarity relationships between products, and varying degrees of complementarity between different pairs of products. Next, we classify and compare the models based on the research problems of complementary recommendation, such as diversity, personalization, and cold-start. Furthermore, we provide a comparative analysis of experimental results from different studies conducted on the same dataset, which helps identify the strengths and weaknesses of the research. Compared to previous surveys, this paper provides a more updated and comprehensive summary of the research, discusses future research directions, and contributes to the advancement of this field.


title: Data-Driven Sliding Mode Control for Partially Unknown Nonlinear Systems

abstract: This paper introduces a new design method for data-driven control of nonlinear systems with partially unknown dynamics and unknown bounded disturbance. Since it is not possible to achieve exact nonlinearity cancellation in the presence of unknown disturbance, this paper adapts the idea of sliding mode control (SMC) to ensure system stability and robustness without assuming that the nonlinearity goes to zero faster than the state as in the existing methods. The SMC consists of a data-dependent robust controller ensuring the system state trajectory reach and remain on the sliding surface and a nominal controller solved from a data-dependent semidefinite program (SDP) ensuring robust stability of the state trajectory on the sliding surface. Numerical simulation results demonstrate effectiveness of the proposed data-driven SMC and its superior in terms of robust stability over the existing data-driven control that also uses approximate nonlinearity cancellation.


title: A Survey on Self-Supervised Pre-Training of Graph Foundation Models: A Knowledge-Based Perspective

abstract: Graph self-supervised learning is now a go-to method for pre-training graph foundation models, including graph neural networks, graph transformers, and more recent large language model (LLM)-based graph models. There is a wide variety of knowledge patterns embedded in the structure and properties of graphs which may be used for pre-training, but we lack a systematic overview of self-supervised pre-training tasks from the perspective of graph knowledge. In this paper, we comprehensively survey and analyze the pre-training tasks of graph foundation models from a knowledge-based perspective, consisting of microscopic (nodes, links, etc) and macroscopic knowledge (clusters, global structure, etc). It covers a total of 9 knowledge categories and 25 pre-training tasks, as well as various downstream task adaptation strategies. Furthermore, an extensive list of the related papers with detailed metadata is provided at https://github.com/Newiz430/Pretext.


title: Glimmers in the Cosmic Dawn: A Census of the Youngest Supermassive Black Holes by Photometric Variability

abstract: We report first results from a deep near infrared campaign with the Hubble Space Telescope to obtain late-epoch images of the Hubble Ultra-Deep Field (HUDF), 10-15 years after the first epoch data were obtained. The main objectives are to search for faint active galactic nuclei (AGN) at high redshifts by virtue of their photometric variability, and measure (or constrain) the comoving number density of supermassive black holes (SMBHs), n_SMBH, at early times. In this Letter we present a brief overview of the program and preliminary results regarding eight objects. Three variables are supernovae, two of which are apparently hostless with indeterminable redshifts, although one has previously been recorded at a z\approx 6 galaxy. Two further objects are clear AGN candidates at z=2.0 and 3.2, based on morphology and/or spectroscopy, in particular infrared spectroscopy from JWST. Three variable targets are identified at z=6-7, which are also likely AGN candidates. These sources provide a first measure of n_SMBH in the reionization epoch by photometric variability, which places a firm lower limit of 3x10^{-4} cMpc^{-3}. After accounting for variability and luminosity incompleteness, we estimate n_SMBH \gtrsim 8x10^{-3} cMpc^{-3}, which is the largest value so far reported at these redshifts. This SMBH abundance is also strikingly similar to estimates of n_SMBH in the local Universe. We discuss how these results test various theories for SMBH formation.


title: A Little Leak Will Sink a Great Ship: Survey of Transparency for Large Language Models from Start to Finish

abstract: Large Language Models (LLMs) are trained on massive web-crawled corpora. This poses risks of leakage, including personal information, copyrighted texts, and benchmark datasets. Such leakage leads to undermining human trust in AI due to potential unauthorized generation of content or overestimation of performance. We establish the following three criteria concerning the leakage issues: (1) leakage rate: the proportion of leaked data in training data, (2) output rate: the ease of generating leaked data, and (3) detection rate: the detection performance of leaked versus non-leaked data. Despite the leakage rate being the origin of data leakage issues, it is not understood how it affects the output rate and detection rate. In this paper, we conduct an experimental survey to elucidate the relationship between the leakage rate and both the output rate and detection rate for personal information, copyrighted texts, and benchmark data. Additionally, we propose a self-detection approach that uses few-shot learning in which LLMs detect whether instances are present or absent in their training data, in contrast to previous methods that do not employ explicit learning. To explore the ease of generating leaked information, we create a dataset of prompts designed to elicit personal information, copyrighted text, and benchmarks from LLMs. Our experiments reveal that LLMs produce leaked information in most cases despite less such data in their training set. This indicates even small amounts of leaked data can greatly affect outputs. Our self-detection method showed superior performance compared to existing detection methods.


title: Rearranged Stochastic Heat Equation: Ergodicity and Related Gradient Descent on ${\mathcal P}({\mathbb R})$

abstract: This article provides a case study for a recently introduced diffusion in the space of probability measures over the reals, namely rearranged stochastic heat, which solves a stochastic partial differential equation valued in the set of symmetrised quantile functions over the unit circle. This contribution studies probability measure-valued flows perturbed by this noise with a special focus on gradient flows. This is done by introducing a drift to the rearranged stochastic heat equation by means of a vector field from the set of random variables over the unit circle into itself. When the flow is a gradient flow, the vector field may coincide with the Wasserstein derivative of a mean-field potential function. The resulting equation reads as a sort of McKean-Vlasov stochastic differential equation with an infinite dimensional common noise. This article provides conditions on the drift under which solutions exist uniquely for any time horizon and converge exponentially fast towards a unique equilibrium. When the drift derives from a potential, some metastability properties are obtained as the intensity of the noise is tuned to zero: it is shown that under a particular scaling regime, the gradient descent lingers near local minimizers for expected times of the same order as in the finite dimensional setting.


title: Entity-NeRF: Detecting and Removing Moving Entities in Urban Scenes

abstract: Recent advancements in the study of Neural Radiance Fields (NeRF) for dynamic scenes often involve explicit modeling of scene dynamics. However, this approach faces challenges in modeling scene dynamics in urban environments, where moving objects of various categories and scales are present. In such settings, it becomes crucial to effectively eliminate moving objects to accurately reconstruct static backgrounds. Our research introduces an innovative method, termed here as Entity-NeRF, which combines the strengths of knowledge-based and statistical strategies. This approach utilizes entity-wise statistics, leveraging entity segmentation and stationary entity classification through thing/stuff segmentation. To assess our methodology, we created an urban scene dataset masked with moving objects. Our comprehensive experiments demonstrate that Entity-NeRF notably outperforms existing techniques in removing moving objects and reconstructing static urban backgrounds, both quantitatively and qualitatively.


title: What Happens to a Dataset Transformed by a Projection-based Concept Removal Method?

abstract: We investigate the behavior of methods that use linear projections to remove information about a concept from a language representation, and we consider the question of what happens to a dataset transformed by such a method. A theoretical analysis and experiments on real-world and synthetic data show that these methods inject strong statistical dependencies into the transformed datasets. After applying such a method, the representation space is highly structured: in the transformed space, an instance tends to be located near instances of the opposite label. As a consequence, the original labeling can in some cases be reconstructed by applying an anti-clustering method.