title: Profile of Vulnerability Remediations in Dependencies Using Graph Analysis

abstract: This research introduces graph analysis methods and a modified Graph Attention Convolutional Neural Network (GAT) to the critical challenge of open source package vulnerability remediation by analyzing control flow graphs to profile breaking changes in applications occurring from dependency upgrades intended to remediate vulnerabilities. Our approach uniquely applies node centrality metrics -- degree, norm, and closeness centrality -- to the GAT model, enabling a detailed examination of package code interactions with a focus on identifying and understanding vulnerable nodes, and when dependency package upgrades will interfere with application workflow. The study's application on a varied dataset reveals an unexpected limited inter-connectivity of vulnerabilities in core code, thus challenging established notions in software security. The results demonstrate the effectiveness of the enhanced GAT model in offering nuanced insights into the relational dynamics of code vulnerabilities, proving its potential in advancing cybersecurity measures. This approach not only aids in the strategic mitigation of vulnerabilities but also lays the groundwork for the development of sophisticated, sustainable monitoring systems for the evaluation of work effort for vulnerability remediation resulting from open source software. The insights gained from this study mark a significant advancement in the field of package vulnerability analysis and cybersecurity.


title: Jet Discrimination with Quantum Complete Graph Neural Network

abstract: Machine learning, particularly deep neural networks, has been widely utilized in high energy physics and has shown remarkable results in various applications. Moreover, the concept of machine learning has been extended to quantum computers, giving rise to a new research area known as quantum machine learning. In this paper, we propose a novel variational quantum circuit model, Quantum Complete Graph Neural Network (QCGNN), designed for learning complete graphs. We argue that QCGNN has a polynomial speedup against its classical counterpart, due to the property of quantum parallelism. In this paper, we study the application of QCGNN through the challenging jet discrimination, where the jets are represented with complete graphs. Subsequently, we conduct a comparative analysis with classical graph neural networks to establish a benchmark.


title: DT-SIM: Property-Based Testing for MPC Security

abstract: Formal methods for guaranteeing that a protocol satisfies a cryptographic security definition have advanced substantially, but such methods are still labor intensive and the need remains for an automated tool that can positively identify an insecure protocol. In this work, we demonstrate that property-based testing, "run it a bunch of times and see if it breaks", is effective for detecting security bugs in secure protocols. We specifically target Secure Multi-Party Computation (MPC), because formal methods targeting this security definition for bit-model implementations are particularly difficult. Using results from the literature for Probabilistic Programming Languages and statistical inference, we devise a test that can detect various flaws in a bit-level implementation of an MPC protocol. The test is grey-box; it requires only transcripts of randomness consumed by the protocol and of the inputs, outputs, and messages. It successfully detects several different mistakes and biases introduced into two different implementations of the classic GMW protocol. Applied to hundreds of randomly generated protocols, it identifies nearly all of them as insecure. We also include an analysis of the parameters of the test, and discussion of what makes detection of MPC (in)security difficult.


title: Probing the Solar System for Dark Matter Using the Sagnac Effect

abstract: This study investigates the potential of the Sagnac Effect for detecting dark matter in the Solar System, particularly within the Sun. Originating from the relative delay and interference of light beams traveling in opposite directions on rotating platforms, the effect can account how varying gravitational conditions affect its manifestation. We analyze the Sagnac time in two static, spherically symmetric spacetimes: Schwarzschild and one incorporating dark matter. By comparing the calculated relative deviations in Sagnac time obtained from satellites orbiting our star with the current precision of onboard atomic clocks (about $10^{-11}$), we evaluate the feasibility of detecting dark matter's gravitational influence through this effect.


title: PromptIQA: Boosting the Performance and Generalization for No-Reference Image Quality Assessment via Prompts

abstract: Due to the diversity of assessment requirements in various application scenarios for the IQA task, existing IQA methods struggle to directly adapt to these varied requirements after training. Thus, when facing new requirements, a typical approach is fine-tuning these models on datasets specifically created for those requirements. However, it is time-consuming to establish IQA datasets. In this work, we propose a Prompt-based IQA (PromptIQA) that can directly adapt to new requirements without fine-tuning after training. On one hand, it utilizes a short sequence of Image-Score Pairs (ISP) as prompts for targeted predictions, which significantly reduces the dependency on the data requirements. On the other hand, PromptIQA is trained on a mixed dataset with two proposed data augmentation strategies to learn diverse requirements, thus enabling it to effectively adapt to new requirements. Experiments indicate that the PromptIQA outperforms SOTA methods with higher performance and better generalization. The code will be available.


title: Enhanced polarization switching characteristics of HfO2 ultrathin films via acceptor-donor co-doping

abstract: In the realm of ferroelectric memories, HfO2-based ferroelectrics stand out because of their exceptional CMOS compatibility and scalability. Nevertheless, their switchable polarization and switching speed are not on par with those of perovskite ferroelectrics. It is widely acknowledged that defects play a crucial role in stabilizing the metastable polar phase of HfO2. Simultaneously, defects also pin the domain walls and impede the switching process, ultimately rendering the sluggish switching of HfO2. Herein, we present an effective strategy involving acceptor-donor co-doping to effectively tackle this dilemma. Remarkably enhanced ferroelectricity and the fastest switching process ever reported among HfO2 polar devices are observed in La3+-Ta5+ co-doped HfO2 ultrathin films. Moreover, robust macro-electrical characteristics of co-doped films persist even at a thickness as low as 3 nm, expanding potential applications of HfO2 in ultrathin devices. Our systematic investigations further demonstrate that synergistic effects of uniform microstructure and smaller switching barrier introduced by co-doping ensure the enhanced ferroelectricity and shortened switching time. The co-doping strategy offers an effective avenue to control the defect state and improve the ferroelectric properties of HfO2 films.


title: A universal phase-field mixture representation of thermodynamics and shock wave mechanics in porous soft biologic continua

abstract: A continuum mixture theory is formulated for large deformations, thermal effects, phase interactions, and degradation of soft biologic tissues. Such tissues consist of one or more solid and fluid phases and can demonstrate nonlinear anisotropic elastic, viscoelastic, thermoelastic, and poroelastic physics. Under extremely large or rapid deformations, for example impact or shock loading, tissues may fracture, tear, or rupture. Mechanisms are encompassed in a universal, thermodynamically consistent formulation that combines the continuum theory of mixtures with phase-field mechanics of fracture. A metric tensor of generalized Finsler space supplies geometric insight on effects rearrangements of microstructure, for example degrading collagen fibers. Governing equations are derived, and energy potentials and kinetic laws posited, for generic soft porous tissues with solid and liquid or gas phases. Shock waves are modeled as singular surfaces; Hugoniot states and shock decay are studied analytically. Suitability of the framework for representing blood, skeletal muscle, and liver is demonstrated. Insight into physics presently unresolved by experiments is obtained.


title: A maximal oscillatory operator on compact manifolds

abstract: This is a continuation of our previous research about an oscillatory integral operator $T_{\alpha, \beta}$ on compact manifolds $\mathbb{M}$. We prove the sharp $H^{p}$-$L^{p,\infty}$ boundedness on the maximal operator $T^{*}_{\alpha, \beta}$ for all $0<p<1$. As applications, we first prove the sharp $H^{p}$-$L^{p,\infty}$ boundedness on the maximal operator corresponding to the Riesz means $I_{k,\alpha}(|\mathcal{L}|)$ associated with the Schr\"odinger type group $e^{is\mathcal{L}^{\alpha/2}}$ and obtain the almost everywhere convergence of $I_{k,\alpha}(|\mathcal{L}|)f(x,t)\to f(x)$ for all $f\in H^{p}$. Also, we are able to obtain the convergence speed of a combination operator from the solutions of the Cauchy problem of fractional Schr\"odinger equations. All results are even new on the n-torus $T^{n}$.


title: DiffChat: Learning to Chat with Text-to-Image Synthesis Models for Interactive Image Creation

abstract: We present DiffChat, a novel method to align Large Language Models (LLMs) to "chat" with prompt-as-input Text-to-Image Synthesis (TIS) models (e.g., Stable Diffusion) for interactive image creation. Given a raw prompt/image and a user-specified instruction, DiffChat can effectively make appropriate modifications and generate the target prompt, which can be leveraged to create the target image of high quality. To achieve this, we first collect an instruction-following prompt engineering dataset named InstructPE for the supervised training of DiffChat. Next, we propose a reinforcement learning framework with the feedback of three core criteria for image creation, i.e., aesthetics, user preference, and content integrity. It involves an action-space dynamic modification technique to obtain more relevant positive samples and harder negative samples during the off-policy sampling. Content integrity is also introduced into the value estimation function for further improvement of produced images. Our method can exhibit superior performance than baseline models and strong competitors based on both automatic and human evaluations, which fully demonstrates its effectiveness.


title: Robust automated calcification meshing for biomechanical cardiac digital twins

abstract: Calcification has significant influence over cardiovascular diseases and interventions. Detailed characterization of calcification is thus desired for predictive modeling, but calcified heart meshes for physics-driven simulations are still often reconstructed using manual operations. This poses a major bottleneck for large-scale adoption of computational simulations for research or clinical use. To address this, we propose an end-to-end automated meshing algorithm that enables robust incorporation of patient-specific calcification onto a given heart mesh. The algorithm provides a substantial speed-up from several hours of manual meshing to $\sim$1 minute of automated computation, and it solves an important problem that cannot be addressed with recent template registration-based heart meshing techniques. We validated our final calcified heart meshes with extensive simulations, demonstrating our ability to accurately model patient-specific aortic stenosis and Transcatheter Aortic Valve Replacement. Our method may serve as an important tool for accelerating the development and usage of physics-driven simulations for cardiac digital twins.


title: A basic lower bound for property testing

abstract: An $\epsilon$-test for any non-trivial property (one for which there are both satisfying inputs and inputs of large distance from the property) should use a number of queries that is at least inversely proportional in $\epsilon$. However, to the best of our knowledge there is no reference proof for this intuition. Such a proof is provided here. It is written so as to not require any prior knowledge of the related literature, and in particular does not use Yao's method.


title: Medical Speech Symptoms Classification via Disentangled Representation

abstract: Intent is defined for understanding spoken language in existing works. Both textual features and acoustic features involved in medical speech contain intent, which is important for symptomatic diagnosis. In this paper, we propose a medical speech classification model named DRSC that automatically learns to disentangle intent and content representations from textual-acoustic data for classification. The intent representations of the text domain and the Mel-spectrogram domain are extracted via intent encoders, and then the reconstructed text feature and the Mel-spectrogram feature are obtained through two exchanges. After combining the intent from two domains into a joint representation, the integrated intent representation is fed into a decision layer for classification. Experimental results show that our model obtains an average accuracy rate of 95% in detecting 25 different medical symptoms.


title: Crystal structure, properties and pressure-induced insulator-metal transition in layered kagome chalcogenides

abstract: Layered materials with kagome lattice have attracted a lot of attention due to the presence of nontrivial topological bands and correlated electronic states with tunability. In this work, we investigate a unique van der Waals (vdW) material system, $A_{2}M_{3}X_{4}$ ($A$ = K, Rb, Cs; $M$ = Ni, Pd; $X$ = S, Se), where transition metal kagome lattices, chalcogen honeycomb lattices and alkali metal triangular lattices coexist simultaneously. A notable feature of this material is that each Ni/Pd atom is positioned in the center of four chalcogen atoms, forming a local square-planar environment. This crystal field environment results in a low spin state $S$ = 0 of Ni$^{2+}$/Pd$^{2+}$. A systematic study of the crystal growth, crystal structure, magnetic and transport properties of two representative compounds, Rb$_{2}$Ni$_{3}$S$_{4}$ and Cs$_{2}$Ni$_{3}$Se$_{4}$, has been carried out on powder and single crystal samples. Both compounds exhibit nonmagnetic $p$-type semiconducting behavior, closely related to the particular chemical environment of Ni$^{2+}$ ions and the alkali metal intercalated vdW structure. Additionally, Cs$_{2}$Ni$_{3}$Se$_{4}$ undergoes an insulator-metal transition (IMT) in transport measurements under pressure up to 87.10 GPa without any structural phase transition, while Rb$_{2}$Ni$_{3}$S$_{4}$ persists in its semiconducting behavior.


title: LHMap-loc: Cross-Modal Monocular Localization Using LiDAR Point Cloud Heat Map

abstract: Localization using a monocular camera in the pre-built LiDAR point cloud map has drawn increasing attention in the field of autonomous driving and mobile robotics. However, there are still many challenges (e.g. difficulties of map storage, poor localization robustness in large scenes) in accurately and efficiently implementing cross-modal localization. To solve these problems, a novel pipeline termed LHMap-loc is proposed, which achieves accurate and efficient monocular localization in LiDAR maps. Firstly, feature encoding is carried out on the original LiDAR point cloud map by generating offline heat point clouds, by which the size of the original LiDAR map is compressed. Then, an end-to-end online pose regression network is designed based on optical flow estimation and spatial attention to achieve real-time monocular visual localization in a pre-built map. In addition, a series of experiments have been conducted to prove the effectiveness of the proposed method. Our code is available at: https://github.com/IRMVLab/LHMap-loc.


title: Morphological evolution of disk galaxies and their concentration, asymmetry and clumpiness (CAS) properties in simulations across Toomre's $Q$ parameter

abstract: We investigate the morphological and structural evolutions of disk galaxies in simulations for a wide range of Toomre's $Q$ parameter. In addition to the inspection of conventional bar modes, we compute the concentration, asymmetry and clumpiness (CAS) parameters to enlarge the understanding of the galaxy evolution. These parameters are widely employed to analyze the light distribution of the observed galaxies, but the adaptation to numerical simulations is not much considered. While the bar formation takes place in a considerable range of $Q$ around $1$, barred galaxies originating from $Q>1$ and $Q<1$ disks yield the CAS values that differ significantly. Disks starting with $Q<1$ develop clumps due to local gravitational instabilities along with the bar and these clumps play a central role in enhancing the CAS values. That process is absent in $Q>1$ counterparts in which the evolution is dominated by linearly unstable two-armed modes that lead to lower CAS values. Likewise, unbarred galaxies that are obtainable from disks with $Q$ far below and far above $1$ exhibit greatly different CAS magnitudes. It turns out that the CAS parameters can serve as indicators of the initial kinematical state and the evolution history of a disk of any morphology. In addition, we find an alternative mechanism of the formation of the lopsided barred galaxy when $Q\lesssim 1$. Bars that evolve in the midst of the clumps can spontaneously become lopsided at the end.


title: Can't Remember Details in Long Documents? You Need Some R&R

abstract: Long-context large language models (LLMs) hold promise for tasks such as question-answering (QA) over long documents, but they tend to miss important information in the middle of context documents (arXiv:2307.03172v3). Here, we introduce $\textit{R&R}$ -- a combination of two novel prompt-based methods called $\textit{reprompting}$ and $\textit{in-context retrieval}$ (ICR) -- to alleviate this effect in document-based QA. In reprompting, we repeat the prompt instructions periodically throughout the context document to remind the LLM of its original task. In ICR, rather than instructing the LLM to answer the question directly, we instruct it to retrieve the top $k$ passage numbers most relevant to the given question, which are then used as an abbreviated context in a second QA prompt. We test R&R with GPT-4 Turbo and Claude-2.1 on documents up to 80k tokens in length and observe a 16-point boost in QA accuracy on average. Our further analysis suggests that R&R improves performance on long document-based QA because it reduces the distance between relevant context and the instructions. Finally, we show that compared to short-context chunkwise methods, R&R enables the use of larger chunks that cost fewer LLM calls and output tokens, while minimizing the drop in accuracy.


title: DITTO: Dual and Integrated Latent Topologies for Implicit 3D Reconstruction

abstract: We propose a novel concept of dual and integrated latent topologies (DITTO in short) for implicit 3D reconstruction from noisy and sparse point clouds. Most existing methods predominantly focus on single latent type, such as point or grid latents. In contrast, the proposed DITTO leverages both point and grid latents (i.e., dual latent) to enhance their strengths, the stability of grid latents and the detail-rich capability of point latents. Concretely, DITTO consists of dual latent encoder and integrated implicit decoder. In the dual latent encoder, a dual latent layer, which is the key module block composing the encoder, refines both latents in parallel, maintaining their distinct shapes and enabling recursive interaction. Notably, a newly proposed dynamic sparse point transformer within the dual latent layer effectively refines point latents. Then, the integrated implicit decoder systematically combines these refined latents, achieving high-fidelity 3D reconstruction and surpassing previous state-of-the-art methods on object- and scene-level datasets, especially in thin and detailed structures.


title: Provable Multi-Party Reinforcement Learning with Diverse Human Feedback

abstract: Reinforcement learning with human feedback (RLHF) is an emerging paradigm to align models with human preferences. Typically, RLHF aggregates preferences from multiple individuals who have diverse viewpoints that may conflict with each other. Our work \textit{initiates} the theoretical study of multi-party RLHF that explicitly models the diverse preferences of multiple individuals. We show how traditional RLHF approaches can fail since learning a single reward function cannot capture and balance the preferences of multiple individuals. To overcome such limitations, we incorporate meta-learning to learn multiple preferences and adopt different social welfare functions to aggregate the preferences across multiple parties. We focus on the offline learning setting and establish sample complexity bounds, along with efficiency and fairness guarantees, for optimizing diverse social welfare functions such as Nash, Utilitarian, and Leximin welfare functions. Our results show a separation between the sample complexities of multi-party RLHF and traditional single-party RLHF. Furthermore, we consider a reward-free setting, where each individual's preference is no longer consistent with a reward model, and give pessimistic variants of the von Neumann Winner based on offline preference data. Taken together, our work showcases the advantage of multi-party RLHF but also highlights its more demanding statistical complexity.


title: Age of Computing: A Metric of Computation Freshness in Communication and Computation Cooperative Networks

abstract: In communication and computation cooperative networks (3CNs), timely computation is crucial but not always guaranteed. There is a strong demand for a computational task to be completed within a given time. The time taken involves both processing time and communication time. However, a measure of such timeliness in 3CNs is lacking. In this letter, we introduce the novel concept, Age of Computing (AoC), to capture computation freshness in 3CNs. We develop two methods for calculating this metric, applicable to a wide range of 3CNs. These calculations are applied to a queue-theoretic system comprising a task-initiating source, a task-executing computational node and a communication link, resulting in the derivation of two expressions for the AoC. Then a tight upper bound and a tight lower bound are derived. Subsequently, we investigate the communication-computation tradeoff and the AoC-delay tradeoff. While our models are simpler than their real-world counterparts, they provide comprehensive insight in understanding computation freshness in 3CNs and the relationships between computing and communications.


title: Clunie lemma in several complex variables and application in PDEs

abstract: Two purposes will be shown in this paper. The first one is to extend the classic Tumura-Clunie type theorem for meromorphic functions of one complex variable to meromorphic functions of several complex variables by using Clunie lemma. The second one is to characterize entire solutions of certain partial differential equations in $\mathbb{C}^{m}$. Our results are extensions and generalizations of the previous theorems by Liao-Ye \cite{Liao-Ye} and Li \cite{Li11}.


title: Clustering Interval Load with Weather to Create Scenarios of Behind-the-Meter Solar Penetration

abstract: Forecasting load at the feeder level has become increasingly challenging with the penetration of behind-the-meter solar, as this self-generation (also called total generation) is only visible to the utility as aggregated net-load. This work proposes a methodology for creation of scenarios of solar penetration at the feeder level for use by forecasters to test the robustness of their algorithm to progressively higher penetrations of solar. The algorithm draws on publicly available observations of weather \emph{condition} (e.g., rainy/cloudy/fair) for use as proxies to sky clearness. These observations are used to mask and weight the interval deviations of similar native usage profiles from which average interval usage is calculated and subsequently added to interval net generation to reconstruct interval total generation. This approach improves the estimate of annual energy generation by 23\%; where the net generation signal currently only reflects 52\% of total annual generation, now 75\% is captured via the proposed algorithm. This proposed methodology is data driven and extensible to service territories which lack information on irradiance measurements and geo-coordinates.


title: RFWave: Multi-band Rectified Flow for Audio Waveform Reconstruction

abstract: Recent advancements in generative modeling have significantly enhanced the reconstruction of audio waveforms from various representations. While diffusion models are adept at this task, they are hindered by latency issues due to their operation at the individual sample point level and the need for numerous sampling steps. In this study, we introduce RFWave, a cutting-edge multi-band Rectified Flow approach designed to reconstruct high-fidelity audio waveforms from Mel-spectrograms or discrete tokens. RFWave uniquely generates complex spectrograms and operates at the frame level, processing all subbands simultaneously to boost efficiency. Leveraging Rectified Flow, which targets a flat transport trajectory, RFWave achieves reconstruction with just 10 sampling steps. Our empirical evaluations show that RFWave not only provides outstanding reconstruction quality but also offers vastly superior computational efficiency, enabling audio generation at speeds up to 97 times faster than real-time on a GPU. An online demonstration is available at: https://rfwave-demo.github.io/rfwave/.


title: Decay-angular-distribution correlated $CP$ violation in heavy hadron cascade decays

abstract: $C\!P$ violation in baryon decay processes is still undiscovered to date. We present a general analysis of the decay-angular-distributions and the corresponding $C\!P$ asymmetries in cascade decays of the type $\mathbb{H}\to R(\to ab) c$, where $\mathbb{H}$ is a heavy hadron that decays through weak interactions $\mathbb{H}\to R c$, and the resonance $R$ decays strongly via $R\to ab$. Based on the analysis, we propose to search for $C\!P$ violation in the decay-angular-distributions in the cascade decay processes ${\mathbb{B}}\to \mathcal{B} M$, with $\mathcal{B}$ or $M$ subsequently decaying through strong interactions, where ${\mathbb{B}}$ is the mother baryon, $\mathcal{B}$ or $M$ are the daughter baryon and meson, respectively, and $M$ has to be spin-nonzero. We also present some typical decay channels in which the search for such kinds of $C\!P$ asymmetries can be performed.


title: Ultrafast Dynamics of Bilayer and Trilayer Nickelate Superconductors

abstract: In addition to the pressurized high-temperature superconductivity, bilayer and trilayer nickelate superconductors Lan+1NinO3n+1 (n = 2 and 3) exhibit many intriguing properties at ambient pressure, such as orbital-dependent electronic correlation, non-Fermi liquid behavior, and density-wave transitions. Here, using ultrafast reflectivity measurement, we observe a drastic difference between the ultrafast dynamics of the bilayer and trilayer nickelates at ambient pressure. Firstly, we observe a coherent phonon mode in La4Ni3O10 involving the collective vibration of La, Ni, and O atoms, which is absent in La3Ni2O7. Secondly, the temperature-dependent relaxation time diverges near the density-wave transition temperature of La4Ni3O10, in drastic contrast to kink-like changes in La3Ni2O7. Moreover, we estimate the electron-phonon coupling constants to be 0.05~0.07 and 0.12~0.16 for La3Ni2O7 and La4Ni3O10, respectively, suggesting a relatively minor role of electron-phonon coupling in the electronic properties of Lan+1NinO3n+1. Our work not only sheds light on the relevant microscopic interaction but also establishes a foundation for further studying the interplay between superconductivity and density-wave transitions in nickelate superconductors.


title: A Note on Fano Planes in Orthogonal Buekenhout-Metz Unitals of Even Order

abstract: An O'Nan configuration in a unital is a set of four lines forming a quadrilateral, where the six intersections of pairs of lines are points of the unital. In 2019 Feng and Li elegantly construct O'Nan configurations in orthogonal and Tits Buekenhout-Metz unitals. We extend their work by extending their construction to a Fano plane embedded in the orthogonal Buekenhout-Metz unital of even order. We deduce that there exist O'Nan configurations in orthogonal Buekenhout-Metz unitals different to those of Feng and Li, and make a conjecture about Fano planes embedded in orthogonal Buekenhout-Metz unitals.


title: Simple Multigraph Convolution Networks

abstract: Existing multigraph convolution methods either ignore the cross-view interaction among multiple graphs, or induce extremely high computational cost due to standard cross-view polynomial operators. To alleviate this problem, this paper proposes a Simple MultiGraph Convolution Networks (SMGCN) which first extracts consistent cross-view topology from multigraphs including edge-level and subgraph-level topology, then performs polynomial expansion based on raw multigraphs and consistent topologies. In theory, SMGCN utilizes the consistent topologies in polynomial expansion rather than standard cross-view polynomial expansion, which performs credible cross-view spatial message-passing, follows the spectral convolution paradigm, and effectively reduces the complexity of standard polynomial expansion. In the simulations, experimental results demonstrate that SMGCN achieves state-of-the-art performance on ACM and DBLP multigraph benchmark datasets. Our codes are available at https://github.com/frinkleko/SMGCN.


title: Quantum Many-body Scar Models in One Dimensional Spin Chains

abstract: The phenomenon of quantum many-body scars has received widespread attention both in theoretical and experimental physics in recent years due to its unique physical properties. In this paper, based on the $su(2)$ algebraic relations, we propose a general method for constructing scar models by combining simple modules.This allows us to investigate many-body scar phenomena in high-spin systems. We numerically verify the thermalization and non-integrability of this model and demonstrate the dynamical properties of the scar states. We also provide a theoretical analysis of the properties of these scar states. For spin-$1$ case, we find that our 1D chain model reduces to the famous PXP model[C. J. Turner et al. Phys. Rev. B 98, 155134(2018)] under special parameter condition. In addition, due to the continuous tunability of the parameters, our model also enables us to investigate the transitions of QMBS from non-integrable to integrable system.


title: DiffClass: Diffusion-Based Class Incremental Learning

abstract: Class Incremental Learning (CIL) is challenging due to catastrophic forgetting. On top of that, Exemplar-free Class Incremental Learning is even more challenging due to forbidden access to previous task data. Recent exemplar-free CIL methods attempt to mitigate catastrophic forgetting by synthesizing previous task data. However, they fail to overcome the catastrophic forgetting due to the inability to deal with the significant domain gap between real and synthetic data. To overcome these issues, we propose a novel exemplar-free CIL method. Our method adopts multi-distribution matching (MDM) diffusion models to unify quality and bridge domain gaps among all domains of training data. Moreover, our approach integrates selective synthetic image augmentation (SSIA) to expand the distribution of the training data, thereby improving the model's plasticity and reinforcing the performance of our method's ultimate component, multi-domain adaptation (MDA). With the proposed integrations, our method then reformulates exemplar-free CIL into a multi-domain adaptation problem to implicitly address the domain gap problem to enhance model stability during incremental training. Extensive experiments on benchmark class incremental datasets and settings demonstrate that our method excels previous exemplar-free CIL methods and achieves state-of-the-art performance.


title: A weighted decoupling inequality and its application to the maximal Bochner-Riesz problem

abstract: We prove some weighted $L^p\ell^p$-decoupling estimates when $p=2n/(n-1)$. As an application, we give a result beyond the real interpolation exponents for the maximal Bochner-Riesz operator in $\mathbb{R}^3$. We also make an improvement in the planar case.


title: InstructGIE: Towards Generalizable Image Editing

abstract: Recent advances in image editing have been driven by the development of denoising diffusion models, marking a significant leap forward in this field. Despite these advances, the generalization capabilities of recent image editing approaches remain constrained. In response to this challenge, our study introduces a novel image editing framework with enhanced generalization robustness by boosting in-context learning capability and unifying language instruction. This framework incorporates a module specifically optimized for image editing tasks, leveraging the VMamba Block and an editing-shift matching strategy to augment in-context learning. Furthermore, we unveil a selective area-matching technique specifically engineered to address and rectify corrupted details in generated images, such as human facial features, to further improve the quality. Another key innovation of our approach is the integration of a language unification technique, which aligns language embeddings with editing semantics to elevate the quality of image editing. Moreover, we compile the first dataset for image editing with visual prompts and editing instructions that could be used to enhance in-context capability. Trained on this dataset, our methodology not only achieves superior synthesis quality for trained tasks, but also demonstrates robust generalization capability across unseen vision tasks through tailored prompts.


title: ERASOR++: Height Coding Plus Egocentric Ratio Based Dynamic Object Removal for Static Point Cloud Mapping

abstract: Mapping plays a crucial role in location and navigation within automatic systems. However, the presence of dynamic objects in 3D point cloud maps generated from scan sensors can introduce map distortion and long traces, thereby posing challenges for accurate mapping and navigation. To address this issue, we propose ERASOR++, an enhanced approach based on the Egocentric Ratio of Pseudo Occupancy for effective dynamic object removal. To begin, we introduce the Height Coding Descriptor, which combines height difference and height layer information to encode the point cloud. Subsequently, we propose the Height Stack Test, Ground Layer Test, and Surrounding Point Test methods to precisely and efficiently identify the dynamic bins within point cloud bins, thus overcoming the limitations of prior approaches. Through extensive evaluation on open-source datasets, our approach demonstrates superior performance in terms of precision and efficiency compared to existing methods. Furthermore, the techniques described in our work hold promise for addressing various challenging tasks or aspects through subsequent migration.


title: Is this the real life? Is this just fantasy? The Misleading Success of Simulating Social Interactions With LLMs

abstract: Recent advances in large language models (LLM) have enabled richer social simulations, allowing for the study of various social phenomena. However, most recent work has used a more omniscient perspective on these simulations (e.g., single LLM to generate all interlocutors), which is fundamentally at odds with the non-omniscient, information asymmetric interactions that involve humans and AI agents in the real world. To examine these differences, we develop an evaluation framework to simulate social interactions with LLMs in various settings (omniscient, non-omniscient). Our experiments show that LLMs perform better in unrealistic, omniscient simulation settings but struggle in ones that more accurately reflect real-world conditions with information asymmetry. Our findings indicate that addressing information asymmetry remains a fundamental challenge for LLM-based agents.


title: Beyond MOT: Semantic Multi-Object Tracking

abstract: Current multi-object tracking (MOT) aims to predict trajectories of targets (i.e.,"where") in videos. Yet, knowing merely "where" is insufficient in many crucial applications. In comparison, semantic understanding such as fine-grained behaviors, interactions, and overall summarized captions (i.e., "what") from videos, associated with "where", is highly-desired for comprehensive video analysis. Thus motivated, we introduce Semantic Multi-Object Tracking (SMOT), that aims to estimate object trajectories and meanwhile understand semantic details of associated trajectories including instance captions, instance interactions, and overall video captions, integrating "where" and "what" for tracking. In order to foster the exploration of SMOT, we propose BenSMOT, a large-scale Benchmark for Semantic MOT. Specifically, BenSMOT comprises 3,292 videos with 151K frames, covering various scenarios for semantic tracking of humans. BenSMOT provides annotations for the trajectories of targets, along with associated instance captions in natural language, instance interactions, and overall caption for each video sequence. To our best knowledge, BenSMOT is the first publicly available benchmark for SMOT. Besides, to encourage future research, we present a novel tracker named SMOTer, which is specially designed and end-to-end trained for SMOT, showing promising performance. By releasing BenSMOT, we expect to go beyond conventional MOT by predicting "where" and "what" for SMOT, opening up a new direction in tracking for video understanding. Our BenSMOT and SMOTer will be released.


title: Effective Fault Localization using Probabilistic and Grouping Approach

abstract: Context: Fault localization (FL) is the key activity while debugging a program. Any improvement to this activity leads to significant improvement in total software development cost. There is an internal linkage between the program spectrum and test execution result. Conditional probability in statistics captures the probability of occurring one event in relationship to one or more other events. Objectives: The aim of this paper is to use the conception of conditional probability to design an effective fault localization technique. Methods: In the paper, we present a fault localization technique that derives the association between statement coverage information and test case execution result using condition probability statistics. This association with the failed test case result shows the fault containing the probability of that specific statement. Subsequently, we use a grouping method to refine the obtained statement ranking sequence for better fault localization. Results: We evaluated the effectiveness of proposed method over eleven open-source data sets. Our obtained results show that on average, the proposed CGFL method is 24.56% more effective than other contemporary fault localization methods such as D*, Tarantula, Ochiai, Crosstab, BPNN, RBFNN, DNN, and CNN. Conclusion: We devised an effective fault localization technique by combining the conditional probabilistic method with failed test case execution-based approach. Our experimental evaluation shows our proposed method outperforms the existing fault localization techniques.


title: Towards Multimodal Sentiment Analysis Debiasing via Bias Purification

abstract: Multimodal Sentiment Analysis (MSA) aims to understand human intentions by integrating emotion-related clues from diverse modalities, such as visual, language, and audio. Unfortunately, the current MSA task invariably suffers from unplanned dataset biases, particularly multimodal utterance-level label bias and word-level context bias. These harmful biases potentially mislead models to focus on statistical shortcuts and spurious correlations, causing severe performance bottlenecks. To alleviate these issues, we present a Multimodal Counterfactual Inference Sentiment (MCIS) analysis framework based on causality rather than conventional likelihood. Concretely, we first formulate a causal graph to discover harmful biases from already-trained vanilla models. In the inference phase, given a factual multimodal input, MCIS imagines two counterfactual scenarios to purify and mitigate these biases. Then, MCIS can make unbiased decisions from biased observations by comparing factual and counterfactual outcomes. We conduct extensive experiments on several standard MSA benchmarks. Qualitative and quantitative results show the effectiveness of the proposed framework.


title: A Probabilistic Hadamard U-Net for MRI Bias Field Correction

abstract: Magnetic field inhomogeneity correction remains a challenging task in MRI analysis. Most established techniques are designed for brain MRI by supposing that image intensities in the identical tissue follow a uniform distribution. Such an assumption cannot be easily applied to other organs, especially those that are small in size and heterogeneous in texture (large variations in intensity), such as the prostate. To address this problem, this paper proposes a probabilistic Hadamard U-Net (PHU-Net) for prostate MRI bias field correction. First, a novel Hadamard U-Net (HU-Net) is introduced to extract the low-frequency scalar field, multiplied by the original input to obtain the prototypical corrected image. HU-Net converts the input image from the time domain into the frequency domain via Hadamard transform. In the frequency domain, high-frequency components are eliminated using the trainable filter (scaling layer), hard-thresholding layer, and sparsity penalty. Next, a conditional variational autoencoder is used to encode possible bias field-corrected variants into a low-dimensional latent space. Random samples drawn from latent space are then incorporated with a prototypical corrected image to generate multiple plausible images. Experimental results demonstrate the effectiveness of PHU-Net in correcting bias-field in prostate MRI with a fast inference speed. It has also been shown that prostate MRI segmentation accuracy improves with the high-quality corrected images from PHU-Net. The code will be available in the final version of this manuscript.


title: Towards Multimodal Human Intention Understanding Debiasing via Subject-Deconfounding

abstract: Multimodal intention understanding (MIU) is an indispensable component of human expression analysis (e.g., sentiment or humor) from heterogeneous modalities, including visual postures, linguistic contents, and acoustic behaviors. Existing works invariably focus on designing sophisticated structures or fusion strategies to achieve impressive improvements. Unfortunately, they all suffer from the subject variation problem due to data distribution discrepancies among subjects. Concretely, MIU models are easily misled by distinct subjects with different expression customs and characteristics in the training data to learn subject-specific spurious correlations, significantly limiting performance and generalizability across uninitiated subjects.Motivated by this observation, we introduce a recapitulative causal graph to formulate the MIU procedure and analyze the confounding effect of subjects. Then, we propose SuCI, a simple yet effective causal intervention module to disentangle the impact of subjects acting as unobserved confounders and achieve model training via true causal effects. As a plug-and-play component, SuCI can be widely applied to most methods that seek unbiased predictions. Comprehensive experiments on several MIU benchmarks clearly demonstrate the effectiveness of the proposed module.


abstract: Dynamic graph neural networks (DyGNNs) currently struggle with handling distribution shifts that are inherent in dynamic graphs. Existing work on DyGNNs with out-of-distribution settings only focuses on the time domain, failing to handle cases involving distribution shifts in the spectral domain. In this paper, we discover that there exist cases with distribution shifts unobservable in the time domain while observable in the spectral domain, and propose to study distribution shifts on dynamic graphs in the spectral domain for the first time. However, this investigation poses two key challenges: i) it is non-trivial to capture different graph patterns that are driven by various frequency components entangled in the spectral domain; and ii) it remains unclear how to handle distribution shifts with the discovered spectral patterns. To address these challenges, we propose Spectral Invariant Learning for Dynamic Graphs under Distribution Shifts (SILD), which can handle distribution shifts on dynamic graphs by capturing and utilizing invariant and variant spectral patterns. Specifically, we first design a DyGNN with Fourier transform to obtain the ego-graph trajectory spectrums, allowing the mixed dynamic graph patterns to be transformed into separate frequency components. We then develop a disentangled spectrum mask to filter graph dynamics from various frequency components and discover the invariant and variant spectral patterns. Finally, we propose invariant spectral filtering, which encourages the model to rely on invariant patterns for generalization under distribution shifts. Experimental results on synthetic and real-world dynamic graph datasets demonstrate the superiority of our method for both node classification and link prediction tasks under distribution shifts.


title: Triple O'Nan Configurations in Buekenhout-Metz Unitals of Odd Order

abstract: An O'Nan configuration in a unital is a set of four lines forming a quadrilateral, where the six intersections of pairs of lines are points of the unital. In 2019 Feng and Li elegantly construct O'Nan configurations in Buekenhout-Metz unitals, in particular, for odd order unitals. We extend their work by showing the existence of Triple O'Nan configurations (a configuration containing three distinct O'Nan configurations) in these odd order Buekenhout-Metz unitals.


title: A Neural Network-Based Submesoscale Vertical Heat Flux Parameterization and Its Implementation in Regional Ocean Modeling System (ROMS)

abstract: Submesoscale processes, with spatio-temporal scales of O(0.01-10) km and hours to 1 day which are hardly resolved by current ocean models, are important sub-grid processes in ocean models. Due to the strong vertical currents, submesoscale processes can lead to submesoscale vertical heat flux (SVHF) in the upper ocean which plays a crucial role in the heat exchange between the atmosphere and the ocean interior, and further modulates the global heat redistribution. At present, simulating a submesoscale-resolving ocean model is still expensive and time-consuming. Parameterizing SVHF becomes a feasible alternative by introducing it into coarse-resolution models. Traditionally, researchers tend to parameterize SVHF by a mathematically fitted relationship based on one or two key background state variables, which fail to represent the relationship between SVHF and the background state variables comprehensively. In this study, we propose a data-driven SVHF parameterization scheme based on a deep neural network and implement it into the Regional Ocean Modeling System (ROMS). In offline tests, our scheme can accurately calculate SVHF using mesoscale-averaged variables and characterize how it varies with depth. In online tests, we simulate an idealized model of an anticyclonic mesoscale eddy and a realistic model of the Gulf Stream, respectively. Compared to the coarse-resolution cases without the SVHF effect, the coarse-resolution cases with the SVHF scheme tend to reproduce results closer to the high-resolution case and the observational state in terms of the temperature structure and mixed layer depth, indicating a good performance of the neural network-based SVHF scheme. Our results show the potential of applying the neural network in parameterizing sub-grid processes in ocean models.


title: BjTT: A Large-scale Multimodal Dataset for Traffic Prediction

abstract: Traffic prediction is one of the most significant foundations in Intelligent Transportation Systems (ITS). Traditional traffic prediction methods rely only on historical traffic data to predict traffic trends and face two main challenges. 1) insensitivity to unusual events. 2) limited performance in long-term prediction. In this work, we explore how generative models combined with text describing the traffic system can be applied for traffic generation, and name the task Text-to-Traffic Generation (TTG). The key challenge of the TTG task is how to associate text with the spatial structure of the road network and traffic data for generating traffic situations. To this end, we propose ChatTraffic, the first diffusion model for text-to-traffic generation. To guarantee the consistency between synthetic and real data, we augment a diffusion model with the Graph Convolutional Network (GCN) to extract spatial correlations of traffic data. In addition, we construct a large dataset containing text-traffic pairs for the TTG task. We benchmarked our model qualitatively and quantitatively on the released dataset. The experimental results indicate that ChatTraffic can generate realistic traffic situations from the text. Our code and dataset are available at https://github.com/ChyaZhang/ChatTraffic.


title: Defending Against Unforeseen Failure Modes with Latent Adversarial Training

abstract: Despite extensive diagnostics and debugging by developers, AI systems sometimes exhibit harmful unintended behaviors. Finding and fixing these is challenging because the attack surface is so large -- it is not tractable to exhaustively search for inputs that may elicit harmful behaviors. Red-teaming and adversarial training (AT) are commonly used to improve robustness, however, they empirically struggle to fix failure modes that differ from the attacks used during training. In this work, we utilize latent adversarial training (LAT) to defend against vulnerabilities without generating inputs that elicit them. LAT leverages the compressed, abstract, and structured latent representations of concepts that the network actually uses for prediction. We use it to remove trojans and defend against held-out classes of adversarial attacks. We show in image classification, text classification, and text generation tasks that LAT usually improves both robustness to novel attacks and performance on clean data relative to AT. This suggests that LAT can be a promising tool for defending against failure modes that are not explicitly identified by developers.


title: LightSword: A Customized Virtual Reality Exergame for Long-Term Cognitive Inhibition Training in Older Adults

abstract: The decline of cognitive inhibition significantly impacts older adults' quality of life and well-being, making it a vital public health problem in today's aging society. Previous research has demonstrated that Virtual reality (VR) exergames have great potential to enhance cognitive inhibition among older adults. However, existing commercial VR exergames were unsuitable for older adults' long-term cognitive training due to the inappropriate cognitive activation paradigm, unnecessary complexity, and unbefitting difficulty levels. To bridge these gaps, we developed a customized VR cognitive training exergame (LightSword) based on Dual-task and Stroop paradigms for long-term cognitive inhibition training among healthy older adults. Subsequently, we conducted an eight-month longitudinal user study with 12 older adults aged 60 years and above to demonstrate the effectiveness of LightSword in improving cognitive inhibition. After the training, the cognitive inhibition abilities of older adults were significantly enhanced, with benefits persisting for 6 months. This result indicated that LightSword has both short-term and long-term effects in enhancing cognitive inhibition. Furthermore, qualitative feedback revealed that older adults exhibited a positive attitude toward long-term training with LightSword, which enhanced their motivation and compliance.


title: Liftings of point-wise finite dimensional persistence modules over local commutative Artinian rings

abstract: Let $\mathbf{k}$ be a field and let $V: \mathscr{C} \to \mathbf{k}\textup{-Mod}$ be a point-wise finite dimensional persistence modules, where $\mathscr{C}$ is a small category. Assume that for all local Artinian $\mathbf{k}$-algebras $R$ with residue field isomorphic to $\mathbf{k}$, there is a generalized persistence module $M: \mathscr{C} \to R\textup{-Mod}$, such that for all $x\in \mathrm{Ob}(\mathscr{C})$, $M(x)$ is free over $R$ with finite rank and $\mathbf{k}\otimes_R M(x)\cong V(x)$. If $V$ is a direct sum of indecomposable persistence modules $V_I: \mathscr{C}\to \mathbf{k}\textup{-Mod}$ with endomorphism ring isomorphic to $\mathbf{k}$, then $M$ is a direct sum of indecomposables $M_I:\mathscr{C}\to R\textup{-Mod}$ with endomorphism ring isomorphic to $R$


title: Quantifying Manifolds: Do the manifolds learned by Generative Adversarial Networks converge to the real data manifold

abstract: This paper presents our experiments to quantify the manifolds learned by ML models (in our experiment, we use a GAN model) as they train. We compare the manifolds learned at each epoch to the real manifolds representing the real data. To quantify a manifold, we study the intrinsic dimensions and topological features of the manifold learned by the ML model, how these metrics change as we continue to train the model, and whether these metrics convergence over the course of training to the metrics of the real data manifold.


title: CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Model

abstract: Feed-forward 3D generative models like the Large Reconstruction Model (LRM) have demonstrated exceptional generation speed. However, the transformer-based methods do not leverage the geometric priors of the triplane component in their architecture, often leading to sub-optimal quality given the limited size of 3D data and slow training. In this work, we present the Convolutional Reconstruction Model (CRM), a high-fidelity feed-forward single image-to-3D generative model. Recognizing the limitations posed by sparse 3D data, we highlight the necessity of integrating geometric priors into network design. CRM builds on the key observation that the visualization of triplane exhibits spatial correspondence of six orthographic images. First, it generates six orthographic view images from a single input image, then feeds these images into a convolutional U-Net, leveraging its strong pixel-level alignment capabilities and significant bandwidth to create a high-resolution triplane. CRM further employs Flexicubes as geometric representation, facilitating direct end-to-end optimization on textured meshes. Overall, our model delivers a high-fidelity textured mesh from an image in just 10 seconds, without any test-time optimization.


title: Fibrations on the 6-sphere

abstract: Let $Z$ be a compact, connected $3$-dimensional complex manifold with vanishing first and second Betti numbers and non-vanishing Euler characteristic. We prove that there is no holomorphic mapping from $Z$ onto any $2$-dimensional complex space. Combining this with a result of Campana-Demailly-Peternell, a corollary is that any holomorphic mapping from the $6$-dimensional sphere $S^6$, endowed with any hypothetical complex structure, to a strictly lower-dimensional complex space must be constant. In other words, there does not exist any holomorphic fibration on $S^6$.


title: Efficient Measurement of the Bi-photon Spatial Mode Entanglement with Stimulated Emission Tomography

abstract: The technique of stimulated emission tomography (SET) provides excellent characterization of SPDC sources of bi-photon states since it increases the average number of photons detected by several orders of magnitude than the traditional coincidence counting method. In a SET experiment, the signal caused by the vacuum fluctuation in SPDC is replaced by a more intense prepared seed with the same mode properties, resulting in an amplification of the corresponding idler. Based on this idea, our experiment uses the difference frequency generation (DFG), a purely classical second-order nonlinear process, to measure the orbital angular momentum (OAM) spectrum of an entangled photon pair produced by a Type-II SPDC crystal. We inject the seed beam at 780 nm with different Laguerre-Gaussian modes together with a pump beam at 405 nm into a Type-II BBO crystal and measure the Laguerre-Gaussian mode distribution of the idler at 842 nm. We observe a strong idler production and good agreement with the theoretical prediction of the OAM spectrum. We expect that this experiment paves the way for the efficient measurement of bi-photon wavefunctions produced by ultra-thin SPDC sources and also the characterization of high-dimensional entangled photon pairs produced in SPDC.


title: Lightator: An Optical Near-Sensor Accelerator with Compressive Acquisition Enabling Versatile Image Processing

abstract: This paper proposes a high-performance and energy-efficient optical near-sensor accelerator for vision applications, called Lightator. Harnessing the promising efficiency offered by photonic devices, Lightator features innovative compressive acquisition of input frames and fine-grained convolution operations for low-power and versatile image processing at the edge for the first time. This will substantially diminish the energy consumption and latency of conversion, transmission, and processing within the established cloud-centric architecture as well as recently designed edge accelerators. Our device-to-architecture simulation results show that with favorable accuracy, Lightator achieves 84.4 Kilo FPS/W and reduces power consumption by a factor of ~24x and 73x on average compared with existing photonic accelerators and GPU baseline.


title: collapse: Advanced and Fast Statistical Computing and Data Transformation in R

abstract: collapse is a large C/C++-based infrastructure package facilitating complex statistical computing, data transformation, and exploration tasks in R - at outstanding levels of performance and memory efficiency. It also implements a class-agnostic approach to R programming, supporting vector, matrix and data frame-like objects and their popular variants (e.g., factor, ts, xts, tibble, data.table, sf), enabling its seamless integration with large parts of the R ecosystem. This article introduces the package's key components and design principles in a structured way, supported by a rich set of examples. A small benchmark demonstrates its computational performance.


title: Tunable non-Hermitian skin effect via gain and loss

abstract: We investigate theoretically tunable non-Hermitian skin effect in systems with gain and loss, and find that bipolar (quadripolar) non-Hermitian skin effect characterized by topological invariants in one (two)-dimensional system. We also find the partial non-Hermitian skin effect with the coexistence of localized states and extended states. Both types of the non-Hermitian skin effect have not yet been predicted together in a single system. A feasible experimental scheme of our model is proposed to realize in electric circuits. Our investigation unveils a new type of non-Hermitian skin effect and enhance the tunability of the non-Hermitian systems by gain and loss other than the conventional non-reciprocal hopping.


title: Spectral radius and the 2-power of Hamilton paths

abstract: We determine the maximum number of a graph without containing the 2-power of a Hamilton path. Using this result, we establish a spectral condition for a graph containing the 2-power of a Hamilton path.


title: Data-Dependent LSH for the Earth Mover's Distance

abstract: We give new data-dependent locality sensitive hashing schemes (LSH) for the Earth Mover's Distance ($\mathsf{EMD}$), and as a result, improve the best approximation for nearest neighbor search under $\mathsf{EMD}$ by a quadratic factor. Here, the metric $\mathsf{EMD}_s(\mathbb{R}^d,\ell_p)$ consists of sets of $s$ vectors in $\mathbb{R}^d$, and for any two sets $x,y$ of $s$ vectors the distance $\mathsf{EMD}(x,y)$ is the minimum cost of a perfect matching between $x,y$, where the cost of matching two vectors is their $\ell_p$ distance. Previously, Andoni, Indyk, and Krauthgamer gave a (data-independent) locality-sensitive hashing scheme for $\mathsf{EMD}_s(\mathbb{R}^d,\ell_p)$ when $p \in [1,2]$ with approximation $O(\log^2 s)$. By being data-dependent, we improve the approximation to $\tilde{O}(\log s)$. Our main technical contribution is to show that for any distribution $\mu$ supported on the metric $\mathsf{EMD}_s(\mathbb{R}^d, \ell_p)$, there exists a data-dependent LSH for dense regions of $\mu$ which achieves approximation $\tilde{O}(\log s)$, and that the data-independent LSH actually achieves a $\tilde{O}(\log s)$-approximation outside of those dense regions. Finally, we show how to "glue" together these two hashing schemes without any additional loss in the approximation. Beyond nearest neighbor search, our data-dependent LSH also gives optimal (distributional) sketches for the Earth Mover's Distance. By known sketching lower bounds, this implies that our LSH is optimal (up to $\mathrm{poly}(\log \log s)$ factors) among those that collide close points with constant probability.


title: Vertical and radial distribution of atomic carbon in HD 163296

abstract: In protoplanetary disks, atomic carbon is expected to originate from the PDR at the disk surface where CO is dissociated by UV photons coming from the stellar, or external interstellar, radiation field. Even though atomic carbon has been detected in several protoplanetary disks, there is a lack of spatially resolved observations of it. For HD 163296 protoplanetary disk, we aim to obtain both radial and vertical structure of [CI]$={^3}{P_1} - {^3}{P_0}$ line emission and perform the first direct comparison of this tracer with optically thick line emission $^{12}$CO $J=2-1$. We used archival ALMA data for [CI]$={^3}{P_1} - {^3}{P_0}$ and previously published ${^{12}}$ CO $J=2-1$ data in HD 163296. Through the software of disksurf we extracted the vertical structure, meanwhile radial profiles were obtained directly from imaging. Brand new DALI modelling was employed to perform direct comparison to the data. We found that these tracers are collocated radially but not vertically, where $^{12}$CO $J=2-1$ emission is, on average, located at higher altitudes, as it is also the case for other tracers in the same disk. Due to this difference in vertical height of the emission, the optically thick $^{12}$CO $J=2-1$ emission line appears to trace the highest altitudes, despite the expected formation mechanism of [CI] in the disk. The latter phenomena may be due to efficient mixing of the upper layers of the disk, or UV photons penetrating deeper than we expected.


title: Infrared Emission of Specific Polycyclic Aromatic Hydrocarbon Molecules: Cyanonaphthalenes

abstract: The unidentified infrared emission (UIE) features at 3.3, 6.2, 7.7, 8.6, 11.3 and 12.7 micron are ubiquitously seen in a wide variety of astrophysical regions and commonly attributed to polycyclic aromatic hydrocarbon (PAH) molecules. However, the unambiguous identification of any individual, specific PAH molecules has proven elusive until very recently two isomers of cyanonapthalene, which consists of two fused benzene rings and substitutes a nitrile (-CN) group for a hydrogen atom, were discovered in the Taurus Molecular Cloud based on their rotational transitions at radio frequencies. To facilitate the James Webb Space Telescope (JWST) to search for cyanonapthalenes in astrophysical regions, we model the vibrational excitation of cyanonapthalenes and calculate their infrared emission spectra in a number of representative astrophysical regions. The model emission spectra and intensities will allow JWST to quantitatively determine or place an upper limit on the abundance of cyanonapthalenes.


title: Information Theory in a Darwinian Evolution Population Dynamics Model

abstract: Using information theory, we propose an estimation method for traits parameters in a Darwinian evolution model for species with on trait or multiple traits. We use the Fisher's information to obtain the errors on the estimation for one species with one or multiple traits. We perform simulations to illustrate the method.

categories: q-bio.PE cs.IT math.DS math.IT math.ST stat.TH


title: Are Human Conversations Special? A Large Language Model Perspective

abstract: This study analyzes changes in the attention mechanisms of large language models (LLMs) when used to understand natural conversations between humans (human-human). We analyze three use cases of LLMs: interactions over web content, code, and mathematical texts. By analyzing attention distance, dispersion, and interdependency across these domains, we highlight the unique challenges posed by conversational data. Notably, conversations require nuanced handling of long-term contextual relationships and exhibit higher complexity through their attention patterns. Our findings reveal that while language models exhibit domain-specific attention behaviors, there is a significant gap in their ability to specialize in human conversations. Through detailed attention entropy analysis and t-SNE visualizations, we demonstrate the need for models trained with a diverse array of high-quality conversational data to enhance understanding and generation of human-like dialogue. This research highlights the importance of domain specialization in language models and suggests pathways for future advancement in modeling human conversational nuances.


title: EgoPAT3Dv2: Predicting 3D Action Target from 2D Egocentric Vision for Human-Robot Interaction

abstract: A robot's ability to anticipate the 3D action target location of a hand's movement from egocentric videos can greatly improve safety and efficiency in human-robot interaction (HRI). While previous research predominantly focused on semantic action classification or 2D target region prediction, we argue that predicting the action target's 3D coordinate could pave the way for more versatile downstream robotics tasks, especially given the increasing prevalence of headset devices. This study expands EgoPAT3D, the sole dataset dedicated to egocentric 3D action target prediction. We augment both its size and diversity, enhancing its potential for generalization. Moreover, we substantially enhance the baseline algorithm by introducing a large pre-trained model and human prior knowledge. Remarkably, our novel algorithm can now achieve superior prediction outcomes using solely RGB images, eliminating the previous need for 3D point clouds and IMU input. Furthermore, we deploy our enhanced baseline algorithm on a real-world robotic platform to illustrate its practical utility in straightforward HRI tasks. The demonstrations showcase the real-world applicability of our advancements and may inspire more HRI use cases involving egocentric vision. All code and data are open-sourced and can be found on the project website.


title: REPS: Reconstruction-based Point Cloud Sampling

abstract: Sampling is widely used in various point cloud tasks as it can effectively reduce resource consumption. Recently, some methods have proposed utilizing neural networks to optimize the sampling process for various task requirements. Currently, deep downsampling methods can be categorized into two main types: generative-based and score-based. Generative-based methods directly generate sampled point clouds using networks, whereas score-based methods assess the importance of points according to specific rules and then select sampled point clouds based on their scores. However, these methods often result in noticeable clustering effects in high-intensity feature areas, compromising their ability to preserve small-scale features and leading to the loss of some structures, thereby affecting the performance of subsequent tasks. In this paper, we propose REPS, a reconstruction-based scoring strategy that evaluates the importance of each vertex by removing and reconstructing them using surrounding vertices. Our reconstruction process comprises point reconstruction and shape reconstruction. The two aforementioned reconstruction methods effectively evaluate the importance of vertices by removing them at different scales for reconstruction. These reconstructions ensure that our method maintains the overall geometric features of the point cloud and avoids disturbing small-scale structures during sampling. Additionally, we propose the Global-Local Fusion Attention (GLFA) module, which aggregates local and global attention features of point clouds, ensuring high-quality reconstruction and sampling effects. Our method outperforms previous approaches in preserving the structural features of the sampled point clouds. Furthermore, abundant experimental results demonstrate the superior performance of our method across various common tasks.


title: Efficient Calculations for k-diagonal Circulant Matrices and Cyclic Banded Matrices

abstract: Calculating the inverse of $k$-diagonal circulant matrices and cyclic banded matrices is a more challenging problem than calculating their determinants. Algorithms that directly involve or specify linear or quadratic complexity for the inverses of these two types of matrices are rare. This paper presents two fast algorithms that can compute the complexity of a $k$-diagonal circulant matrix within complexity $O(k^3 \log n+k^4)+kn$, and for $k$-diagonal cyclic banded matrices it is $O(k^3 n+k^5)+kn^2$. Since $k$ is generally much smaller than $n$, the cost of these two algorithms can be approximated as $kn$ and $kn^2$.


title: XPSR: Cross-modal Priors for Diffusion-based Image Super-Resolution

abstract: Diffusion-based methods, endowed with a formidable generative prior, have received increasing attention in Image Super-Resolution (ISR) recently. However, as low-resolution (LR) images often undergo severe degradation, it is challenging for ISR models to perceive the semantic and degradation information, resulting in restoration images with incorrect content or unrealistic artifacts. To address these issues, we propose a \textit{Cross-modal Priors for Super-Resolution (XPSR)} framework. Within XPSR, to acquire precise and comprehensive semantic conditions for the diffusion model, cutting-edge Multimodal Large Language Models (MLLMs) are utilized. To facilitate better fusion of cross-modal priors, a \textit{Semantic-Fusion Attention} is raised. To distill semantic-preserved information instead of undesired degradations, a \textit{Degradation-Free Constraint} is attached between LR and its high-resolution (HR) counterpart. Quantitative and qualitative results show that XPSR is capable of generating high-fidelity and high-realism images across synthetic and real-world datasets. Codes will be released at \url{https://github.com/qyp2000/XPSR}.


title: DyRoNet: Dynamic Routing and Low-Rank Adapters for Autonomous Driving Streaming Perception

abstract: The advancement of autonomous driving systems hinges on the ability to achieve low-latency and high-accuracy perception. To address this critical need, this paper introduces Dynamic Routering Network (DyRoNet), a low-rank enhanced dynamic routing framework designed for streaming perception in autonomous driving systems. DyRoNet integrates a suite of pre-trained branch networks, each meticulously fine-tuned to function under distinct environmental conditions. At its core, the framework offers a speed router module, developed to assess and route input data to the most suitable branch for processing. This approach not only addresses the inherent limitations of conventional models in adapting to diverse driving conditions but also ensures the balance between performance and efficiency. Extensive experimental evaluations demonstrating the adaptability of DyRoNet to diverse branch selection strategies, resulting in significant performance enhancements across different scenarios. This work not only establishes a new benchmark for streaming perception but also provides valuable engineering insights for future work.


title: Superconductivity in Two-Dimensional Systems with Unconventional Rashba Bands

abstract: In two-dimensional system with Rashba spin-orbit coupling, it is well-known that superconductivity can have mixed spin-singlet and -triplet parity, and the $\boldsymbol{d}$-vector of spin-triplet pairing is parallel to $\boldsymbol{g}$-vector of Rashba spin-orbit coupling. Here, we propose a model to describe a two-dimensional system with unconventional Rashba bands and study its superconductivity. We show that the $\boldsymbol{d}$-vector of spin-triplet pairing can be either parallel or perpendicular to $\boldsymbol{g}$-vector of Rashba spin-orbit coupling depending on the different pairing interaction. We also propose a junction to generate tunneling current depending on the direction of $\boldsymbol{d}$-vector. It provides a detectable evidence to distinguish these two different but very similar pairing channels. Furthermore, we find this model can give arise to a subleading spin-singlet chiral $p$-wave topological superconducting state. More significantly, we find that such unconventional Rashba bands and unconventional superconudcting pairings can be realized on surface of some superconducting topological materials, such as trigonal layered PtBi$_{2}$.


title: The role of Rashba spin-orbit induced spin textures in the anomalous Josephson effect

abstract: This work reports the theoretical investigation into the mechanism underpinning the anomalous Josephson effect. The prototypical system we study is a ballistic two-dimensional junction containing a two-dimensional Rashba spin-orbit interaction. In this paper we demonstrate how this two-dimensional Rashba interaction mixes the spins of adjacent transverse subbands which leads to significant spin-asymmetry within the junction. Under an external magnetic field, applied perpendicular to both the axis of transport and the normal vector of the junction, the sinusoidal Josephson current can then experience an anomalous phase shift. The role of this spin mixing in the limit of a single sub-band is initially explored by deriving an analytical expression for the resulting anomalous phase shift. The analysis is then extended to systems with multiple occupied sub-bands; in this later section, starting from a microscopic model, we derive an analytic formula for the resulting anomalous phase shift indicating it is linear in both magnetic field and spin-orbit strength. We then verify and validate all findings by comparing them with numerical results evaluated by a tight-binding model.


title: PrimeComposer: Faster Progressively Combined Diffusion for Image Composition with Attention Steering

abstract: Image composition involves seamlessly integrating given objects into a specific visual context. The current training-free methods rely on composing attention weights from several samplers to guide the generator. However, since these weights are derived from disparate contexts, their combination leads to coherence confusion in synthesis and loss of appearance information. These issues worsen with their excessive focus on background generation, even when unnecessary in this task. This not only slows down inference but also compromises foreground generation quality. Moreover, these methods introduce unwanted artifacts in the transition area. In this paper, we formulate image composition as a subject-based local editing task, solely focusing on foreground generation. At each step, the edited foreground is combined with the noisy background to maintain scene consistency. To address the remaining issues, we propose PrimeComposer, a faster training-free diffuser that composites the images by well-designed attention steering across different noise levels. This steering is predominantly achieved by our Correlation Diffuser, utilizing its self-attention layers at each step. Within these layers, the synthesized subject interacts with both the referenced object and background, capturing intricate details and coherent relationships. This prior information is encoded into the attention weights, which are then integrated into the self-attention layers of the generator to guide the synthesis process. Besides, we introduce a Region-constrained Cross-Attention to confine the impact of specific subject-related words to desired regions, addressing the unwanted artifacts shown in the prior method thereby further improving the coherence in the transition area. Our method exhibits the fastest inference efficiency and extensive experiments demonstrate our superiority both qualitatively and quantitatively.


title: A Sinkhorn-type Algorithm for Constrained Optimal Transport

abstract: Entropic optimal transport (OT) and the Sinkhorn algorithm have made it practical for machine learning practitioners to perform the fundamental task of calculating transport distance between statistical distributions. In this work, we focus on a general class of OT problems under a combination of equality and inequality constraints. We derive the corresponding entropy regularization formulation and introduce a Sinkhorn-type algorithm for such constrained OT problems supported by theoretical guarantees. We first bound the approximation error when solving the problem through entropic regularization, which reduces exponentially with the increase of the regularization parameter. Furthermore, we prove a sublinear first-order convergence rate of the proposed Sinkhorn-type algorithm in the dual space by characterizing the optimization procedure with a Lyapunov function. To achieve fast and higher-order convergence under weak entropy regularization, we augment the Sinkhorn-type algorithm with dynamic regularization scheduling and second-order acceleration. Overall, this work systematically combines recent theoretical and numerical advances in entropic optimal transport with the constrained case, allowing practitioners to derive approximate transport plans in complex scenarios.


title: MUC: Mixture of Uncalibrated Cameras for Robust 3D Human Body Reconstruction

abstract: Multiple cameras can provide multi-view video coverage of a person. It is necessary to fuse multi-view data, e.g., for subsequent behavioral analysis, while such fusion often relies on calibration of cameras in traditional solutions. However, it is non-trivial to calibrate multiple cameras. In this work, we propose a method to reconstruct 3D human body from multiple uncalibrated camera views. First, we adopt a pre-trained human body encoder to process each individual camera view, such that human body models and parameters can be reconstructed for each view. Next, instead of simply averaging models across views, we train a network to determine the weights of individual views for their fusion, based on the parameters estimated for joints and hands of human body as well as camera positions. Further, we turn to the mesh surface of human body for dynamic fusion, such that facial expression can be seamlessly integrated into the model of human body. Our method has demonstrated superior performance in reconstructing human body upon two public datasets. More importantly, our method can flexibly support ad-hoc deployment of an arbitrary number of cameras, which has significant potential in related applications. We will release source code upon acceptance of the paper.


title: Stealing Stable Diffusion Prior for Robust Monocular Depth Estimation

abstract: Monocular depth estimation is a crucial task in computer vision. While existing methods have shown impressive results under standard conditions, they often face challenges in reliably performing in scenarios such as low-light or rainy conditions due to the absence of diverse training data. This paper introduces a novel approach named Stealing Stable Diffusion (SSD) prior for robust monocular depth estimation. The approach addresses this limitation by utilizing stable diffusion to generate synthetic images that mimic challenging conditions. Additionally, a self-training mechanism is introduced to enhance the model's depth estimation capability in such challenging environments. To enhance the utilization of the stable diffusion prior further, the DINOv2 encoder is integrated into the depth model architecture, enabling the model to leverage rich semantic priors and improve its scene understanding. Furthermore, a teacher loss is introduced to guide the student models in acquiring meaningful knowledge independently, thus reducing their dependency on the teacher models. The effectiveness of the approach is evaluated on nuScenes and Oxford RobotCar, two challenging public datasets, with the results showing the efficacy of the method. Source code and weights are available at: https://github.com/hitcslj/SSD.


title: Impurity in a zero-temperature three-dimensional Fermi gas

abstract: We consider an impurity in a sea of zero-temperature fermions uniformly distributed throughout the space. The impurity scatters on fermions. On average, the momentum of impurity decreases with time as $t^{-1/(d+1)}$ in $d$ dimensions, and the momentum distribution acquires a scaling form in the long time limit. We solve the Lorentz-Boltzmann equation for the scaled momentum distribution of the impurity in three dimensions. The solution is a combination of confluent hypergeometric functions. In two spatial dimensions, the Lorentz-Boltzmann equation is analytically intractable, so we merely extract a few exact predictions about asymptotic behaviors when the scaled momentum of the impurity is small or large.


title: Intrinsic anomalous Hall effect arising from antiferromagnetic structure revealed by high-quality NbMnP

abstract: The large anomalous Hall effect (AHE) in antiferromagnetic (AF) materials arises from symmetry breaking equivalent to a ferromagnetic (FM) state. Consequently, this suggests that the observed AHE is induced by the intrinsic mechanism of the band structure effect, which in turn induces dissipationless transverse conductivity. Confirmation of impurity-insensitive anomalous Hall conductivity (AHC) is crucial to conclude this interpretation; however, experimental investigations in AF materials are limited by the lack of high quality systems. In this study, we show that the AF material NbMnP, which exhibits a large AHE, offers a high quality single crystal. Our findings clearly revealed that the large AHC and the tiny net magnetization of $\sim10^{-3} \mu_{\mathrm{B}}$/Mn are inherent in this material, irrespective of disorder. NbMnP is a novel AF material that generates FM responses in the regime where there is less impurity scattering.


title: Bug Priority Change: An Empirical Study on Apache Projects

abstract: In issue tracking systems, each bug is assigned a priority level (e.g., Blocker, Critical, Major, Minor, or Trivial in JIRA from highest to lowest), which indicates the urgency level of the bug. In this sense, understanding bug priority changes helps to arrange the work schedule of participants reasonably, and facilitates a better analysis and resolution of bugs. According to the data extracted from JIRA deployed by Apache, a proportion of bugs in each project underwent priority changes after such bugs were reported, which brings uncertainty to the bug fixing process. However, there is a lack of indepth investigation on the phenomenon of bug priority changes, which may negatively impact the bug fixing process. Thus, we conducted a quantitative empirical study on bugs with priority changes through analyzing 32 non-trivial Apache open source software projects. The results show that: (1) 8.3% of the bugs in the selected projects underwent priority changes; (2) the median priority change time interval is merely a few days for most (28 out of 32) projects, and half (50. 7%) of bug priority changes occurred before bugs were handled; (3) for all selected projects, 87.9% of the bugs with priority changes underwent only one priority change, most priority changes tend to shift the priority to its adjacent priority, and a higher priority has a greater probability to undergo priority change; (4) bugs that require bug-fixing changes of higher complexity or that have more comments are likely to undergo priority changes; and (5) priorities of bugs reported or allocated by a few specific participants are more likely to be modified, and maximally only one participant in each project tends to modify priorities.


title: Multimodal Infusion Tuning for Large Models

abstract: Recent advancements in large-scale models have showcased remarkable generalization capabilities in various tasks. However, integrating multimodal processing into these models presents a significant challenge, as it often comes with a high computational burden. To address this challenge, we introduce a new parameter-efficient multimodal tuning strategy for large models in this paper, referred to as Multimodal Infusion Tuning (MiT). MiT leverages decoupled self-attention mechanisms within large language models to effectively integrate information from diverse modalities such as images and acoustics. In MiT, we also design a novel adaptive rescaling strategy at the attention head level, which optimizes the representation of infused multimodal features. Notably, all foundation models are kept frozen during the tuning process to reduce the computational burden and only 2.5\% parameters are tunable. We conduct experiments across a range of multimodal tasks, including image-related tasks like referring segmentation and non-image tasks such as sentiment analysis. Our results showcase that MiT achieves state-of-the-art performance in multimodal understanding while significantly reducing computational overhead(10\% of previous methods). Moreover, our tuned model exhibits robust reasoning abilities even in complex scenarios.


title: RadarDistill: Boosting Radar-based Object Detection Performance via Knowledge Distillation from LiDAR Features

abstract: The inherent noisy and sparse characteristics of radar data pose challenges in finding effective representations for 3D object detection. In this paper, we propose RadarDistill, a novel knowledge distillation (KD) method, which can improve the representation of radar data by leveraging LiDAR data. RadarDistill successfully transfers desirable characteristics of LiDAR features into radar features using three key components: Cross-Modality Alignment (CMA), Activation-based Feature Distillation (AFD), and Proposal-based Feature Distillation (PFD). CMA enhances the density of radar features by employing multiple layers of dilation operations, effectively addressing the challenge of inefficient knowledge transfer from LiDAR to radar. AFD selectively transfers knowledge based on regions of the LiDAR features, with a specific focus on areas where activation intensity exceeds a predefined threshold. PFD similarly guides the radar network to selectively mimic features from the LiDAR network within the object proposals. Our comparative analyses conducted on the nuScenes datasets demonstrate that RadarDistill achieves state-of-the-art (SOTA) performance for radar-only object detection task, recording 20.5% in mAP and 43.7% in NDS. Also, RadarDistill significantly improves the performance of the camera-radar fusion model.


title: Agile Multi-Source-Free Domain Adaptation

abstract: Efficiently utilizing rich knowledge in pretrained models has become a critical topic in the era of large models. This work focuses on adaptively utilizing knowledge from multiple source-pretrained models to an unlabeled target domain without accessing the source data. Despite being a practically useful setting, existing methods require extensive parameter tuning over each source model, which is computationally expensive when facing abundant source domains or larger source models. To address this challenge, we propose a novel approach which is free of the parameter tuning over source backbones. Our technical contribution lies in the Bi-level ATtention ENsemble (Bi-ATEN) module, which learns both intra-domain weights and inter-domain ensemble weights to achieve a fine balance between instance specificity and domain consistency. By slightly tuning source bottlenecks, we achieve comparable or even superior performance on a challenging benchmark DomainNet with less than 3% trained parameters and 8 times of throughput compared with SOTA method. Furthermore, with minor modifications, the proposed module can be easily equipped to existing methods and gain more than 4% performance boost. Code is available at https://github.com/TL-UESTC/Bi-ATEN.


title: Aligning Large Language Models for Controllable Recommendations

abstract: Inspired by the exceptional general intelligence of Large Language Models (LLMs), researchers have begun to explore their application in pioneering the next generation of recommender systems - systems that are conversational, explainable, and controllable. However, existing literature primarily concentrates on integrating domain-specific knowledge into LLMs to enhance accuracy, often neglecting the ability to follow instructions. To address this gap, we initially introduce a collection of supervised learning tasks, augmented with labels derived from a conventional recommender model, aimed at explicitly improving LLMs' proficiency in adhering to recommendation-specific instructions. Subsequently, we develop a reinforcement learning-based alignment procedure to further strengthen LLMs' aptitude in responding to users' intentions and mitigating formatting errors. Through extensive experiments on two real-world datasets, our method markedly advances the capability of LLMs to comply with instructions within recommender systems, while sustaining a high level of accuracy performance.


title: Unsupervised Graph Neural Architecture Search with Disentangled Self-supervision

abstract: The existing graph neural architecture search (GNAS) methods heavily rely on supervised labels during the search process, failing to handle ubiquitous scenarios where supervisions are not available. In this paper, we study the problem of unsupervised graph neural architecture search, which remains unexplored in the literature. The key problem is to discover the latent graph factors that drive the formation of graph data as well as the underlying relations between the factors and the optimal neural architectures. Handling this problem is challenging given that the latent graph factors together with architectures are highly entangled due to the nature of the graph and the complexity of the neural architecture search process. To address the challenge, we propose a novel Disentangled Self-supervised Graph Neural Architecture Search (DSGAS) model, which is able to discover the optimal architectures capturing various latent graph factors in a self-supervised fashion based on unlabeled graph data. Specifically, we first design a disentangled graph super-network capable of incorporating multiple architectures with factor-wise disentanglement, which are optimized simultaneously. Then, we estimate the performance of architectures under different factors by our proposed self-supervised training with joint architecture-graph disentanglement. Finally, we propose a contrastive search with architecture augmentations to discover architectures with factor-specific expertise. Extensive experiments on 11 real-world datasets demonstrate that the proposed model is able to achieve state-of-the-art performance against several baseline methods in an unsupervised manner.


title: Can we obtain significant success in RST discourse parsing by using Large Language Models?

abstract: Recently, decoder-only pre-trained large language models (LLMs), with several tens of billion parameters, have significantly impacted a wide range of natural language processing (NLP) tasks. While encoder-only or encoder-decoder pre-trained language models have already proved to be effective in discourse parsing, the extent to which LLMs can perform this task remains an open research question. Therefore, this paper explores how beneficial such LLMs are for Rhetorical Structure Theory (RST) discourse parsing. Here, the parsing process for both fundamental top-down and bottom-up strategies is converted into prompts, which LLMs can work with. We employ Llama 2 and fine-tune it with QLoRA, which has fewer parameters that can be tuned. Experimental results on three benchmark datasets, RST-DT, Instr-DT, and the GUM corpus, demonstrate that Llama 2 with 70 billion parameters in the bottom-up strategy obtained state-of-the-art (SOTA) results with significant differences. Furthermore, our parsers demonstrated generalizability when evaluated on RST-DT, showing that, in spite of being trained with the GUM corpus, it obtained similar performances to those of existing parsers trained with RST-DT.


title: Reset & Distill: A Recipe for Overcoming Negative Transfer in Continual Reinforcement Learning

abstract: We argue that one of the main obstacles for developing effective Continual Reinforcement Learning (CRL) algorithms is the negative transfer issue occurring when the new task to learn arrives. Through comprehensive experimental validation, we demonstrate that such issue frequently exists in CRL and cannot be effectively addressed by several recent work on mitigating plasticity loss of RL agents. To that end, we develop Reset & Distill (R&D), a simple yet highly effective method, to overcome the negative transfer problem in CRL. R&D combines a strategy of resetting the agent's online actor and critic networks to learn a new task and an offline learning step for distilling the knowledge from the online actor and previous expert's action probabilities. We carried out extensive experiments on long sequence of Meta-World tasks and show that our method consistently outperforms recent baselines, achieving significantly higher success rates across a range of tasks. Our findings highlight the importance of considering negative transfer in CRL and emphasize the need for robust strategies like R&D to mitigate its detrimental effects.


title: Prediction of turbulent energy based on low-rank resolvent modes and machine learning

abstract: A modelling framework based on the resolvent analysis and machine learning is proposed to predict the turbulent energy in incompressible channel flows. In the framework, the optimal resolvent response modes are selected as the basis functions modelling the low-rank behaviour of high-dimensional nonlinear turbulent flow-fields, and the corresponding weight functions are determined by data-driven neural networks. Turbulent-energy distribution in space and scales, at the friction Reynolds number 1000, is predicted and compared to the data of direct numerical simulation. Close agreement is observed, suggesting the feasibility and reliability of the proposed framework for turbulence prediction.


title: A Multiwavelength Machine-learning Approach to Classifying X-ray Sources in the Fields of Unidentified 4FGL-DR4 sources

abstract: A large fraction of Fermi-LAT sources in the 4th Fermi LAT 14-year Catalog (4FGL) still remain unidentified (unIDed). We continued to improve our machine learning pipeline (MUWCLASS) and used it to classify 1206 X-ray sources located within the extent of 73 unIDed 4FGL sources with Chandra X-ray Observatory (CXO) observations included in the Chandra Source Catalog 2.0. Recent improvements to our pipeline include astrometric corrections, probabilistic cross-matching to lower-frequency counterparts, and a more realistic oversampling method. X-ray sources are classified into 8 broad pre-determined astrophysical classes defined in the updated training dataset which we also release. The classifications give 115 plausible X-ray counterparts to 45 GeV sources. We present details of the machine learning classification, describe the pipeline improvements, and perform additional spectral and variability analysis for brighter sources. We identify 3 GeV sources as isolated neutron star candidates, 1 as an X-ray binary candidate, 16 as active galactic nucleus candidates, 7 sources are associated with star-forming regions, and 9 are ambiguous cases. For the remaining 37 unIDed 4FGL sources, we could not identify any plausible counterpart in X-rays or they are too close to the Galactic Center. Finally, we outline the observational strategies and further improvements in the pipeline that can lead to more accurate classifications.


title: Improving Diffusion-Based Generative Models via Approximated Optimal Transport

abstract: We introduce the Approximated Optimal Transport (AOT) technique, a novel training scheme for diffusion-based generative models. Our approach aims to approximate and integrate optimal transport into the training process, significantly enhancing the ability of diffusion models to estimate the denoiser outputs accurately. This improvement leads to ODE trajectories of diffusion models with lower curvature and reduced truncation errors during sampling. We achieve superior image quality and reduced sampling steps by employing AOT in training. Specifically, we achieve FID scores of 1.88 with just 27 NFEs and 1.73 with 29 NFEs in unconditional and conditional generations, respectively. Furthermore, when applying AOT to train the discriminator for guidance, we establish new state-of-the-art FID scores of 1.68 and 1.58 for unconditional and conditional generations, respectively, each with 29 NFEs. This outcome demonstrates the effectiveness of AOT in enhancing the performance of diffusion models.