title: Prediction of dual quantum spin Hall insulator in NbIrTe$_4$ monolayer

abstract: Dual quantum spin Hall insulator (QSHI) is a newly discovered topological state in the 2D material TaIrTe$_4$, exhibiting both a traditional $Z_2$ band gap at charge neutrality point and a van Hove singularity (VHS) induced correlated $Z_2$ band gap with weak doping. Inspired by the recent progress in theoretical understanding and experimental measurements, we predicted a promising dual QSHI in the counterpart material of the NbIrTe4 monolayer by first-principles calculations. In addition to the well-known band inversion at the charge neutrality point, two new band inversions were found after CDW phase transition when the chemical potential is near the VHS, one direct and one indirect $Z_2$ band gap. The VHS-induced non-trivial band gap is around 10 meV, much larger than that from TaIrTe$_4$. Furthermore, since the new generated band gap is mainly dominated by the $4d$ orbitals of Nb, electronic correlation effects should be relatively stronger in NbIrTe$_4$ as compared to TaIrTe$_4$. Therefore, the dual QSHI state in the NbIrTe$_4$ monolayer is expected to be a good platform for investigating the interplay between topology and correlation effects.


title: Selectively Answering Visual Questions

abstract: Recently, large multi-modal models (LMMs) have emerged with the capacity to perform vision tasks such as captioning and visual question answering (VQA) with unprecedented accuracy. Applications such as helping the blind or visually impaired have a critical need for precise answers. It is specially important for models to be well calibrated and be able to quantify their uncertainty in order to selectively decide when to answer and when to abstain or ask for clarifications. We perform the first in-depth analysis of calibration methods and metrics for VQA with in-context learning LMMs. Studying VQA on two answerability benchmarks, we show that the likelihood score of visually grounded models is better calibrated than in their text-only counterparts for in-context learning, where sampling based methods are generally superior, but no clear winner arises. We propose Avg BLEU, a calibration score combining the benefits of both sampling and likelihood methods across modalities.


title: Understanding the nature of the $\Delta(1600)$ resonance

abstract: We present a coupled-channel analysis of the $ J^P = 3/2^+ \Delta $-baryon spectrum, based in the framework of Hamiltonian Effective Field Theory (HEFT). We construct a Hamiltonian which mixes quark model-like single-particle states and two-particle meson-baryon channels, and constrain this via experimentally measured $ \pi N \to \pi N $ scattering observables. In the same vein as L\"{u}scher's approach, we then connect this infinite-volume inspired Hamiltonian with finite-volume lattice QCD results. Drawing on lattice correlation-matrix eigenvectors identifying the $ 1s $ and $ 2s $ states in the finite-volume $ \Delta(3/2^+) $ spectrum, and utilising the HEFT eigenvectors describing the composition of the energy eigenstates, we resolve the structure of these states and their relation to the $ \Delta(1600) $ resonance. We find the dominant contributions to this resonance come from strong rescattering in the $ \pi N $ and $ \pi \Delta $ channels. This contrasts the long-held view of a dominant quark model-like core for the $ \Delta(1600) $. Further discussion of other contemporary lattice results for the $ \Delta $ spectrum and $ \pi N $ scattering states is also presented.


title: Constructing Dynamic Feedback Linearizable Discretizations

abstract: Dynamic feedback linearization-based methods allow us to design control algorithms for a fairly large class of nonlinear systems in continuous time. However, this feature does not extend to their sampled counterparts, i.e., for a given dynamically feedback linearizable continuous time system, its numerical discretization may fail to be so. In this article, we present a way to construct discretization schemes (accurate up to first order) that result in schemes that are feedback linearizable. This result is an extension of our previous work, where we had considered only static feedback linearizable systems. The result presented here applies to a fairly general class of nonlinear systems, in particular, our analysis applies to both endogenous and exogenous types of feedback. While the results in this article are presented on a control affine form of nonlinear systems, they can be readily modified to general nonlinear systems.


title: Take its Essence, Discard its Dross! Debiasing for Toxic Language Detection via Counterfactual Causal Effect

abstract: Current methods of toxic language detection (TLD) typically rely on specific tokens to conduct decisions, which makes them suffer from lexical bias, leading to inferior performance and generalization. Lexical bias has both "useful" and "misleading" impacts on understanding toxicity. Unfortunately, instead of distinguishing between these impacts, current debiasing methods typically eliminate them indiscriminately, resulting in a degradation in the detection accuracy of the model. To this end, we propose a Counterfactual Causal Debiasing Framework (CCDF) to mitigate lexical bias in TLD. It preserves the "useful impact" of lexical bias and eliminates the "misleading impact". Specifically, we first represent the total effect of the original sentence and biased tokens on decisions from a causal view. We then conduct counterfactual inference to exclude the direct causal effect of lexical bias from the total effect. Empirical evaluations demonstrate that the debiased TLD model incorporating CCDF achieves state-of-the-art performance in both accuracy and fairness compared to competitive baselines applied on several vanilla models. The generalization capability of our model outperforms current debiased models for out-of-distribution data.


title: Predicting Drug-Gene Relations via Analogy Tasks with Word Embeddings

abstract: Natural language processing (NLP) is utilized in a wide range of fields, where words in text are typically transformed into feature vectors called embeddings. BioConceptVec is a specific example of embeddings tailored for biology, trained on approximately 30 million PubMed abstracts using models such as skip-gram. Generally, word embeddings are known to solve analogy tasks through simple vector arithmetic. For instance, $\mathrm{\textit{king}} - \mathrm{\textit{man}} + \mathrm{\textit{woman}}$ predicts $\mathrm{\textit{queen}}$. In this study, we demonstrate that BioConceptVec embeddings, along with our own embeddings trained on PubMed abstracts, contain information about drug-gene relations and can predict target genes from a given drug through analogy computations. We also show that categorizing drugs and genes using biological pathways improves performance. Furthermore, we illustrate that vectors derived from known relations in the past can predict unknown future relations in datasets divided by year.


title: MultiEdits: Simultaneous Multi-Aspect Editing with Text-to-Image Diffusion Models

abstract: Text-driven image synthesis has made significant advancements with the development of diffusion models, transforming how visual content is generated from text prompts. Despite these advances, text-driven image editing, a key area in computer graphics, faces unique challenges. A major challenge is making simultaneous edits across multiple objects or attributes. Applying these methods sequentially for multi-aspect edits increases computational demands and efficiency losses. In this paper, we address these challenges with significant contributions. Our main contribution is the development of MultiEdits, a method that seamlessly manages simultaneous edits across multiple attributes. In contrast to previous approaches, MultiEdits not only preserves the quality of single attribute edits but also significantly improves the performance of multitasking edits. This is achieved through an innovative attention distribution mechanism and a multi-branch design that operates across several processing heads. Additionally, we introduce the PIE-Bench++ dataset, an expansion of the original PIE-Bench dataset, to better support evaluating image-editing tasks involving multiple objects and attributes simultaneously. This dataset is a benchmark for evaluating text-driven image editing methods in multifaceted scenarios. Dataset and code are available at https://mingzhenhuang.com/projects/MultiEdits.html.


title: Non-reductive special cycles and Twisted Arithmetic Fundamental Lemma

abstract: We consider arithmetic analogs of the relative Langlands program and applications of new non-reductive geometry. Firstly, we introduce mirabolic special cycles, which produce special cycles on many Hodge type Rapoport-Zink spaces via pullbacks e.g. Kudla--Rapoport cycles. Secondly, we formulate arithmetic intersection problems for these cycles and formulate a method of arithmetic induction. As a main example, we formulate arithmetic twisted Gan--Gross--Prasad conjectures on unitary Shimura varieties and prove a key twisted arithmetic fundamental lemma using mirabolic special cycles, arithmetic inductions, and Weil type relative trace formulas.


title: Enhancing Fairness in Unsupervised Graph Anomaly Detection through Disentanglement

abstract: Graph anomaly detection (GAD) is increasingly crucial in various applications, ranging from financial fraud detection to fake news detection. However, current GAD methods largely overlook the fairness problem, which might result in discriminatory decisions skewed toward certain demographic groups defined on sensitive attributes (e.g., gender, religion, ethnicity, etc.). This greatly limits the applicability of these methods in real-world scenarios in light of societal and ethical restrictions. To address this critical gap, we make the first attempt to integrate fairness with utility in GAD decision-making. Specifically, we devise a novel DisEntangle-based FairnEss-aware aNomaly Detection framework on the attributed graph, named DEFEND. DEFEND first introduces disentanglement in GNNs to capture informative yet sensitive-irrelevant node representations, effectively reducing societal bias inherent in graph representation learning. Besides, to alleviate discriminatory bias in evaluating anomalous nodes, DEFEND adopts a reconstruction-based anomaly detection, which concentrates solely on node attributes without incorporating any graph structure. Additionally, given the inherent association between input and sensitive attributes, DEFEND constrains the correlation between the reconstruction error and the predicted sensitive attributes. Our empirical evaluations on real-world datasets reveal that DEFEND performs effectively in GAD and significantly enhances fairness compared to state-of-the-art baselines. To foster reproducibility, our code is available at https://github.com/AhaChang/DEFEND.


title: ADE-HGNN: Accelerating HGNNs through Attention Disparity Exploitation

abstract: Heterogeneous Graph Neural Networks (HGNNs) have recently demonstrated great power in handling heterogeneous graph data, rendering them widely applied in many critical real-world domains. Most HGNN models leverage attention mechanisms to significantly improvemodel accuracy, albeit at the cost of increased computational complexity and memory bandwidth requirements. Fortunately, the attention disparity from source vertices towards a common target vertex unveils an opportunity to boost the model execution performance by pruning unimportant source vertices during neighbor aggregation. In this study, we commence with a quantitative analysis of the attention disparity in HGNN models, where the importance of different source vertices varies for the same target vertex. To fully exploit this finding for inference acceleration, we propose a runtime pruning method based on min-heap and map it to a dedicated hardware pruner to discard unimportant vertices. Given that the pruning overhead itself is non-negligible and cannot be amortized by conventional staged execution paradigm, an operation-fusion execution fow of HGNNs is introduced to overlap the pruning overhead while harnessing inter-stage parallelism. Finally, we present the design of a novel HGNN accelerator, ADE-HGNN, tailored to support the proposed execution framework. Our experimental results demonstrate that ADE-HGNN achieves an average performance improvement of 28.21x over the NVIDIA GPU T4 platform and 7.98x over the advanced GPU A100, with the inference accuracy loss kept within a negligible range of 0.11%~1.47%. Furthermore, ADE-HGNN significantly reduces energy consumption to 1.97% and 5.37% of the two platforms, respectively.


title: On the exact limit of the time-dependent coupled cluster ansatz and its approximations in the real-time equation-of-motion coupled cluster cumulant Green's function approach

abstract: In this paper, we analyze the properties of the recently proposed real-time equation-of-motion coupled-cluster (RT-EOM-CC) cumulant Green's function approach [J. Chem. Phys. 2020, 152, 174113]. We specifically focus on identifying the limitations of the original time-dependent coupled cluster (TDCC) ansatz and propose an enhanced extended TDCC ansatz ensuring the exactness in the expansion limit. Additionally, we introduce a practical cluster-analysis-based approach for characterizing the peaks in the computed spectral function from the RT-EOM-CC cumulant Green's function approach, which is particularly useful for the assignments of satellite peaks when many-body effects dominate the spectra. Our preliminary numerical tests focus on reproducing, approximating, and characterizing the exact impurity Green's function of the three-site and four-site single impurity Anderson models using the RT-EOM-CC cumulant Green's function approach. The numerical tests allow us to have a direct comparison between the RT-EOM-CC cumulant Green's function approach and other Green's function approaches in the numerical exact limit.


title: Constraint-Aware Diffusion Models for Trajectory Optimization

abstract: The diffusion model has shown success in generating high-quality and diverse solutions to trajectory optimization problems. However, diffusion models with neural networks inevitably make prediction errors, which leads to constraint violations such as unmet goals or collisions. This paper presents a novel constraint-aware diffusion model for trajectory optimization. We introduce a novel hybrid loss function for training that minimizes the constraint violation of diffusion samples compared to the groundtruth while recovering the original data distribution. Our model is demonstrated on tabletop manipulation and two-car reach-avoid problems, outperforming traditional diffusion models in minimizing constraint violations while generating samples close to locally optimal solutions.


title: A High-Order Hybrid-Spectral Incompressible Navier-Stokes Model For Nonlinear Water Waves

abstract: We present a new high-order accurate computational fluid dynamics model based on the incompressible Navier-Stokes equations with a free surface for the accurate simulation of nonlinear and dispersive water waves in the time domain. The spatial discretization is based on Chebyshev polynomials in the vertical direction and a Fourier basis in the horizontal direction, allowing for the use of the fast Chebyshev and Fourier transforms for the efficient computation of spatial derivatives. The temporal discretization is done through a generalized low-storage explicit 4th order Runge-Kutta, and for the scheme to conserve mass and achieve high-order accuracy, a velocity-pressure coupling needs to be satisfied at all Runge-Kutta stages. This result in the emergence of a Poisson pressure problem that constitute a geometric conservation law for mass conservation. The occurring Poisson problem is proposed to be solved efficiently via an accelerated iterative solver based on a geometric $p$-multigrid scheme, which takes advantage of the high-order polynomial basis in the spatial discretization and hence distinguishes itself from conventional low-order numerical schemes. We present numerical experiments for validation of the scheme in the context of numerical wave tanks demonstrating that the $p$-multigrid accelerated numerical scheme can effectively solve the Poisson problem that constitute the computational bottleneck, that the model can achieve the desired spectral convergence, and is capable of simulating wave-propagation over non-flat bottoms with excellent agreement in comparison to experimental results.


title: Hybrid Automated Program Repair by Combining Large Language Models and Program Analysis

abstract: Automated Program Repair (APR) has garnered significant attention due to its potential to streamline the bug repair process for human developers. Recently, LLM-based APR methods have shown promise in repairing real-world bugs. However, existing APR methods often utilize patches generated by LLMs without further optimization, resulting in reduced effectiveness due to the lack of program-specific knowledge. Furthermore, the evaluations of these APR methods have typically been conducted under the assumption of perfect fault localization, which may not accurately reflect their real-world effectiveness. To address these limitations, this paper introduces an innovative APR approach called GIANTREPAIR. Our approach leverages the insight that LLM-generated patches, although not necessarily correct, offer valuable guidance for the patch generation process. Based on this insight, GIANTREPAIR first constructs patch skeletons from LLM-generated patches to confine the patch space, and then generates high-quality patches tailored to specific programs through context-aware patch generation by instantiating the skeletons. To evaluate the performance of our approach, we conduct two large-scale experiments. The results demonstrate that GIANTREPAIR not only effectively repairs more bugs (an average of 27.78% on Defects4J v1.2 and 23.40% on Defects4J v2.0) than using LLM-generated patches directly, but also outperforms state-of-the-art APR methods by repairing at least 42 and 7 more bugs under perfect and automated fault localization scenarios, respectively.


title: Detection of Acetone as a Gas Biomarker for Diabetes Based on Gas Sensor Technology

abstract: With the continuous development and improvement of medical services, there is a growing demand for improving diabetes diagnosis. Exhaled breath analysis, characterized by its speed, convenience, and non-invasive nature, is leading the trend in diagnostic development. Studies have shown that the acetone levels in the breath of diabetes patients are higher than normal, making acetone a basis for diabetes breath analysis. This provides a more readily accepted method for early diabetes prevention and monitoring. Addressing issues such as the invasive nature, disease transmission risks, and complexity of diabetes testing, this study aims to design a diabetes gas biomarker acetone detection system centered around a sensor array using gas sensors and pattern recognition algorithms. The research covers sensor selection, sensor preparation, circuit design, data acquisition and processing, and detection model establishment to accurately identify acetone. Titanium dioxide was chosen as the nano gas-sensitive material to prepare the acetone gas sensor, with data collection conducted using STM32. Filtering was applied to process the raw sensor data, followed by feature extraction using principal component analysis. A recognition model based on support vector machine algorithm was used for qualitative identification of gas samples, while a recognition model based on backpropagation neural network was employed for quantitative detection of gas sample concentrations. Experimental results demonstrated recognition accuracies of 96% and 97.5% for acetone-ethanol and acetone-methanol mixed gases, and 90% for ternary acetone, ethanol, and methanol mixed gases.


title: Half-integer Vortices Paired via String Micelles in Ferroelectric Liquid Crystals Facilitated by Ionic Polymer Doping

abstract: Ferroelectric nematic (NF) liquid crystals are an intriguing polar system for exploring topological defects, and their properties are subject to significant influence by ionic doping. A prior theory based on a modified XY model predicts that string defects with half-integer vortex-antivortex pairs can be excited, while such stable string defects have not been directly observed in polar materials. Here, we report that doping the ferroelectric nematic material RM734 with cationic polymers can facilitate the formation of abundant string defects with butterfly textures. The string defects exhibit a polarization field restricted to 2D plane that is divided by N\'eel type domain walls into domains with either uniform polarization or negative splay deformation in the butterfly wing areas (positive bound charges). We establish a charge double layer model for the string defects: the strings of cationic polymer chains and close packing RM734 molecules form the Stern charge layer, and the small anionic ions and the positive bound charges (due to splay deformation) form the charge diffusion layer. We demonstrate that only cationic polymeric doping is effective due to the coupling between the flexoelectricity and the pear shape of the RM734 molecules. We estimate the line charge density of the strings via measuring the divergence of the polarization and the electrophoretic motion mobility, and obtain good qualitative agreement. We further show that the field-driven polarization reversal undergoes either string rotation or generating and merging with kink walls.


title: Volume forms on balanced manifolds and the Calabi-Yau equation

abstract: We introduce the space of mixed-volume forms endowed with an $L^2$ metric on a balanced manifold. A geodesic equation can be derived in this space that has an interesting structure and extends the equation of Donaldson \cite{Donaldson10} and Chen-He \cite{CH11} in the space of volume forms on a Riemannian manifold. This nonlinear PDE is studied in detail and the existence of weak solution is shown for the Dirichlet problem, under a positivity assumption. Later we study the Calabi-Yau equation for balanced metrics and introduce a geometric criteria for prescribing volume forms that is closely related to the positivity assumption above. We call this assumption the sub-Astheno-K\"ahler condition. By deriving $C^0$ a priori estimates, we show that the existence of solutions can be established on all sub-Astheno-K\"ahler manifolds.


title: Focusing Airborne Ultrasound with Partially Occluded Emission from Rectangular Plate with Flexural Vibration Mode

abstract: We propose a focusing method of intense midair ultrasound out of ultrasonic emission from a single flexurally vibrating square plate partially covered with a purposely designed amplitude mask. Many applications relying on nonlinear acoustic effects, such as radiation force employed in acoustic levitation, have been devised. For those applications, focused intense airborne ultrasound is conventionally formed using phased arrays of transducers or sound sources with specific fabricated shapes. However, the former strategies are considerably costly, and the latter may require minute three-dimensional fabrication processes, which both hinder their utility, especially for the construction of a large ultrasound emitting aperture. Our method offers a possible solution for this, where the amplitude masks are designed in a fashion similar to the Freznel-zone-plate designing, but according to the positions of nodes and antinodes of the vibrating plate that are measured beforehand. We experimentally demonstrate the successful formation of midair ultrasound focus at a desired position. Our method only requires a monolithic plate, a driving transducer under the plate, and an amplitude mask fabricated out of laser machining processes of an acrylic plate. Magnification of the spatial scale of ultrasound apertures based on our method is much more readily and affordably achieved than conventional methods, which will lead to new midair ultrasound applications with the whole room workspace.


title: Toward regular black holes in sixth-derivative gravity

abstract: We study spherically symmetric static solutions of the most general sixth-derivative gravity using series expansions. Specifically, we prove that the only solutions of the complete theory (i.e., with generic coupling constants) that possess a Frobenius expansion around the origin, $r=0$, are necessarily regular. When restricted to specific branches of theories (i.e., imposing particular constraints on the coupling constants), families of potentially singular solutions emerge. By expanding around $r=r_0 \neq 0$, we identify solutions with black-hole horizons. Finally, we argue that, unlike in fourth-derivative gravity, the conditions $R=0$ and $g_{tt}g_{rr}=-1$ are too restrictive for sixth-derivative gravity solutions.


title: Distributional Refinement Network: Distributional Forecasting via Deep Learning

abstract: A key task in actuarial modelling involves modelling the distributional properties of losses. Classic (distributional) regression approaches like Generalized Linear Models (GLMs; Nelder and Wedderburn, 1972) are commonly used, but challenges remain in developing models that can (i) allow covariates to flexibly impact different aspects of the conditional distribution, (ii) integrate developments in machine learning and AI to maximise the predictive power while considering (i), and, (iii) maintain a level of interpretability in the model to enhance trust in the model and its outputs, which is often compromised in efforts pursuing (i) and (ii). We tackle this problem by proposing a Distributional Refinement Network (DRN), which combines an inherently interpretable baseline model (such as GLMs) with a flexible neural network-a modified Deep Distribution Regression (DDR; Li et al., 2019) method. Inspired by the Combined Actuarial Neural Network (CANN; Schelldorfer and W{\''u}thrich, 2019), our approach flexibly refines the entire baseline distribution. As a result, the DRN captures varying effects of features across all quantiles, improving predictive performance while maintaining adequate interpretability. Using both synthetic and real-world data, we demonstrate the DRN's superior distributional forecasting capacity. The DRN has the potential to be a powerful distributional regression model in actuarial science and beyond.


title: Seeing the Forest through the Trees: Data Leakage from Partial Transformer Gradients

abstract: Recent studies have shown that distributed machine learning is vulnerable to gradient inversion attacks, where private training data can be reconstructed by analyzing the gradients of the models shared in training. Previous attacks established that such reconstructions are possible using gradients from all parameters in the entire models. However, we hypothesize that most of the involved modules, or even their sub-modules, are at risk of training data leakage, and we validate such vulnerabilities in various intermediate layers of language models. Our extensive experiments reveal that gradients from a single Transformer layer, or even a single linear component with 0.54% parameters, are susceptible to training data leakage. Additionally, we show that applying differential privacy on gradients during training offers limited protection against the novel vulnerability of data disclosure.


title: Seasonal variation in nighttime NO radiative cooling as observed by TIMED/SABER in lower thermosphere during solar maximum and solar minimum

abstract: Both composition and temperature play a crucial role in determining the NO radiative cooling in lower thermosphere as observed by TIMED/SABER. In this work, we present a detailed investigation of seasonal variation in thermospheric NO radiative cooling. We have carried forward the investigation of \cite{li2018} regarding the variations in local nighttime peak NO radiative cooling and its altitude during solar maximum and solar minimum conditions. By analyzing latitudinal changes over quiet times for each month in year 2018, it is evident that both the investigative parameters exhibit summer-winter variability. The qualitative contribution of different species (i.e., NO, and O), and temperatures in determining the vertical profile of NO radiative cooling for different latitudes is investigated by utilizing the NRLMSISE-00 estimated parameters, and SNOE observed NO density. The temperature, NO density, meridional wind, and associated compositional variations due to asymmetrical solar heating in both the hemispheres during solar minimum conditions seem to be the dominating factor in controlling the NO radiative cooling during different seasons. The altitudes at which maximum cooling by NO occurs exhibits an inverse correlation with the amount of radiative cooling. The region of enhanced NO densities (polar and summer hemispheric low-mid latitude regions) have larger NO radiative cooling with lower peak altitudes in comparison to other regions (equatorial to winter hemispheric low-mid latitude regions), where NO radiative cooling is low with higher peak altitude values.


title: Discreteness Effects in the Post-Reconstruction Galaxy Power Spectrum

abstract: Recent studies have increasingly recognized the value of analyzing the post-reconstruction galaxy power spectrum for investigations into redshift space distortion (RSD) effects. In this paper, we present a novel theoretical model for the post-reconstruction galaxy power spectrum, designed for RSD analyses. In particular, we emphasize the importance of accounting for discrete effects arising from the reconstruction displacement vector, which have been overlooked. We specifically calculate these discrete effects, i.e., shot noise terms, within the framework of standard perturbation theory at the 1-loop level. In addition, we adopt a formulation that accounts for infrared (IR) effects to accurately model the non-linear damping of the Baryon Acoustic Oscillation (BAO) signal. Our model comprehensively integrates key physical phenomena relevant to the post-reconstruction galaxy power spectrum, such as gravitational non-linearities, RSD effects, bias effects, reconstruction effects, reconstruction-specific shot-noise effects, and the non-linear damping of the reconstructed BAO signal, thereby making it applicable to post-reconstruction RSD analyses.


title: Random Subspace Local Projections

abstract: We show how random subspace methods can be adapted to estimating local projections with many controls. Random subspace methods have their roots in the machine learning literature and are implemented by averaging over regressions estimated over different combinations of subsets of these controls. We document three key results: (i) Our approach can successfully recover the impulse response functions across Monte Carlo experiments representative of different macroeconomic settings and identification schemes. (ii) Our results suggest that random subspace methods are more accurate than other dimension reduction methods if the underlying large dataset has a factor structure similar to typical macroeconomic datasets such as FRED-MD. (iii) Our approach leads to differences in the estimated impulse response functions relative to benchmark methods when applied to two widely studied empirical applications.


title: Uni-ISP: Unifying the Learning of ISPs from Multiple Cameras

abstract: Modern end-to-end image signal processors (ISPs) can learn complex mappings from RAW/XYZ data to sRGB (or inverse), opening new possibilities in image processing. However, as the diversity of camera models continues to expand, developing and maintaining individual ISPs is not sustainable in the long term, which inherently lacks versatility, hindering the adaptability to multiple camera models. In this paper, we propose a novel pipeline, Uni-ISP, which unifies the learning of ISPs from multiple cameras, offering an accurate and versatile processor to multiple camera models. The core of Uni-ISP is leveraging device-aware embeddings through learning inverse/forward ISPs and its special training scheme. By doing so, Uni-ISP not only improves the performance of inverse/forward ISPs but also unlocks a variety of new applications inaccessible to existing learned ISPs. Moreover, since there is no dataset synchronously captured by multiple cameras for training, we construct a real-world 4K dataset, FiveCam, comprising more than 2,400 pairs of sRGB-RAW images synchronously captured by five smartphones. We conducted extensive experiments demonstrating Uni-ISP's accuracy in inverse/forward ISPs (with improvements of +1.5dB/2.4dB PSNR), its versatility in enabling new applications, and its adaptability to new camera models.


title: Pt nanoparticles dispersed in a metal-organic framework as peroxidase mimics for colorimetric detection of GSH

abstract: Metal-organic skeleton materials have been widely used in catalysis with their porous structure and adsorption properties. Precious metal nanoparticles have good catalytic properties. If the noble metal nanoparticles are adsorbed on the MOFs surface, the active sites can be increased and the catalytic effect of the materials can be greatly improved. We successfully synthesized Pt@ZIF-8 in two steps, the average particle size of Pt nanoparticles is about 3 nm. Pt@ZIF-8 possesses peroxidase activity and can oxidize colorless TMB to oxTMB in the presence of hydrogen peroxide. The peroxide-like nature of Pt@ZIF-8 is consistent with Michaelis-Menten kinetics. Glutathione is a reducing substance that reduces blue oxTMB to colorless oxTMB. This colorimetric method achieves a simple, sensitive and intuitive detection of glutathione. The detection limit of this experiment is low, which is promising in biomolecular detection.


title: Transfer Matrix Approach for Topological Edge States

abstract: We suggest and develop a novel approach for describing topological properties of a periodic system purely from the transfer matrix associated to a unit cell. This approach is employed to obtain a simple pictorial proof of the Zak phase bulk-edge correspondence for any one dimensional system. We apply the transfer matrix method to study some generalisations of the Su-Schrieffer-Heeger (SSH) model, such as the tetramer SSH4 model and a dimerised one-dimensional photonic crystal.


title: SemCoder: Training Code Language Models with Comprehensive Semantics

abstract: Code Large Language Models (Code LLMs) have excelled at tasks like code completion but often miss deeper semantics such as execution effects and dynamic states. This paper aims to bridge the gap between Code LLMs' reliance on static text data and the need for thorough semantic understanding for complex tasks like debugging and program repair. We introduce a novel strategy to train Code LLMs with comprehensive semantics, encompassing high-level functional descriptions, local execution effects of individual statements, and overall input/output behavior, thereby linking static code text with dynamic execution states. We begin by collecting PyX, a clean code corpus of fully executable samples with functional descriptions and execution tracing. We propose training Code LLMs to write code and represent and reason about execution behaviors using natural language, mimicking human verbal debugging. This approach led to the development of SemCoder, a Code LLM with only 6.7B parameters, which shows competitive performance with GPT-3.5-turbo on code generation and execution reasoning tasks. SemCoder achieves 81.1% on HumanEval (GPT-3.5-turbo: 76.8%) and 54.5% on CRUXEval-I (GPT-3.5-turbo: 50.3%). We also study the effectiveness of SemCoder's monologue-style execution reasoning compared to concrete scratchpad reasoning, showing that our approach integrates semantics from multiple dimensions more smoothly. Finally, we demonstrate the potential of applying learned semantics to improve Code LLMs' debugging and self-refining capabilities.


title: Measurement of Electron Antineutrino Oscillation Amplitude and Frequency via Neutron Capture on Hydrogen at Daya Bay

abstract: This Letter reports the first measurement of the oscillation amplitude and frequency of reactor antineutrinos at Daya Bay via neutron capture on hydrogen using 1958 days of data. With over 3.6 million signal candidates, an optimized candidate selection, improved treatment of backgrounds and efficiencies, refined energy calibration, and an energy response model for the capture-on-hydrogen sensitive region, the relative $\overline{\nu}_{e}$ rates and energy spectra variation among the near and far detectors gives $\mathrm{sin}^22\theta_{13} = 0.0759_{-0.0049}^{+0.0050}$ and $\Delta m^2_{32} = (2.72^{+0.14}_{-0.15})\times10^{-3}$ eV$^2$ assuming the normal neutrino mass ordering, and $\Delta m^2_{32} = (-2.83^{+0.15}_{-0.14})\times10^{-3}$ eV$^2$ for the inverted neutrino mass ordering. This estimate of $\sin^2 2\theta_{13}$ is consistent with and essentially independent from the one obtained using the capture-on-gadolinium sample at Daya Bay. The combination of these two results yields $\mathrm{sin}^22\theta_{13}= 0.0833\pm0.0022$, which represents an 8% relative improvement in precision regarding the Daya Bay full 3158-day capture-on-gadolinium result.


title: Separability in B\"uchi Vass and Singly Non-Linear Systems of Inequalities

abstract: The omega-regular separability problem for B\"uchi VASS coverability languages has recently been shown to be decidable, but with an EXPSPACE lower and a non-primitive recursive upper bound -- the exact complexity remained open. We close this gap and show that the problem is EXPSPACE-complete. A careful analysis of our complexity bounds additionally yields a PSPACE procedure in the case of fixed dimension >= 1, which matches a pre-established lower bound of PSPACE for one dimensional B\"uchi VASS. Our algorithm is a non-deterministic search for a witness whose size, as we show, can be suitably bounded. Part of the procedure is to decide the existence of runs in VASS that satisfy certain non-linear properties. Therefore, a key technical ingredient is to analyze a class of systems of inequalities where one variable may occur in non-linear (polynomial) expressions. These so-called singly non-linear systems (SNLS) take the form A(x).y >= b(x), where A(x) and b(x) are a matrix resp. a vector whose entries are polynomials in x, and y ranges over vectors in the rationals. Our main contribution on SNLS is an exponential upper bound on the size of rational solutions to singly non-linear systems. The proof consists of three steps. First, we give a tailor-made quantifier elimination to characterize all real solutions to x. Second, using the root separation theorem about the distance of real roots of polynomials, we show that if a rational solution exists, then there is one with at most polynomially many bits. Third, we insert the solution for x into the SNLS, making it linear and allowing us to invoke standard solution bounds from convex geometry. Finally, we combine the results about SNLS with several techniques from the area of VASS to devise an EXPSPACE decision procedure for omega-regular separability of B\"uchi VASS.


title: Detour Monophonic Vertex Cover Pebbling Number (DMVCPN) of Some Standard Graphs

abstract: Let $G$ be a connected graph with vertex set $V(G)$ and edge set $E(G)$. Pebbling shift is a deletion of two pebbles from a vertex and a placement of one pebble at a neighbouring vertex. The vertex cover set, $D_{vc}$ for graph $G$ is the subset of $V(G)$ such that every edge in $G$ has at least one end in $D_{vc}$. A detour monophonic path is considered to be a longest chordless path between two non adjacent vertices $x$ and $y$. A detour monophonic vertex cover pebbling number, ${\mu}_{vc}(G),$ is a minimum number of pebbles required to cover all the vertices of the vertex cover set of $G$ with at least one pebble each on them after the transformation of pebbles by using detour monophonic paths. We determine the detour monophonic vertex cover pebbling number (DMVCPN) of the cycle, path, fan, and wheel graphs.


title: Joint Frame Structure, Beamwidth, and Power Allocation for UAV-Aided Localization and Communication

abstract: In wireless sensors networks, integrating localization and communications techniques is crucial for efficient spectrum and hardware utilization. In this paper, we present a novel framework of unmanned aerial vehicle (UAV)-aided localization and communication for ground node (GN), where the average spectral efficiency (SE) is used to reveal the intricate relationship among frame structure, channel estimation error, and localization accuracy. In particular, we first derive the lower bounds for channel estimation error and the three dimensional location prediction error. Leveraging these comprehensive analysis, we formulate a problem to maximize the average SE in UAV-GN communication, where the frame structure, beamwidth and power allocation are jointly optimized. Subsequently, we propose an efficient iterative algorithm to address this non-convex problem with closed-form expressions for beamwidth and power allocation. Numerical results demonstrate that the performance of our proposed method can approach the upper bound with much lower complexity, and achieve over 70\% performance gain compared to non-localization benchmarks. Additionally, the analysis highlights the dominant impacts from the Doppler effect over noise on the average SE.


title: Multi-Object Tracking based on Imaging Radar 3D Object Detection

abstract: Effective tracking of surrounding traffic participants allows for an accurate state estimation as a necessary ingredient for prediction of future behavior and therefore adequate planning of the ego vehicle trajectory. One approach for detecting and tracking surrounding traffic participants is the combination of a learning based object detector with a classical tracking algorithm. Learning based object detectors have been shown to work adequately on lidar and camera data, while learning based object detectors using standard radar data input have proven to be inferior. Recently, with the improvements to radar sensor technology in the form of imaging radars, the object detection performance on radar was greatly improved but is still limited compared to lidar sensors due to the sparsity of the radar point cloud. This presents a unique challenge for the task of multi-object tracking. The tracking algorithm must overcome the limited detection quality while generating consistent tracks. To this end, a comparison between different multi-object tracking methods on imaging radar data is required to investigate its potential for downstream tasks. The work at hand compares multiple approaches and analyzes their limitations when applied to imaging radar data. Furthermore, enhancements to the presented approaches in the form of probabilistic association algorithms are considered for this task.


title: Attention-based Iterative Decomposition for Tensor Product Representation

abstract: In recent research, Tensor Product Representation (TPR) is applied for the systematic generalization task of deep neural networks by learning the compositional structure of data. However, such prior works show limited performance in discovering and representing the symbolic structure from unseen test data because their decomposition to the structural representations was incomplete. In this work, we propose an Attention-based Iterative Decomposition (AID) module designed to enhance the decomposition operations for the structured representations encoded from the sequential input data with TPR. Our AID can be easily adapted to any TPR-based model and provides enhanced systematic decomposition through a competitive attention mechanism between input features and structured representations. In our experiments, AID shows effectiveness by significantly improving the performance of TPR-based prior works on the series of systematic generalization tasks. Moreover, in the quantitative and qualitative evaluations, AID produces more compositional and well-bound structural representations than other works.


title: Scalable Ensembling For Mitigating Reward Overoptimisation

abstract: Reinforcement Learning from Human Feedback (RLHF) has enabled significant advancements within language modeling for powerful, instruction-following models. However, the alignment of these models remains a pressing challenge as the policy tends to overfit the learned ``proxy" reward model past an inflection point of utility as measured by a ``gold" reward model that is more performant -- a phenomenon known as overoptimisation. Prior work has mitigated this issue by computing a pessimistic statistic over an ensemble of reward models, which is common in Offline Reinforcement Learning but incredibly costly for language models with high memory requirements, making such approaches infeasible for sufficiently large models. To this end, we propose using a shared encoder but separate linear heads. We find this leads to similar performance as the full ensemble while allowing tremendous savings in memory and time required for training for models of similar size.


title: Mobile-Agent-v2: Mobile Device Operation Assistant with Effective Navigation via Multi-Agent Collaboration

abstract: Mobile device operation tasks are increasingly becoming a popular multi-modal AI application scenario. Current Multi-modal Large Language Models (MLLMs), constrained by their training data, lack the capability to function effectively as operation assistants. Instead, MLLM-based agents, which enhance capabilities through tool invocation, are gradually being applied to this scenario. However, the two major navigation challenges in mobile device operation tasks, task progress navigation and focus content navigation, are significantly complicated under the single-agent architecture of existing work. This is due to the overly long token sequences and the interleaved text-image data format, which limit performance. To address these navigation challenges effectively, we propose Mobile-Agent-v2, a multi-agent architecture for mobile device operation assistance. The architecture comprises three agents: planning agent, decision agent, and reflection agent. The planning agent generates task progress, making the navigation of history operations more efficient. To retain focus content, we design a memory unit that updates with task progress. Additionally, to correct erroneous operations, the reflection agent observes the outcomes of each operation and handles any mistakes accordingly. Experimental results indicate that Mobile-Agent-v2 achieves over a 30% improvement in task completion compared to the single-agent architecture of Mobile-Agent. The code is open-sourced at https://github.com/X-PLUG/MobileAgent.


title: Regularity of the semigroup of transformations preserving a length

abstract: Let $X_n = \{1,2,\dots,n\}$ be a finite set $(n\geq 2)$ and $T_n$ the full transformation semigroup on $X_n$. For a positive integer $l\leq n-1$, we define $$T_n(l) = \{\alpha\in T_n \colon \forall x,y\in X_n,\, |x-y| = l \;\Rightarrow\; |x\alpha - y\alpha| = l\}$$ and $$T^*_n(l) = \{\alpha\in T_n \colon \forall x,y\in X_n,\, |x-y| = l \;\Leftrightarrow\; |x\alpha - y\alpha| = l\}.$$ Then $T_n(l)$ and $T^*_n(l)$ are subsemigroups of $T_n$. In this paper, we give a necessary and sufficient condition for $T_n(l)$ to be regular. Moreover, we prove that $T^*_n(l)$ is a regular semigroup.


title: Sensing, Communication, and Control Co-design for Energy Efficient Satellite-UAV Networks

abstract: Traditional terrestrial communication infrastructures often fail to collect the timely information from Internet of Thing (IoT) devices in remote areas. To address this challenge, we investigate a Satellite-unmanned aerial vehicles (UAV) integrated Non-terrestrial network (NTN), where the UAV is controlled by remote control center via UAV-to-Satellite connections. To maximize the energy efficiency (EE) of the UAV, we optimize the UAV trajectory, power allocation, and state sensing strategies, while guaranteing the control stability and communication reliability. This challenging problem is addressed using an efficient algorithm, incorporating a Deep Q-Network (DQN)-based trajectory determination, a closed form of power allocation, and one-dimensional searching for sensing. Numerical simulations are conducted to validate the effectiveness of our approach. The results showcase the data size of collection has a greater impact than transmission power, and reveal the relationship among sensing interval, communication maximum power and control performance. This study provides promising solutions and valuable insights for efficient data collection in remote IoT.


title: Neural Quantum States in Variational Monte Carlo Method: A Brief Summary

abstract: In this note, variational Monte Carlo method based on neural quantum states for spin systems is reviewed. Using a neural network as the wave function allows for a more generalized expression of various types of interactions, including highly non-local interactions, which are closely related to its non-linear activation functions. Additionally, neural networks can represent relatively complex wave functions with relatively small computational resources when dealing with higher-dimensional systems, which is undoubtedly a "flattening" advantage. In quantum-state tomography, the representation method of neural quantum states has already achieved significant results, hinting at its potential in handling larger-sized systems.


title: Accent Conversion in Text-To-Speech Using Multi-Level VAE and Adversarial Training

abstract: With rapid globalization, the need to build inclusive and representative speech technology cannot be overstated. Accent is an important aspect of speech that needs to be taken into consideration while building inclusive speech synthesizers. Inclusive speech technology aims to erase any biases towards specific groups, such as people of certain accent. We note that state-of-the-art Text-to-Speech (TTS) systems may currently not be suitable for all people, regardless of their background, as they are designed to generate high-quality voices without focusing on accent. In this paper, we propose a TTS model that utilizes a Multi-Level Variational Autoencoder with adversarial learning to address accented speech synthesis and conversion in TTS, with a vision for more inclusive systems in the future. We evaluate the performance through both objective metrics and subjective listening tests. The results show an improvement in accent conversion ability compared to the baseline.


title: Simple derivations in two variables

abstract: $ $Let $k$ be a field of characteristic zero. If $c_1, c_2\in k\setminus \{0\}, s,t\geq 1$ and $u\geq 0$, then it is shown that the $k$-derivations $\partial_x + x^u(c_1x^ty^s+c_2)\partial_y$ and $\partial_x + x^u(c_1x^t+c_2y^{s+1})\partial_y$ of $k[x,y]$ are simple. We also give a necessary and sufficient condition for the $k$-derivation $y^r\partial_x + (c_1x^{t_1}y^{s_1}+c_2x^{t_2}y^{s_2})\partial_y$, where $r, t_1, s_1, t_2, s_2 \geq 0$ and $c_1, c_2\in k$, of $k[x,y]$ to be simple.


title: CLIP-Guided Attribute Aware Pretraining for Generalizable Image Quality Assessment

abstract: In no-reference image quality assessment (NR-IQA), the challenge of limited dataset sizes hampers the development of robust and generalizable models. Conventional methods address this issue by utilizing large datasets to extract rich representations for IQA. Also, some approaches propose vision language models (VLM) based IQA, but the domain gap between generic VLM and IQA constrains their scalability. In this work, we propose a novel pretraining framework that constructs a generalizable representation for IQA by selectively extracting quality-related knowledge from VLM and leveraging the scalability of large datasets. Specifically, we carefully select optimal text prompts for five representative image quality attributes and use VLM to generate pseudo-labels. Numerous attribute-aware pseudo-labels can be generated with large image datasets, allowing our IQA model to learn rich representations about image quality. Our approach achieves state-of-the-art performance on multiple IQA datasets and exhibits remarkable generalization capabilities. Leveraging these strengths, we propose several applications, such as evaluating image generation models and training image enhancement models, demonstrating our model's real-world applicability. We will make the code available for access.


title: Combining Qualitative and Computational Approaches for Literary Analysis of Finnish Novels

abstract: What can we learn from the classics of Finnish literature by using computational emotion analysis? This article tries to answer this question by examining how computational methods of sentiment analysis can be used in the study of literary works in conjunction with a qualitative or more 'traditional' approach to literature and affect. We present and develop a simple but robust computational approach of affect analysis that uses a carefully curated emotion lexicon adapted to Finnish turn-of-the-century literary texts combined with word embeddings to map out the semantic emotional spaces of seminal works of Finnish literature. We focus our qualitative analysis on selected case studies: four works by Juhani Aho, Minna Canth, Maria Jotuni, and F. E. Sillanp\"a\"a, but provide emotion arcs for a total of 975 Finnish novels. We argue that a computational analysis of a text's lexicon can be valuable in evaluating the large distribution of the emotional valence in a text and provide guidelines to help other researchers replicate our findings. We show that computational approaches have a place in traditional studies on affect in literature as a support tool for close-reading-based analyses, but also allowing for large-scale comparison between, for example, genres or national canons.


title: Poisoning Attacks and Defenses in Recommender Systems: A Survey

abstract: Modern recommender systems (RS) have profoundly enhanced user experience across digital platforms, yet they face significant threats from poisoning attacks. These attacks, aimed at manipulating recommendation outputs for unethical gains, exploit vulnerabilities in RS through injecting malicious data or intervening model training. This survey presents a unique perspective by examining these threats through the lens of an attacker, offering fresh insights into their mechanics and impacts. Concretely, we detail a systematic pipeline that encompasses four stages of a poisoning attack: setting attack goals, assessing attacker capabilities, analyzing victim architecture, and implementing poisoning strategies. The pipeline not only aligns with various attack tactics but also serves as a comprehensive taxonomy to pinpoint focuses of distinct poisoning attacks. Correspondingly, we further classify defensive strategies into two main categories: poisoning data filtering and robust training from the defender's perspective. Finally, we highlight existing limitations and suggest innovative directions for further exploration in this field.


title: Noise And Artifacts Elimination In ECG Signals Using Wavelet, Variational Mode Decomposition And Nonlocal Means Algorithm

abstract: Electrocardiogram (ECG) signals can frequently be affected by the introduction of noise and artifacts. Since these types of signal corruptions disrupt the accurate interpretation of ECG signals, noise and artifacts must be eliminated during the preprocessing phase. In this paper, we introduced a comprehensive pre-processing phase that eliminates motion artifacts and noise prior to detecting and extracting entirely corrupted ECG signal segments. The first method, denoted as the WLNH method, is constructed using wavelet multiresolution analysis (MRA), the Lillifors test, NLM, and a high-pass filter. The second method entails substituting the wavelet MRA decomposition with the variational mode decomposition (VMD) while retaining all other stages from the first method. This technique is denoted as the VLWNH. The two proposed methods differ from some existing methods in that they first employ the Lilliefors test to identify whether a component is white Gaussian noise and then utilize the High Pass Filter to eliminate motion anomalies. The simulation results show that the offered solutions are effective, particularly when dealing with white Gaussian noise and base-line wander (BW) noise.


title: Gravitational disturbance on asteroidal ring systems by close encounter with a small object

abstract: To date, rings are found around a Centaur (10199) Chariklo, trans-neptunian objects (TNOs) (136108) Haumea, and (50000) Quaoar. These discoveries suggest that asteroidal ring systems may be common, particularly in the outer solar system. Since collisions are a ubiquitous and fundamental evolutionary process throughout the solar system, we conjecture that asteroidal ring systems must have experienced close encounters with small objects as part of their evolutionary process. Here, we investigate the response of ring systems when they experience gravitational disturbance by a close encounter with another small object, by calculating the change in eccentricity and the fraction of lost ring particles. We find that a perturber needs to be as massive as or more massive than the ringed object, and needs to pass in the immediate vicinity of the ring in order to cause significant disruption. The change in eccentricity expected for Chariklo's inner ring and Quaoar's outer ring agrees with the analytical expression derived from the impulse approximation, while that for Haumea's ring agrees with the analytical expression called "exponential regime". If we define a lifetime of a ring as the mean time to experience disruptive close encounters that can raise the eccentricity of ring particles greater than 0.1, the lifetime for ring systems around Chariklo, Haumea, and Quaoar are >10^4 Gyr. We conclude that ring systems around Chariklo, Haumea, and Quaoar are highly unlikely to suffer from close encounters with another small object even if those systems are as old as 4 Gyr. We also find that the lifetime is shorter for smaller ringed objects, and it still exceeds 4 Gyr for km-sized ringed objects in the outer solar system. Therefore, regardless of the size of ringed objects, asteroidal ring systems in the outer solar system are unlikely to suffer severe damage by close encounter with a small object.


title: Khayyam Offline Persian Handwriting Dataset

abstract: Handwriting analysis is still an important application in machine learning. A basic requirement for any handwriting recognition application is the availability of comprehensive datasets. Standard labelled datasets play a significant role in training and evaluating learning algorithms. In this paper, we present the Khayyam dataset as another large unconstrained handwriting dataset for elements (words, sentences, letters, digits) of the Persian language. We intentionally concentrated on collecting Persian word samples which are rare in the currently available datasets. Khayyam's dataset contains 44000 words, 60000 letters, and 6000 digits. Moreover, the forms were filled out by 400 native Persian writers. To show the applicability of the dataset, machine learning algorithms are trained on the digits, letters, and word data and results are reported. This dataset is available for research and academic use.


title: Strengthened Symbol Binding Makes Large Language Models Reliable Multiple-Choice Selectors

abstract: Multiple-Choice Questions (MCQs) constitute a critical area of research in the study of Large Language Models (LLMs). Previous works have investigated the selection bias problem in MCQs within few-shot scenarios, in which the LLM's performance may be influenced by the presentation of answer choices, leaving the selection bias during Supervised Fine-Tuning (SFT) unexplored. In this paper, we reveal that selection bias persists in the SFT phase , primarily due to the LLM's inadequate Multiple Choice Symbol Binding (MCSB) ability. This limitation implies that the model struggles to associate the answer options with their corresponding symbols (e.g., A/B/C/D) effectively. To enhance the model's MCSB capability, we first incorporate option contents into the loss function and subsequently adjust the weights of the option symbols and contents, guiding the model to understand the option content of the current symbol. Based on this, we introduce an efficient SFT algorithm for MCQs, termed Point-wise Intelligent Feedback (PIF). PIF constructs negative instances by randomly combining the incorrect option contents with all candidate symbols, and proposes a point-wise loss to provide feedback on these negative samples into LLMs. Our experimental results demonstrate that PIF significantly reduces the model's selection bias by improving its MCSB capability. Remarkably, PIF exhibits a substantial enhancement in the accuracy for MCQs.


title: PRICE: A Pretrained Model for Cross-Database Cardinality Estimation

abstract: Cardinality estimation (CardEst) is essential for optimizing query execution plans. Recent ML-based CardEst methods achieve high accuracy but face deployment challenges due to high preparation costs and lack of transferability across databases. In this paper, we propose PRICE, a PRetrained multI-table CardEst model, which addresses these limitations. PRICE takes low-level but transferable features w.r.t. data distributions and query information and elegantly applies self-attention models to learn meta-knowledge to compute cardinality in any database. It is generally applicable to any unseen new database to attain high estimation accuracy, while its preparation cost is as little as the basic one-dimensional histogram-based CardEst methods. Moreover, PRICE can be finetuned to further enhance its performance on any specific database. We pretrained PRICE using 30 diverse datasets, completing the process in about 5 hours with a resulting model size of only about 40MB. Evaluations show that PRICE consistently outperforms existing methods, achieving the highest estimation accuracy on several unseen databases and generating faster execution plans with lower overhead. After finetuning with a small volume of databasespecific queries, PRICE could even find plans very close to the optimal ones. Meanwhile, PRICE is generally applicable to different settings such as data updates, data scaling, and query workload shifts. We have made all of our data and codes publicly available at https://github.com/StCarmen/PRICE.


title: LLEMamba: Low-Light Enhancement via Relighting-Guided Mamba with Deep Unfolding Network

abstract: Transformer-based low-light enhancement methods have yielded promising performance by effectively capturing long-range dependencies in a global context. However, their elevated computational demand limits the scalability of multiple iterations in deep unfolding networks, and hence they have difficulty in flexibly balancing interpretability and distortion. To address this issue, we propose a novel Low-Light Enhancement method via relighting-guided Mamba with a deep unfolding network (LLEMamba), whose theoretical interpretability and fidelity are guaranteed by Retinex optimization and Mamba deep priors, respectively. Specifically, our LLEMamba first constructs a Retinex model with deep priors, embedding the iterative optimization process based on the Alternating Direction Method of Multipliers (ADMM) within a deep unfolding network. Unlike Transformer, to assist the deep unfolding framework with multiple iterations, the proposed LLEMamba introduces a novel Mamba architecture with lower computational complexity, which not only achieves light-dependent global visual context for dark images during reflectance relight but also optimizes to obtain more stable closed-form solutions. Experiments on the benchmarks show that LLEMamba achieves superior quantitative evaluations and lower distortion visual results compared to existing state-of-the-art methods.


title: CYCLO: Cyclic Graph Transformer Approach to Multi-Object Relationship Modeling in Aerial Videos

abstract: Video scene graph generation (VidSGG) has emerged as a transformative approach to capturing and interpreting the intricate relationships among objects and their temporal dynamics in video sequences. In this paper, we introduce the new AeroEye dataset that focuses on multi-object relationship modeling in aerial videos. Our AeroEye dataset features various drone scenes and includes a visually comprehensive and precise collection of predicates that capture the intricate relationships and spatial arrangements among objects. To this end, we propose the novel Cyclic Graph Transformer (CYCLO) approach that allows the model to capture both direct and long-range temporal dependencies by continuously updating the history of interactions in a circular manner. The proposed approach also allows one to handle sequences with inherent cyclical patterns and process object relationships in the correct sequential order. Therefore, it can effectively capture periodic and overlapping relationships while minimizing information loss. The extensive experiments on the AeroEye dataset demonstrate the effectiveness of the proposed CYCLO model, demonstrating its potential to perform scene understanding on drone videos. Finally, the CYCLO method consistently achieves State-of-the-Art (SOTA) results on two in-the-wild scene graph generation benchmarks, i.e., PVSG and ASPIRe.


title: Neutrino observables in gauged $U(1)_{L_\alpha-L_\beta}$ models with two Higgs doublet and one singlet scalars

abstract: We discuss neutrino sector in models with two Higgs doublet and one singlet scalar fields under local $U(1)_{L_\alpha- L_\beta}$ symmetry. A neutrino mass matrix is formulated for these models where the matrix is generated via type-I seesaw mechanism introducing right-handed neutrinos. The neutrino mass matrix has more degrees of freedom compared to minimal scenarios which have only one new scalar field, but its structure is still restricted by the symmetry. Then it is find that sum of neutrino mass can be lower than minimal scenarios and it is easier to satisfy observed constraints. In addition, we can fit neutrino data for $U(1)_{L_e - L_{\mu(\tau)}}$ cases which are disfavored in minimal models. Furthermore, some correlations among sum of neutrino mass and CP violating phases are still found although we have more free parameters.


title: Geometric constellation shaping for wireless optical intensity channels

abstract: A simple geometric shaping method is proposed for optical wireless communication systems based on intensity modulation and direct detection (IM/DD). Constellations consisting of equiprobable levels with exponential-like distribution are obtained. The method possesses asymptotic optimality in the sense that the high-SNR channel capacity can be approached by such constellations with increasing size. By an additional quantization step, all $2^b$ levels ($b \in \mathbb N$) of the obtained constellation can be represented by a basic level and $b+2$ bits, thereby reducing the required resolution of the digital-to-analog converter (DAC) without affecting the asymptotic optimality. Achievable information rate evaluations verify the asymptotic optimality of the proposed method. As an example, error performance results of a simple 16-level LDPC coded modulation scheme show that a shaping gain of 0.8 dB can be obtained by applying the proposed constellation design.


title: LLM and GNN are Complementary: Distilling LLM for Multimodal Graph Learning

abstract: Recent progress in Graph Neural Networks (GNNs) has greatly enhanced the ability to model complex molecular structures for predicting properties. Nevertheless, molecular data encompasses more than just graph structures, including textual and visual information that GNNs do not handle well. To bridge this gap, we present an innovative framework that utilizes multimodal molecular data to extract insights from Large Language Models (LLMs). We introduce GALLON (Graph Learning from Large Language Model Distillation), a framework that synergizes the capabilities of LLMs and GNNs by distilling multimodal knowledge into a unified Multilayer Perceptron (MLP). This method integrates the rich textual and visual data of molecules with the structural analysis power of GNNs. Extensive experiments reveal that our distilled MLP model notably improves the accuracy and efficiency of molecular property predictions.


title: Generalized Jersey Number Recognition Using Multi-task Learning With Orientation-guided Weight Refinement

abstract: Jersey number recognition (JNR) has always been an important task in sports analytics. Improving recognition accuracy remains an ongoing challenge because images are subject to blurring, occlusion, deformity, and low resolution. Recent research has addressed these problems using number localization and optical character recognition. Some approaches apply player identification schemes to image sequences, ignoring the impact of human body rotation angles on jersey digit identification. Accurately predicting the number of jersey digits by using a multi-task scheme to recognize each individual digit enables more robust results. Based on the above considerations, this paper proposes a multi-task learning method called the angle-digit refine scheme (ADRS), which combines human body orientation angles and digit number clues to recognize athletic jersey numbers. Based on our experimental results, our approach increases inference information, significantly improving prediction accuracy. Compared to state-of-the-art methods, which can only handle a single type of sport, the proposed method produces a more diverse and practical JNR application. The incorporation of diverse types of team sports such as soccer, football, basketball, volleyball, and baseball into our dataset contributes greatly to generalized JNR in sports analytics. Our accuracy achieves 64.07% on Top-1 and 89.97% on Top-2, with corresponding F1 scores of 67.46% and 90.64%, respectively.


title: FourierKAN-GCF: Fourier Kolmogorov-Arnold Network -- An Effective and Efficient Feature Transformation for Graph Collaborative Filtering

abstract: Graph Collaborative Filtering (GCF) has achieved state-of-the-art performance for recommendation tasks. However, most GCF structures simplify the feature transformation and nonlinear operation during message passing in the graph convolution network (GCN). We revisit these two components and discover that a part of feature transformation and nonlinear operation during message passing in GCN can improve the representation of GCF, but increase the difficulty of training. In this work, we propose a simple and effective graph-based recommendation model called FourierKAN-GCF. Specifically, it utilizes a novel Fourier Kolmogorov-Arnold Network (KAN) to replace the multilayer perceptron (MLP) as a part of the feature transformation during message passing in GCN, which improves the representation power of GCF and is easy to train. We further employ message dropout and node dropout strategies to improve the representation power and robustness of the model. Extensive experiments on two public datasets demonstrate the superiority of FourierKAN-GCF over most state-of-the-art methods. The implementation code is available at https://github.com/Jinfeng-Xu/FKAN-GCF.


title: Explicit inverse of symmetric, tridiagonal near Toeplitz matrices with strictly diagonally dominant Toeplitz part

abstract: This study investigates tridiagonal near-Toeplitz matrices in which the Toeplitz part is strictly diagonally dominant. The focus is on determining the exact inverse of these matrices and establishing upper bounds for the infinite norms of the inverse matrices. For cases with $b > 2$ and $b < -2$, we derive the compact form of the entries of the exact inverse. These results remain valid even when the matrices' corners are not diagonally dominant, specifically when $|\widetilde{b}| < 1$. Furthermore, we calculate the traces and row sums of the inverse matrices. Afterwards, we present upper bound theorems for the infinite norms of the inverse matrices. To demonstrate the effectiveness of the bounds and their application, we provide numerical results for solving Fisher's problem. Our findings reveal that the converging rates of fixed-point iterations closely align with the expected rates, and there is minimal disparity between the upper bounds and infinite norm of the inverse matrix. Specifically, this observation holds true when $b > 2$ with $\widetilde{b} \leq 1$ and $b < -2$ with $\widetilde{b} \geq -1$. For other cases, there is potential for further improvement in the obtained upper bounds. This study contributes to the field of numerical analysis of fixed-point iterations by improving the convergence rate of iterations and reducing the computing time of the inverse matrices.


title: Remarks on the geometric structure of port-Hamiltonian systems

abstract: We study the geometric structure of port-Hamiltonian systems. Starting with the intuitive understanding that port-Hamiltonian systems are "in between" certain closed Hamiltonian systems, the geometric structure of port-Hamiltonian systems must be "in between" the geometric structures of the latter systems. These are Courant algebroids; and hence the geometric structures should be related by Courant algebroid morphisms. Using this idea, we propose a definition of an intrinsic geometric structure and show that it is unique, if it exists.


title: Engineering second-order topological insulators via coupling two first-order topological insulators

abstract: We theoretically investigate the engineering of two-dimensional second-order topological insulators with corner states by coupling two first-order topological insulators. We find that the interlayer coupling between two topological insulators with opposite topological invariants results in the formation of edge-state gaps, which are essential for the emergence of the corner states. Using the effective Hamiltonian framework, We elucidate that the formation of topological corner states requires either the preservation of symmetry in the crystal system or effective mass countersigns for neighboring edge states. Our proposed strategy for inducing corner state through interlayer coupling is versatile and applicable to both $\mathbb{Z}_2$ topological insulators and quantum anomalous Hall effects. We demonstrate this approach using several representative models including the seminal Kane-Mele model, the Bernevig-Hughes-Zhang model, and the Rashba graphene model to explicitly exhibit the formation of corner states via interlater coupling. Moreover, we also observe that the stacking of the coupled $\mathbb{Z}_2$ topological insulating systems results in the formation of the time-reversal invariant three-dimensional second-order nodal ring semimetals. Remarkably, the three-dimensional system from the stacking of the Bernevig-Hughes-Zhang model can be transformed into second-order Dirac semimetals, characterized by one-dimensional hinge Fermi arcs. Our strategy of engineering second-order topological phases via simple interlayer coupling promises to advance the exploration of higher-order topological insulators in two-dimensional spinful systems.


title: Dynamical clustering and wetting phenomena in inertial active matter

abstract: Dynamical clustering represents a characteristic feature of active matter consisting of self-propelled agents that convert energy from the environment into mechanical motion. At the micron scale, typical of overdamped dynamics, particles with opposite motility block each other and show transient dynamical arrest that can induce cluster nucleation and motility-induced phase separation. However, for macroscopic agents, inertia plays a leading role, and clustering is strongly affected by bounce-back effects during collisions that could inhibit cluster growth. Here we present an experiment on the clustering of active granular particles, in which inertia can be systematically tuned. A plethora of new phenomena impacted severely by inertia is presented. Clusters display an inertia-induced transition from liquid-like to crystal-like inner structures that is accompanied by the suppression of cluster nucleation at system boundaries due to particle inertia. In contrast to microswimmers, where active particles wet the boundary by primarily forming clusters attached to the container walls, in an underdamped inertial active system, walls do not favor cluster formation and effectively annihilate motility-induced wetting phenomena.


title: Time Dependent Density Functional Theory calculations of the optical properties of charge-transfer complexes

abstract: Charge transfer complexes are materials with a wide range of interesting optical and electronic properties. They have seen a great deal of research over the past decade, both in device development as well as research to elucidate the underlying mechanisms of charge transfer and transport. Here we present time dependent density-functional theory (TD-DFT) calculations of the energy levels of the donor-acceptor complexes perylene-TCNQ (7,7,8,8-tetracyanoquinodimethane) and hexamethylbenzene-chloranil. The calculations show a good match to the experimentally measured optical absorption spectra, and indicate that low energy CT absorption bands appear at the dimer/tetramer stage of cocrystal formation. We also report the degree of charge transfer for these complexes in various stoichiometries and compare them.


title: Synthetic Data Generation for 3D Myocardium Deformation Analysis

abstract: Accurate analysis of 3D myocardium deformation using high-resolution computerized tomography (CT) datasets with ground truth (GT) annotations is crucial for advancing cardiovascular imaging research. However, the scarcity of such datasets poses a significant challenge for developing robust myocardium deformation analysis models. To address this, we propose a novel approach to synthetic data generation for enriching cardiovascular imaging datasets. We introduce a synthetic data generation method, enriched with crucial GT 3D optical flow annotations. We outline the data preparation from a cardiac four-dimensional (4D) CT scan, selection of parameters, and the subsequent creation of synthetic data from the same or other sources of 3D cardiac CT data for training. Our work contributes to overcoming the limitations imposed by the scarcity of high-resolution CT datasets with precise annotations, thereby facilitating the development of accurate and reliable myocardium deformation analysis algorithms for clinical applications and diagnostics. Our code is available at: http://www.github.com/shaharzuler/cardio_volume_skewer


title: Compositions of Resolvents: Fixed Points Sets and Set of Cycles

abstract: In this paper, we investigate the cycles and fixed point sets of compositions of resolvents using Attouch Th\'era duality. We demonstrate that the cycles defined by the resolvent operators can be formulated in Hilbert space as the solution to a fixed point equation. Furthermore, we introduce the relationship between these cycles and the fixed point sets of the composition of resolvents.


title: Self-Calibrating 4D Novel View Synthesis from Monocular Videos Using Gaussian Splatting

abstract: Gaussian Splatting (GS) has significantly elevated scene reconstruction efficiency and novel view synthesis (NVS) accuracy compared to Neural Radiance Fields (NeRF), particularly for dynamic scenes. However, current 4D NVS methods, whether based on GS or NeRF, primarily rely on camera parameters provided by COLMAP and even utilize sparse point clouds generated by COLMAP for initialization, which lack accuracy as well are time-consuming. This sometimes results in poor dynamic scene representation, especially in scenes with large object movements, or extreme camera conditions e.g. small translations combined with large rotations. Some studies simultaneously optimize the estimation of camera parameters and scenes, supervised by additional information like depth, optical flow, etc. obtained from off-the-shelf models. Using this unverified information as ground truth can reduce robustness and accuracy, which does frequently occur for long monocular videos (with e.g. > hundreds of frames). We propose a novel approach that learns a high-fidelity 4D GS scene representation with self-calibration of camera parameters. It includes the extraction of 2D point features that robustly represent 3D structure, and their use for subsequent joint optimization of camera parameters and 3D structure towards overall 4D scene optimization. We demonstrate the accuracy and time efficiency of our method through extensive quantitative and qualitative experimental results on several standard benchmarks. The results show significant improvements over state-of-the-art methods for 4D novel view synthesis. The source code will be released soon at https://github.com/fangli333/SC-4DGS.


title: Generalized Young Measure Solutions for a Class of Quasilinear Parabolic Equations with Linear Growth

abstract: Using the generalized Young measure theory, we extend the theory of Young measure solutions to a class of quasilinear parabolic equations with linear growth, and introduce the concept of generalized Young measure solutions. We prove the existence and uniqueness of the generalized Young measure solutions. In addition, for the gradient flow of convex parabolic variational integral, we show that the generalized Young measure solutions are equivalent to the strong solutions.


title: Nuclear Medicine Artificial Intelligence in Action: The Bethesda Report (AI Summit 2024)

abstract: The 2nd SNMMI Artificial Intelligence (AI) Summit, organized by the SNMMI AI Task Force, took place in Bethesda, MD, on February 29 - March 1, 2024. Bringing together various community members and stakeholders, and following up on a prior successful 2022 AI Summit, the summit theme was: AI in Action. Six key topics included (i) an overview of prior and ongoing efforts by the AI task force, (ii) emerging needs and tools for computational nuclear oncology, (iii) new frontiers in large language and generative models, (iv) defining the value proposition for the use of AI in nuclear medicine, (v) open science including efforts for data and model repositories, and (vi) issues of reimbursement and funding. The primary efforts, findings, challenges, and next steps are summarized in this manuscript.


title: Decompose, Enrich, and Extract! Schema-aware Event Extraction using LLMs

abstract: Large Language Models (LLMs) demonstrate significant capabilities in processing natural language data, promising efficient knowledge extraction from diverse textual sources to enhance situational awareness and support decision-making. However, concerns arise due to their susceptibility to hallucination, resulting in contextually inaccurate content. This work focuses on harnessing LLMs for automated Event Extraction, introducing a new method to address hallucination by decomposing the task into Event Detection and Event Argument Extraction. Moreover, the proposed method integrates dynamic schema-aware augmented retrieval examples into prompts tailored for each specific inquiry, thereby extending and adapting advanced prompting techniques such as Retrieval-Augmented Generation. Evaluation findings on prominent event extraction benchmarks and results from a synthesized benchmark illustrate the method's superior performance compared to baseline approaches.


title: The Energy Budget in the Jet of High-frequency Peaked BL Lacertae Objects

abstract: Energy equipartition and the energy budget in the jet are import issues for the radiation mechanism of blazars. Early work predominantly concentrated on flat-spectrum radio quasars and a limited number of BL Lacertae objects (BL Lacs). In this paper, we compile 348 high-frequency peaked BL Lac objects (HBLs) based on the catalog of active galactic nuclei (4LAC-DR3) from Fermi-LAT, and employ \textit{JetSet} to fit the spectral energy distributions (SEDs) of these HBLs in the framework of the one-zone lepton model. We aim to determine whether the energy budget is reasonable and whether the energy equipartition is satisfied in HBLs. The results of the statistical analysis suggest that: (1) SEDs of HBLs can be reproduced well by using the one-zone lepton model; however it cannot achieve the energy equalization, and the relativistic electron energy density is far greater than the magnetic field energy density, $U_{e} \gtrsim100 U_{B}$; (2) the majority of the HBLs are located in the $t_{cool}$$<$$t_{dyn}$ region (where the horizontal coordinate represents the jet power of electrons, while the ordinate indicates the ratio between the dynamic time scale to the cooling timescale), and the jet kinetic power of HBLs is greater than the jet power of radiation; there is a very low radiation efficiency, we deduce that HBLs may have optically thin advection-dominated accretion flows; (3) the $\log\epsilon_{B}$ of HBLs is less than zero, which indicates that the jet kinetic power of HBLs is not affected by Poynting flux; (4) the relationships with $U_{e} >U_{Syn}\sim U_{B}$, $L_{e}\sim L_{p}>L_{B}\sim L_{rad}$ and $\log\epsilon_{e}>0.5$ are established. These relations indicate that most of the energy of HBLs is stored in the population of low-energy electrons.


title: An Advanced Reinforcement Learning Framework for Online Scheduling of Deferrable Workloads in Cloud Computing

abstract: Efficient resource utilization and perfect user experience usually conflict with each other in cloud computing platforms. Great efforts have been invested in increasing resource utilization but trying not to affect users' experience for cloud computing platforms. In order to better utilize the remaining pieces of computing resources spread over the whole platform, deferrable jobs are provided with a discounted price to users. For this type of deferrable jobs, users are allowed to submit jobs that will run for a specific uninterrupted duration in a flexible range of time in the future with a great discount. With these deferrable jobs to be scheduled under the remaining capacity after deploying those on-demand jobs, it remains a challenge to achieve high resource utilization and meanwhile shorten the waiting time for users as much as possible in an online manner. In this paper, we propose an online deferrable job scheduling method called \textit{Online Scheduling for DEferrable jobs in Cloud} (\OSDEC{}), where a deep reinforcement learning model is adopted to learn the scheduling policy, and several auxiliary tasks are utilized to provide better state representations and improve the performance of the model. With the integrated reinforcement learning framework, the proposed method can well plan the deployment schedule and achieve a short waiting time for users while maintaining a high resource utilization for the platform. The proposed method is validated on a public dataset and shows superior performance.


title: Comparison of 5G Performance Post-Merger between Two Network Operators Using Field Tests in Urban Areas

abstract: In late Q1/2023, DTAC and TRUE officially completed their merger. Consequently, this study was initiated to ascertain whether their respective 5G networks had been seamlessly integrated several months following the merger. The investigation involved conducting drive tests along two predefined routes within the urban areas of Bangkok, employing the G-NetTrack Pro tool for testing and data collection. Additionally, stationary tests were conducted in two crowded places using an application called Speedtest. Subsequently, an array of Quality of Service (QoS) metrics, including Reference Signal Received Power (RSRP), Reference Signal Received Quality (RSRQ), Signal to Noise Ratio (SNR), Download (DL), Upload (UL) speeds, and latency, were meticulously analyzed and presented. The findings of this study unveiled that, despite the successful completion of the DTAC and TRUE merger from a business standpoint, the technical integration of their respective 5G networks had not been finalized, although there were no significant differences between DTAC and TRUE for DL (p-value = 0.542) and UL (p-value = 0.090). Notably, significant differences were found between DTAC and TRUE for four metrics, including RSRP, RSRQ, SNR, and latency (p-values < 0.05). Remarkably, roaming functionalities were still operational between the two networks.


title: Searching For Music Mixing Graphs: A Pruning Approach

abstract: Music mixing is compositional -- experts combine multiple audio processors to achieve a cohesive mix from dry source tracks. We propose a method to reverse engineer this process from the input and output audio. First, we create a mixing console that applies all available processors to every chain. Then, after the initial console parameter optimization, we alternate between removing redundant processors and fine-tuning. We achieve this through differentiable implementation of both processors and pruning. Consequently, we find a sparse mixing graph that achieves nearly identical matching quality of the full mixing console. We apply this procedure to dry-mix pairs from various datasets and collect graphs that also can be used to train neural networks for music mixing applications.


title: Quiver Hecke algebras for Borcherds-Cartan datum II

abstract: We give the crystal structure of the Grothendieck group $G_0(R)$ of irreducible modules over the quiver Hecke algebra $R$ constructed in \cite{TW2023}. This leads to the categorification of the crystal $B(\infty)$ of the quantum Borcherds algebra $U_q(\mathscr g)$ and its irreducible highest weight crystal $B(\lambda)$ for arbitrary Borcherds-Cartan data. Additionally, we study the cyclotomic categorification of irreducible highest weight $U_q(\mathscr g)$-modules.


title: The Waldschmidt constant of special fat flat subschemes in $\mathbb{P}^N$]{The Waldschmidt constant of special fat flat subschemes in $\mathbb{P}^N$

abstract: The purpose of this paper is to construct some special kind of subschemes in $\mathbb{P}^N$ with $ N\ge 3$, which we call them "fat flat subschemes" and compute their Waldschmidt constants. These subschemes are constructed by adding, in a particular way, a finite number of linear subspaces of $\mathbb{P}^N$ of many different dimensions to a star configuration in $\mathbb{P}^N$, with arbitrary preassigned multiplicities to each one of these linear subspaces, as well as the star configuration. Among other things, it will be shown that for every positive integer $d$, there are infinitely many fat flat subschemes in $\mathbb{P}^N$ with the Waldschmidt constant equal to $d$. In addition to this, for any two integers $1\le a<b$, we also construct a fat flat subscheme of the above type in some projective space $\mathbb{P}^M$, which its Waldschmidt constant is equal to $b/a$. In addition to these, all non-reduced fat points subschemes $Z$ in $\mathbb{P}^2$ with the Waldschmidt constants less than $5/2$ are classified.


title: MACT: Model-Agnostic Cross-Lingual Training for Discourse Representation Structure Parsing

abstract: Discourse Representation Structure (DRS) is an innovative semantic representation designed to capture the meaning of texts with arbitrary lengths across languages. The semantic representation parsing is essential for achieving natural language understanding through logical forms. Nevertheless, the performance of DRS parsing models remains constrained when trained exclusively on monolingual data. To tackle this issue, we introduce a cross-lingual training strategy. The proposed method is model-agnostic yet highly effective. It leverages cross-lingual training data and fully exploits the alignments between languages encoded in pre-trained language models. The experiments conducted on the standard benchmarks demonstrate that models trained using the cross-lingual training method exhibit significant improvements in DRS clause and graph parsing in English, German, Italian and Dutch. Comparing our final models to previous works, we achieve state-of-the-art results in the standard benchmarks. Furthermore, the detailed analysis provides deep insights into the performance of the parsers, offering inspiration for future research in DRS parsing. We keep updating new results on benchmarks to the appendix.


title: Intrinsic conformal order revealed in geometrically confined long-range repulsive particles

abstract: Elucidating long-range interaction guided organization of matter is a fundamental question in physical systems covering multiple length scales. Here, based on the hexagonal disk model, we analyze the characteristic inhomogeneity created by long-range repulsions, and reveal the intrinsic conformal order in particle packings in mechanical equilibrium. Specifically, we highlight the delicate angle-preserved bending of the lattice to match the inhomogeneity condition. The revealed conformal order is found to be protected by the surrounding topological defects. These results advance our understanding on long-range interacting systems, and open the promising possibilities of using long-range forces to create particle packings not accessible by short-range forces, which may have practical consequences.


title: Confidence-Based Task Prediction in Continual Disease Classification Using Probability Distribution

abstract: Deep learning models are widely recognized for their effectiveness in identifying medical image findings in disease classification. However, their limitations become apparent in the dynamic and ever-changing clinical environment, characterized by the continuous influx of newly annotated medical data from diverse sources. In this context, the need for continual learning becomes particularly paramount, not only to adapt to evolving medical scenarios but also to ensure the privacy of healthcare data. In our research, we emphasize the utilization of a network comprising expert classifiers, where a new expert classifier is added each time a new task is introduced. We present CTP, a task-id predictor that utilizes confidence scores, leveraging the probability distribution (logits) of the classifier to accurately determine the task-id at inference time. Logits are adjusted to ensure that classifiers yield a high-entropy distribution for data associated with tasks other than their own. By defining a noise region in the distribution and computing confidence scores, CTP achieves superior performance when compared to other relevant continual learning methods. Additionally, the performance of CTP can be further improved by providing it with a continuum of data at the time of inference.


title: Requirements Quality Research Artifacts: Recovery, Analysis, and Management Guideline

abstract: Requirements quality research, which is dedicated to assessing and improving the quality of requirements specifications, is dependent on research artifacts like data sets (containing information about quality defects) and implementations (automatically detecting and removing these defects). However, recent research exposed that the majority of these research artifacts have become unavailable or have never been disclosed, which inhibits progress in the research domain. In this work, we aim to improve the availability of research artifacts in requirements quality research. To this end, we (1) extend an artifact recovery initiative, (2) empirically evaluate the reasons for artifact unavailability using Bayesian data analysis, and (3) compile a concise guideline for open science artifact disclosure. Our results include 10 recovered data sets and 7 recovered implementations, empirical support for artifact availability improving over time and the positive effect of public hosting services, and a pragmatic artifact management guideline open for community comments. With this work, we hope to encourage and support adherence to open science principles and improve the availability of research artifacts for the requirements research quality community.


title: Virtual avatar generation models as world navigators

abstract: We introduce SABR-CLIMB, a novel video model simulating human movement in rock climbing environments using a virtual avatar. Our diffusion transformer predicts the sample instead of noise in each diffusion step and ingests entire videos to output complete motion sequences. By leveraging a large proprietary dataset, NAV-22M, and substantial computational resources, we showcase a proof of concept for a system to train general-purpose virtual avatars for complex tasks in robotics, sports, and healthcare.


title: Knapsack with Vertex Cover, Set Cover, and Hitting Set

abstract: Given an undirected graph $\GG=(\VV,\EE)$, with vertex weights $(w(u))_{u\in\VV}$, vertex values $(\alpha(u))_{u\in\VV}$, a knapsack size $s$, and a target value $d$, the \vcknapsack problem is to determine if there exists a subset $\UU\subseteq\VV$ of vertices such that \UU forms a vertex cover, $w(\UU)=\sum_{u\in\UU} w(u) \le s$, and $\alpha(\UU)=\sum_{u\in\UU} \alpha(u) \ge d$. In this paper, we closely study the \vcknapsack problem and its variations, such as \vcknapsackbudget, \minimalvcknapsack, and \minimumvcknapsack, for both general graphs and trees. We first prove that the \vcknapsack problem belongs to the complexity class \NPC and then study the complexity of the other variations. We generalize the problem to \setc and \hs versions and design polynomial time $H_g$-factor approximation algorithm for the \setckp problem and d-factor approximation algorithm for \hstp using primal dual method. We further show that \setcks and \hsmb are hard to approximate in polynomial time. Additionally, we develop a fixed parameter tractable algorithm running in time $8^{\OO(\tw)}\cdot n\cdot {\sf min}\{s,d\}$ where $\tw,s,d,n$ are respectively treewidth of the graph, the size of the knapsack, the target value of the knapsack, and the number of items for the \minimalvcknapsack problem.