title: Adaptive Split Balancing for Optimal Random Forest

abstract: While random forests are commonly used for regression problems, existing methods often lack adaptability in complex situations or lose optimality under simple, smooth scenarios. In this study, we introduce the adaptive split balancing forest (ASBF), capable of learning tree representations from data while simultaneously achieving minimax optimality under the Lipschitz class. To exploit higher-order smoothness levels, we further propose a localized version that attains the minimax rate under the H\"older class $\mathcal{H}^{q,\beta}$ for any $q\in\mathbb{N}$ and $\beta\in(0,1]$. Rather than relying on the widely-used random feature selection, we consider a balanced modification to existing approaches. Our results indicate that an over-reliance on auxiliary randomness may compromise the approximation power of tree models, leading to suboptimal results. Conversely, a less random, more balanced approach demonstrates optimality. Additionally, we establish uniform upper bounds and explore the application of random forests in average treatment effect estimation problems. Through simulation studies and real-data applications, we demonstrate the superior empirical performance of the proposed methods over existing random forests.


title: Spin dynamics and dark particle in a weak-coupled quantum Ising ladder with $\mathcal{D}_8^{(1)}$ spectrum

abstract: Emergent Ising$_h^2$ integrability is anticipated in a quantum Ising ladder composed of two weakly coupled, critical transverse field Ising chains. This integrable system is remarkable for including eight types of massive relativistic particles, with their scattering matrix and spectrum characterized by the $\mathcal{D}_8^{(1)}$ Lie algebra. In this article we delve into the zero-temperature spin dynamics of this integrable quantum Ising ladder. By computing the dynamical structure factors from analytical form factor approach, we clearly identify dispersive single-particle excitations of (anti-) soliton and breathers as well as their multi-particle continua in the spin dynamical spectrum. We show that the selection rule to the form factor, which is inherent in the intrinsic charge-parity $\mathcal{C}$ of the Ising$_h^2$ particles as well as the local spin operators, causes a significant result that $\mathcal{C}$-odd particles, termed as dark particles, cannot be directly excited from the ground state through any local or quasi-local operations. Furthermore, the lightest dark particle is proposed to be generated and controlled through resonant absorption-resonant emission processes. The long lifetime of dark particle suggests its potential as a stable qubit for advancing quantum information technology.


title: Time-harmonic scattering by locally perturbed periodic structures with Dirichlet and Neumann boundary conditions

abstract: The paper is concerned with well-posedness of TE and TM polarizations of time-harmonic electromagnetic scattering by perfectly conducting periodic surfaces and periodically arrayed obstacles with local perturbations. The classical Rayleigh Expansion radiation condition does not always lead to well-posedness of the Helmholtz equation even in unperturbed periodic structures. We propose two equivalent radiation conditions to characterize the radiating behavior of time-harmonic wave fields incited by a source term in an open waveguide under impenetrable boundary conditions. With these open waveguide radiation conditions, uniqueness and existence of time-harmonic scattering by incoming point source waves, plane waves and surface waves from locally perturbed periodic structures are established under either the Dirichlet or Neumann boundary condition. A DtN operator without using the Green's function is constructed for proving well-posedness of perturbed scattering problems.


title: Enhancing Security in Blockchain Networks: Anomalies, Frauds, and Advanced Detection Techniques

abstract: Blockchain technology, a foundational distributed ledger system, enables secure and transparent multi-party transactions. Despite its advantages, blockchain networks are susceptible to anomalies and frauds, posing significant risks to their integrity and security. This paper offers a detailed examination of blockchain's key definitions and properties, alongside a thorough analysis of the various anomalies and frauds that undermine these networks. It describes an array of detection and prevention strategies, encompassing statistical and machine learning methods, game-theoretic solutions, digital forensics, reputation-based systems, and comprehensive risk assessment techniques. Through case studies, we explore practical applications of anomaly and fraud detection in blockchain networks, extracting valuable insights and implications for both current practice and future research. Moreover, we spotlight emerging trends and challenges within the field, proposing directions for future investigation and technological development. Aimed at both practitioners and researchers, this paper seeks to provide a technical, in-depth overview of anomaly and fraud detection within blockchain networks, marking a significant step forward in the search for enhanced network security and reliability.


title: 95 GeV light Higgs in the top-pair-associated diphoton channel at the LHC in the minimal dilaton model

abstract: Motivated by experimental hints and theoretical frameworks indicating the existence of an extended Higgs sector, we explore the feasibility of detecting a 95 GeV light Higgs boson decaying into a diphoton within the minimal dilaton model at the 14 TeV LHC. Initially, we identify the correlations between the production cross section, decay branching ratios, and model parameters, e.g., the scalar mixing angle $\sin\theta_S$. Subsequently, we utilize Monte Carlo simulations to generate the signal of the light Higgs boson via the $pp \to t\bar{t}(s\to \gamma\gamma)$ process, along with the corresponding backgrounds. To effectively separate the signal from the dominant backgrounds $tt\gamma\gamma$, we employ a meticulous cut-based selection process. Ultimately, we find that with an integrated luminosity of $L = 3000 {{~\rm fb}^{-1}}$, the regions of $|\sin\theta_S|>0.2$ can be covered over the $3\sigma$ level.


title: Asymptotics of the determinant of the modified Bessel functions and the second Painlev\'e equation

abstract: In the paper, we consider the extended Gross-Witten-Wadia unitary matrix model by introducing a logarithmic term in the potential. The partition function of the model can be expressed equivalently in terms of the Toeplitz determinant with the $(i,j)$-entry being the modified Bessel functions of order $i-j-\nu$, $\nu\in\mathbb{C}$. When the degree $n$ is finite, we show that the Toeplitz determinant is described by the isomonodromy $\tau$-function of the Painlev\'{e} III equation. As a double scaling limit, %In the double scaling limit as the degree $n\to\infty$, we establish an asymptotic approximation of the logarithmic derivative of the Toeplitz determinant, expressed in terms of the Hastings-McLeod solution of the inhomogeneous Painlev\'{e} II equation with parameter $\nu+\frac{1}{2}$. The asymptotics of the leading coefficient and recurrence coefficient of the associated orthogonal polynomials are also derived. We obtain the results by applying the Deift-Zhou nonlinear steepest descent method to the Riemann-Hilbert problem for orthogonal polynomials on the Hankel loop. The main concern here is the construction of a local parametrix at the critical point $z=-1$, where the $\psi$-function of the Jimbo-Miwa Lax pair for the inhomogeneous Painlev\'{e} II equation is involved.


title: Polariton-Based Room Temperature Quantum Phototransistors

abstract: Strong light-matter coupling is a quantum process in which light and matter are coupled together, generating hybridized states. This is similar to the notion of molecular hybridization, but one of the components is light. Here, we utilized the idea and prepared quantum phototransistors using donor-acceptor combinations that can transfer energy via Rabi oscillations. As a prototype experiment, we used a cyanine J-aggregate (TDBC; donor) and MoS2 monolayer (acceptor) in a field effect transistor cavity and studied the photoresponsivity. The energy migrates through the newly formed polaritonic ladder, and the relative efficiency of the device is nearly seven-fold at the ON resonance. Further, the photon mixing fraction is calculated for each independent device and correlated with energy transfer efficiency. In the strongly coupled system, newly formed polaritonic states reshuffle the probability function. A theoretical model based on the time dependent Schr\"odinger equation is also used to interpret the results. Here, the entangled light-matter states act as a strong channel for funnelling the energy to the MoS2 monolayer, thereby boosting its ability to show the highest photoresponsivity at ON-resonance. These experimental findings and the proposed model suggest novel applications of strong light-matter coupling in quantum materials.


title: ZeroG: Investigating Cross-dataset Zero-shot Transferability in Graphs

abstract: With the development of foundation models such as large language models, zero-shot transfer learning has become increasingly significant. This is highlighted by the generative capabilities of NLP models like GPT-4, and the retrieval-based approaches of CV models like CLIP, both of which effectively bridge the gap between seen and unseen data. In the realm of graph learning, the continuous emergence of new graphs and the challenges of human labeling also amplify the necessity for zero-shot transfer learning, driving the exploration of approaches that can generalize across diverse graph data without necessitating dataset-specific and label-specific fine-tuning. In this study, we extend such paradigms to zero-shot transferability in graphs by introducing ZeroG, a new framework tailored to enable cross-dataset generalization. Addressing the inherent challenges such as feature misalignment, mismatched label spaces, and negative transfer, we leverage a language model to encode both node attributes and class semantics, ensuring consistent feature dimensions across datasets. We also propose a prompt-based subgraph sampling module that enriches the semantic information and structure information of extracted subgraphs using prompting nodes and neighborhood aggregation, respectively. We further adopt a lightweight fine-tuning strategy that reduces the risk of overfitting and maintains the zero-shot learning efficacy of the language model. The results underscore the effectiveness of our model in achieving significant cross-dataset zero-shot transferability, opening pathways for the development of graph foundation models. Codes and data are available at https://github.com/NineAbyss/ZeroG.


title: On extended model of Josephson junction, linear systems with polynomial solutions, determinantal surfaces and Painlev\'e 3 equations

abstract: We consider a 3-parameter family of linear special double confluent Heun equations introduced and studied by V.M.Buchstaber and S.I.Tertychnyi, which is an equivalent presentation of a model of Josephson junction in superconductivity. Buchstaber and Tertychnyi have shown that the set of those complex parameters for which the Heun equation has a polynomial solution is a union of explicit planar algebraic curves: the spectral curves indexed by $\ell\in\mathbb N$. In his paper with I.V.Netay, the author has shown that each spectral curve is irreducible in Heun equation parameters (consists of two irreducible components in parameters of Josephson junction model). Netay discovered numerically and conjectured a genus formula for spectral curves. He reduced it to the conjecture stating that each of them is regular in $\mathbb C^2$ with a coordinate axis deleted. Here we prove Netay's regularity and genus conjectures. For the proof we study a 4-parameter extension of a family of linear systems equivalent to the Heun equations. They yield an equivalent presentation of the extension of model of Josephson junction introduced by the author in his paper with Yu.P.Bibilo. We describe the so-called determinantal surfaces consisting of linear systems with polynomial solutions as explicit algebraic surfaces indexed by $\ell\in\mathbb N$. The spectral curves are their intersections with the hyperplane of the initial Heun equation family. We prove that each determinantal surface is regular outside appropriate hyperplane and consists of two rational irreducible components. The proofs use Stokes phenomena theory, holomorphic vector bundle technique, foliation of determinantal surfaces by isomonodromic families of linear systems governed by Painlev\'e 3 equation and transversality of the latter foliation to the initial model.


title: Be Persistent: Towards a Unified Solution for Mitigating Shortcuts in Deep Learning

abstract: Deep neural networks (DNNs) are vulnerable to shortcut learning: rather than learning the intended task, they tend to draw inconclusive relationships between their inputs and outputs. Shortcut learning is ubiquitous among many failure cases of neural networks, and traces of this phenomenon can be seen in their generalizability issues, domain shift, adversarial vulnerability, and even bias towards majority groups. In this paper, we argue that this commonality in the cause of various DNN issues creates a significant opportunity that should be leveraged to find a unified solution for shortcut learning. To this end, we outline the recent advances in topological data analysis~(TDA), and persistent homology~(PH) in particular, to sketch a unified roadmap for detecting shortcuts in deep learning. We demonstrate our arguments by investigating the topological features of computational graphs in DNNs using two cases of unlearnable examples and bias in decision-making as our test studies. Our analysis of these two failure cases of DNNs reveals that finding a unified solution for shortcut learning in DNNs is not out of reach, and TDA can play a significant role in forming such a framework.


title: Exploring sustainable alternatives for the deployment of microservices architectures in the cloud

abstract: As organizations increasingly migrate their applications to the cloud, the optimization of microservices architectures becomes imperative for achieving sustainability goals. Nonetheless, sustainable deployments may increase costs and deteriorate performance, thus the identification of optimal tradeoffs among these conflicting requirements is a key objective not easy to achieve. This paper introduces a novel approach to support cloud deployment of microservices architectures by targeting optimal combinations of application performance, deployment costs, and power consumption. By leveraging genetic algorithms, specifically NSGA-II, we automate the generation of alternative architectural deployments. The results demonstrate the potential of our approach through a comprehensive assessment of the Train Ticket case study.


title: CARLA-Autoware-Bridge: Facilitating Autonomous Driving Research with a Unified Framework for Simulation and Module Development

abstract: Extensive testing is necessary to ensure the safety of autonomous driving modules. In addition to component tests, the safety assessment of individual modules also requires a holistic view at system level, which can be carried out efficiently with the help of simulation. Achieving seamless compatibility between a modular software stack and simulation is complex and poses a significant challenge for many researchers. To ensure testing at the system level with state-of-the-art AV software and simulation software, we have developed and analyzed a bridge connecting the CARLA simulator with the AV software Autoware Core/Universe. This publicly available bridge enables researchers to easily test their modules within the overall software. Our investigations show that an efficient and reliable communication system has been established. We provide the simulation bridge as open-source software at https://github.com/TUMFTM/Carla-Autoware-Bridge


title: Search for charged lepton flavor violation of vector mesons in the $\mathrm{U}(1)_{X} \mathrm{SSM}$

abstract: Charged lepton flavor violation (CLFV) represents a clear new physics (NP) signal beyond the standard model (SM). In this work, we investigate the CLFV decays of vector mesons $V\rightarrow l_i^{\pm}l_j^{\mp}$ with $V\in\{\phi, J/\Psi, \Upsilon(1S), \Upsilon(2S),\Upsilon(3S)\}$ in the $\mathrm{U}(1)_{X} \mathrm{SSM}$. Considering the SM-like Higgs boson mass within $3\sigma$ region, we discuss the corresponding constraints on the relevant parameter space of the model, which indicate this model can produce significant contributions to such CLFV decays. From the numerical analyses, the main sensitive parameters and CLFV sources originate from the non-diagonal elements correspond to the initial and final generations of the leptons. And the branching ratios to these CLFV processes can easily reach the present experimental upper bounds. Therefore, searching for CLFV processes of vector mesons may be an effective channel to study new physics.


title: DiffPoint: Single and Multi-view Point Cloud Reconstruction with ViT Based Diffusion Model

abstract: As the task of 2D-to-3D reconstruction has gained significant attention in various real-world scenarios, it becomes crucial to be able to generate high-quality point clouds. Despite the recent success of deep learning models in generating point clouds, there are still challenges in producing high-fidelity results due to the disparities between images and point clouds. While vision transformers (ViT) and diffusion models have shown promise in various vision tasks, their benefits for reconstructing point clouds from images have not been demonstrated yet. In this paper, we first propose a neat and powerful architecture called DiffPoint that combines ViT and diffusion models for the task of point cloud reconstruction. At each diffusion step, we divide the noisy point clouds into irregular patches. Then, using a standard ViT backbone that treats all inputs as tokens (including time information, image embeddings, and noisy patches), we train our model to predict target points based on input images. We evaluate DiffPoint on both single-view and multi-view reconstruction tasks and achieve state-of-the-art results. Additionally, we introduce a unified and flexible feature fusion module for aggregating image features from single or multiple input images. Furthermore, our work demonstrates the feasibility of applying unified architectures across languages and images to improve 3D reconstruction tasks.


title: Learning with Imbalanced Noisy Data by Preventing Bias in Sample Selection

abstract: Learning with noisy labels has gained increasing attention because the inevitable imperfect labels in real-world scenarios can substantially hurt the deep model performance. Recent studies tend to regard low-loss samples as clean ones and discard high-loss ones to alleviate the negative impact of noisy labels. However, real-world datasets contain not only noisy labels but also class imbalance. The imbalance issue is prone to causing failure in the loss-based sample selection since the under-learning of tail classes also leans to produce high losses. To this end, we propose a simple yet effective method to address noisy labels in imbalanced datasets. Specifically, we propose Class-Balance-based sample Selection (CBS) to prevent the tail class samples from being neglected during training. We propose Confidence-based Sample Augmentation (CSA) for the chosen clean samples to enhance their reliability in the training process. To exploit selected noisy samples, we resort to prediction history to rectify labels of noisy samples. Moreover, we introduce the Average Confidence Margin (ACM) metric to measure the quality of corrected labels by leveraging the model's evolving training dynamics, thereby ensuring that low-quality corrected noisy samples are appropriately masked out. Lastly, consistency regularization is imposed on filtered label-corrected noisy samples to boost model performance. Comprehensive experimental results on synthetic and real-world datasets demonstrate the effectiveness and superiority of our proposed method, especially in imbalanced scenarios. Comprehensive experimental results on synthetic and real-world datasets demonstrate the effectiveness and superiority of our proposed method, especially in imbalanced scenarios.


title: Can Large Language Models perform Relation-based Argument Mining?

abstract: Argument mining (AM) is the process of automatically extracting arguments, their components and/or relations amongst arguments and components from text. As the number of platforms supporting online debate increases, the need for AM becomes ever more urgent, especially in support of downstream tasks. Relation-based AM (RbAM) is a form of AM focusing on identifying agreement (support) and disagreement (attack) relations amongst arguments. RbAM is a challenging classification task, with existing methods failing to perform satisfactorily. In this paper, we show that general-purpose Large Language Models (LLMs), appropriately primed and prompted, can significantly outperform the best performing (RoBERTa-based) baseline. Specifically, we experiment with two open-source LLMs (Llama-2 and Mistral) with ten datasets.


title: Characterizing the dynamical magnetosphere of the extremely slowly rotating magnetic O9.7 V star HD 54879 using rotational modulation of the H $\alpha$ profile

abstract: The magnetic field in the O9.7 V star HD54879 has been monitored for almost a decade. Spectropolarimetric observations reveal a rather strong mean longitudinal magnetic field that varies with a period of about 7.41 yr. Observations in the H$\alpha$ line show a variation with the same period, while the H$\beta$ line shows only little variation. Assuming the periodic variation to be caused by a slow rotation and a dipolar magnetic field, we find a magnetic field strength of $\ge$2 kG at the magnetic poles. With the relatively low mass loss rate of $10^{-9} M_\odot$ yr$^{-1}$, this star is a case of extremely strong magnetic confinement. Both theoretical arguments and numerical simulations indicate the presence of an extended disk of increased gas density in the equatorial plane of the magnetic field, where gas from the line-driven stellar wind is trapped. This disk is likely to be the origin of the observed H$\alpha$ emission, which peaks together with the strongest line-of-sight magnetic field. The profile of the H$\alpha$ line is resolved in several components and shows a remarkable variability with the rotation period.


title: AI Model Placement for 6G Networks under Epistemic Uncertainty Estimation

abstract: The adoption of Artificial Intelligence (AI) based Virtual Network Functions (VNFs) has witnessed significant growth, posing a critical challenge in orchestrating AI models within next-generation 6G networks. Finding optimal AI model placement is significantly more challenging than placing traditional software-based VNFs, due to the introduction of numerous uncertain factors by AI models, such as varying computing resource consumption, dynamic storage requirements, and changing model performance. To address the AI model placement problem under uncertainties, this paper presents a novel approach employing a sequence-to-sequence (S2S) neural network which considers uncertainty estimations. The S2S model, characterized by its encoding-decoding architecture, is designed to take the service chain with a number of AI models as input and produce the corresponding placement of each AI model. To address the introduced uncertainties, our methodology incorporates the orthonormal certificate module for uncertainty estimation and utilizes fuzzy logic for uncertainty representation, thereby enhancing the capabilities of the S2S model. Experiments demonstrate that the proposed method achieves competitive results across diverse AI model profiles, network environments, and service chain requests.


title: Theory of the linewidth-power product of photonic-crystal surface-emitting lasers

abstract: A general theory for the intrinsic (Lorentzian) linewidth of photonic-crystal surface-emitting lasers (PCSELs) is presented. The effect of spontaneous emission is modeled by a classical Langevin force entering the equation for the slowly varying waves. The solution of the coupled-wave equations, describing the propagation of four basic waves within the plane of the photonic crystal, is expanded in terms of the solutions of the associated spectral problem, i.e. the laser modes. Expressions are given for photon number, rate of spontaneous emission into the laser mode, Petermann factor and effective Henry factor entering the general formula for the linewidth. The theoretical framework is applied to the calculation of the linewidth-power product of air-hole and all-semiconductor PCSELs. For output powers in the Watt range, intrinsic linewidths of a few tens of Hertz are predicted if stable single mode operation is ensured


title: Well-posedness and Continuity Properties of the Fornberg_Whitham equation in Besov space $B^1_{\infty,1}(\R)$

abstract: For the Fornberg-Whitham equation, the local well-posedness in the critical Besov space $B_{p, 1}^{1+\frac{1}{p}}(\mathbb{R})$ with $1\leq p <\infty$ has been studied in (Guo, Nonlinear Anal. RWA., 2023). However, for the endpoint case $p=\infty$, whether it is locally well-posed or ill-posed in $B_{\infty, 1}^{1}(\mathbb{R})$ is still unknown. In this paper, we prove that the Fornberg-Whitham equation is well-posed in the critical Besov space $B_{\infty, 1}^{1}(\mathbb{R})$ with solutions depending continuously on initial data, which is different from that of the Camassa-Holm equation (Guo et al., J. Differ. Equ., 2022). In addition, we show that this dependence is sharp by showing that the solution map is not uniformly continuous on the initial data.


title: CoLLaVO: Crayon Large Language and Vision mOdel

abstract: The remarkable success of Large Language Models (LLMs) and instruction tuning drives the evolution of Vision Language Models (VLMs) towards a versatile general-purpose model. Yet, it remains unexplored whether current VLMs genuinely possess quality object-level image understanding capabilities determined from 'what objects are in the image?' or 'which object corresponds to a specified bounding box?'. Our findings reveal that the image understanding capabilities of current VLMs are strongly correlated with their zero-shot performance on vision language (VL) tasks. This suggests that prioritizing basic image understanding is crucial for VLMs to excel at VL tasks. To enhance object-level image understanding, we propose Crayon Large Language and Vision mOdel (CoLLaVO), which incorporates instruction tuning with Crayon Prompt as a new visual prompt tuning scheme based on panoptic color maps. Furthermore, we present a learning strategy of Dual QLoRA to preserve object-level image understanding without forgetting it during visual instruction tuning, thereby achieving a significant leap in numerous VL benchmarks in a zero-shot setting.


title: Non-contingecy in a paraconsistent setting

abstract: We study an extension of First Degree Entailment (FDE) by Dunn and Belnap with a non-contingency operator $\blacktriangle\phi$ which is construed as "$\phi$ has the same value in all accessible states" or "all sources give the same information on the truth value of $\phi$". We equip this logic dubbed $\mathbf{K}^\blacktriangle_\mathbf{FDE}$ with frame semantics and show how the bi-valued models can be interpreted as interconnected networks of Belnapian databases with the $\blacktriangle$ operator modelling search for inconsistencies in the provided information. We construct an analytic cut system for the logic and show its soundness and completeness. We prove that $\blacktriangle$ is not definable via the necessity modality $\Box$ of $\mathbf{K_{FDE}}$. Furthermore, we prove that in contrast to the classical non-contingency logic, reflexive, $\mathbf{S4}$, and $\mathbf{S5}$ (among others) frames \emph{are definable}.


title: Hierarchical Prior-based Super Resolution for Point Cloud Geometry Compression

abstract: The Geometry-based Point Cloud Compression (G-PCC) has been developed by the Moving Picture Experts Group to compress point clouds. In its lossy mode, the reconstructed point cloud by G-PCC often suffers from noticeable distortions due to the na\"{i}ve geometry quantization (i.e., grid downsampling). This paper proposes a hierarchical prior-based super resolution method for point cloud geometry compression. The content-dependent hierarchical prior is constructed at the encoder side, which enables coarse-to-fine super resolution of the point cloud geometry at the decoder side. A more accurate prior generally yields improved reconstruction performance, at the cost of increased bits required to encode this side information. With a proper balance between prior accuracy and bit consumption, the proposed method demonstrates substantial Bjontegaard-delta bitrate savings on the MPEG Cat1A dataset, surpassing the octree-based and trisoup-based G-PCC v14. We provide our implementations for reproducible research at https://github.com/lidq92/mpeg-pcc-tmc13.


title: LLM can Achieve Self-Regulation via Hyperparameter Aware Generation

abstract: In the realm of Large Language Models (LLMs), users commonly employ diverse decoding strategies and adjust hyperparameters to control the generated text. However, a critical question emerges: Are LLMs conscious of the existence of these decoding strategies and capable of regulating themselves? The current decoding generation process often relies on empirical and heuristic manual adjustments to hyperparameters based on types of tasks and demands. However, this process is typically cumbersome, and the decoding hyperparameters may not always be optimal for each sample. To address the aforementioned challenges, we propose a novel text generation paradigm termed Hyperparameter Aware Generation (HAG). By leveraging hyperparameter-aware instruction tuning, the LLM autonomously determines the optimal decoding strategy and configs based on the input samples, enabling self-regulation. Our approach eliminates the need for extensive manual tuning, offering a more autonomous, self-regulate model behavior. Experimental results spanning six datasets across reasoning, creativity, translation, and mathematics tasks demonstrate that hyperparameter-aware instruction tuning empowers the LLMs to self-regulate the decoding strategy and hyperparameter. HAG extends the current paradigm in the text generation process, highlighting the feasibility of endowing the LLMs with self-regulate decoding strategies.


title: Longitudinal phase space diagnostics with a nonmovable corrugated passive wakefield streaker

abstract: Time-resolved diagnostics at Free-Electron Laser (FEL) facilities, in particular electron beam longitudinal phase space (LPS) and FEL power profile measurements, provide information highly valuable for users, machine development studies, and beam setup. We investigate the slice energy resolution of passive streaker setups, in particular the effect of an energy chirp on the measured slice energy spread. Downstream of the hard X-ray SASE2 beamline at the European XFEL, these measurements are enabled by a single-plate non-movable passive wakefield streaker, essentially a rectangular corrugated plate placed inside a vacuum chamber. We show measurements with a time resolution down to a few femtoseconds, and an energy resolution down to a few MeVs.


title: Aligning Large Language Models by On-Policy Self-Judgment

abstract: Existing approaches for aligning large language models with human preferences face a trade-off that requires a separate reward model (RM) for on-policy learning. In this paper, we present a novel alignment framework, SELF-JUDGE that (1) does on-policy learning and 2) is parameter efficient, as it does not require an additional RM for evaluating the samples for on-policy learning. To this end, we propose Judge-augmented Supervised Fine-Tuning (JSFT) to train a single model to act as both a policy and a judge. Specifically, we view the pairwise judgment task, choosing the better response from a response pair, as a special case of the instruction-following task. The resulting model can judge preferences of on-the-fly responses from current policy initialized from itself. Experimental results show the efficacy of SELF-JUDGE, outperforming baselines in preference benchmarks. We also show that the rejecting sampling by itself can improve performance further without an additional evaluator.


title: C-ICL: Contrastive In-context Learning for Information Extraction

abstract: There has been increasing interest in exploring the capabilities of advanced large language models (LLMs) in the field of information extraction (IE), specifically focusing on tasks related to named entity recognition (NER) and relation extraction (RE). Although researchers are exploring the use of few-shot information extraction through in-context learning with LLMs, they tend to focus only on using correct or positive examples for demonstration, neglecting the potential value of incorporating incorrect or negative examples into the learning process. In this paper, we present c-ICL, a novel few-shot technique that leverages both correct and incorrect sample constructions to create in-context learning demonstrations. This approach enhances the ability of LLMs to extract entities and relations by utilizing prompts that incorporate not only the positive samples but also the reasoning behind them. This method allows for the identification and correction of potential interface errors. Specifically, our proposed method taps into the inherent contextual information and valuable information in hard negative samples and the nearest positive neighbors to the test and then applies the in-context learning demonstrations based on LLMs. Our experiments on various datasets indicate that c-ICL outperforms previous few-shot in-context learning methods, delivering substantial enhancements in performance across a broad spectrum of related tasks. These improvements are noteworthy, showcasing the versatility of our approach in miscellaneous scenarios.


title: Superconductivity enhancement and particle-hole asymmetry: interplay with electron attraction in doped Hubbard model

abstract: The role of near-neighbor electron attraction $V$ in strongly correlated systems has been at the forefront of recent research of unconventional superconductivity. However, its implications in the doped Hubbard model on expansive systems remain predominantly unexplored. In this study, we employ the density-matrix renormalization group to examine its effect in the lightly doped $t$-$t'$-Hubbard model on six-leg square cylinders, where $t$ and $t'$ are the first and second neighbor electron hopping amplitudes. For positive $t'$ in the electron-doped case, our results show that the attractive $V$ can significantly enhance the superconducting correlations and drive the system into a pronounced superconducting phase when the attraction exceeds a modest value $V_c \approx 0.7t$. In contrast, in the hole-doped regime with negative $t' $, while heightened superconducting correlations have also been observed in the charge stripe phase, the systems remain insulating with pronounced charge density wave order. Our results demonstrate the importance of the electron attraction in boosting superconductivity in broader doped Hubbard systems and highlight the asymmetry between the electron and hole-doped regimes.


title: On the Idempotent Graph of Matrix Ring

abstract: Let F be a finite field and R = M2(F) be 2x2 matrix ring over F. In this paper, we explicitly determine all the idempotents in R. Using these idempotents, we study the idempotent graph of R whose vertex set is the set of non-trivial idempotents in R and two idempotents e, f are adjacent if ef = 0 or fe = 0. It is proved that the idempotent graph of R is connected regular graph with diameter 2. Its girth is also characterized. Further, we determine the Wiener and Harary index of the idempotent graph of R.


title: Construction of Linear Codes from the Unit Graph $G(\mathbb{Z}_{n}\oplus \mathbb{Z}_{m})$

abstract: In this paper, we develop the python code for generating unit graph $G(\mathbb{Z}_{n}\oplus\mathbb{Z}_{m})$, for any integers $m\ \& \ n$. For any prime $r$, we construct $r$-ary linear codes from the incidence matrix of the unit graph $G(\mathbb{Z}_{n}\oplus\mathbb{Z}_{m})$, where $n \ \& \ m$ are either power of prime or product of power of primes. We also prove the minimum distance of dual of the constructed codes as either 3 or 4. Finally, we state conjectures two on linear codes constructed from the unit graph $G(\mathbb{Z}_{n}\oplus \mathbb{Z}_{m})$, for any integer $m\ \& \ n$.


title: Generalized Lomb-Scargle Analysis of 22 years of Super-Kamiokande solar $^8$B neutrino data

abstract: We apply the generalized Lomb-Scargle periodogram to 22 years data of solar $^{8}$B neutrino fluxes detected by Super-Kamiokande. The primary motivation of this work was to check if the sinusoidal modulation at a frequency of 9.43/year (with a period of 38 days), which we had found to be marginally significant with the first five years of Super-K data, persists, with the accumulated data. We use four different metrics for the calculation of significance. We do not find any evidence for periodicity at the aforementioned frequency or any other frequency with the updated data. Therefore the marginally detected periodicity at 9.43/year with the first five years of data was only a statistical fluctuation.


title: Fourier Electron Optics with Massless Dirac Fermions Scattered by Quantum Dot Lattice

abstract: The field of electron optics exploits the analogy between the movement of electrons or charged quasiparticles, primarily in two-dimensional materials subjected to electric and magnetic (EM) fields and the propagation of electromagnetic waves in a dielectric medium with varied refractive index. We significantly extend this analogy by introducing Fourier electron optics (FEO) with massless Dirac fermions (MDF), namely the charge carriers of single-layer graphene under ambient conditions, by considering their scattering from a two-dimensional quantum dot lattice (TDQDL) treated within Lippmann-Schwinger formalism. By considering the scattering of MDF from TDQDL with a cavity, as well as the moir\'{e} pattern of twisted TDQDLs, we establish an electronic analogue of Babinet's principle in optics. Exploiting the similarity of the resulting differential scattering cross-section with the Fraunhofer diffraction pattern, we construct a dictionary for such FEO. Subsequently, we evaluate the resistivity of such scattered MDF using the Boltzmann approach as a function of the angle made between the direction of propagation of these charge-carriers and the symmetry axis of the dot-lattice, and Fourier analyze them to show that the spatial frequency associated with the angle-resolved resistivity gets filtered according to the structural changes in the dot lattice, indicating wider applicability of FEO of MDF.


title: MoRAL: MoE Augmented LoRA for LLMs' Lifelong Learning

abstract: Adapting large language models (LLMs) to new domains/tasks and enabling them to be efficient lifelong learners is a pivotal challenge. In this paper, we propose MoRAL, i.e., Mixture-of-Experts augmented Low-Rank Adaptation for Lifelong Learning. MoRAL combines the multi-tasking abilities of MoE with the fine-tuning abilities of LoRA for effective life-long learning of LLMs. In contrast to the conventional approaches that use factual triplets as inputs MoRAL relies on simple question-answer pairs, which is a more practical and effective strategy for robust and efficient learning. Owing to new data settings, we introduce a new evaluation benchmark namely: Life Long Learning of LLM (5L-bench) encompassing a newly curated dataset of question-answer pairs, and a set of evaluation metrics for rigorous evaluation of MoRAL in open-book and closed-book settings. Experimental evaluation shows (i) LLMs learn fast in open-book settings with up to 30.15% improvement in "RA" for Phi-2-2.7B compared to closed-book (for models fine-tuned with MoRAL); (ii) MoRAL shows higher performance improvement for models with a greater number of parameters; (iii) MoRAL is robust to catastrophic forgetting offering better knowledge retention compared to baselines.


title: Isotypic equivalence of Abelian p-groups with separable reduced parts

abstract: We prove that two elementarily equivalent Abelian p-groups with separable reduced parts are isotypically equivalent.


title: Mirror Gradient: Towards Robust Multimodal Recommender Systems via Exploring Flat Local Minima

abstract: Multimodal recommender systems utilize various types of information to model user preferences and item features, helping users discover items aligned with their interests. The integration of multimodal information mitigates the inherent challenges in recommender systems, e.g., the data sparsity problem and cold-start issues. However, it simultaneously magnifies certain risks from multimodal information inputs, such as information adjustment risk and inherent noise risk. These risks pose crucial challenges to the robustness of recommendation models. In this paper, we analyze multimodal recommender systems from the novel perspective of flat local minima and propose a concise yet effective gradient strategy called Mirror Gradient (MG). This strategy can implicitly enhance the model's robustness during the optimization process, mitigating instability risks arising from multimodal information inputs. We also provide strong theoretical evidence and conduct extensive empirical experiments to show the superiority of MG across various multimodal recommendation models and benchmarks. Furthermore, we find that the proposed MG can complement existing robust training methods and be easily extended to diverse advanced recommendation models, making it a promising new and fundamental paradigm for training multimodal recommender systems. The code is released at https://github.com/Qrange-group/Mirror-Gradient.


title: $C^1$ Pesin (un)stable manifold without domination

abstract: For $C^1$ diffeomorphisms with continuous invariant splitting without domination, we prove the existence of Pesin (un)stable manifold under the hyperbolicity of invariant measures.


title: Internal-wave convection and shear near the top of a deep equatorial seamount

abstract: The near-equatorial ocean experiences particular dynamics because the Coriolis force is weak. One modelled effect of these dynamics is strong reduction of turbulent mixing in the ocean interior. Unknowns are effects on internal wave breaking and associated turbulent mixing above steeply sloping topography. In this paper, high-resolution temperature observations are analyzed from sensors that were moored near the top of a deep Ceara Basin seamount for one week. A vertical string held sensors between 0.4 and 56.4 meters above the seafloor. The observations show common semidiurnal-periodic internal wave breaking, with tidal- and 56-m mean turbulence values that are not significantly different from those observed near the top of 1000-m shallower mid-latitude Great Meteor Seamount, despite the twice lower vertical density stratification. Profiles of 6-day mean turbulence values yield vertically uniform values except for a small decrease in the lower 2 m above the seafloor. The lower 2-m show a distinct departure from turbulent inertial subrange in temperature variance spectra. In 10-m higher-up, spectral slopes indicate dominant turbulent convection with reduced flow and turbulence, except when a primary tidal bore is present. Further-up than 15 m, shear dominates (stratified) turbulence. The lack of Coriolis force is not found to be important for internal wave-induced turbulence above steeply sloping topography, except that Kelvin-Helmholtz instabilities seem somewhat less chaotic and more organized roll-up than at mid-latitudes.


title: Beyond Literal Descriptions: Understanding and Locating Open-World Objects Aligned with Human Intentions

abstract: Visual grounding (VG) aims at locating the foreground entities that match the given natural language expressions. Previous datasets and methods for classic VG task mainly rely on the prior assumption that the given expression must literally refer to the target object, which greatly impedes the practical deployment of agents in real-world scenarios. Since users usually prefer to provide intention-based expression for the desired object instead of covering all the details, it is necessary for the agents to interpret the intention-driven instructions. Thus, in this work, we take a step further to the intention-driven visual-language (V-L) understanding. To promote classic VG towards human intention interpretation, we propose a new intention-driven visual grounding (IVG) task and build a large-scale IVG dataset termed IntentionVG with free-form intention expressions. Considering that practical agents need to move and find specific targets among various scenarios to realize the grounding task, our IVG task and IntentionVG dataset have taken the crucial properties of both multi-scenario perception and egocentric view into consideration. Besides, various types of models are set up as the baselines to realize our IVG task. Extensive experiments on our IntentionVG dataset and baselines demonstrate the necessity and efficacy of our method for the V-L field. To foster future research in this direction, our newly built dataset and baselines will be publicly available at https://github.com/Rubics-Xuan/IVG.


title: Filtered Lie-Trotter splitting for the "good" Boussinesq equation: low regularity error estimates

abstract: We investigate a filtered Lie-Trotter splitting scheme for the ``good" Boussinesq equation and derive an error estimate for initial data with very low regularity. Through the use of discrete Bourgain spaces, our analysis extends to initial data in $H^{s}$ for $0<s\leq 2$, overcoming the constraint of $s>1/2$ imposed by the bilinear estimate in smooth Sobolev spaces. We establish convergence rates of order $\tau^{s/2}$ in $L^2$ for such levels of regularity. Our analytical findings are supported by numerical experiments.


title: On the optimal relaxation rate for the Metropolis algorithm in one dimension

abstract: We study the relaxation of the Metropolis Monte Carlo algorithm corresponding to a single particle trapped in a one-dimensional confining potential, with even jump distributions that ensure that the dynamics verifies detailed balance. Previous work suggested that, for smooth jump distributions, the fastest relaxation rate is obtained as a result of the competition between diffusive and rejection-dominated dynamics. In this work, we show that a new regime comes into play for two-peaked jump distributions, where the relaxation dynamics is neither dominated by diffusion nor rejection: the eigenmodes adopt an oscillatory form, reminiscent of charge density waves (CDW) -- thus we term this new regime the CDW regime. Using a combination of numerical and analytical techniques, the parameter regions corresponding to diffusion, rejection, and CDW are characterised, as well as the transition lines between them -- i.e. a phase diagram is built. The optimal relaxation rate is located at the triple point of phase coexistence, where the transition lines (diffusive-rejection, diffusive-CDW, and CDW-rejection) intersect. Our theoretical framework is checked versus the numerical diagonalisation of the master equation. We also briefly discuss more sophisticated attempts at optimising the relaxation rate to equilibrium.


title: Constrained Hellinger-Kantorovich barycenters: least-cost soft and conic multi-marginal formulations

abstract: We show that the problem of finding the barycenter in the Hellinger-Kantorovich setting admits a least-cost soft multi-marginal formulation, provided that a one-sided hard marginal constraint is introduced. The constrained approach is then shown to admit a conic multi-marginal reformulation based on defining a single joint multi-marginal perspective cost function in the conic multi-marginal formulation, as opposed to separate two-marginal perspective cost functions for each two-marginal problem in the coupled-two-marginal formulation, as was studied previously in literature. We further establish that, as in the Wasserstein metric, the recently introduced framework of unbalanced multi-marginal optimal transport can be reformulated using the notion of the least cost. Subsequently, we discuss an example when input measures are Dirac masses and numerically solve an example for Gaussian measures. Finally, we also explore why the constrained approach can be seen as a natural extension of a Wasserstein space barycenter to the unbalanced setting.


title: A New Approach to Generic Lower Bounds: Classical/Quantum MDL, Quantum Factoring, and More

abstract: This paper studies the limitations of the generic approaches to solving cryptographic problems in classical and quantum settings in various models. - In the classical generic group model (GGM), we find simple alternative proofs for the lower bounds of variants of the discrete logarithm (DL) problem: the multiple-instance DL and one-more DL problems (and their mixture). We also re-prove the unknown-order GGM lower bounds, such as the order finding, root extraction, and repeated squaring. - In the quantum generic group model (QGGM), we study the complexity of variants of the discrete logarithm. We prove the logarithm DL lower bound in the QGGM even for the composite order setting. We also prove an asymptotically tight lower bound for the multiple-instance DL problem. Both results resolve the open problems suggested in a recent work by Hhan, Yamakawa, and Yun. - In the quantum generic ring model we newly suggested, we give the logarithmic lower bound for the order-finding algorithms, an important step for Shor's algorithm. We also give a logarithmic lower bound for a certain generic factoring algorithm outputting relatively small integers, which includes a modified version of Regev's algorithm. - Finally, we prove a lower bound for the basic index calculus method for solving the DL problem in a new idealized group model regarding smooth numbers. The quantum lower bounds in both models allow certain (different) types of classical preprocessing. All of the proofs are significantly simpler than the previous proofs and are through a single tool, the so-called compression lemma, along with linear algebra tools. Our use of this lemma may be of independent interest.


title: Constructing the three-dimensional extinction density maps using V-net

abstract: One of the major challenges we face is how to quickly and accurately create the three-dimensional (3D) density distributions of interstellar dust in the Milky Way using extinction and distance measurements of large samples of stars. In this study, we introduce a novel machine-learning approach that utilizes a convolution neural network, specifically a V-net, to infer the 3D distribution of dust density. Experiments are performed within two regions located towards the Galactic anti-center. The neural network is trained and tested using 10,000 simulations of dust density and line-of-sight extinction maps. Evaluation of the test sample confirms the successful generation of dust density maps from extinction maps by our model. Additionally, the performance of the trained network is evaluated using data from the literature. Our results demonstrate that our model is capable of capturing detailed dust density variations and can recover dust density maps while reducing the ``fingers of god" effect. Moving forward, we plan to apply this model to real observational data to obtain the fine distribution of dust at large and small scales in the Milky Way.


title: MONAL: Model Autophagy Analysis for Modeling Human-AI Interactions

abstract: The increasing significance of large models and their multi-modal variants in societal information processing has ignited debates on social safety and ethics. However, there exists a paucity of comprehensive analysis for: (i) the interactions between human and artificial intelligence systems, and (ii) understanding and addressing the associated limitations. To bridge this gap, we propose Model Autophagy Analysis (MONAL) for large models' self-consumption explanation. MONAL employs two distinct autophagous loops (referred to as ``self-consumption loops'') to elucidate the suppression of human-generated information in the exchange between human and AI systems. Through comprehensive experiments on diverse datasets, we evaluate the capacities of generated models as both creators and disseminators of information. Our key findings reveal (i) A progressive prevalence of model-generated synthetic information over time within training datasets compared to human-generated information; (ii) The discernible tendency of large models, when acting as information transmitters across multiple iterations, to selectively modify or prioritize specific contents; and (iii) The potential for a reduction in the diversity of socially or human-generated information, leading to bottlenecks in the performance enhancement of large models and confining them to local optima.


title: Many-body localization properties of fully frustrated Heisenberg spin-1/2 ladder model with next-nearest-neighbor interaction

abstract: Many-body localization (MBL) is an intriguing physical phenomenon that arises from the interplay of interaction and disorder, allowing quantum systems to prevent thermalization. In this study, we investigate the MBL properties of the fully frustrated Heisenberg spin-1/2 ladder model with next-nearest-neighbor hopping interaction along the leg direction and compare it with the Heisenberg spin-1/2 single-chain model with next-nearest-neighbor hopping interaction. We explore the MBL transition using random matrix theory and study the characteristics of entanglement entropy and its variance. Our results show that for the single-chain model, the critical point $w _{1} \sim$ 7.5 $\pm$ 0.5, whereas for the frustrated ladder model, $w _{2} \sim$ 10.5 $\pm$ 0.5. Moreover, we observe the existence of a many-body mobility edge in the frustrated ladder model. We also investigate the dynamical properties of the frustrated ladder model and identify the logarithmic growth of entanglement entropy, high fidelity of initial information, and magnetic localization phenomenon in the localized phase. Finally, we explore the finite-size scaling of the two models. Our findings suggest that interpreting MBL transition as a continuous second-order phase transition yields a better scaling solution than the Kosterlitz-Thouless type transition for our two models, and this difference is more pronounced in the frustrated ladder model compared with the single-chain model.


title: Semi-supervised Medical Image Segmentation Method Based on Cross-pseudo Labeling Leveraging Strong and Weak Data Augmentation Strategies

abstract: Traditional supervised learning methods have historically encountered certain constraints in medical image segmentation due to the challenging collection process, high labeling cost, low signal-to-noise ratio, and complex features characterizing biomedical images. This paper proposes a semi-supervised model, DFCPS, which innovatively incorporates the Fixmatch concept. This significantly enhances the model's performance and generalizability through data augmentation processing, employing varied strategies for unlabeled data. Concurrently, the model design gives appropriate emphasis to the generation, filtration, and refinement processes of pseudo-labels. The novel concept of cross-pseudo-supervision is introduced, integrating consistency learning with self-training. This enables the model to fully leverage pseudo-labels from multiple perspectives, thereby enhancing training diversity. The DFCPS model is compared with both baseline and advanced models using the publicly accessible Kvasir-SEG dataset. Across all four subdivisions containing different proportions of unlabeled data, our model consistently exhibits superior performance. Our source code is available at https://github.com/JustlfC03/DFCPS.


title: TC-DiffRecon: Texture coordination MRI reconstruction method based on diffusion model and modified MF-UNet method

abstract: Recently, diffusion models have gained significant attention as a novel set of deep learning-based generative methods. These models attempt to sample data from a Gaussian distribution that adheres to a target distribution, and have been successfully adapted to the reconstruction of MRI data. However, as an unconditional generative model, the diffusion model typically disrupts image coordination because of the consistent projection of data introduced by conditional bootstrap. This often results in image fragmentation and incoherence. Furthermore, the inherent limitations of the diffusion model often lead to excessive smoothing of the generated images. In the same vein, some deep learning-based models often suffer from poor generalization performance, meaning their effectiveness is greatly affected by different acceleration factors. To address these challenges, we propose a novel diffusion model-based MRI reconstruction method, named TC-DiffRecon, which does not rely on a specific acceleration factor for training. We also suggest the incorporation of the MF-UNet module, designed to enhance the quality of MRI images generated by the model while mitigating the over-smoothing issue to a certain extent. During the image generation sampling process, we employ a novel TCKG module and a Coarse-to-Fine sampling scheme. These additions aim to harmonize image texture, expedite the sampling process, while achieving data consistency. Our source code is available at https://github.com/JustlfC03/TC-DiffRecon.


title: Systematic Absences of Optical Phonon Modes in Phonon Dispersion Measured by Electron Microscopy

abstract: Phonon dispersion is widely used to elucidate the vibrational properties of materials. As an emerging technique, momentum-resolved vibrational spectroscopy in scanning transmission electron microscopy (STEM) offers an unparalleled approach to explore q-dependent phonon behavior at local structures. In this study, we systematically investigate the phonon dispersion of monolayer graphene across several Brillouin zones (BZs) using momentum-resolved vibrational spectroscopy and find that the optical phonon signals vanish at the {\Gamma} points with indices (hk0) satisfying h+2k=3n (n denoted integers). Theoretical analysis reveals that the observed phenomena arise from the complete destructive interference of the scattered waves from different basis atoms. This observation, corroborated by the study of diamond, should be a general characteristic of materials composed of symmetrically equivalent pairs of the same elements. Moreover, our results emphasize the importance of multiple scattering in interpreting the vibrational signals in bulk materials. We demonstrate that the systematic absences and dynamic effects, which have not been much appreciated before, offer new insights into the experimental assessment of local vibrational properties of materials.


title: Multiplet of minima across nuclear landscape

abstract: By varying a general pair condensate (VPC), we explore the multiplet of minima in even-even nuclei from $sd$ shell to media-heavy $sdg7h11$ shell, which may provide the foundation of universal coexistence. The VPC calculation is limited within a single major shell, and thus the conventional interpretation for the coexistence near magic number, i.e., multiple-particle-hole excitation across a major shell gap, does not account for coexistence observed in this work. The inclusion of all possible pairing channel is crucial to this ``new'' type of shape coexistence, or increase the energy minima of such coexistence. The angular-momentum projected VPC (PVPC) is adopted to further calculate the low-lying level scheme of some light nuclei, and to identify the band structures emerging from the coexistence. Well agreement between the PVPC results and the experimental data is achieved, and thus the picture of universal coexistence is experimentally supported, at least, in light nuclei.


title: Mod 2 representation of the symmetric group of order 2 over cohomology groups of 2-configuration space of torus

abstract: In this article, we compute the mod 2 representarion of the symmetric group of order 2 over the singular cohomology groups of orderd 2-configuration space $C_{2}(T^{d})$ of the $d$-torus $T^{d}$ for $d\geq 1$. As applications of the computation, we determine the Stiefel-Whitney height of $C_{2}(T^{d})$ for any $d$, and determine $\mathbb{F}_{2}[{\Sigma}_{2}]$-module structure of the cohomology groups of the unordered 2-configuration space of the $d$-torus for $d=2,3$ using the Serre spectral sequence.


title: Neural network study on nuclear ground-state spin distribution within random interaction ensemble

abstract: The distribution of nuclear ground-state spin in the two-body random ensemble (TBRE) is studied by using a general classification neural network (NN) model with the two-body interaction matrix elements as input features and corresponding ground-state spins as labels or output predictions. It seems that quantum many-body system problem exceeds the capability of our optimized neural networks when it comes to accurately predicting the ground-state spin of each sample within the TBRE. However, our neural network model effectively captures the statistical properties of the ground-state spin. This may be attributed to the fact that the neural network (NN) model has learned the empirical regularity of the ground-state spin distribution in TBRE, as discovered by human physicists.


title: Multi-Perspective Consistency Enhances Confidence Estimation in Large Language Models

abstract: In the deployment of large language models (LLMs), accurate confidence estimation is critical for assessing the credibility of model predictions. However, existing methods often fail to overcome the issue of overconfidence on incorrect answers. In this work, we focus on improving the confidence estimation of large language models. Considering the fragility of self-awareness in language models, we introduce a Multi-Perspective Consistency (MPC) method. We leverage complementary insights from different perspectives within models (MPC-Internal) and across different models (MPC-Across) to mitigate the issue of overconfidence arising from a singular viewpoint. The experimental results on eight publicly available datasets show that our MPC achieves state-of-the-art performance. Further analyses indicate that MPC can mitigate the problem of overconfidence and is effectively scalable to other models.


title: Understanding high-index saddle dynamics via numerical analysis

abstract: High-index saddle dynamics (HiSD) serves as a competitive instrument in searching the any-index saddle points and constructing the solution landscape of complex systems. The Lagrangian multiplier terms in HiSD ensure the Stiefel manifold constraint, which, however, are dropped in the commonly-used discrete HiSD scheme and are replaced by an additional Gram-Schmidt orthonormalization. Though this scheme has been successfully applied in various fields, it is still unclear why the above modification does not affect its effectiveness. We recover the same form as HiSD from this scheme, which not only leads to error estimates naturally, but indicates that the mechanism of Stiefel manifold preservation by Lagrangian multiplier terms in HiSD is nearly a Gram-Schmidt process (such that the above modification is appropriate). The developed methods are further extended to analyze the more complicated constrained HiSD on high-dimensional sphere, which reveals more mechanisms of the constrained HiSD in preserving several manifold properties.


title: Can Large Multimodal Models Uncover Deep Semantics Behind Images?

abstract: Understanding the deep semantics of images is essential in the era dominated by social media. However, current research works primarily on the superficial description of images, revealing a notable deficiency in the systematic investigation of the inherent deep semantics. In this work, we introduce DEEPEVAL, a comprehensive benchmark to assess Large Multimodal Models' (LMMs) capacities of visual deep semantics. DEEPEVAL includes human-annotated dataset and three progressive subtasks: fine-grained description selection, in-depth title matching, and deep semantics understanding. Utilizing DEEPEVAL, we evaluate 9 open-source LMMs and GPT-4V(ision). Our evaluation demonstrates a substantial gap between the deep semantic comprehension capabilities of existing LMMs and humans. For example, GPT-4V is 30% behind humans in understanding deep semantics, even though it achieves human-comparable performance in image description. Further analysis reveals that LMM performance on DEEPEVAL varies according to the specific facets of deep semantics explored, indicating the fundamental challenges remaining in developing LMMs.


title: Grammaticality illusion or ambiguous interpretation? Event-related potentials reveal the nature of the missing-NP effect in Mandarin centre-embedded structures

abstract: In several languages, omitting a verb phrase (VP) in double centre-embedded structures creates a grammaticality illusion. Similar illusion also exhibited in Mandarin missing-NP double centre-embedded structures. However, there is no consensus on its very nature. Instead of treating it as grammaticality illusion, we argue that ambiguous interpretations of verbs can best account for this phenomenon in Mandarin. To further support this hypothesis, we conducted two electroencephalography (EEG) experiments on quasi double centre-embedded structures whose complexity is reduced by placing the self-embedding relative clauses into the sentence's subject position. Experiment 1 showed that similar phenomenon even exhibited in this structure, evidenced by an absence of P600 effect and a presence of N400 effect. In Experiment 2, providing semantic cues to reduce ambiguity dispelled this illusion, as evidenced by a P600 effect. We interpret the results under garden-path theory and propose that word-order difference may account for this cross-linguistic variation.


title: Deep adaptive sampling for surrogate modeling without labeled data

abstract: Surrogate modeling is of great practical significance for parametric differential equation systems. In contrast to classical numerical methods, using physics-informed deep learning methods to construct simulators for such systems is a promising direction due to its potential to handle high dimensionality, which requires minimizing a loss over a training set of random samples. However, the random samples introduce statistical errors, which may become the dominant errors for the approximation of low-regularity and high-dimensional problems. In this work, we present a deep adaptive sampling method for surrogate modeling ($\text{DAS}^2$), where we generalize the deep adaptive sampling (DAS) method [62] [Tang, Wan and Yang, 2023] to build surrogate models for low-regularity parametric differential equations. In the parametric setting, the residual loss function can be regarded as an unnormalized probability density function (PDF) of the spatial and parametric variables. This PDF is approximated by a deep generative model, from which new samples are generated and added to the training set. Since the new samples match the residual-induced distribution, the refined training set can further reduce the statistical error in the current approximate solution. We demonstrate the effectiveness of $\text{DAS}^2$ with a series of numerical experiments, including the parametric lid-driven 2D cavity flow problem with a continuous range of Reynolds numbers from 100 to 1000.


title: Fragment-wise differentiable structures

abstract: The $p$-modulus of curves, test plans, upper gradients, charts, differentials, approximations in energy and density of directions are all concepts associated to the theory of Sobolev functions in metric measure spaces. The purpose of this paper is to give an analogous geometric and ``fragment-wise'' theory for Lipschitz functions and Weaver derivations, where $\infty$-modulus of curve fragments, $\ast$-upper gradients and Alberti representations play a central role. We give a new definition of fragment-wise charts and prove that they exists for spaces with finite Hausdorff dimension. We give a replacement for $p$-duality in terms of Alberti representations and $\infty$-modulus and present the theory of $\ast$-upper gradients. Further, we give new and sharper results for approximations of Lipschitz functions, which yields the density of directions. Our results are applicable to all complete and separable metric measure spaces. In the process, we show that there are strong parallels between the Sobolev and Lipschitz worlds.


title: Fair Resource Allocation in Virtualized O-RAN Platforms

abstract: O-RAN systems and their deployment in virtualized general-purpose computing platforms (O-Cloud) constitute a paradigm shift expected to bring unprecedented performance gains. However, these architectures raise new implementation challenges and threaten to worsen the already-high energy consumption of mobile networks. This paper presents first a series of experiments which assess the O-Cloud's energy costs and their dependency on the servers' hardware, capacity and data traffic properties which, typically, change over time. Next, it proposes a compute policy for assigning the base station data loads to O-Cloud servers in an energy-efficient fashion; and a radio policy that determines at near-real-time the minimum transmission block size for each user so as to avoid unnecessary energy costs. The policies balance energy savings with performance, and ensure that both of them are dispersed fairly across the servers and users, respectively. To cater for the unknown and time-varying parameters affecting the policies, we develop a novel online learning framework with fairness guarantees that apply to the entire operation horizon of the system (long-term fairness). The policies are evaluated using trace-driven simulations and are fully implemented in an O-RAN compatible system where we measure the energy costs and throughput in realistic scenarios.


title: Prospects for joint reconstruction of imaging air Cherenkov Telescope array and extensive air shower array

abstract: In this paper we proposed a joint reconstruction of \gray events using both extensive air array (EAS) and Imaging air Cherenkov Telescope array (IACT). We considered eight Cherenkov telescopes to be built on the LHAASO (Large High Altitude Air Shower Observatory) site and investigate the improvement in differential sensitivity when combining the information from both IACT and Moun detectors of LHAASO-KM2A. We found that due to the higher cosmic ray background rejection power and higher gamma ray retention ratio provided by muon detectors of LHAASO, such a joint reconstruction can significantly improve the sensitivity of IACTs, especially for extended sources and long exposure time. In this article, we have shown the performance of an eight-telescopes mini array, and our results indicate that above $10~\rm TeV$, the sensitivity can be improved by muon detector from $25\% - 60\%$ in different energy ranges.


title: Dense Matchers for Dense Tracking

abstract: Optical flow is a useful input for various applications, including 3D reconstruction, pose estimation, tracking, and structure-from-motion. Despite its utility, the field of dense long-term tracking, especially over wide baselines, has not been extensively explored. This paper extends the concept of combining multiple optical flows over logarithmically spaced intervals as proposed by MFT. We demonstrate the compatibility of MFT with different optical flow networks, yielding results that surpass their individual performance. Moreover, we present a simple yet effective combination of these networks within the MFT framework. This approach proves to be competitive with more sophisticated, non-causal methods in terms of position prediction accuracy, highlighting the potential of MFT in enhancing long-term tracking applications.


title: Enhancing Surgical Performance in Cardiothoracic Surgery with Innovations from Computer Vision and Artificial Intelligence: A Narrative Review

abstract: When technical requirements are high, and patient outcomes are critical, opportunities for monitoring and improving surgical skills via objective motion analysis feedback may be particularly beneficial. This narrative review synthesises work on technical and non-technical surgical skills, collaborative task performance, and pose estimation to illustrate new opportunities to advance cardiothoracic surgical performance with innovations from computer vision and artificial intelligence. These technological innovations are critically evaluated in terms of the benefits they could offer the cardiothoracic surgical community, and any barriers to the uptake of the technology are elaborated upon. Like some other specialities, cardiothoracic surgery has relatively few opportunities to benefit from tools with data capture technology embedded within them (as with robotic-assisted laparoscopic surgery, for example). In such cases, pose estimation techniques that allow for movement tracking across a conventional operating field without using specialist equipment or markers offer considerable potential. With video data from either simulated or real surgical procedures, these tools can (1) provide insight into the development of expertise and surgical performance over a surgeon's career, (2) provide feedback to trainee surgeons regarding areas for improvement, (3) provide the opportunity to investigate what aspects of skill may be linked to patient outcomes which can (4) inform the aspects of surgical skill which should be focused on within training or mentoring programmes. Classifier or assessment algorithms that use artificial intelligence to 'learn' what expertise is from expert surgical evaluators could further assist educators in determining if trainees meet competency thresholds.


title: Predicting Breast Cancer Phenotypes from Single-cell RNA-seq Data Using CloudPred

abstract: Numerous tools have been recently developed to predict disease phenotypes using single-cell RNA sequencing (RNA-seq) data. CloudPred is an end-to-end differentiable learning algorithm coupled with a biologically informed mixture model, originally tested on lupus data. This study extends CloudPred's applications to breast cancer disease phenotype prediction to test its robustness and applicability on untested and unrelated biological data. When applying a breast cancer single-cell RNA seq dataset, CloudPred achieved an area under the ROC curve (AUC) of 1 in predicting cancer status and performed better than a linear and Deepset models.


title: Exploring the Emerging Technologies within the Blockchain Landscape

abstract: Although blockchain technology was first introduced in 2008 and materialised in 2009, the early usage of blockchain were mainly limited to financial technologies, particularly cryptocurrencies. Later, blockchain became a widespread emerging technology, utilised in multifaceted sectors and applications. In fact, various new and innovative application of blockchain and distributed ledger technologies are still continuously being researched and explored. On the other hand, smart-contracts were first introduced in 1990s, however, it did not gain enough popularity until being integrated with blockchain technologies lately. The duo lately been seen as the key to many innovations in various industries and sectors. So, we took data from 1445 blockchain-related patent documents and tried to map out the historical and current trends in patenting activities in the blockchain field. This helps us get a better grasp of how blockchain technologies are evolving and being tracked. In addition to serving as an indicator of science and technology growth, patents are also used to judge the research potential and development of a particular technology.


title: Puzzle Solving using Reasoning of Large Language Models: A Survey

abstract: Exploring the capabilities of Large Language Models (LLMs) in puzzle solving unveils critical insights into their potential and challenges in AI, marking a significant step towards understanding their applicability in complex reasoning tasks. This survey leverages a unique taxonomy -- dividing puzzles into rule-based and rule-less categories -- to critically assess LLMs through various methodologies, including prompting techniques, neuro-symbolic approaches, and fine-tuning. Through a critical review of relevant datasets and benchmarks, we assess LLMs' performance, identifying significant challenges in complex puzzle scenarios. Our findings highlight the disparity between LLM capabilities and human-like reasoning, particularly in those requiring advanced logical inference. The survey underscores the necessity for novel strategies and richer datasets to advance LLMs' puzzle-solving proficiency and contribute to AI's logical reasoning and creative problem-solving advancements.


title: Semi-functional partial linear regression with measurement error: An approach based on $k$NN estimation

abstract: This paper focuses on a semiparametric regression model in which the response variable is explained by the sum of two components. One of them is parametric (linear), the corresponding explanatory variable is measured with additive error and its dimension is finite ($p$). The other component models, in a nonparametric way, the effect of a functional variable (infinite dimension) on the response. $k$-NN based estimators are proposed for each component, and some asymptotic results are obtained. A simulation study illustrates the behaviour of such estimators for finite sample sizes, while an application to real data shows the usefulness of our proposal.


title: Different behaviors of wavelet results for type-B and type-C QPOs of MAXI J1535-571 based on NICER data

abstract: Wavelet analysis, in addition to power density spectra, is another method to study the quasi-periodic signals in the light curves, but has been rarely used in black hole X-ray transients. We performed wavelet analysis of X-ray timing features and quasi-periodic oscillations (QPOs) based on NICER observations of the black hole candidate MAXI J1535-571 in this paper. Separating the light curves by the confidence level of wavelet results, we find significant differences exist in the PDS, hardness ratio and mean count between light curve segments above and below the confidence level. The S-factor, which is defined as the ratio of the effective oscillation time and the total time, demonstrates distinct values between type-C and type-B QPOs. Based on our results, the S-factor for type-B QPO is very close or equal to 0, no matter the confidence level is set as 95\% or 68\%, while the S-factor of type-C QPO is significantly higher, especially in the 68\% confidence level case. We discuss the implications of the wavelet results on resolving type-B and type-C QPOs in black hole X-ray binaries.


title: Power Optimization for Integrated Active and Passive Sensing in DFRC Systems

abstract: Most existing works on dual-function radar-communication (DFRC) systems mainly focus on active sensing, but ignore passive sensing. To leverage multi-static sensing capability, we explore integrated active and passive sensing (IAPS) in DFRC systems to remedy sensing performance. The multi-antenna base station (BS) is responsible for communication and active sensing by transmitting signals to user equipments while detecting a target according to echo signals. In contrast, passive sensing is performed at the receive access points (RAPs). We consider both the cases where the capacity of the backhaul links between the RAPs and BS is unlimited or limited and adopt different fusion strategies. Specifically, when the backhaul capacity is unlimited, the BS and RAPs transfer sensing signals they have received to the central controller (CC) for signal fusion. The CC processes the signals and leverages the generalized likelihood ratio test detector to determine the present of a target. However, when the backhaul capacity is limited, each RAP, as well as the BS, makes decisions independently and sends its binary inference results to the CC for result fusion via voting aggregation. Then, aiming at maximize the target detection probability under communication quality of service constraints, two power optimization algorithms are proposed. Finally, numerical simulations demonstrate that the sensing performance in case of unlimited backhaul capacity is much better than that in case of limited backhaul capacity. Moreover, it implied that the proposed IAPS scheme outperforms only-passive and only-active sensing schemes, especially in unlimited capacity case.


title: OneBit: Towards Extremely Low-bit Large Language Models

abstract: Model quantification uses low bit-width values to represent the weight matrices of existing models to be quantized, which is a promising approach to reduce both storage and computational overheads of deploying highly anticipated LLMs. However, current quantization methods suffer severe performance degradation when the bit-width is extremely reduced, and thus focus on utilizing 4-bit or 8-bit values to quantize models. This paper boldly quantizes the weight matrices of LLMs to 1-bit, paving the way for the extremely low bit-width deployment of LLMs. For this target, we introduce a 1-bit model compressing framework named OneBit, including a novel 1-bit parameter representation method to better quantize LLMs as well as an effective parameter initialization method based on matrix decomposition to improve the convergence speed of the quantization framework. Sufficient experimental results indicate that OneBit achieves good performance (at least 81% of the non-quantized performance on LLaMA models) with robust training processes when only using 1-bit weight matrices.


title: Dissecting Human and LLM Preferences

abstract: As a relative quality comparison of model responses, human and Large Language Model (LLM) preferences serve as common alignment goals in model fine-tuning and criteria in evaluation. Yet, these preferences merely reflect broad tendencies, resulting in less explainable and controllable models with potential safety risks. In this work, we dissect the preferences of human and 32 different LLMs to understand their quantitative composition, using annotations from real-world user-model conversations for a fine-grained, scenario-wise analysis. We find that humans are less sensitive to errors, favor responses that support their stances, and show clear dislike when models admit their limits. On the contrary, advanced LLMs like GPT-4-Turbo emphasize correctness, clarity, and harmlessness more. Additionally, LLMs of similar sizes tend to exhibit similar preferences, regardless of their training methods, and fine-tuning for alignment does not significantly alter the preferences of pretrained-only LLMs. Finally, we show that preference-based evaluation can be intentionally manipulated. In both training-free and training-based settings, aligning a model with the preferences of judges boosts scores, while injecting the least preferred properties lowers them. This results in notable score shifts: up to 0.59 on MT-Bench (1-10 scale) and 31.94 on AlpacaEval 2.0 (0-100 scale), highlighting the significant impact of this strategic adaptation. Interactive Demo: https://huggingface.co/spaces/GAIR/Preference-Dissection-Visualization Dataset: https://huggingface.co/datasets/GAIR/preference-dissection Code: https://github.com/GAIR-NLP/Preference-Dissection


title: MMMModal -- Multi-Images Multi-Audio Multi-turn Multi-Modal

abstract: Our contribution introduces a groundbreaking multimodal large language model designed to comprehend multi-images, multi-audio, and multi-images-multi-audio within a single multiturn session. Leveraging state-of-the-art models, we utilize the SigLIP encoder for visual inputs and the Whisper Encoder for audio inputs. Notably, this multimodal large language model is bilingual, proficient in understanding both English and Malay simultaneously. We proudly unveil two versions of this model: TinyLlama with 1.1B parameters, and Mistral with 7B parameters. With its ability to navigate diverse modalities and languages, our model represents a significant advancement for the Malaysian context and beyond. All models released at https://huggingface.co/collections/mesolitica/multimodal-malaysian-llm-65c6f893e03f78fa9e5c8859


title: Clebsch-Gordan coefficients, hypergeometric functions and the binomial distribution

abstract: A particular case of degenerate Clebsch-Gordan coefficient can be expressed with three binomial coefficients. Such a formula, which may be obtained using the standard ladder operator procedure, can also be derived from the Racah-Shimpuku formula or from expressions of Clebsch-Gordan coefficients in terms of $_3F_2$ hypergeometric functions. The O'Hara interesting interpretation of this Clebsch-Gordan coefficient by binomial random variables can also be related to hypergeometric functions ($_2F_1$), in the case where one of the parameters tends to infinity. This emphasizes the links between Clebsch-Gordan coefficients, hypergeometric functions and, what has been less exploited until now, the notion of probability within the framework of the quantum theory of angular momentum.


title: Quasi-optimal complexity $hp$-FEM for Poisson on a rectangle

abstract: We show, in one dimension, that an $hp$-Finite Element Method ($hp$-FEM) discretisation can be solved in optimal complexity because the discretisation has a special sparsity structure that ensures that the \emph{reverse Cholesky factorisation} -- Cholesky starting from the bottom right instead of the top left -- remains sparse. Moreover, computing and inverting the factorisation almost entirely trivially parallelises across the different elements. By incorporating this approach into an Alternating Direction Implicit (ADI) method \`a la Fortunato and Townsend (2020) we can solve, within a prescribed tolerance, an $hp$-FEM discretisation of the (screened) Poisson equation on a rectangle, in parallel, with quasi-optimal complexity: $O(N^2 \log N)$ operations where $N$ is the maximal total degrees of freedom in each dimension. When combined with fast Legendre transforms we can also solve nonlinear time-evolution partial differential equations in a quasi-optimal complexity of $O(N^2 \log^2 N)$ operations, which we demonstrate on the (viscid) Burgers' equation.


title: Dynamical system analysis of DBI scalar field cosmology in coincident $f(Q)$ gravity

abstract: In this article, we offer the dynamical system analysis of the DBI (Dirac-Born-Infeld) scalar field in a modified $f(Q)$ gravity context. We have taken a polynomial form of modified gravity and used two different kinds of scalar potential, i.e., polynomial and exponential, and found a closed autonomous dynamical system of equations. We have analyzed the fixed points of such a system and commented on the conditions under which deceleration to late-time acceleration happens in this model. We have noted the similarity of the two models and have also shown that our result is indeed consistent with the previous work done on Einstein's gravity. We have also investigated the phenomenological implications of our models by plotting the EoS ($\omega$), Energy density ($\Omega$), and deceleration parameter ($q$) w.r.t. to e-fold time and comparing with the present value. Finally, we conclude the paper by observing how the dynamical system analysis differs in modified $f(Q)$ gravity, and we also provide some of the future scope of our work.


title: ReViT: Enhancing Vision Transformers with Attention Residual Connections for Visual Recognition

abstract: Vision Transformer (ViT) self-attention mechanism is characterized by feature collapse in deeper layers, resulting in the vanishing of low-level visual features. However, such features can be helpful to accurately represent and identify elements within an image and increase the accuracy and robustness of vision-based recognition systems. Following this rationale, we propose a novel residual attention learning method for improving ViT-based architectures, increasing their visual feature diversity and model robustness. In this way, the proposed network can capture and preserve significant low-level features, providing more details about the elements within the scene being analyzed. The effectiveness and robustness of the presented method are evaluated on five image classification benchmarks, including ImageNet1k, CIFAR10, CIFAR100, Oxford Flowers-102, and Oxford-IIIT Pet, achieving improved performances. Additionally, experiments on the COCO2017 dataset show that the devised approach discovers and incorporates semantic and spatial relationships for object detection and instance segmentation when implemented into spatial-aware transformer models.


title: Knowledge Graph-based Session Recommendation with Adaptive Propagation

abstract: Session-based recommender systems (SBRSs) predict users' next interacted items based on their historical activities. While most SBRSs capture purchasing intentions locally within each session, capturing items' global information across different sessions is crucial in characterizing their general properties. Previous works capture this cross-session information by constructing graphs and incorporating neighbor information. However, this incorporation cannot vary adaptively according to the unique intention of each session, and the constructed graphs consist of only one type of user-item interaction. To address these limitations, we propose knowledge graph-based session recommendation with session-adaptive propagation. Specifically, we build a knowledge graph by connecting items with multi-typed edges to characterize various user-item interactions. Then, we adaptively aggregate items' neighbor information considering user intention within the learned session. Experimental results demonstrate that equipping our constructed knowledge graph and session-adaptive propagation enhances session recommendation backbones by 10%-20%. Moreover, we provide an industrial case study showing our proposed framework achieves 2% performance boost over an existing well-deployed model at The Home Depot e-platform.


title: FViT: A Focal Vision Transformer with Gabor Filter

abstract: Vision transformers have achieved encouraging progress in various computer vision tasks. A common belief is that this is attributed to the competence of self-attention in modeling the global dependencies among feature tokens. Unfortunately, self-attention still faces some challenges in dense prediction tasks, such as the high computational complexity and absence of desirable inductive bias. To address these issues, we revisit the potential benefits of integrating vision transformer with Gabor filter, and propose a Learnable Gabor Filter (LGF) by using convolution. As an alternative to self-attention, we employ LGF to simulate the response of simple cells in the biological visual system to input images, prompting models to focus on discriminative feature representations of targets from various scales and orientations. Additionally, we design a Bionic Focal Vision (BFV) block based on the LGF. This block draws inspiration from neuroscience and introduces a Multi-Path Feed Forward Network (MPFFN) to emulate the working way of biological visual cortex processing information in parallel. Furthermore, we develop a unified and efficient pyramid backbone network family called Focal Vision Transformers (FViTs) by stacking BFV blocks. Experimental results show that FViTs exhibit highly competitive performance in various vision tasks. Especially in terms of computational efficiency and scalability, FViTs show significant advantages compared with other counterparts. Code is available at https://github.com/nkusyl/FViT


title: What Powered the Kilonova-Like Emission After GRB 230307A in the Framework of a Neutron Star-White Dwarf Merger?

abstract: The second brightest gamma-ray burst, GRB 230307A (with a duration $T_{90}$ ~ 40 s), exhibited characteristics indicative of a magnetar engine during the prompt emission phase. Notably, a suspected kilonova was identified in its follow-up optical and infrared observations. Here we propose that the origin of GRB 230307A is a neutron star-white dwarf (NS-WD) merger, as this could naturally interpret the long duration and the large physical offset from the center of its host galaxy. In the framework of such a NS-WD merger event, the late-time kilonova-like emission is very likely to be powered by the spin-down of the magnetar and the radioactive decay of $^{56}$Ni, rather than by the decay of r-process elements as these heavy elements may not be easy to be synthesized in a NS-WD merger. It is demonstrated that the above scenario can be supported by our fit to the late-time observational data, where a mass of ~ $10^{-3} \ \rm M_{\odot}$ $^{56}$Ni is involved in the ejecta of a mass of ~ $0.1 \ \rm M_{\odot}$. Particularly, the magnetar parameters required by the fit are consistent with those derived from the early X-ray observation.


title: On Good Practices for Task-Specific Distillation of Large Pretrained Visual Models

abstract: Large pretrained visual models exhibit remarkable generalization across diverse recognition tasks. Yet, real-world applications often demand compact models tailored to specific problems. Variants of knowledge distillation have been devised for such a purpose, enabling task-specific compact models (the students) to learn from a generic large pretrained one (the teacher). In this paper, we show that the excellent robustness and versatility of recent pretrained models challenge common practices established in the literature, calling for a new set of optimal guidelines for task-specific distillation. To address the lack of samples in downstream tasks, we also show that a variant of Mixup based on stable diffusion complements standard data augmentation. This strategy eliminates the need for engineered text prompts and improves distillation of generic models into streamlined specialized networks.


title: Linear and Non-Linear Models for Master Scheduling of Dynamic Resources Product Mix

abstract: The literature on master production scheduling for product mix problems under the Theory of Constraints (TOC) was considered by many previous studies. Most studies assume a static resources availability. In this study, the raw materials supplied to the manufacturer is considered as dynamic depending on the results of the problem. Thus, an integer linear heuristic, an integer non-linear optimization model, and a basic non-linear model are developed to find a good solution of the problem. The results of the three models were compared to each other in terms of profit, raw materials costs, inventory costs and raw materials utilization. Recent studies in the field are reviewed and conclusions are drawn.


title: ICHPro: Intracerebral Hemorrhage Prognosis Classification Via Joint-attention Fusion-based 3d Cross-modal Network

abstract: Intracerebral Hemorrhage (ICH) is the deadliest subtype of stroke, necessitating timely and accurate prognostic evaluation to reduce mortality and disability. However, the multi-factorial nature and complexity of ICH make methods based solely on computed tomography (CT) image features inadequate. Despite the capacity of cross-modal networks to fuse additional information, the effective combination of different modal features remains a significant challenge. In this study, we propose a joint-attention fusion-based 3D cross-modal network termed ICHPro that simulates the ICH prognosis interpretation process utilized by neurosurgeons. ICHPro includes a joint-attention fusion module to fuse features from CT images with demographic and clinical textual data. To enhance the representation of cross-modal features, we introduce a joint loss function. ICHPro facilitates the extraction of richer cross-modal features, thereby improving classification performance. Upon testing our method using a five-fold cross-validation, we achieved an accuracy of 89.11%, an F1 score of 0.8767, and an AUC value of 0.9429. These results outperform those obtained from other advanced methods based on the test dataset, thereby demonstrating the superior efficacy of ICHPro. The code is available at our Github: https://github.com/YU-deep/ICH.


title: Non-constant functions with zero nonlocal gradient and their role in nonlocal Neumann-type problems

abstract: This work revolves around properties and applications of functions whose nonlocal gradient, or more precisely, finite-horizon fractional gradient, vanishes. Surprisingly, in contrast to the classical local theory, we show that this class forms an infinite-dimensional vector space. Our main result characterizes the functions with zero nonlocal gradient in terms of two simple features, namely, their values in a layer around the boundary and their average. The proof exploits recent progress in the solution theory of boundary-value problems with pseudo-differential operators. We complement these findings with a discussion of the regularity properties of such functions and give illustrative examples. Regarding applications, we provide several useful technical tools for working with nonlocal Sobolev spaces when the common complementary-value conditions are dropped. Among these, are new nonlocal Poincar\'e inequalities and compactness statements, which are obtained after factoring out functions with vanishing nonlocal gradient. Following a variational approach, we exploit the previous findings to study a class of nonlocal partial differential equations subject to natural boundary conditions, in particular, nonlocal Neumann-type problems. Our analysis includes a proof of well-posedness and a rigorous link with their classical local counterparts via $\Gamma$-convergence as the fractional parameter tends to 1.