title: ClawMachine: Fetching Visual Tokens as An Entity for Referring and Grounding

abstract: An essential topic for multimodal large language models (MLLMs) is aligning vision and language concepts at a finer level. In particular, we devote efforts to encoding visual referential information for tasks such as referring and grounding. Existing methods, including proxy encoding and geometry encoding, incorporate additional syntax to encode the object's location, bringing extra burdens in training MLLMs to communicate between language and vision. This study presents ClawMachine, offering a new methodology that notates an entity directly using the visual tokens. It allows us to unify the prompt and answer of visual referential tasks without additional syntax. Upon a joint vision-language vocabulary, ClawMachine unifies visual referring and grounding into an auto-regressive format and learns with a decoder-only architecture. Experiments validate that our model achieves competitive performance across visual referring and grounding tasks with a reduced demand for training data. Additionally, ClawMachine demonstrates a native ability to integrate multi-source information for complex visual reasoning, which prior MLLMs can hardly perform without specific adaptions.


title: Are Large Language Models True Healthcare Jacks-of-All-Trades? Benchmarking Across Health Professions Beyond Physician Exams

abstract: Recent advancements in Large Language Models (LLMs) have demonstrated their potential in delivering accurate answers to questions about world knowledge. Despite this, existing benchmarks for evaluating LLMs in healthcare predominantly focus on medical doctors, leaving other critical healthcare professions underrepresented. To fill this research gap, we introduce the Examinations for Medical Personnel in Chinese (EMPEC), a pioneering large-scale healthcare knowledge benchmark in traditional Chinese. EMPEC consists of 157,803 exam questions across 124 subjects and 20 healthcare professions, including underrepresented occupations like Optometrists and Audiologists. Each question is tagged with its release time and source, ensuring relevance and authenticity. We conducted extensive experiments on 17 LLMs, including proprietary, open-source models, general domain models and medical specific models, evaluating their performance under various settings. Our findings reveal that while leading models like GPT-4 achieve over 75\% accuracy, they still struggle with specialized fields and alternative medicine. Surprisingly, general-purpose LLMs outperformed medical-specific models, and incorporating EMPEC's training data significantly enhanced performance. Additionally, the results on questions released after the models' training cutoff date were consistent with overall performance trends, suggesting that the models' performance on the test set can predict their effectiveness in addressing unseen healthcare-related queries. The transition from traditional to simplified Chinese characters had a negligible impact on model performance, indicating robust linguistic versatility. Our study underscores the importance of expanding benchmarks to cover a broader range of healthcare professions to better assess the applicability of LLMs in real-world healthcare scenarios.


title: Molybdenum low resistance thin film resistors for cryogenic devices

abstract: We present a study of thin-film molybdenum resistors for NbN electronics operating at cryogenic temperatures. The key step is the 0.5-1.5 keV ion cleaning-activation of NbN before Mo deposition which allows to obtain a high-quality Mo/NbN interface which together with additional aluminum bandage layer in the area of contact pads allow to reduce contact resistance below 1 Ohm. The quality of the interfaces is confirmed by transmission electron microscopy and X-ray reflectometry.


title: A Dictionary Based Approach for Removing Out-of-Focus Blur

abstract: The field of image deblurring has seen tremendous progress with the rise of deep learning models. These models, albeit efficient, are computationally expensive and energy consuming. Dictionary based learning approaches have shown promising results in image denoising and Single Image Super-Resolution. We propose an extension of the Rapid and Accurate Image Super-Resolution (RAISR) algorithm introduced by Isidoro, Romano and Milanfar for the task of out-of-focus blur removal. We define a sharpness quality measure which aligns well with the perceptual quality of an image. A metric based blending strategy based on asset allocation management is also proposed. Our method demonstrates an average increase of approximately 13% (PSNR) and 10% (SSIM) compared to popular deblurring methods. Furthermore, our blending scheme curtails ringing artefacts post restoration.


title: They're All Doctors: Synthesizing Diverse Counterfactuals to Mitigate Associative Bias

abstract: Vision Language Models (VLMs) such as CLIP are powerful models; however they can exhibit unwanted biases, making them less safe when deployed directly in applications such as text-to-image, text-to-video retrievals, reverse search, or classification tasks. In this work, we propose a novel framework to generate synthetic counterfactual images to create a diverse and balanced dataset that can be used to fine-tune CLIP. Given a set of diverse synthetic base images from text-to-image models, we leverage off-the-shelf segmentation and inpainting models to place humans with diverse visual appearances in context. We show that CLIP trained on such datasets learns to disentangle the human appearance from the context of an image, i.e., what makes a doctor is not correlated to the person's visual appearance, like skin color or body type, but to the context, such as background, the attire they are wearing, or the objects they are holding. We demonstrate that our fine-tuned CLIP model, $CF_\alpha$, improves key fairness metrics such as MaxSkew, MinSkew, and NDKL by 40-66\% for image retrieval tasks, while still achieving similar levels of performance in downstream tasks. We show that, by design, our model retains maximal compatibility with the original CLIP models, and can be easily controlled to support different accuracy versus fairness trade-offs in a plug-n-play fashion.


title: Joint Distributed Generation Maximization and Radial Distribution Network Reconfiguration

abstract: This paper studies an optimization problem for joint radial distribution system network reconfiguration and power dispatch for distributed generation (DG) maximization. We provide counterexamples to show that for DG maximization, standard techniques such as interior point method (as in Matpower), linear approximation and second order cone relaxation (e.g., by Jabr et.~al.~and by Farivar and Low) do not deliver the desired control. Instead, we propose a control decision model based on exact DistFlow equations bypassing relaxation and a solution approach based on spatial branch-and-bound algorithm. We justify our work with comparative studies and numerical demonstrations with benchmarks and a 533-bus real example, performing reconfiguration and power dispatch in a time scale relevant for control center applications.


title: Hallucination Mitigation Prompts Long-term Video Understanding

abstract: Recently, multimodal large language models have made significant advancements in video understanding tasks. However, their ability to understand unprocessed long videos is very limited, primarily due to the difficulty in supporting the enormous memory overhead. Although existing methods achieve a balance between memory and information by aggregating frames, they inevitably introduce the severe hallucination issue. To address this issue, this paper constructs a comprehensive hallucination mitigation pipeline based on existing MLLMs. Specifically, we use the CLIP Score to guide the frame sampling process with questions, selecting key frames relevant to the question. Then, We inject question information into the queries of the image Q-former to obtain more important visual features. Finally, during the answer generation stage, we utilize chain-of-thought and in-context learning techniques to explicitly control the generation of answers. It is worth mentioning that for the breakpoint mode, we found that image understanding models achieved better results than video understanding models. Therefore, we aggregated the answers from both types of models using a comparison mechanism. Ultimately, We achieved 84.2\% and 62.9\% for the global and breakpoint modes respectively on the MovieChat dataset, surpassing the official baseline model by 29.1\% and 24.1\%. Moreover the proposed method won the third place in the CVPR LOVEU 2024 Long-Term Video Question Answering Challenge. The code is avaiable at https://github.com/lntzm/CVPR24Track-LongVideo


title: Program Synthesis Benchmark for Visual Programming in XLogoOnline Environment

abstract: Large language and multimodal models have shown remarkable successes on various benchmarks focused on specific skills such as general-purpose programming, natural language understanding, math word problem-solving, and visual question answering. However, it is unclear how well these models perform on tasks that require a combination of these skills. In this paper, we curate a novel program synthesis benchmark based on the XLogoOnline visual programming environment. The benchmark comprises 85 real-world tasks from the Mini-level of the XLogoOnline environment, each requiring a combination of different skills such as spatial planning, basic programming, and logical reasoning. Our evaluation shows that current state-of-the-art models like GPT-4V and Llama3-70B struggle to solve these tasks, achieving only 20% and 2.35% success rates. Next, we develop a fine-tuning pipeline to boost the performance of models by leveraging a large-scale synthetic training dataset with over 80000 tasks. Moreover, we showcase how emulator-driven feedback can be used to design a curriculum over training data distribution. We showcase that a fine-tuned Llama3-8B drastically outperforms GPT-4V and Llama3-70B models, and provide an in-depth analysis of the models' expertise across different skill dimensions. We will publicly release the benchmark for future research on program synthesis in visual programming.


title: Multimodal Security of Iris and Fingerprint with Bloom Filters

abstract: The standard methods of identification such as PIN Numbers (Personal Identification Number), Passwords, smart cards can be easily stolen and can be misused easily. To overcome this, biometric is introduced, as it will be unique to each individual. In this modern world, security has become a serious threat. So many biometric securities have also come up to secure. In biometrics, the iris has become more popular and widely used biometric because of its stability. This iris is researched for the past two decades along with computer technology. This paper will tell about basic concepts of iris, fingerprint, and securing iris with Cancellable Biometrics. Often we get iris templates and store in server or database. There is a chance of losing the data as well as security is a big question here. Here we are proposing a system for protecting iris templates using bloom filters with feature fusion of iris with fingerprint to provide security. Bloom filters are a useful asset in the fields of computer science. In feature-level fusion, the function units originating from more than one biometric assets are consolidated into a single feature set by the appliance of acceptable feature standardization, transformation, and reduction schemes. We can combine bloom filters with feature level fusion for more secure iris templates.


title: LFPLM: A General and Flexible Load Forecasting Framework based on Pre-trained Language Model

abstract: Accurate load forecasting is essential for maintaining the power balance between generators and consumers, especially with the increasing integration of renewable energy sources, which introduce significant intermittent volatility. With the development of data-driven methods, machine learning and deep learning-based models have become the predominant approach for load forecasting tasks. In recent years, pre-trained language models (PLMs) have made significant advancements, demonstrating superior performance in various fields. This paper proposes a load forecasting method based on PLMs, which offers not only accurate predictive ability but also general and flexible applicability. Additionally, a data modeling method is proposed to effectively transform load sequence data into natural language for PLM training. Furthermore, we introduce a data enhancement strategy that eliminate the impact of PLM hallucinations on forecasting results. The effectiveness of the proposed method has been validated on two real-world datasets. Compared with existing methods, our approach shows state-of-the-art performance across all validation metrics.


title: A modified Cayley transform for SU(3)

abstract: We propose a modification to the Cayley transform that defines a suitable local parameterization for the special unitary group $\mathrm{SU(3)}$. The new mapping is used to construct splitting methods for separable Hamiltonian systems whose phase space is the cotangent bundle of $\mathrm{SU(3)}$ or, more general, $\mathrm{SU(3)}^N$, $N \in \mathbb{N}$. Special attention is given to the hybrid Monte Carlo algorithm for gauge field generation in lattice quantum chromodynamics. We show that the use of the modified Cayley transform instead of the matrix exponential neither affects the time-reversibility nor the volume-preservation of the splitting method. Furthermore, the advantages and disadvantages of the Cayley-based algorithms are discussed and illustrated in pure gauge field simulations.


title: Fine-grained Controllable Text Generation through In-context Learning with Feedback

abstract: We present a method for rewriting an input sentence to match specific values of nontrivial linguistic features, such as dependency depth. In contrast to earlier work, our method uses in-context learning rather than finetuning, making it applicable in use cases where data is sparse. We show that our model performs accurate rewrites and matches the state of the art on rewriting sentences to a specified school grade level.


title: Unveiling Assumptions: Exploring the Decisions of AI Chatbots and Human Testers

abstract: The integration of Large Language Models (LLMs) and chatbots introduces new challenges and opportunities for decision-making in software testing. Decision-making relies on a variety of information, including code, requirements specifications, and other software artifacts that are often unclear or exist solely in the developer's mind. To fill in the gaps left by unclear information, we often rely on assumptions, intuition, or previous experiences to make decisions. This paper explores the potential of LLM-based chatbots like Bard, Copilot, and ChatGPT, to support software testers in test decisions such as prioritizing test cases effectively. We investigate whether LLM-based chatbots and human testers share similar "assumptions" or intuition in prohibitive testing scenarios where exhaustive execution of test cases is often impractical. Preliminary results from a survey of 127 testers indicate a preference for diverse test scenarios, with a significant majority (96%) favoring dissimilar test sets. Interestingly, two out of four chatbots mirrored this preference, aligning with human intuition, while the others opted for similar test scenarios, chosen by only 3.9% of testers. Our initial insights suggest a promising avenue within the context of enhancing the collaborative dynamics between testers and chatbots.


title: CM2-Net: Continual Cross-Modal Mapping Network for Driver Action Recognition

abstract: Driver action recognition has significantly advanced in enhancing driver-vehicle interactions and ensuring driving safety by integrating multiple modalities, such as infrared and depth. Nevertheless, compared to RGB modality only, it is always laborious and costly to collect extensive data for all types of non-RGB modalities in car cabin environments. Therefore, previous works have suggested independently learning each non-RGB modality by fine-tuning a model pre-trained on RGB videos, but these methods are less effective in extracting informative features when faced with newly-incoming modalities due to large domain gaps. In contrast, we propose a Continual Cross-Modal Mapping Network (CM2-Net) to continually learn each newly-incoming modality with instructive prompts from the previously-learned modalities. Specifically, we have developed Accumulative Cross-modal Mapping Prompting (ACMP), to map the discriminative and informative features learned from previous modalities into the feature space of newly-incoming modalities. Then, when faced with newly-incoming modalities, these mapped features are able to provide effective prompts for which features should be extracted and prioritized. These prompts are accumulating throughout the continual learning process, thereby boosting further recognition performances. Extensive experiments conducted on the Drive&Act dataset demonstrate the performance superiority of CM2-Net on both uni- and multi-modal driver action recognition.


title: A Systematic Analysis of Large Language Models as Soft Reasoners: The Case of Syllogistic Inferences

abstract: The reasoning abilities of Large Language Models (LLMs) are becoming a central focus of study in NLP. In this paper, we consider the case of syllogistic reasoning, an area of deductive reasoning studied extensively in logic and cognitive psychology. Previous research has shown that pre-trained LLMs exhibit reasoning biases, such as $\textit{content effects}$, avoid answering that $\textit{no conclusion follows}$, display human-like difficulties, and struggle with multi-step reasoning. We contribute to this research line by systematically investigating the effects of chain-of-thought reasoning, in-context learning (ICL), and supervised fine-tuning (SFT) on syllogistic reasoning, considering syllogisms with conclusions that support or violate world knowledge, as well as ones with multiple premises. Crucially, we go beyond the standard focus on accuracy, with an in-depth analysis of the conclusions generated by the models. Our results suggest that the behavior of pre-trained LLMs can be explained by heuristics studied in cognitive science and that both ICL and SFT improve model performance on valid inferences, although only the latter mitigates most reasoning biases without harming model consistency.


title: KAOS: Large Model Multi-Agent Operating System

abstract: The intelligent interaction model based on large models reduces the differences in user experience across various system platforms but faces challenges in multi-agent collaboration and resource sharing. To demonstrate a uniform user experience across different foundational software platforms and address resource coordination management challenges, this paper proposes a multi-agent operating system based on the open-source Kylin. The research method involves empowering agents with large models to serve applications. First, by introducing management role agents and vertical multi-agent collaboration to construct or replace typical application software. Second, by studying system-level shared resource scheduling strategies to enhance user experience and optimize resource utilization. And finally, by validating the efficiency and superiority of the large model multi-agent operating system through real applications and scoring intelligence. The feasibility of this system is demonstrated, providing a new perspective for the development of multi-agent operating systems. Experimental results show significant advantages of multi-agent collaboration in various application scenarios.


title: Error Control and Automatic Detection of Reference Active Spaces in Many-Body Expanded Full Configuration Interaction

abstract: We present a wide-reaching revamp of the generalized many-body expanded full configuration interaction (MBE-FCI) method. First, we outline how to automatize the selection of reference active spaces whereby the inherent bias introduced through a manual identification is reduced, also within the context of traditional complete active space methods. Second, we allow for the use of compact orbital clusters as expansion objects, which works to circumvent the unfavorable scaling with the number of orbitals included in the space complementary to the reference orbitals. Finally, we present a new algorithm for ensuring that many-body expansions can be efficiently terminated while conservatively accounting for resulting errors. These developments are all tested on a variety of molecular systems and different orbital representations to illustrate the abilities of our algorithm to produce correlation energies within predetermined error bounds, significantly broadening the overall applicability of the MBE-FCI method.


title: Progress, problems and prospects of room-temperature superconductivity

abstract: Discovery of superconductivity at megabar (MB) pressures in hydrogen sulfide H3S, then in metal polyhydrides, starting with binary, LaH10, etc., and ending with ternary ones, including (La, Y)H10, revolutionized the field of condensed matter physics. These discoveries strengthen hopes for solution of the century-old problem of creating materials that are superconducting at room temperature. In experiments performed over the past 5 years at MB pressures, in addition to the synthesis of hydrides itself, their physical properties were studied using optical, X-ray and Mossbauer spectroscopy, as well as galvanomagnetic measurement techniques. This paper presents the major results of galvanomagnetic studies, including measurements in high static (up to 21T) and pulsed (up to 70T) magnetic fields. Measurements of resistance drops to vanishingly small level at temperatures below the critical Tc value, a decrease in the critical temperature Tc with increasing magnetic field, as well as diamagnetic screening, indicate the superconducting state of the polyhydrides. The results of measurements of the isotope effect, together with the effect of magnetic impurities on Tc, indicate the electron-phonon mechanism of electron pairing. However, electron-electron correlations in polyhydrides are by no means small, both in the superconducting and normal states. It is possible that this is precisely what accounts for the unusual properties of polyhydrides that have not yet received a satisfactory explanation, such as a linear temperature dependence of the second critical field Hc2(T), a linear dependence of resistance R(T), and a linear magnetoresistance, very similar to that discovered by P. L. Kapitza in 1929.


title: Full-ECE: A Metric For Token-level Calibration on Large Language Models

abstract: Deep Neural Networks (DNNs) excel in various domains but face challenges in providing accurate uncertainty estimates, which are crucial for high-stakes applications. Large Language Models (LLMs) have recently emerged as powerful tools, demonstrating exceptional performance in language tasks. However, traditional calibration metrics such as Expected Calibration Error (ECE) and classwise-ECE (cw-ECE) are inadequate for LLMs due to their vast vocabularies, data complexity, and distributional focus. To address this, we propose a novel calibration concept called full calibration and introduce its corresponding metric, Full-ECE. Full-ECE evaluates the entire predicted probability distribution, offering a more accurate and robust measure of calibration for LLMs.


title: WaDec: Decompile WebAssembly Using Large Language Model

abstract: WebAssembly (abbreviated Wasm) has emerged as a cornerstone of web development, offering a compact binary format that allows high-performance applications to run at near-native speeds in web browsers. Despite its advantages, Wasm's binary nature presents significant challenges for developers and researchers, particularly regarding readability when debugging or analyzing web applications. Therefore, effective decompilation becomes crucial. Unfortunately, traditional decompilers often struggle with producing readable outputs. While some large language model (LLM)-based decompilers have shown good compatibility with general binary files, they still face specific challenges when dealing with Wasm. In this paper, we introduce a novel approach, WaDec, which is the first use of a fine-tuned LLM to interpret and decompile Wasm binary code into a higher-level, more comprehensible source code representation. The LLM was meticulously fine-tuned using a specialized dataset of wat-c code snippets, employing self-supervised learning techniques. This enables WaDec to effectively decompile not only complete wat functions but also finer-grained wat code snippets. Our experiments demonstrate that WaDec markedly outperforms current state-of-the-art tools, offering substantial improvements across several metrics. It achieves a code inflation rate of only 3.34%, a dramatic 97% reduction compared to the state-of-the-art's 116.94%. Unlike baselines' output that cannot be directly compiled or executed, WaDec maintains a recompilability rate of 52.11%, a re-execution rate of 43.55%, and an output consistency of 27.15%. Additionally, it significantly exceeds state-of-the-art performance in AST edit distance by 185%, cyclomatic complexity by 8%, and cosine similarity by 41%, achieving an average code similarity above 50%.


title: Ergodic Estimation and Model Assessment for Dynamic Exceedance Times

abstract: This article concerns the estimation of hitting time statistics for potentially non-stationary processes. The main focus is exceedance times of environmental processes. To this end we consider an empirical estimator based on ergodic theory under the assumption that the considered process is a deterministic transformation of some ergodic process. This estimator is empirically analysed and rigorous convergence results, including a central limit theorem, are covered. Using our estimator, we compute confidence intervals for mean exceedance times of empirical wind data. This serves as a baseline for assessing the performance of several models in terms of predicted mean exceedance time. Special attention is given to the model class known as Gaussian copula processes, which models the environmental process as a deterministic, possibly time-dependent, transformation of a stationary parent Gaussian process.


title: Shape uncertainty analysis of laminar forced convection in a round microchannel with viscous dissipation

abstract: The shape of a microchannel is usually affected by a significant uncertainty due to the small size of the cross-section, comparable with the typical wall-roughness length scale. Such an uncertainty is present at any scale, but it is definitely amplified and, hence, significantly important when the hydraulic diameter becomes smaller than some tenth micrometers. The focus of this paper is on the numerical analysis of the sensitivity to shape random modification, within a prefixed maximum extent, of the main flow and heat transfer characteristics of fully-developed forced convection. The numerical solutions are carried out by employing a finite-element solver repeated over a statistical sample of randomly generated perimetral profiles that simulate the wall roughness. The study includes the evaluation of the Fanning friction factor and of the Nusselt number for the T, H1 and H2 thermal boundary conditions.


title: Explicit Hilbert spaces for the unitary dual of rank one orthogonal groups and applications

abstract: We realize all irreducible unitary representations of the group $\mathrm{SO}_0(n+1,1)$ on explicit Hilbert spaces of vector-valued $L^2$-functions on $\mathbb{R}^n\setminus\{0\}$. The key ingredient in our construction is an explicit expression for the standard Knapp-Stein intertwining operators between arbitrary principal series representations in terms of the Euclidean Fourier transform on a maximal unipotent subgroup isomorphic to $\mathbb{R}^n$. As an application, we describe the space of Whittaker vectors on all irreducible Casselman-Wallach representations. Moreover, the new realizations of the irreducible unitary representations immediately reveal their decomposition into irreducible representations of a parabolic subgroup, thus providing a simple proof of a recent result of Liu-Oshima-Yu.


title: Quantum Algorithm for a Stochastic Multicloud Model

abstract: Quantum computers have attracted much attention in recent years. This may be because the development of the actual quantum machine is accelerating. Research on how to use quantum computers is active in the fields such as quantum chemistry and machine learning, where vast amounts of computation are required. However, in weather and climate simulations, less research has been done despite similar computational demands. In this study, a quantum computing algorithm was applied to a problem of the atmospheric science to demonstrate that it can achieve the same simulations as a conventional algorithm designed for the classical computers. More specifically, the stochastic nature of a multi-cloud model was reproduced by utilizing probabilistic outputs of computed quantum states. Our results demonstrate that quantum computers can suitably solve some problems in atmospheric and oceanic phenomena, in which stochasticity is widely inherent.


title: A Subclass of Mu-Calculus with the Freeze Quantifier Equivalent to Buchi Register Automata

abstract: Register automaton (RA) is an extension of finite automaton for dealing with data values in an infinite domain. In the previous work, we proposed disjunctive mu$^\downarrow$-calculus, which is a subclass of modal mu-calculus with the freeze quantifier, and showed that it has the same expressive power as RA. However, disjunctive mu$^\downarrow$-calculus is defined as a logic on finite words, whereas temporal specifications in model checking are usually given in terms of infinite words. In this paper, we re-define the syntax and semantics of disjunctive mu$^\downarrow$-calculus to be suitable for infinite words and prove that the obtained temporal logic has the same expressive power as Buchi RA.


title: Disentangling electric field effect on spin waves in ferromagnetic insulators

abstract: In this paper we extend the micromagnetic theory of magnetostatic surface waves in insulating ferromagnetic thin films to include the applied electric field effects. We start by identifying the two main effects on the dispersion relation: the first one is of relativistic nature and emerges as a consequence of the Ahronov-Casher effect, while the second one is a consequence of the electric field induced symmetry breaking operating at the level of magnetic exchange interactions. We support our theory by comparing its predictions with experimental data on ittrium iron garnet thin films taken from the literature. The main result is to evidence the limitations of using the same value of the applied electric field to address both effects and to emphasize that crystal symmetry breaking due to the applied electric field brings about the contributions of the crystal field and determines different amplitudes for the two effects.


title: $\texttt{MoE-RBench}$: Towards Building Reliable Language Models with Sparse Mixture-of-Experts

abstract: Mixture-of-Experts (MoE) has gained increasing popularity as a promising framework for scaling up large language models (LLMs). However, the reliability assessment of MoE lags behind its surging applications. Moreover, when transferred to new domains such as in fine-tuning MoE models sometimes underperform their dense counterparts. Motivated by the research gap and counter-intuitive phenomenon, we propose $\texttt{MoE-RBench}$, the first comprehensive assessment of SMoE reliability from three aspects: $\textit{(i)}$ safety and hallucination, $\textit{(ii)}$ resilience to adversarial attacks, and $\textit{(iii)}$ out-of-distribution robustness. Extensive models and datasets are tested to compare the MoE to dense networks from these reliability dimensions. Our empirical observations suggest that with appropriate hyperparameters, training recipes, and inference techniques, we can build the MoE model more reliably than the dense LLM. In particular, we find that the robustness of SMoE is sensitive to the basic training settings. We hope that this study can provide deeper insights into how to adapt the pre-trained MoE model to other tasks with higher-generation security, quality, and stability. Codes are available at https://github.com/UNITES-Lab/MoE-RBench


title: Preserving Knowledge in Large Language Model with Model-Agnostic Self-Decompression

abstract: Humans can retain old knowledge while learning new information, but Large Language Models (LLMs) often suffer from catastrophic forgetting when post-pretrained or supervised fine-tuned (SFT) on domain-specific data. Moreover, for Multimodal Large Language Models (MLLMs) which are composed of the LLM base and visual projector (e.g. LLaVA), a significant decline in performance on language benchmarks was observed compared to their single-modality counterparts. To address these challenges, we introduce a novel model-agnostic self-decompression method, Tree Generation (TG), that decompresses knowledge within LLMs into the training corpus. This paper focuses on TG-SFT, which can synthetically generate SFT data for the instruction tuning steps. By incorporating the dumped corpus during SFT for MLLMs, we significantly reduce the forgetting problem.


title: Non-Ergodic-Induced Negative Differential Piezoresponse in Relaxor Ferroelectrics

abstract: Relaxor ferroelectrics exhibit a unique competition between long-range and short-range interactions that can be tuned electrically which prioritizes these materials in a broad range of electro-mechanical energy-conversion technologies, including biomedical imaging and electric-charge generators. Here, we demonstrate differential negative piezoresponse by utilizing the short-range interactions in relaxor ferroelectrics. The effect was observed over a broad temperature range with local piezoresponse spectroscopy in unpoled samples, while no negative piezoresponse was observed when the material was pre-scan poled. These measurements suggest that the effect, that is promising for power-generation applications, originates from non-ergodic behavior. Complementary macroscale impedance and dielectric constant measurements as a function of temperature and frequency supported the mesoscopic findings. Bearing in mind the direct relationship between piezoresponse and capacitance, relaxor ferroelectrics appear as an excellent platform for the emerging technology of low-power negative-capacitance transistors.


title: DIDChain: Advancing Supply Chain Data Management with Decentralized Identifiers and Blockchain

abstract: Supply chain data management faces challenges in traceability, transparency, and trust. These issues stem from data silos and communication barriers. This research introduces DIDChain, a framework leveraging blockchain technology, Decentralized Identifiers, and the InterPlanetary File System. DIDChain improves supply chain data management. To address privacy concerns, DIDChain employs a hybrid blockchain architecture that combines public blockchain transparency with the control of private systems. Our hybrid approach preserves the authenticity and reliability of supply chain events. It also respects the data privacy requirements of the participants in the supply chain. Central to DIDChain is the cheqd infrastructure. The cheqd infrastructure enables digital tracing of asset events, such as an asset moving from the milk-producing dairy farm to the cheese manufacturer. In this research, assets are raw materials and products. The cheqd infrastructure ensures the traceability and reliability of assets in the management of supply chain data. Our contribution to blockchain-enabled supply chain systems demonstrates the robustness of DIDChain. Integrating blockchain technology through DIDChain offers a solution to data silos and communication barriers. With DIDChain, we propose a framework to transform the supply chain infrastructure across industries.


title: Refiner: Restructure Retrieval Content Efficiently to Advance Question-Answering Capabilities

abstract: Large Language Models (LLMs) are limited by their parametric knowledge, leading to hallucinations in knowledge-extensive tasks. To address this, Retrieval-Augmented Generation (RAG) incorporates external document chunks to expand LLM knowledge. Furthermore, compressing information from document chunks through extraction or summarization can improve LLM performance. Nonetheless, LLMs still struggle to notice and utilize scattered key information, a problem known as the "lost-in-the-middle" syndrome. Therefore, we typically need to restructure the content for LLM to recognize the key information. We propose $\textit{Refiner}$, an end-to-end extract-and-restructure paradigm that operates in the post-retrieval process of RAG. $\textit{Refiner}$ leverages a single decoder-only LLM to adaptively extract query-relevant contents verbatim along with the necessary context, and section them based on their interconnectedness, thereby highlights information distinction, and aligns downstream LLMs with the original context effectively. Experiments show that a trained $\textit{Refiner}$ (with 7B parameters) exhibits significant gain to downstream LLM in improving answer accuracy, and outperforms other state-of-the-art advanced RAG and concurrent compressing approaches in various single-hop and multi-hop QA tasks. Notably, $\textit{Refiner}$ achieves a 80.5% tokens reduction and a 1.6-7.0% improvement margin in multi-hop tasks compared to the next best solution. $\textit{Refiner}$ is a plug-and-play solution that can be seamlessly integrated with RAG systems, facilitating its application across diverse open-source frameworks.


title: On the stability of Type I self-similar blowups for the Keller-Segel system in three dimensions and higher

abstract: We consider the parabolic-elliptic Keller-Segel system in spatial dimensions $d\geq3$, which corresponds to the mass supercritical case. Some solutions become singular in finite time, an important example being backward self-similar solutions. Herrero et al. and Brenner et al. showed the existence of such profiles, countably many in dimensions $3\leq d \leq 9$ and at least two for $d\geq 10$. We establish that all these self-similar profiles are stable along a set of initial data with finite Lipschitz codimension equal to the number of instable eigenmodes. This extends the recent finding of Glogi\'c et al. showing the stability of the fundamental self-similar profile. We obtain additional results, such as the possibility of the solutions we construct to originate from smooth and compactly supported initial data, their convergence at blow-up time, and the Lipschitz regularity of the blow-up time. Our proof extends the approach proposed in Collot et al., based on renormalizing the solution around a modulated self-similar solution, and using a spectral gap for the linearized operator in the parabolic neighbourhood of the singularity.


title: Quantized orbital angular momentums of dipolar magnons and magnetoelectric cavity polaritons

abstract: Magnons are viewed as local deviations from the ordered state. Usually, the spin magnetic moment of magnons is considered. In a 3D-confined structure of a magnetic insulator with magnetodipolar mode (MDM) oscillations, an orbital angular momentum (OAM) as well as a spin angular momentum (SAM) can be observed along a static magnetic field. In such a confined structure as quasi-2D ferrite disk, energy levels of MDM oscillations are quantized. Quantum confinement is characterized by a half-integer internal OAM, which is also associated with a circulating energy flow. The observation of MDM resonances in the 3D-confined structure of a magnetic insulator is due to the interaction of two subsystems: ferromagnetic and electric polarization orders. The coupling states of these two concurrent orders, caused by OAMs, are considered as magnetoelectric (ME) states. The fields in the vicinity of MDM resonators are characterized by simultaneous violation of time reversal and inversion symmetry. This plays a significant role in the problems of strong light-matter interaction regime and quantum atmosphere. The analysis of SAM and OAM in 3D-confined magnetic insulators becomes very important for the realization of ME meta-atomic structures. Current interest lies in considering such artificial systems as subwavelength ME quantum emitters of electromagnetic radiation.


title: A Representative Framework for Implementing Quantum Finite Automata on Real Devices

abstract: We present a framework for the implementation of quantum finite automata algorithms designed for the language $ MOD_p = \{ a^{i\cdot p } \mid i \geq 0 \}$ on gate-based quantum computers. First, we compile the known theoretical results from the literature to reduce the number of CNOT gates. Second, we demonstrate techniques for modifying the algorithms based on the basis gates of available quantum hardware in order to reduce circuit depth. Lastly, we explore how the number of CNOT gates may be reduced further if the topology of the qubits is known.


title: Precise timing of solar flare footpoint sources from mid-infrared observations

abstract: Solar flares are powerful particle accelerators, and in the accepted standard flare model most of the flare energy is transported from a coronal energy-release region by accelerated electrons which stop collisionally in the chromosphere, heating and ionising the plasma, producing a broadband enhancement to the solar radiative output. We present a time-delay analysis of the infrared emission from two chromospheric sources in the flare SOL2014-09-24T17:50 taken at the McMath-Pierce telescope. By cross-correlating the intensity signals, measured with 1s cadence, from the two spatially resolved infrared sources we find a delay of 0.75 $\pm$ 0.07 s at 8.2 $\mu$m, where the uncertainties are quantified by a Monte Carlo analysis. The sources correlate well in brightness but have a time lag larger than can be reasonably explained by the energy transport dominated by non-thermal electrons precipitating from a single acceleration site in the corona. If interpreted as a time-of-flight difference between electrons traveling to each footpoint, we estimate time delays between 0.14 s and 0.42 s, for a reconnection site at the interior quasi-separatrix layer or at the null-point of the spine-fan topology inferred for this event. We employed modelling of electron transport via time-dependent Fokker-Planck and radiative hydrodynamic simulations to evaluate other possible sources of time-delay in the generation of the IR emission, such as differing ionisation timescales under different chromospheric conditions. Our results demonstrate that they are also unable to account for this discrepancy. This flare appears to require energy transport by some means other than electron beams originating in the corona.


title: Characterising Contributions that Coincide with Vulnerability Mitigation in NPM Libraries

abstract: With the urgent need to secure supply chains among Open Source libraries, attention has focused on mitigating vulnerabilities detected in these libraries. Although awareness has improved recently, most studies still report delays in the mitigation process. This suggests that developers still have to deal with other contributions that occur during the period of fixing vulnerabilities, such as coinciding Pull Requests (PRs) and Issues, yet the impact of these contributions remains unclear. To characterize these contributions, we conducted a mixed-method empirical study to analyze NPM GitHub projects affected by 554 different vulnerability advisories, mining a total of 4,699 coinciding PRs and Issues. We believe that tool development and improved workload management for developers have the potential to create a more efficient and effective vulnerability mitigation process.


title: A Preliminary Study on Self-Contained Libraries in the NPM Ecosystem

abstract: The widespread of libraries within modern software ecosystems creates complex networks of dependencies. These dependencies are fragile to breakage, outdated, or redundancy, potentially leading to cascading issues in dependent libraries. One mitigation strategy involves reducing dependencies; libraries with zero dependencies become to self-contained. This paper explores the characteristics of self-contained libraries within the NPM ecosystem. Analyzing a dataset of 2763 NPM libraries, we found that 39.49\% are self-contained. Of these self-contained libraries, 40.42\% previously had dependencies that were later removed. This analysis revealed a significant trend of dependency reduction within the NPM ecosystem. The most frequently removed dependency was babel-runtime. Our investigation indicates that the primary reasons for dependency removal are concerns about the performance and the size of the dependency. Our findings illuminate the nature of self-contained libraries and their origins, offering valuable insights to guide software development practices.


title: AnoPatch: Towards Better Consistency in Machine Anomalous Sound Detection

abstract: Large pre-trained models have demonstrated dominant performances in multiple areas, where the consistency between pre-training and fine-tuning is the key to success. However, few works reported satisfactory results of pre-trained models for the machine anomalous sound detection (ASD) task. This may be caused by the inconsistency of the pre-trained model and the inductive bias of machine audio, resulting in inconsistency in data and architecture. Thus, we propose AnoPatch which utilizes a ViT backbone pre-trained on AudioSet and fine-tunes it on machine audio. It is believed that machine audio is more related to audio datasets than speech datasets, and modeling it from patch level suits the sparsity of machine audio. As a result, AnoPatch showcases state-of-the-art (SOTA) performances on the DCASE 2020 ASD dataset and the DCASE 2023 ASD dataset. We also compare multiple pre-trained models and empirically demonstrate that better consistency yields considerable improvement.


title: Shape perturbation of a nonlinear mixed problem for the heat equation

abstract: We consider the heat equation in a domain that has a hole in its interior. We impose a Neumann condition on the exterior boundary and a nonlinear Robin condition on the boundary of the hole. The shape of the hole is determined by a suitable diffeomorphism $\phi$ defined on the boundary of a reference domain. Assuming that the problem has a solution $u_0$ when $\phi$ is the identity map, we demonstrate that a solution $u_\phi$ continues to exist for $\phi$ close to the identity map and that the "domain-to-solution" map $\phi\mapsto u_\phi$ is of class $C^\infty$. Moreover, we show that the family of solutions $\{u_\phi\}_{\phi}$ is, in a sense, locally unique. Our argument relies on tools from Potential Theory and the Implicit Function Theorem. Some remarks on the linear case complete the paper.


title: xeoverse: A Real-time Simulation Platform for Large LEO Satellite Mega-Constellations

abstract: In the evolving landscape of satellite communications, the deployment of Low-Earth Orbit (LEO) satellite constellations promises to revolutionize global Internet access by providing low-latency, high-bandwidth connectivity to underserved regions. However, the dynamic nature of LEO satellite networks, characterized by rapid orbital movement and frequent changes in Inter-Satellite Links (ISLs), challenges the suitability of existing Internet protocols designed for static terrestrial infrastructures. Testing and developing new solutions and protocols on actual satellite mega-constellations are either too expensive or impractical because some of these constellations are not fully deployed yet. This creates the need for a realistic simulation platform that can accurately simulate this large scale of satellites, and allow end-to-end control over all aspects of LEO constellations. This paper introduces xeoverse, a scalable and realistic network simulator designed to support comprehensive LEO satellite network research and experimentation. By modeling user terminals, satellites, and ground stations as lightweight Linux virtual machines within Mininet and implementing three key strategies -- pre-computing topology and routing changes, updating only changing ISL links, and focusing on ISL links relevant to the simulation scenario -- xeoverse achieves real-time simulation, where 1 simulated second equals 1 wall-clock second. Our evaluations show that xeoverse outperforms state-of-the-art simulators Hypatia and StarryNet in terms of total simulation time by being 2.9 and 40 times faster, respectively.


title: Non-LTE abundances of nitrogen in the Sun and reference A-F type stars

abstract: A new model atom of nitrogen was developed using the energy levels of N I from laboratory measurements and also predicted in atomic structure calculations and the most up-to-date atomic data for computing radiative and collisional rates of the transitions. Solar abundance $\log\varepsilon_{\odot,N}$(1D NLTE) = 7.92$\pm$0.03 was determined from lines of N I by applying the synthetic spectrum method with the plane-parallel (1D) MARCS model atmosphere and taking into account the departures from local thermodynamic equilibrium (non-LTE = NLTE effects). Having implemented the 3D-corrections of Amarsi et al. (2020), we obtained $\log\varepsilon_{\odot,N}$(NLTE+3D) = 7.88$\pm$0.03 for the Sun. Based on high spectral resolution spectra, the NLTE abundances of nitrogen were derived for 11 unevolved A-F type stars with reliable atmospheric parameters. Non-LTE leads to strengthened N I lines, and the non-LTE effects grow with increasing effective temperature. For each star, non-LTE leads to smaller abundance error compared to the LTE case. For superficially normal A stars, non-LTE removes the enhancements relative to the solar nitrogen abundance obtained in the LTE case. A $\lambda$ Boo-type star HD 172167 (Vega) also has close-to-solar N abundance. The four Am stars reveal a scatter of the N abundances, from [N/H] = -0.44 to [N/H] = 0.39. The N abundances of the Sun and superficially normal A stars are consistent within 0.09 dex with the nitrogen abundance of the interstellar gas and the early B-type stars.


title: Improving Quotation Attribution with Fictional Character Embeddings

abstract: Humans naturally attribute utterances of direct speech to their speaker in literary works. When attributing quotes, we process contextual information but also access mental representations of characters that we build and revise throughout the narrative. Recent methods to automatically attribute such utterances have explored simulating human logic with deterministic rules or learning new implicit rules with neural networks when processing contextual information. However, these systems inherently lack \textit{character} representations, which often leads to errors on more challenging examples of attribution: anaphoric and implicit quotes. In this work, we propose to augment a popular quotation attribution system, BookNLP, with character embeddings that encode global information of characters. To build these embeddings, we create DramaCV, a corpus of English drama plays from the 15th to 20th century focused on Character Verification (CV), a task similar to Authorship Verification (AV), that aims at analyzing fictional characters. We train a model similar to the recently proposed AV model, Universal Authorship Representation (UAR), on this dataset, showing that it outperforms concurrent methods of characters embeddings on the CV task and generalizes better to literary novels. Then, through an extensive evaluation on 22 novels, we show that combining BookNLP's contextual information with our proposed global character embeddings improves the identification of speakers for anaphoric and implicit quotes, reaching state-of-the-art performance. Code and data will be made publicly available.


title: Approximation Algorithms for Smallest Intersecting Balls

abstract: We study a general smallest intersecting ball problem and its soft-margin variant in high-dimensional Euclidean spaces, which only require the input objects to be compact and convex. These two problems link and unify a series of fundamental problems in computational geometry and machine learning, including smallest enclosing ball, polytope distance, intersection radius, $\ell_1$-loss support vector machine, $\ell_1$-loss support vector data description, and so on. Two general approximation algorithms are presented respectively, and implementation details are given for specific inputs of convex polytopes, reduced polytopes, axis-aligned bounding boxes, balls, and ellipsoids. For most of these inputs, our algorithms are the first results in high-dimensional spaces, and also the first approximation methods. To achieve this, we develop a novel framework for approximating zero-sum games in Euclidean Jordan algebra systems, which may be useful in its own right.


title: Fairer Preferences Elicit Improved Human-Aligned Large Language Model Judgments

abstract: Large language models (LLMs) have shown promising abilities as cost-effective and reference-free evaluators for assessing language generation quality. In particular, pairwise LLM evaluators, which compare two generated texts and determine the preferred one, have been employed in a wide range of applications. However, LLMs exhibit preference biases and worrying sensitivity to prompt designs. In this work, we first reveal that the predictive preference of LLMs can be highly brittle and skewed, even with semantically equivalent instructions. We find that fairer predictive preferences from LLMs consistently lead to judgments that are better aligned with humans. Motivated by this phenomenon, we propose an automatic Zero-shot Evaluation-oriented Prompt Optimization framework, ZEPO, which aims to produce fairer preference decisions and improve the alignment of LLM evaluators with human judgments. To this end, we propose a zero-shot learning objective based on the preference decision fairness. ZEPO demonstrates substantial performance improvements over state-of-the-art LLM evaluators, without requiring labeled data, on representative meta-evaluation benchmarks. Our findings underscore the critical correlation between preference fairness and human alignment, positioning ZEPO as an efficient prompt optimizer for bridging the gap between LLM evaluators and human judgments.


title: Video Frame Interpolation for Polarization via Swin-Transformer

abstract: Video Frame Interpolation (VFI) has been extensively explored and demonstrated, yet its application to polarization remains largely unexplored. Due to the selective transmission of light by polarized filters, longer exposure times are typically required to ensure sufficient light intensity, which consequently lower the temporal sample rates. Furthermore, because polarization reflected by objects varies with shooting perspective, focusing solely on estimating pixel displacement is insufficient to accurately reconstruct the intermediate polarization. To tackle these challenges, this study proposes a multi-stage and multi-scale network called Swin-VFI based on the Swin-Transformer and introduces a tailored loss function to facilitate the network's understanding of polarization changes. To ensure the practicality of our proposed method, this study evaluates its interpolated frames in Shape from Polarization (SfP) and Human Shape Reconstruction tasks, comparing them with other state-of-the-art methods such as CAIN, FLAVR, and VFIT. Experimental results demonstrate our approach's superior reconstruction accuracy across all tasks.


title: Universal spectrum of non efimovian three-body resonances at finite scattering length

abstract: Using exact solutions of the three-body problem, the spectrum of non efimovian three-body resonances for two identical particles interacting with another one is derived in the regime of large but finite scattering length. The universality of the problem is depicted by using a contact model in the generalized effective range approximation, parameterized by two three-body parameters and the scattering length.


title: Kaniadakis entropy in extreme gravitational and cosmological environments: a review on the state-of-the-art and future prospects

abstract: Kaniadakis ($\kappa$-deformed) statistics is being widely used for describing relativistic systems with non-extensive behavior and/or interactions. It is built upon a one-parameter generalization of the classical Boltzmann-Gibbs-Shannon entropy, possessing the latter as a particular sub-case. Recently, Kaniadakis model has been adapted to accommodate the complexities of systems under the influence of gravity. The ensuing framework exhibits a rich phenomenology that allows for a deeper understanding of the most extreme conditions of the Universe. Here we present the state-of-the-art of $\kappa$-statistics, discussing its virtues and drawbacks at different energy scales. Special focus is dedicated to gravitational and cosmological implications, including effects on the expanding Universe in dark energy scenarios. This review highlights the versatility of Kaniadakis paradigm, demonstrating its broad application across various fields and setting the stage for further advancements in statistical modeling and theoretical physics.


title: Pseudogap with Fermi arcs and Fermi pockets in half-filled twisted transition metal dichalcogenides

abstract: Twisted transition metal dichalcogenides are a new platform for realizing strongly correlated physics with high tunability. Recent transport experiments have reported the realization of a Mott insulator, its bandwidth-driven evolution to a metal, and the strange metal behavior in proximity to the transition via the tuning of a displacement field in twisted $\mathrm{WSe_2}$($\mathrm{tWSe_2}$) fixed at half filling. However, the nature of the correlated states and the related Mott physics involved in the whole process remain to be determined. Here, we unveil theoretically the evolution of the ground state of the half-filled $\boldsymbol{\mathrm{moir\acute{e}}}$ Hubbard model as applied to $\mathrm{tWSe_2}$, transiting from a pseudogap state with Fermi arcs to a 120$^\circ$ Ne$\boldsymbol{\acute{\mathrm{e}}}$l ordered Mott insulator, then to another pseudogap state with Fermi pockets, and eventually to a Fermi liquid via a Lifshitz transition. The pseudogap phases are definitively identified by the vanishing of quasiparticle weights over an extended region of the free Fermi surface, with the remaining parts forming disconnected Fermi arcs or pockets that contain well-defined quasiparticles. The loss of quasiparticle weights in the pseudogap phases indicates the breakdown of Landau's Fermi liquid theory. We demonstrate that the emergence of the Fermi arcs/pockets results from the electronic structure reconstruction driven by strong electron correlations, marked by the existence of Luttinger surface enclosed by the zeros of single-particle Green's function. This work reveals the fundamental aspects of the Mottness in $\boldsymbol{\mathrm{moir\acute{e}}}$ systems and will stimulate the advance of the direct probes of the Fermi surface and quasiparticles beyond transports, such as angle-resolved photoemission spectroscopy (ARPES) and scanning tunnelling microscopy (STM) experiments.


title: Boosting Scientific Concepts Understanding: Can Analogy from Teacher Models Empower Student Models?

abstract: Analogical reasoning plays a critical role in human cognition, enabling us to understand new concepts by associating them with familiar ones. Previous research in the AI community has mainly focused on identifying and generating analogies and then examining their quality under human evaluation, which overlooks the practical application of these analogies in real-world settings. Inspired by the human education process, in this paper, we propose to investigate how analogies created by teacher language models (LMs) can assist student LMs in understanding scientific concepts, thereby aligning more closely with practical scenarios. Our results suggest that free-form analogies can indeed aid LMs in understanding concepts. Additionally, analogies generated by student LMs can improve their own performance on scientific question answering, demonstrating their capability to use analogies for self-learning new knowledge. Resources are available at https://github.com/siyuyuan/SCUA.


title: Spatially constrained vs. unconstrained filtering in neural spatiospectral filters for multichannel speech enhancement

abstract: When using artificial neural networks for multichannel speech enhancement, filtering is often achieved by estimating a complex-valued mask that is applied to all or one reference channel of the input signal. The estimation of this mask is based on the noisy multichannel signal and, hence, can exploit spatial and spectral cues simultaneously. While it has been shown that exploiting spatial and spectral cues jointly is beneficial for the speech enhancement result, the mechanics of the interplay of the two inside the neural network are still largely unknown. In this contribution, we investigate how two conceptually different neural spatiospectral filters (NSSFs) exploit spatial cues depending on the training target signal and show that, while one NSSF always performs spatial filtering, the other one is selective in leveraging spatial information depending on the task at hand. These insights provide better understanding of the information the NSSFs use to make their prediction and, thus, allow to make informed decisions regarding their design and deployment.


title: Vague and basic convergence of signed measures

abstract: We study the relationship between different kinds of convergence of finite signed measures and discuss their metrizability. In particular, we study the concept of basic convergence recently introduced by Khartov [arXiv:2204.13667] and introduce the related concept of almost basic convergence. We discover that a sequence of finite signed measures converges vaguely if and only if it is locally uniformly bounded in variation and the corresponding sequence of distribution functions either converges in Lebesgue measure up to constants, converges basically, or converges almost basically.


title: Non-freeness of parabolic two-generator groups

abstract: A complex number $\lambda$ is said to be non-free if the subgroup of $SL(2,\bc)$ generated by $$X=\begin{pmatrix} 1& 1\\ 0 & 1 \end{pmatrix} \,\, \text{and}\,\,\,Y_{\lambda}=\begin{pmatrix} 1& 0\\ \lambda & 1 \end{pmatrix}$$ is not a free group of rank 2. In this case the number $\lambda$ is called a relation number, and it has been a long standing problem to determine the relation numbers. In this paper, we characterize the relation numbers by establishing the equivalence between $\lambda$ being a relation number and $u:=\sqrt{- \lambda}$ being a root of a `generalized Chebyshev polynomial'. The generalized Chebyshev polynomials of degree $k$ are given by a sequence of $k$ integers $(n_1, n_2,\cdots, n_k)$ using the usual recursive formula, and thereby can be studied systematically using continuants and continued fractions. Such formulation, then, enables us to prove that, the question whether a given number $\lambda$ is a relation number of $u$-degree $k$ can be answered by checking only finitely many generalized Chebyshev polynomials. Based on these theorems, we design an algorithm deciding any given number is a relation number with minimal degree $k$. With its computer implementation we provide a few sample examples, with a particular emphasis on the well known conjecture that every rational number in the interval $(-4, 4)$ is a relation number.


title: On existence of Sadovskii vortex patch: A touching pair of symmetric counter-rotating uniform vortex

abstract: The Sadovskii vortex patch is a traveling wave for the two-dimensional incompressible Euler equations consisting of an odd symmetric pair of vortex patches touching the symmetry axis. Its existence was first suggested by numerical computations of Sadovskii in [J. Appl. Math. Mech., 1971], and has gained significant interest due to its relevance in inviscid limit of planar flows via Prandtl--Batchelor theory and as the asymptotic state for vortex ring dynamics. In this work, we prove the existence of a Sadovskii vortex patch, by solving the energy maximization problem under the exact impulse condition and an upper bound on the circulation.


title: A Realistic Evaluation of LLMs for Quotation Attribution in Literary Texts: A Case Study of LLaMa3

abstract: Large Language Models (LLMs) zero-shot and few-shot performance are subject to memorization and data contamination, complicating the assessment of their validity. In literary tasks, the performance of LLMs is often correlated to the degree of book memorization. In this work, we carry out a realistic evaluation of LLMs for quotation attribution in novels, taking the instruction fined-tuned version of Llama3 as an example. We design a task-specific memorization measure and use it to show that Llama3's ability to perform quotation attribution is positively correlated to the novel degree of memorization. However, Llama3 still performs impressively well on books it has not memorized nor seen. Data and code will be made publicly available.


title: Negative thermal expansion in transition-metal dicyanides: the hidden role of the underlying diamondoid framework

abstract: The transition-metal dicyanides M(CN)$_2$ (M = Zn, Cd) are amongst the most important negative thermal expansion (NTE) materials known, favoured for the magnitude, isotropy, and thermal persistence of the NTE behaviour they show. The conventional picture of the NTE mechanism in this family is one of correlated rotations and translations of M(C/N)$_4$ polyhedra acting to draw the diamondoid network of M--CN--M linkages in on itself. An implication of this mechanism is increased transverse vibrational motion of C and N atoms relative to the isotropic displacements of M atoms, which act as anchors. Here, we use a combination of neutron total scattering measurements and \emph{ab initio} calculations to reassess the vibrational behaviour of the M(CN)$_2$ family. We find that M, C, and N atoms all exhibit similar degrees of local thermal motion, such that the cyanide linkages behave as pseudo-springs connecting M$\ldots$M pairs. This interpretation leads us to uncover a `hidden' dispersion in the M(CN)$_2$ phonon dispersions, closely related to that of diamond and silicon themselves. By virtue of this mapping, a simple geometric model based on the competing energy scales of network stretching and flexing -- long applied to interpret NTE modes in C and Si -- turns out to capture the key NTE physics of M(CN)$_2$, especially at low temperatures. Our study highlights the potential insight gained by coarse-graining the complex lattice dynamics of framework materials in terms of what we call `framework modes' -- the correlated distortions of the underlying network structure itself.


title: Baryon-number-violating nucleon decays in ALP effective field theories

abstract: The search for baryon-number-violating (BNV) nucleon decay is an intriguing probe of new physics beyond the SM in future neutrino experiments with enhanced sensitivity. The dark sector states such as an axion or axion-like particle (ALP) can induce nucleon decays with distinct signature and kinematics from the conventional nucleon decays. In this work, we study the ALP effective field theories (EFTs) with baryon number violation and the impact of light ALP on BNV nucleon decays. We revisit the dimension-8 BNV operators in the extended EFTs with an ALP field $a$ respecting shift symmetry. The low-energy EFT operators with $|\Delta (B-L)|=2$ and $|\Delta (B-L)|=0$ are matched to the baryon chiral perturbation theory. We obtain the effective chiral Lagrangian and the BNV interactions between ALP and baryons/mesons. The ALP interactions lead to two-body baryon decays $B\to \ell~({\rm or}~\nu)~a$ and three-body nucleon decays $N\to M~\ell~({\rm or}~\nu)~a$. We obtain the constraints on the UV scale from the invisible $\Lambda^0$ decay search at BESIII, the invisible neutron decay search at KamLAND and proton decay search at Super-K. We also show the projections of some other baryon/nucleon decays and present the distinct distributions of kinematic observable.


title: Coherence of an Electronic Two-Level System under Continuous Charge Sensing by a Quantum Dot Detector

abstract: We investigate experimentally the quantum coherence of an electronic two-level system in a double quantum dot under continuous charge detection. The charge-state of the two-level system is monitored by a capacitively coupled single quantum dot detector that imposes a back-action effect to the system. The measured back-action is well described by an additional decoherence rate, approximately linearly proportional to the detector electron tunneling rate. We provide a model for the decoherence rate arising due to level detuning fluctuations induced by detector charge fluctuations. The theory predicts a factor of two lower decoherence rate than observed in the experiment, suggesting the need for a more elaborate theory accounting for additional sources of decoherence.


title: Understanding Multi-Granularity for Open-Vocabulary Part Segmentation

abstract: Open-vocabulary part segmentation (OVPS) is an emerging research area focused on segmenting fine-grained entities based on diverse and previously unseen vocabularies. Our study highlights the inherent complexities of part segmentation due to intricate boundaries and diverse granularity, reflecting the knowledge-based nature of part identification. To address these challenges, we propose PartCLIPSeg, a novel framework utilizing generalized parts and object-level contexts to mitigate the lack of generalization in fine-grained parts. PartCLIPSeg integrates competitive part relationships and attention control techniques, alleviating ambiguous boundaries and underrepresented parts. Experimental results demonstrate that PartCLIPSeg outperforms existing state-of-the-art OVPS methods, offering refined segmentation and an advanced understanding of part relationships in images. Through extensive experiments, our model demonstrated an improvement over the state-of-the-art models on the Pascal-Part-116, ADE20K-Part-234, and PartImageNet datasets.


title: MetaGPT: Merging Large Language Models Using Model Exclusive Task Arithmetic

abstract: The advent of large language models (LLMs) like GPT-4 has catalyzed the exploration of multi-task learning (MTL), in which a single model demonstrates proficiency across diverse tasks. Task arithmetic has emerged as a cost-effective approach for MTL. It enables performance enhancement across multiple tasks by adding their corresponding task vectors to a pre-trained model. However, the current lack of a method that can simultaneously achieve optimal performance, computational efficiency, and data privacy limits their application to LLMs. In this paper, we propose \textbf{M}odel \textbf{E}xclusive \textbf{T}ask \textbf{A}rithmetic for merging \textbf{GPT}-scale models, which formalizes the objective of model merging into a multi-task learning framework, aiming to minimize the average loss difference between the merged model and each individual task model. Since data privacy limits the use of multi-task training data, we leverage LLMs' local linearity and task vectors' orthogonality to separate the data term and scaling coefficients term and derive a model-exclusive task arithmetic method. Our proposed MetaGPT is data-agnostic and bypasses the heavy search process, making it cost-effective and easy to implement for LLMs.Extensive experiments demonstrate that MetaGPT leads to improvements in task arithmetic and achieves state-of-the-art performance on multiple tasks.


title: Coarsening and metastability of the long-range voter model in three dimensions

abstract: We study analytically the ordering kinetics and the final metastable states in the three-dimensional long-range voter model where $N$ agents described by a boolean spin variable $S_i$ can be found in two states (or opinion) $\pm 1$. The kinetics is such that each agent copies the opinion of another at distance $r$ chosen with probability $P(r) \propto r^{-\alpha}$ ($\al >0$). In the thermodynamic limit $N\to \infty$ the system approaches a correlated metastable state without consensus, namely without full spin alignment. In such states the equal-time correlation function $C(r)=\langle S_iS_j\rangle$ (where r is the $i-j$ distance) decrease algebraically in a slow, non-integrable way. Specifically, we find $C(r)\sim r^{-1}$, or $C(r)\sim r^{-(6-\al)}$, or $C(r)\sim r^{-\al}$ for $\al >5$, $3<\al \le 5$ and $0\le \al \le 3$, respectively. In a finite system metastability is escaped after a time of order $N$ and full ordering is eventually achieved. The dynamics leading to metastability is of the coarsening type, with an ever increasing correlation length $L(t)$ (for $N\to \infty$). We find $L(t)\sim t^{\frac{1}{2}}$ for $\al >5$, $L(t)\sim t^{\frac{5}{2\al}}$ for $4<\al \le 5$, and $L(t)\sim t^{\frac{5}{8}}$ for $3\le \al \le 4$. For $0\le \al < 3$ there is not macroscopic coarsening because stationarity is reached in a microscopic time. Such results allow us to conjecture the behavior of the model for generic space dimension.


title: Second ideal intersection graph of a commutative ring

abstract: Let R be a commutative ring with identity. In this paper, we introduce and investigate the second ideal intersection graph SII(R) of R with vertices are non-zero proper ideals of R and two distinct vertices I and J are adjacent if and only if $I \cap J$ is a second ideal of R.


title: Influence of the flow split ratio on the position of the main atrial vortex: implications for stasis on the left atrial appendage

abstract: Background: Despite the recent advances in computational fluid dynamics (CFD) techniques applied to blood flow within the left atrium (LA), the relationship between atrial geometry, flow patterns, and blood stasis within the left atrial appendage (LAA) remains unclear. A better understanding of this relationship would have important clinical implications, as thrombi originating in the LAA are a common cause of stroke in patients with atrial fibrillation (AF). Aim: To identify the most representative atrial flow patterns on a patient-specific basis and study their influence on LAA blood stasis by varying the flow split ratio and some common atrial modeling assumptions. Methods: Three recent techniques were applied to nine patient-specific computational fluid dynamics (CFD) models of patients with AF: a kinematic atrial model to isolate the influence of wall motion because of AF, projection on a universal LAA coordinate system, and quantification of stagnant blood volume (SBV). Results: We identified three different atrial flow patterns based on the position of the center of the main circulatory flow. The results also illustrate how atrial flow patterns are highly affected by the flow split ratio, increasing the SBV within the LAA. As the flow split ratio is determined by the patient's lying position, the results suggest that the most frequent position adopted while sleeping may have implications for the medium- and long-term risks of stroke.


title: SEFraud: Graph-based Self-Explainable Fraud Detection via Interpretative Mask Learning

abstract: Graph-based fraud detection has widespread application in modern industry scenarios, such as spam review and malicious account detection. While considerable efforts have been devoted to designing adequate fraud detectors, the interpretability of their results has often been overlooked. Previous works have attempted to generate explanations for specific instances using post-hoc explaining methods such as a GNNExplainer. However, post-hoc explanations can not facilitate the model predictions and the computational cost of these methods cannot meet practical requirements, thus limiting their application in real-world scenarios. To address these issues, we propose SEFraud, a novel graph-based self-explainable fraud detection framework that simultaneously tackles fraud detection and result in interpretability. Concretely, SEFraud first leverages customized heterogeneous graph transformer networks with learnable feature masks and edge masks to learn expressive representations from the informative heterogeneously typed transactions. A new triplet loss is further designed to enhance the performance of mask learning. Empirical results on various datasets demonstrate the effectiveness of SEFraud as it shows considerable advantages in both the fraud detection performance and interpretability of prediction results. Moreover, SEFraud has been deployed and offers explainable fraud detection service for the largest bank in China, Industrial and Commercial Bank of China Limited (ICBC). Results collected from the production environment of ICBC show that SEFraud can provide accurate detection results and comprehensive explanations that align with the expert business understanding, confirming its efficiency and applicability in large-scale online services.


title: Unfolding Time: Generative Modeling for Turbulent Flows in 4D

abstract: A recent study in turbulent flow simulation demonstrated the potential of generative diffusion models for fast 3D surrogate modeling. This approach eliminates the need for specifying initial states or performing lengthy simulations, significantly accelerating the process. While adept at sampling individual frames from the learned manifold of turbulent flow states, the previous model lacks the capability to generate sequences, hindering analysis of dynamic phenomena. This work addresses this limitation by introducing a 4D generative diffusion model and a physics-informed guidance technique that enables the generation of realistic sequences of flow states. Our findings indicate that the proposed method can successfully sample entire subsequences from the turbulent manifold, even though generalizing from individual frames to sequences remains a challenging task. This advancement opens doors for the application of generative modeling in analyzing the temporal evolution of turbulent flows, providing valuable insights into their complex dynamics.


title: P-TA: Using Proximal Policy Optimization to Enhance Tabular Data Augmentation via Large Language Models

abstract: A multitude of industries depend on accurate and reasonable tabular data augmentation for their business processes. Contemporary methodologies in generating tabular data revolve around utilizing Generative Adversarial Networks (GAN) or fine-tuning Large Language Models (LLM). However, GAN-based approaches are documented to produce samples with common-sense errors attributed to the absence of external knowledge. On the other hand, LLM-based methods exhibit a limited capacity to capture the disparities between synthesized and actual data distribution due to the absence of feedback from a discriminator during training. Furthermore, the decoding of LLM-based generation introduces gradient breakpoints, impeding the backpropagation of loss from a discriminator, thereby complicating the integration of these two approaches. To solve this challenge, we propose using proximal policy optimization (PPO) to apply GANs, guiding LLMs to enhance the probability distribution of tabular features. This approach enables the utilization of LLMs as generators for GANs in synthesizing tabular data. Our experiments demonstrate that PPO leads to an approximately 4\% improvement in the accuracy of models trained on synthetically generated data over state-of-the-art across three real-world datasets.


title: Multi-Camera Hand-Eye Calibration for Human-Robot Collaboration in Industrial Robotic Workcells

abstract: In industrial scenarios, effective human-robot collaboration relies on multi-camera systems to robustly monitor human operators despite the occlusions that typically show up in a robotic workcell. In this scenario, precise localization of the person in the robot coordinate system is essential, making the hand-eye calibration of the camera network critical. This process presents significant challenges when high calibration accuracy should be achieved in short time to minimize production downtime, and when dealing with extensive camera networks used for monitoring wide areas, such as industrial robotic workcells. Our paper introduces an innovative and robust multi-camera hand-eye calibration method, designed to optimize each camera's pose relative to both the robot's base and to each other camera. This optimization integrates two types of key constraints: i) a single board-to-end-effector transformation, and ii) the relative camera-to-camera transformations. We demonstrate the superior performance of our method through comprehensive experiments employing the METRIC dataset and real-world data collected on industrial scenarios, showing notable advancements over state-of-the-art techniques even using less than 10 images. Additionally, we release an open-source version of our multi-camera hand-eye calibration algorithm at https://github.com/davidea97/Multi-Camera-Hand-Eye-Calibration.git.


title: Diagram Control and Model Order for Sugiyama Layouts

abstract: Graphical WYSIWYG editors programming languages are popular since they allow to control the diagram layout to express intention via secondary notation such as proximity and topology. However, such editors typically require users to do manual layout. Conversely, automatic layout of diagrams typically fails to capture intention because graphs are usually considered to not contain any order. Model order can combine the desire for control of secondary notation with automatic layout, without additional overhead, since the textual model already employs secondary notation. We illustrate how model order can exert control on the example of programming languages SCCharts and Lingua Franca. We also propose a first guidebook how such model order configurations can be extracted for other programming languages with a graphical notation.


title: Disk Assembly of the Milky Way Suggested from the Time-resolved Chemical Abundance

abstract: Both simulations and observations suggest that the disk assembly of galaxies is governed by the interplay between coplanar gas inflow, ex-planar gas outflow and in-situ star formation on the disk, known as the leaky accretion disk. This scenario predicts a strong connection between radial distributions of star formation and chemical abundances. The Milky Way, being the sole galaxy where we can reliably measure star formation histories and the corresponding temporally-resolved chemical abundances with individual stars, provides a unique opportunity to scrutinize this scenario. Based on the recent large spectroscopic and photometric surveys of Milky Way stars, we obtain the radial profiles of magnesium abundance ([Mg/H]) and star formation rate (SFR) surface density at different lookback time. We find the radial profiles of [Mg/H] can be well-reproduced using the leaky accretion disk model with only two free parameters for stars formed within 4 Gyr, as well as the flattening at large radii of metallicity profiles traced by HII regions and Cepheids. Furthermore, the constraint effective yield of the Milky Way and nearby galaxies show broad consistency with the theoretical predictions from stellar chemical evolution model with a mass-loading factor of 0-2. These results support that the recent assembly of the Milky Way adheres to the leaky accretion disk scenario, bridging the disk formation of our home galaxy to the big picture of disk formation in the Universe.


title: Complementarity-based complementarity

abstract: We show that the amount of complementarity that a quantum system can exhibit depends on which complementary properties one is considering. Consider a set of mutually unbiased bases (MUBs) which corresponds to the spectral decomposition of some maximally complementary properties: The perfect knowledge of one, i.e. the state of the system is one of the basis states, implies that all the others are completely unknown, namely the measurement of another property will find any of its possible outcomes with uniform probability. We show that, depending on which three of the MUBs we choose, a 5-dimensional system can have different degrees of complementarity, measured using the minimum over all the system states of the sum of the entropies and of the variances of the measurement outcomes related to the three chosen observables. This property was first found experimentally, and demonstrates that an experimental discovery can disclose quantum information effects.


title: Uncertainties in ROC (Receiver Operating Characteristic) Curves Derived from Counting Data

abstract: The ROC (receiver operating characteristic) curve is a widely used device for assessing decision-making systems. It seems surprising, in view of its history dating back to World War Two, that the assignment of uncertainties to a ROC curve is apparently not settled. This note returns to the question, focusing on the application of ROC curves to the analysis of data from counting experiments and taking a practical operational approach to the concept of uncertainty.


title: DistPred: A Distribution-Free Probabilistic Inference Method for Regression and Forecasting

abstract: Traditional regression and prediction tasks often only provide deterministic point estimates. To estimate the uncertainty or distribution information of the response variable, methods such as Bayesian inference, model ensembling, or MC Dropout are typically used. These methods either assume that the posterior distribution of samples follows a Gaussian process or require thousands of forward passes for sample generation. We propose a novel approach called DistPred for regression and forecasting tasks, which overcomes the limitations of existing methods while remaining simple and powerful. Specifically, we transform proper scoring rules that measure the discrepancy between the predicted distribution and the target distribution into a differentiable discrete form and use it as a loss function to train the model end-to-end. This allows the model to sample numerous samples in a single forward pass to estimate the potential distribution of the response variable. We have compared our method with several existing approaches on multiple datasets and achieved state-of-the-art performance. Additionally, our method significantly improves computational efficiency. For example, compared to state-of-the-art models, DistPred has a 90x faster inference speed. Experimental results can be reproduced through https://github.com/Anoise/DistPred.


title: Deciphering the imprint of AGN feedback in Seyfert galaxies: Nuclear-scale molecular gas deficits

abstract: We use a sample of 64 nearby (D=7-45 Mpc) disk galaxies including 45 AGN and 19 non-AGN, that have high spatial resolution multiline CO observations obtained with the ALMA and/or PdBI arrays to study the distribution of cold molecular gas in their circumunuclear disks (CND). We analyze whether the concentration of cold molecular gas changes as a function of the X-ray luminosity in the 2-10 keV range ($L_{\rm X}$). We also study the concentration of the hot molecular gas using NIR data obtained for the H2 1-0S(1) line. We find a turnover in the distribution of the cold molecular gas concentration as a function of $L_{\rm X}$ with a breakpoint which divides the sample into two branches: the AGN build-up branch ($L_{\rm X}\leq10^{41.5\pm0.3}$erg/s) and the AGN feedback branch ($L_{\rm X}\geq10^{41.5\pm0.3}$erg/s) . Lower luminosity AGN and non-AGN of the AGN build-up branch show high cold molecular gas concentrations and centrally peaked radial profiles on nuclear ($r\leq50$~pc) scales. Higher luminosity AGN of the AGN feedback branch, show a sharp decrease in the concentration of molecular gas and flat or inverted radial profiles. The cold molecular gas concentration index ($CCI$), defined as the ratio of surface densities at $r\leq50$~pc and $r\leq200$~pc , namely $CCI \equiv$~log$_{\rm 10}(\Sigma^{\rm gas}_{\rm 50}/\Sigma^{\rm gas}_{\rm 200}$), spans a factor ~4-5 between the galaxies lying at the high end of the AGN build-up branch and the galaxies of the AGN feedback branch. The concentration and radial distributions of the hot molecular gas in our sample follow less extreme trends as a function of the X-ray luminosity. These observations confirm, on a three times larger sample, previous evidence found by the GATOS survey that the imprint of AGN feedback on the CND-scale distribution of molecular gas is more extreme in higher luminosity Seyfert galaxies of the local universe.


title: Spillover Detection for Donor Selection in Synthetic Control Models

abstract: Synthetic control (SC) models are widely used to estimate causal effects in settings with observational time-series data. To identify the causal effect on a target unit, SC requires the existence of correlated units that are not impacted by the intervention. Given one of these potential donor units, how can we decide whether it is in fact a valid donor - that is, one not subject to spillover effects from the intervention? Such a decision typically requires appealing to strong a priori domain knowledge specifying the units, which becomes infeasible in situations with large pools of potential donors. In this paper, we introduce a practical, theoretically-grounded donor selection procedure, aiming to weaken this domain knowledge requirement. Our main result is a Theorem that yields the assumptions required to identify donor values at post-intervention time points using only pre-intervention data. We show how this Theorem - and the assumptions underpinning it - can be turned into a practical method for detecting potential spillover effects and excluding invalid donors when constructing SCs. Importantly, we employ sensitivity analysis to formally bound the bias in our SC causal estimate in situations where an excluded donor was indeed valid, or where a selected donor was invalid. Using ideas from the proximal causal inference and instrumental variables literature, we show that the excluded donors can nevertheless be leveraged to further debias causal effect estimates. Finally, we illustrate our donor selection procedure on both simulated and real-world datasets.


title: Large Language Models and Knowledge Graphs for Astronomical Entity Disambiguation

abstract: This paper presents an experiment conducted during a hackathon, focusing on using large language models (LLMs) and knowledge graph clustering to extract entities and relationships from astronomical text. The study demonstrates an approach to disambiguate entities that can appear in various contexts within the astronomical domain. By collecting excerpts around specific entities and leveraging the GPT-4 language model, relevant entities and relationships are extracted. The extracted information is then used to construct a knowledge graph, which is clustered using the Leiden algorithm. The resulting Leiden communities are utilized to identify the percentage of association of unknown excerpts to each community, thereby enabling disambiguation. The experiment showcases the potential of combining LLMs and knowledge graph clustering techniques for information extraction in astronomical research. The results highlight the effectiveness of the approach in identifying and disambiguating entities, as well as grouping them into meaningful clusters based on their relationships.


title: An Exploration of Length Generalization in Transformer-Based Speech Enhancement

abstract: The use of Transformer architectures has facilitated remarkable progress in speech enhancement. Training Transformers using substantially long speech utterances is often infeasible as self-attention suffers from quadratic complexity. It is a critical and unexplored challenge for a Transformer-based speech enhancement model to learn from short speech utterances and generalize to longer ones. In this paper, we conduct comprehensive experiments to explore the length generalization problem in speech enhancement with Transformer. Our findings first establish that position embedding provides an effective instrument to alleviate the impact of utterance length on Transformer-based speech enhancement. Specifically, we explore four different position embedding schemes to enable length generalization. The results confirm the superiority of relative position embeddings (RPEs) over absolute PE (APEs) in length generalization.


title: Evaluating Open Language Models Across Task Types, Application Domains, and Reasoning Types: An In-Depth Experimental Analysis

abstract: The rapid rise of Language Models (LMs) has expanded their use in several applications. Yet, due to constraints of model size, associated cost, or proprietary restrictions, utilizing state-of-the-art (SOTA) LLMs is not always feasible. With open, smaller LMs emerging, more applications can leverage their capabilities, but selecting the right LM can be challenging. This work conducts an in-depth experimental analysis of the semantic correctness of outputs of 10 smaller, open LMs across three aspects: task types, application domains and reasoning types, using diverse prompt styles. We demonstrate that most effective models and prompt styles vary depending on the specific requirements. Our analysis provides a comparative assessment of LMs and prompt styles using a proposed three-tier schema of aspects for their strategic selection based on use-case and other constraints. We also show that if utilized appropriately, these LMs can compete with, and sometimes outperform, SOTA LLMs like DeepSeek-v2, GPT-3.5-Turbo, and GPT-4o.


title: Multimodal Structured Generation: CVPR's 2nd MMFM Challenge Technical Report

abstract: Multimodal Foundation Models (MMFMs) have shown remarkable performance on various computer vision and natural language processing tasks. However, their performance on particular tasks such as document understanding is still limited. They also require more compute, time, and engineering resources to finetune and deploy compared to traditional, unimodal models. In this report, we present Multimodal Structured Generation, a general framework which constrains the output logits of frozen MMFMs to force them to reason before responding with structured outputs that downstream APIs can parse and use. We provide a detailed account of our approach, including the technical details, theoretical discussions, and final evaluation results in the 2nd Multimodal Foundation Models Challenge hosted by the Computer Vision and Pattern Recognition (CVPR) conference. Our approach achieved the second highest score in the hidden test set for Phase 2 and third highest overall. This shows the method's ability to generalize to unseen tasks. And that simple engineering can beat expensive & complicated modelling steps as we first discussed in our paper, Retrieval Augmented Structured Generation: Business Document Information Extraction as Tool Use. All of our scripts, deployment steps, and evaluation results can be accessed in https://github.com/leloykun/MMFM-Challenge


title: Quantum versus classical quenches and the broadening of wave packets

abstract: The time dependence of one-dimensional quantum mechanical probability densities is presented when the potential in which a particle moves is suddenly changed, called a quench. Quantum quenches are mainly addressed but a comparison with results for the dynamics in the framework of classical statistical mechanics is useful. Analytical results are presented when the initial and final potentials are harmonic oscillators. When the final potential vanishes the problem reduces to the broadening of wave packets. A simple introduction to the concept of the Wigner function is presented which allows a better understanding of the dynamics of general wave packets. It is pointed out how special the broadening of Gaussian wave packets is, the only example usually presented in quantum mechanics textbooks.


title: Network growth under opportunistic attachment

abstract: Growing network models can potentially be a useful tool in the development of economic theory. This work introduces an "opportunistic attachment" mechanism where incoming nodes, in deciding where to join a network, consider features of the entry points available to them. For example, an entrepreneur looking to start a thriving business might consider the expected revenue of many hypothetical businesses. This mechanism is explored, in isolation, via a minimal model where PageRank serves to score the available opportunities. Despite its simplicity, this model gives rise to rich node dynamics, path-dependence, and an unexpected degenerate structure. We go on to argue that this model might be useful to theoretical development as a maximally stylised model of entrepreneurial growth. Central to the argument is an alternative set of microfoundations introduced in Leontief & Brody (1993) whereby the steady state of a random walk is a notion of economic equilibrium. To the extent this argument holds, our findings suggest that entrepreneurs face a shifting "opportunity space" where the number of potential business opportunities is effectively unbounded. Opportunistic attachment is thus a candidate mechanism for relating the structure of an economic system to its future growth.