title: A Dynamic Computational Model of Head Sway Responses in Human Upright Stance Postural Control during Support Surface Tilt

abstract: Human and humanoid posture control models usually rely on single or multiple degrees of freedom inverted pendulum representation of upright stance associated with a feedback controller. In models typically focused on the action between ankles, hips, and knees, the control of head position is often neglected, and the head is considered one with the upper body. However, two of the three main contributors to the human motion sensorium reside in the head: the vestibular and the visual system. As the third contributor, the proprioceptive system is distributed throughout the body. In human neurodegenerative brain diseases of motor control, like Progressive Supranuclear Palsy PSP and Idiopathic Parkinson's Disease IPD, clinical studies have demonstrated the importance of head motion deficits. This work specifically addresses the control of the head during a perturbed upright stance. A control model for the neck is proposed following the hypothesis of a modular posture control from previous studies. Data from human experiments are used to fit the model and retrieve sets of parameters representative of the behavior obtained in different conditions. The result of the analysis is twofold: validate the model and its underlying hypothesis and provide a system to assess the differences in posture control that can be used to identify the differences between healthy subjects and patients with different conditions. Implications for clinical pathology and application in humanoid and assistive robotics are discussed.


title: Measurements of strange and multi-strange hadrons elliptic flow in isobar collisions at RHIC by STAR

abstract: We present measurements of elliptic flow ($v_{2}$) of $K_{s}^{0}$, $\Lambda$, $\bar{\Lambda}$, $\phi$, $\Xi^{-}$, $\overline{\Xi}^{+}$, and $\Omega^{-}$+$\overline{\Omega}^{+}$ at mid-rapidity ($|\eta| <$ 1.0) in isobar collisions ($^{96}_{44}$Ru+$^{96}_{44}$Ru and $^{96}_{40}$Zr+$^{96}_{40}$Zr) at $\sqrt{s_{\mathrm{NN}}}$ = 200 GeV. The centrality and transverse momentum ($p_{\mathrm{T}}$) dependence of elliptic flow is presented. The number of constituent quark (NCQ) scaling of $v_{2}$ in isobar collisions is discussed. $p_{T}$-integrated elliptic flow ($\left\langle v_{2}\right\rangle$) is observed to increase from central to peripheral collisions. The ratio of $\left\langle v_{2}\right\rangle$ between the two isobars shows a deviation from unity for strange hadrons ($K_{s}^{0}$, $\Lambda$ and $\bar{\Lambda}$) indicating a difference in nuclear structure and deformation. A system size dependence of strange hadron $v_{2}$ at high $p_{T}$ is observed among Ru+Ru, Zr+Zr, Cu+Cu, Au+Au, and U+U systems. A multi-phase transport (AMPT) model with string melting (SM) describes the experimental data well in the measured $p_{\mathrm{T}}$ range for isobar collisions at $\sqrt{s_{\mathrm{NN}}}$ = 200 GeV.


title: Boltzmann's Billiard Systems: Computation of the Billiard Mapping and Some Numerical Results

abstract: L. Boltzmann proposed a billiard model with a planar central force problem reflected against a line not passing through the center. He asserted that such a system is ergodic, which thus illustrates his ergodic hypothesis. However, it has been recently shown that when the underlying central force problem is the Kepler problem then the system is actually integrable by Gallavotti-Jauslin. This raises the question of whether Boltzmann's assertion holds true for some central force problems that he considered. In this paper, we present some geometrical and numerical analysis on the dynamics of several of these systems. As indicated by the numerics, many of these systems show chaotic dynamics and a system seems to be ergodic.


title: Hybrid classical-quantum branch-and-bound algorithm for solving integer linear problems

abstract: Quantum annealers are suited to solve several logistic optimization problems expressed in the QUBO formulation. However, the solutions proposed by the quantum annealers are generally not optimal, as thermal noise and other disturbing effects arise when the number of qubits involved in the calculation is too large. In order to deal with this issue, we propose the use of the classical branch-and-bound algorithm, that divides the problem into sub-problems which are described by a lower number of qubits. We analyze the performance of this method on two problems, the knapsack problem and the traveling salesman problem. Our results show the advantages of this method, that balances the number of steps that the algorithm has to make with the amount of error in the solution found by the quantum hardware that the user is willing to risk. All the results are actual runs on the quantum annealer D-Wave Advantage.


title: Global H\"{o}lder solvability of linear and quasilinear Poisson equations

abstract: We discuss the homogeneous Dirichlet problem for $p$-Poisson type equations with locally finite measure data. If there is a H\"{o}lder continuous solution, the corresponding data satisfies a local Morrey type condition. The main result of this paper provides existence of a global H\"{o}lder continuous solution under the same condition. The existence result gives a compact embedding theorem. Our results are also new even for the Poisson equation.


title: Deceptive Semantic Shortcuts on Reasoning Chains: How Far Can Models Go without Hallucination?

abstract: Despite the recent advancement in large language models (LLMs) and their high performances across numerous benchmarks, recent research has unveiled that LLMs suffer from hallucinations and unfaithful reasoning. This work studies a specific type of hallucination induced by semantic associations. Specifically, we investigate to what extent LLMs take shortcuts from certain keyword/entity biases in the prompt instead of following the correct reasoning path. To quantify this phenomenon, we propose a novel probing method and benchmark called EureQA. We start from questions that LLMs will answer correctly with utmost certainty, and mask the important entity with evidence sentence recursively, asking models to find masked entities according to a chain of evidence before answering the question. During the construction of the evidence, we purposefully replace semantic clues (entities) that may lead to the correct answer with distractor clues (evidence) that will not directly lead to the correct answer but require a chain-like reasoning process. We evaluate if models can follow the correct reasoning chain instead of short-cutting through distractor clues. We find that existing LLMs lack the necessary capabilities to follow correct reasoning paths and resist the attempt of greedy shortcuts. We show that the distractor semantic associations often lead to model hallucination, which is strong evidence that questions the validity of current LLM reasoning.


title: Cosmological constraints on neutrino masses in light of JWST red and massive candidate galaxies

abstract: The overabundance of the red and massive candidate galaxies observed by the James Webb Space Telescope (JWST) implies efficient structure formation or large star formation efficiency at high redshift $z\sim 10$. In the scenario of a low or moderate star formation efficiency, because massive neutrinos tend to suppress the growth of structure of the universe, the JWST observation tightens the upper bound of the neutrino masses. Assuming $\Lambda$ cold dark matter cosmology and a star formation efficiency $ \in [0.05, 0.3]$ (flat prior), we perform joint analyses of Planck+JWST and Planck+BAO+JWST, and obtain improved constraints $\sum m_\nu < 0.196\,\mathrm{eV}$ and $\sum m_\nu < 0.111\,\mathrm{eV}$ at 95% confidence level, respectively. Based on the above assumptions, the inverted mass ordering, which implies $\sum m_\nu\geq 0.1\mathrm{eV}$, is excluded by Planck+BAO+JWST at 92.7% confidence level.

categories: astro-ph.CO astro-ph.GA hep-ex hep-ph hep-th


title: International System of Quantities library in VDM

abstract: The International Systems of Quantities (ISQ) standard was published in 1960 to tame the wide diversity of measurement systems being developed across the world, such as the centimetre-gram-second versus the meter-kilogram-second for example. Such a standard is highly motivated by the potential of ``trivial'' (rather error-prone) mistakes in converting between incompatible units. There have been such accidents in space missions, medical devices, etc. Thus, rendering modelling or simulation experiments unusable or unsafe. We address this problem by providing a \textbf{SAFE}-ISQ VDM-library that is: Simple, Accurate, Fast, and Effective. It extends an ecosystem of other VDM mathematical toolkit extensions, which include a translation and proof environment for VDM in Isabelle at https://github.com/leouk/VDM_Toolkit.


title: edibble: An R package to encapsulate elements of experimental designs for better planning, management and workflow

abstract: I present an R package called edibble that facilitates the design of experiments by encapsulating elements of the experiment in a series of composable functions. This package is an interpretation of "the grammar of experimental designs" by Tanaka (2023) in the R programming language. The main features of the edibble package are demonstrated, illustrating how it can be used to create a wide array of experimental designs. The implemented system aims to encourage cognitive thinking for holistic planning and data management of experiments in a streamlined workflow. This workflow can increase the inherent value of experimental data by reducing potential errors or noise with careful preplanning, as well as, ensuring fit-for-purpose analysis of experimental data.


title: Towards Autonomous Hypothesis Verification via Language Models with Minimal Guidance

abstract: Research automation efforts usually employ AI as a tool to automate specific tasks within the research process. To create an AI that truly conduct research themselves, it must independently generate hypotheses, design verification plans, and execute verification. Therefore, we investigated if an AI itself could autonomously generate and verify hypothesis for a toy machine learning research problem. We prompted GPT-4 to generate hypotheses and Python code for hypothesis verification with limited methodological guidance. Our findings suggest that, in some instances, GPT-4 can autonomously generate and validate hypotheses without detailed guidance. While this is a promising result, we also found that none of the verifications were flawless, and there remain significant challenges in achieving autonomous, human-level research using only generic instructions. These findings underscore the need for continued exploration to develop a general and autonomous AI researcher.


title: GenCodeSearchNet: A Benchmark Test Suite for Evaluating Generalization in Programming Language Understanding

abstract: Language models can serve as a valuable tool for software developers to increase productivity. Large generative models can be used for code generation and code completion, while smaller encoder-only models are capable of performing code search tasks using natural language queries.These capabilities are heavily influenced by the quality and diversity of the available training data. Source code datasets used for training usually focus on the most popular languages and testing is mostly conducted on the same distributions, often overlooking low-resource programming languages. Motivated by the NLP generalization taxonomy proposed by Hupkes et.\,al., we propose a new benchmark dataset called GenCodeSearchNet (GeCS) which builds upon existing natural language code search datasets to systemically evaluate the programming language understanding generalization capabilities of language models. As part of the full dataset, we introduce a new, manually curated subset StatCodeSearch that focuses on R, a popular but so far underrepresented programming language that is often used by researchers outside the field of computer science. For evaluation and comparison, we collect several baseline results using fine-tuned BERT-style models and GPT-style large language models in a zero-shot setting.


title: A Self-enhancement Multitask Framework for Unsupervised Aspect Category Detection

abstract: Our work addresses the problem of unsupervised Aspect Category Detection using a small set of seed words. Recent works have focused on learning embedding spaces for seed words and sentences to establish similarities between sentences and aspects. However, aspect representations are limited by the quality of initial seed words, and model performances are compromised by noise. To mitigate this limitation, we propose a simple framework that automatically enhances the quality of initial seed words and selects high-quality sentences for training instead of using the entire dataset. Our main concepts are to add a number of seed words to the initial set and to treat the task of noise resolution as a task of augmenting data for a low-resource task. In addition, we jointly train Aspect Category Detection with Aspect Term Extraction and Aspect Term Polarity to further enhance performance. This approach facilitates shared representation learning, allowing Aspect Category Detection to benefit from the additional guidance offered by other tasks. Extensive experiments demonstrate that our framework surpasses strong baselines on standard datasets.


title: The Ups and Downs of Large Language Model Inference with Vocabulary Trimming by Language Heuristics

abstract: Deploying large language models (LLMs) encounters challenges due to intensive computational and memory requirements. Our research examines vocabulary trimming (VT) inspired by restricting embedding entries to the language of interest to bolster time and memory efficiency. While such modifications have been proven effective in tasks like machine translation, tailoring them to LLMs demands specific modifications given the diverse nature of LLM applications. We apply two language heuristics to trim the full vocabulary - Unicode-based script filtering and corpus-based selection - to different LLM families and sizes. The methods are straightforward, interpretable, and easy to implement. It is found that VT reduces the memory usage of small models by nearly 50% and has an upper bound of 25% improvement in generation speed. Yet, we reveal the limitations of these methods in that they do not perform consistently well for each language with diminishing returns in larger models.


title: An improved high-resolution shear velocity model beneath the Iranian plateau using adjoint noise tomography

abstract: We perform an adjoint waveform tomography using Rayleigh wave Empirical Green's Functions (EGFs) at 10-50 s periods to improve a prior 3-D velocity model of the crust and uppermost mantle beneath the Iranian Plateau. EGFs were derived from cross-correlations of ~8 years of continuous vertical component seismic noise recorded by 119 broadband stations within the region. Adjoint tomography refines the initial model by iteratively minimizing the frequency-dependent travel-time misfits between the synthetic Green's Functions (SGFs) and EGFs measured in different period bands. The total misfit is dropped by ~75 percent after 6 iterations. Overall, the adjoint tomography provides images with more realistic and improved resolutions and amplitudes due to the inclusion of finite-frequency waveforms. The use of a numerical spectral-element solver in adjoint tomography provides highly precise structural sensitivity kernels, resulting in more robust images compared to those generated by ray-theory tomography. Our study also demonstrates improvement in lateral resolution and depth sensitivity. The final model adjusts the shapes of velocity anomalies at crustal and uppermost mantle depths especially in the Zagros convergence zone. These improvements include a high-resolution image of delamination of the subducting Arabian lithosphere from Zagros lower crust beneath the central and NW Zagros. The refine, high-resolution images also better show the geometry of low-velocity anomalies, which represent diachronous underthrusting of Arabian crust beneath central Iran.


title: Second-order Rate Analysis of a Two-user Gaussian Interference Channel with Heterogeneous Blocklength Constraints

abstract: We consider a two-user Gaussian interference channel with heterogeneous blocklength constraints (HB-GIC), strong interference, and two private messages. We propose to apply the successive interference cancellation with early decoding, i.e., decoding a message with a number of received symbols less than the blocklength at the receiver. We determine the necessary number of received symbols to achieve successful decoding of the longer codeword that satisfies the input power constraints and target average error probability constraints. To attain the results, we investigate the dependence testing bound analysis over an independent and identically distributed (i.i.d.) Gaussian input. Besides, we derive the second-order achievable rate region of the considered HB-GIC. By numerical results based on the rate-profile approach, we compare the derived second-order rate region to the first-order one, which shows the rate back-off of the considered model due to the impact of finite blocklength.


title: Regularized Conventions: Equilibrium Computation as a Model of Pragmatic Reasoning

abstract: We present a model of pragmatic language understanding, where utterances are produced and understood by searching for regularized equilibria of signaling games. In this model (which we call ReCo, for Regularized Conventions), speakers and listeners search for contextually appropriate utterance--meaning mappings that are both close to game-theoretically optimal conventions and close to a shared, ''default'' semantics. By characterizing pragmatic communication as equilibrium search, we obtain principled sampling algorithms and formal guarantees about the trade-off between communicative success and naturalness. Across several datasets capturing real and idealized human judgments about pragmatic implicatures, ReCo matches or improves upon predictions made by best response and rational speech act models of language understanding.


title: Search for the origin of wobbling motion in the $ A \approx 130 $ region: The case of $^{131}$Xe

abstract: In-beam $ \gamma $-ray spectroscopy of $^{131}$Xe has been carried out to study the structure of the intruder $ \nu h_{11/2} $ band. Excited states were populated via an $ \alpha $-induced fusion-evaporation reaction at E$ _{\alpha} = 38 $ MeV. Inspection of $ \gamma \gamma $-coincidence data resulted in the identification of a new rotational sequence. Based on the systematics of excitation energy, assigned spin-parity, decay pattern, and the electromagnetic character of the inter-band $ \Delta I = 1 $ $ \gamma $-transitions, this sequence is proposed as the unfavoured signature partner of the $ \nu h_{11/2} $ band. The structure of this band is further illuminated in the light of the triaxial particle rotor model (TPRM). The possibility of wobbling excitation in $ N = 77 $ Xe-Ba-Ce isotones has been explored in a systematic manner.


title: A Survey of the Metrics, Uses, and Subjects of Diversity-Based Techniques in Software Testing

abstract: There has been a significant amount of interest regarding the use of diversity-based testing techniques in software testing over the past two decades. Diversity-based testing (DBT) technique uses similarity metrics to leverage the dissimilarity between software artefacts - such as requirements, abstract models, program structures, or inputs - in order to address a software testing problem. DBT techniques have been used to assist in finding solutions to several different types of problems including generating test cases, prioritising them, and reducing very large test suites. This paper is a systematic survey of DBT techniques that summarises the key aspects and trends of 144 papers that report the use of 70 different similarity metrics with 24 different types of software artefacts, which have been used by researchers to tackle 11 different types of software testing problems. We further present an analysis of the recent trends in DBT techniques and review the different application domains to which the techniques have been applied, giving an overview of the tools developed by researchers to do so. Finally, the paper identifies some DBT challenges that are potential topics for future work.


title: Measurement of $ZZ$ production cross-sections in the four-lepton final state in $pp$ collisions at $\sqrt{s}=13.6$ TeV with the ATLAS experiment

abstract: This paper reports cross-section measurements of $ZZ$ production in $pp$ collisions at $\sqrt{s}=13.6$ TeV at the Large Hadron Collider. The data were collected by the ATLAS detector in 2022, and correspond to an integrated luminosity of 29 fb$^-1$. Events in the $ZZ\rightarrow4\ell$ ($\ell = e$, $\mu$) final states are selected and used to measure the inclusive and differential cross-sections in a fiducial region defined close to the analysis selections. The inclusive cross-section is further extrapolated to the total phase space with a requirement of 66 $< m_Z <$ 116 GeV for both $Z$ bosons, yielding $16.8 \pm 1.1$ pb. The results are well described by the Standard Model predictions.


title: Using the Built-in iPhone Body Tracking System for Neurological Tests: The Example of Assessing Arm Weakness in Stroke Patients. A Preliminary Evaluation of Accuracy and Performance

abstract: Timely treatment of stroke is critical to minimize brain damage. Therefore, efforts are being made to educate the public on detecting stroke symptoms, e.g., face, arms, and speech test (FAST). In this position paper, we propose to perform the arm weakness test using the integrated video tracking from an iPhone - some general tests to assess the tracking quality and discuss potential critical points. The test has been performed on 4 stroke patients. The result is compared with the report of the clinician. Although presenting some limitations, the system proved to be able to detect arm weakness as a symptom of stroke. We envisage that introducing a portable body tracking system in such clinical tests will provide advantages in terms of objectivity, repeatability, and the possibility to record and compare groups of patients.


title: A Deep uGMRT view of the ultra steep spectrum radio halo in Abell 521

abstract: We present the first detailed analysis of the ultra-steep spectrum radio halo in the merging galaxy cluster Abell 521, based on upgraded Giant Metrewave Radio telescope (uGMRT) observations. The combination of radio observations (300-850 MHz) and archival X-ray data provide a new window into the complex physics occurring in this system. When compared to all previous analyses, our sensitive radio images detected the centrally located radio halo emission to a greater extent of $\sim$ 1.3 Mpc. A faint extension of the southeastern radio relic has been discovered. We detected another relic, recently discovered by MeerKAT, and coincident with a possible shock front in the X-rays, at the northwest position of the center. We find that the integrated spectrum of the radio halo is well-fitted with a spectral index of $-1.86 \pm 0.12$. A spatially resolved spectral index map revealed the spectral index fluctuations, as well as an outward radial steepening of the average spectral index. The radio and X-ray surface brightness are well correlated for the entire and different sub-parts of the halo, with sub-linear correlation slopes (0.50$-$0.65). We also found a mild anti-correlation between the spectral index and X-ray surface brightness. Newly detected extensions of the SE relic and the counter relic are consistent with the merger in the plane of the sky.


title: You don't need a personality test to know these models are unreliable: Assessing the Reliability of Large Language Models on Psychometric Instruments

abstract: The versatility of Large Language Models (LLMs) on natural language understanding tasks has made them popular for research in social sciences. To properly understand the properties and innate personas of LLMs, researchers have performed studies that involve using prompts in the form of questions that ask LLMs about particular opinions. In this study, we take a cautionary step back and examine whether the current format of prompting LLMs elicits responses in a consistent and robust manner. We first construct a dataset that contains 693 questions encompassing 39 different instruments of persona measurement on 115 persona axes. Additionally, we design a set of prompts containing minor variations and examine LLMs' capabilities to generate answers, as well as prompt variations to examine their consistency with respect to content-level variations such as switching the order of response options or negating the statement. Our experiments on 17 different LLMs reveal that even simple perturbations significantly downgrade a model's question-answering ability, and that most LLMs have low negation consistency. Our results suggest that the currently widespread practice of prompting is insufficient to accurately and reliably capture model perceptions, and we therefore discuss potential alternatives to improve these issues.


title: Spectrally distinguishing symmetric spaces I

abstract: We prove that the irreducible symmetric space of complex structures on $\mathbb R^{2n}$ (resp.\ quaternionic structures on $\mathbb C^{2n}$) is spectrally unique within a $2$-parameter (resp.\ $3$-parameter) family of homogeneous metrics on the underlying differentiable manifold. Such families are strong candidates to contain all homogeneous metrics admitted on the corresponding manifolds. The main tool in the proof is an explicit expression for the smallest positive eigenvalue of the Laplace-Beltrami operator associated to each homogeneous metric involved. As a second consequence of this expression, we prove that any non-symmetric Einstein metric in the homogeneous families mentioned above are $\nu$-unstable.


title: Shortcuts to adiabaticity: theoretical framework, relations between different methods, and versatile approximations

abstract: Shortcuts to adiabaticity guide given systems to final destinations of adiabatic control via fast tracks. Various methods were proposed as varieties of shortcuts to adiabaticity. Basic theory of shortcuts to adiabaticity was established in the 2010s, but it has still been developing and many fundamental findings have been reported. In this Topical Review, we give a pedagogical introduction to theory of shortcuts to adiabaticity and revisit relations between different methods. Some versatile approximations in counterdiabatic driving, which is one of the methods of shortcuts to adiabaticity, will be explained in detail. We also summarize recent progress in studies of shortcuts to adiabaticity.


title: On Evaluating the Integration of Reasoning and Action in LLM Agents with Database Question Answering

abstract: This study introduces a new long-form database question answering dataset designed to evaluate how Large Language Models (LLMs) interact with a SQL interpreter. The task necessitates LLMs to strategically generate multiple SQL queries to retrieve sufficient data from a database, to reason with the acquired context, and to synthesize them into a comprehensive analytical narrative. Our findings highlight that this task poses great challenges even for the state-of-the-art GPT-4 model. We propose and evaluate two interaction strategies, and provide a fine-grained analysis of the individual stages within the interaction. A key discovery is the identification of two primary bottlenecks hindering effective interaction: the capacity for planning and the ability to generate multiple SQL queries. To address the challenge of accurately assessing answer quality, we introduce a multi-agent evaluation framework that simulates the academic peer-review process, enhancing the precision and reliability of our evaluations. This framework allows for a more nuanced understanding of the strengths and limitations of current LLMs in complex retrieval and reasoning tasks.


title: Comprehensive Quantum Calculation of the First Dielectric Virial Coefficient of Water

abstract: We present a complete calculation, fully accounting for quantum effects and for molecular flexibility, of the first dielectric virial coefficient of water and its isotopologues. The contribution of the electronic polarizability is computed from a state-of-the-art intramolecular potential and polarizability surface from the literature, and its small temperature dependence is quantified. The dipolar polarizability is calculated in a similar manner with an accurate literature dipole-moment surface; it differs from the classical result both due to the different molecular geometries sampled at different temperatures and due to the quantization of rotation. We calculate the dipolar contribution independently from spectroscopic information in the HITRAN2020 database and find that the two methods yield consistent results. The resulting first dielectric virial coefficient provides a complete description of the dielectric constant at low density that can be used in humidity metrology and as a boundary condition for new formulations for the static dielectric constant of water and heavy water.


title: A study of Geodesic (E, F)-preinvex Functions on Riemannian Manifolds

abstract: In this manuscript, we define (E, F)-invex set, (E, F)-invex functions, and (E, F)-preinvex functions on Euclidean space. We explore the concepts on the Riemannian manifold. We also detail the fundamental properties of (E, F)-preinvex functions and some examples that illustrate the concepts well. We have established a relation between (E, F)-invex and (E, F)-preinvex functions on the Riemannian manifolds. We introduce the conditions A and define (E, F)-proximal sub-gradient. To explore and demonstrate its applicability to optimization problems, (E, F)-preinvex is utilized. In the last, we establish the points of extrema of a non-smooth (E, F)-preinvex functions on (E, F)-invex subset of the Riemannian manifolds by using (E, F)-proximal sub-gradient.


title: OVM, Outcome-supervised Value Models for Planning in Mathematical Reasoning

abstract: Large language models (LLMs) often struggle with maintaining accuracy throughout multiple multiple reasoning steps, especially in mathematical reasoning where an error in earlier steps can propagate to subsequent ones and it ultimately leading to an incorrect answer. To reduce error propagation, guided decoding is employed to direct the LM decoding on a step-by-step basis. We argue that in guided decoding, assessing the potential of an incomplete reasoning path can be more advantageous than simply ensuring per-step correctness, as the former approach leads towards a correct final answer. This transforms the task into a $\textit{value estimation}$ problem in planning. Inspired by the findings that $\textit{outcome supervision for guided decoding essentially acts as a value model}$, we propose Outcome-supervised Value Model (OVM) that employs outcome supervision for training a value model, which prioritizes steps that lead to accurate conclusions. Furthermore, the OVM eliminates the need for labor-intensive annotations of step-level correctness, thereby significantly enhancing its scalability. Our experiments on two multi-step mathematical reasoning datasets, GSM8K and Game of 24, demonstrate the superior performance of the OVM model. Notably, in GSM8K, our $\textbf{OVM-7B model achieves state-of-the-art results among LLMs up to 13B parameters}$; especially it does not utilize GPT-4 or code execution. These findings offer a novel perspective on the role of outcome supervision in training value models for multi-step reasoning tasks and provide theoretical justification for its advantage in value estimation for guided decoding.


title: Neutrino nonradiative decay and the diffuse supernova neutrino background

abstract: The diffuse supernova neutrino background (DSNB) is the constant flux of neutrinos and antineutrinos emitted by all past core collapses in the observable Universe. We study the potential to extract information on the neutrino lifetime from the upcoming observation of the DSNB flux. The DSNB flux has a unique sensitivity to neutrino nonradiative decay for $\tau / m \in \left[ 10^9, 10^{11}\right]$~s/eV. To this end, we integrate, for the first time, astrophysical uncertainties, the contribution from failed supernovae, and a three-neutrino description of neutrino nonradiative decay. We present our predictions for future detection at the running Super-Kamiokande + Gd and the upcoming Hyper-Kamiokande, JUNO, and DUNE experiments. Finally, our results show the importance of identifying the neutrino mass ordering to restrict the possible decay scenarios for the impact of nonradiative neutrino decay on the DSNB.


title: MS-Former: Memory-Supported Transformer for Weakly Supervised Change Detection with Patch-Level Annotations

abstract: Fully supervised change detection methods have achieved significant advancements in performance, yet they depend severely on acquiring costly pixel-level labels. Considering that the patch-level annotations also contain abundant information corresponding to both changed and unchanged objects in bi-temporal images, an intuitive solution is to segment the changes with patch-level annotations. How to capture the semantic variations associated with the changed and unchanged regions from the patch-level annotations to obtain promising change results is the critical challenge for the weakly supervised change detection task. In this paper, we propose a memory-supported transformer (MS-Former), a novel framework consisting of a bi-directional attention block (BAB) and a patch-level supervision scheme (PSS) tailored for weakly supervised change detection with patch-level annotations. More specifically, the BAM captures contexts associated with the changed and unchanged regions from the temporal difference features to construct informative prototypes stored in the memory bank. On the other hand, the BAM extracts useful information from the prototypes as supplementary contexts to enhance the temporal difference features, thereby better distinguishing changed and unchanged regions. After that, the PSS guides the network learning valuable knowledge from the patch-level annotations, thus further elevating the performance. Experimental results on three benchmark datasets demonstrate the effectiveness of our proposed method in the change detection task. The demo code for our work will be publicly available at \url{https://github.com/guanyuezhen/MS-Former}.


title: Analysis of Comments Given in Documents Inspection in Software Development PBL and Investigation of the Impact on Students

abstract: This study considers inspection conducted in software development PBL as learning feedback and investigates the impact of each inspection comment on students. The authors have already collected most inspection comments for not only requirements specification but also UML diagrams on GitHub. The authors develop a tool that collects comments given in Figma to GitHub. We examine the impact on students of each classification of inspection comments based on the post-lesson questionnaire submitted by the students. Finally, we present the benefits that classification of inspection comments can bring to PBL and discuss automatic comment classification by machine learning enabled by text-based comments and the concept of software development PBL support application enabled by automatic classification of inspection comments.


title: Massless field equations for spin 3/2 in dimension 6

abstract: Main topic of the paper is a study of properties of massless fields of spin 3/2 in its Euclidean version. A lot of information is available already for massless fields in dimension 4. Here, we concentrate on dimension 6 and we are using the fact that the group SL(4,C) is isomorphic with the group Spin(6,C). It makes it possible to use tensor formalism for massless fields. Main problems treated in the paper are a description of fields which need to be considered in the spin 3/2 case, a suitable choice of equations they should satisfy, irreducibility of homogeneous solutions of massless field equations, the Fischer decomposition and the Howe duality for such fields.


title: Dynamics of Particle-laden Turbulent Suspensions: Effect of particle roughness

abstract: The Fluctuating Force Fluctuating Torque (F3T) model is developed and evaluated for the dynamics of a turbulent particle-gas suspension of rough spherical particles in a turbulent Couette flow in the limit where the viscous relaxation time of the particles and the time between collisions are much larger than the integral time for the fluid turbulence. The fluid force/torque exerted on the particles comprise a steady part due to the difference in the particle velocity/angular velocity and the fluid mean velocity/rotation rate, and a fluctuating part due to the turbulent velocity/vorticity fluctuations. The fluctuations are modeled as Gaussian white noise whose variance is determined from the fluid velocity and vorticity fluctuations. The smooth and rough inelastic collision models are considered for particle-particle and particle-wall collisions. The results show that inclusion of roughness is important for accurately predicting the particle dynamics; the second moments of the velocity fluctuations for rough particles are higher than those for smooth particles by a factor of 2-10, while the second moments of the angular velocity fluctuations are higher by 1-2 orders of magnitude. The F3T model quantitatively predicts the number density, mean and root mean square velocity and angular velocity profiles, and the distribution functions for the particle velocity and angular velocity, even though a Gaussian model is used for the highly non-Gaussian distributions for the force and torque fluctuations.


title: Aligning with Whom? Large Language Models Have Gender and Racial Biases in Subjective NLP Tasks

abstract: Human perception of language depends on personal backgrounds like gender and ethnicity. While existing studies have shown that large language models (LLMs) hold values that are closer to certain societal groups, it is unclear whether their prediction behaviors on subjective NLP tasks also exhibit a similar bias. In this study, leveraging the POPQUORN dataset which contains annotations of diverse demographic backgrounds, we conduct a series of experiments on four popular LLMs to investigate their capability to understand group differences and potential biases in their predictions for politeness and offensiveness. We find that for both tasks, model predictions are closer to the labels from White and female participants. We further explore prompting with the target demographic labels and show that including the target demographic in the prompt actually worsens the model's performance. More specifically, when being prompted to respond from the perspective of "Black" and "Asian" individuals, models show lower performance in predicting both overall scores as well as the scores from corresponding groups. Our results suggest that LLMs hold gender and racial biases for subjective NLP tasks and that demographic-infused prompts alone may be insufficient to mitigate such effects. Code and data are available at https://github.com/Jiaxin-Pei/LLM-Group-Bias.


title: Examining LLMs' Uncertainty Expression Towards Questions Outside Parametric Knowledge

abstract: Can large language models (LLMs) express their uncertainty in situations where they lack sufficient parametric knowledge to generate reasonable responses? This work aims to systematically investigate LLMs' behaviors in such situations, emphasizing the trade-off between honesty and helpfulness. To tackle the challenge of precisely determining LLMs' knowledge gaps, we diagnostically create unanswerable questions containing non-existent concepts or false premises, ensuring that they are outside the LLMs' vast training data. By compiling a benchmark, UnknownBench, which consists of both unanswerable and answerable questions, we quantitatively evaluate the LLMs' performance in maintaining honesty while being helpful. Using a model-agnostic unified confidence elicitation approach, we observe that most LLMs fail to consistently refuse or express uncertainty towards questions outside their parametric knowledge, although instruction fine-tuning and alignment techniques can provide marginal enhancements. Moreover, LLMs' uncertainty expression does not always stay consistent with the perceived confidence of their textual outputs.


title: Source Prompt: Coordinated Pre-training of Language Models on Diverse Corpora from Multiple Sources

abstract: Pre-trained language models (PLMs) have established the new paradigm in the field of NLP. For more powerful PLMs, one of the most popular and successful way is to continuously scale up sizes of the models and the pre-training corpora. These large corpora are generally obtained by converging smaller ones from multiple sources, they are thus growing increasingly diverse. However, the side-effects of these colossal converged corpora remain understudied. In this paper, we identify the disadvantage of heterogeneous corpora from multiple sources for pre-training PLMs. Towards coordinated pre-training on diverse corpora, we further propose source prompts (SP), which explicitly prompt the model of the data source at the pre-training and fine-tuning stages. Results of extensive experiments demonstrate that PLMs pre-trained with SP on diverse corpora gain significant improvement in various downstream tasks.


title: MOKA: Moral Knowledge Augmentation for Moral Event Extraction

abstract: News media often strive to minimize explicit moral language in news articles, yet most articles are dense with moral values as expressed through the reported events themselves. However, values that are reflected in the intricate dynamics among participating entities and moral events are far more challenging for most NLP systems to detect, including LLMs. To study this phenomenon, we annotate a new dataset, MORAL EVENTS, consisting of 5,494 structured event annotations on 474 news articles by diverse US media across the political spectrum. We further propose MOKA, a moral event extraction framework with MOral Knowledge Augmentation, which leverages knowledge derived from moral words and moral scenarios to produce structural representations of morality-bearing events. Experiments show that MOKA outperforms competitive baselines across three moral event understanding tasks. Further analysis shows even ostensibly nonpartisan media engage in the selective reporting of moral events. Our data and codebase are available at https://github.com/launchnlp/MOKA.


title: Tracking the Newsworthiness of Public Documents

abstract: Journalists must find stories in huge amounts of textual data (e.g. leaks, bills, press releases) as part of their jobs: determining when and why text becomes news can help us understand coverage patterns and help us build assistive tools. Yet, this is challenging because very few labelled links exist, language use between corpora is very different, and text may be covered for a variety of reasons. In this work we focus on news coverage of local public policy in the San Francisco Bay Area by the San Francisco Chronicle. First, we gather news articles, public policy documents and meeting recordings and link them using probabilistic relational modeling, which we show is a low-annotation linking methodology that outperforms other retrieval-based baselines. Second, we define a new task: newsworthiness prediction, to predict if a policy item will get covered. We show that different aspects of public policy discussion yield different newsworthiness signals. Finally we perform human evaluation with expert journalists and show our systems identify policies they consider newsworthy with 68% F1 and our coverage recommendations are helpful with an 84% win-rate.


title: GEO: Generative Engine Optimization

abstract: The advent of large language models (LLMs) has ushered in a new paradigm of search engines that use generative models to gather and summarize information to answer user queries. This emerging technology, which we formalize under the unified framework of generative engines (GEs), can generate accurate and personalized responses, rapidly replacing traditional search engines like Google and Bing. Generative Engines typically satisfy queries by synthesizing information from multiple sources and summarizing them using LLMs. While this shift significantly improves \textit{user} utility and \textit{generative search engine} traffic, it poses a huge challenge for the third stakeholder - website and content creators. Given the black-box and fast-moving nature of generative engines, content creators have little to no control over \textit{when} and \textit{how} their content is displayed. With generative engines here to stay, we must ensure the creator economy is not disadvantaged. To address this, we introduce Generative Engine Optimization (GEO), the first novel paradigm to aid content creators in improving their content visibility in GE responses through a flexible black-box optimization framework for optimizing and defining visibility metrics. We facilitate systematic evaluation by introducing GEO-bench, a large-scale benchmark of diverse user queries across multiple domains, along with relevant web sources to answer these queries. Through rigorous evaluation, we demonstrate that GEO can boost visibility by up to 40\% in GE responses. Moreover, we show the efficacy of these strategies varies across domains, underscoring the need for domain-specific optimization methods. Our work opens a new frontier in information discovery systems, with profound implications for both developers of GEs and content creators.


title: CARE: Extracting Experimental Findings From Clinical Literature

abstract: Extracting fine-grained experimental findings from literature can provide dramatic utility for scientific applications. Prior work has developed annotation schemas and datasets for limited aspects of this problem, failing to capture the real-world complexity and nuance required. Focusing on biomedicine, this work presents CARE -- a new IE dataset for the task of extracting clinical findings. We develop a new annotation schema capturing fine-grained findings as n-ary relations between entities and attributes, which unifies phenomena challenging for current IE systems such as discontinuous entity spans, nested relations, variable arity n-ary relations and numeric results in a single schema. We collect extensive annotations for 700 abstracts from two sources: clinical trials and case reports. We also demonstrate the generalizability of our schema to the computer science and materials science domains. We benchmark state-of-the-art IE systems on CARE, showing that even models such as GPT4 struggle. We release our resources to advance research on extracting and aggregating literature findings.


title: Gradient-Map-Guided Adaptive Domain Generalization for Cross Modality MRI Segmentation

abstract: Cross-modal MRI segmentation is of great value for computer-aided medical diagnosis, enabling flexible data acquisition and model generalization. However, most existing methods have difficulty in handling local variations in domain shift and typically require a significant amount of data for training, which hinders their usage in practice. To address these problems, we propose a novel adaptive domain generalization framework, which integrates a learning-free cross-domain representation based on image gradient maps and a class prior-informed test-time adaptation strategy for mitigating local domain shift. We validate our approach on two multi-modal MRI datasets with six cross-modal segmentation tasks. Across all the task settings, our method consistently outperforms competing approaches and shows a stable performance even with limited training data.


title: Projection-Free Methods for Solving Convex Bilevel Optimization Problems

abstract: When faced with multiple minima of an "inner-level" convex optimization problem, the convex bilevel optimization problem selects an optimal solution which also minimizes an auxiliary "outer-level" convex objective of interest. Bilevel optimization requires a different approach compared to single-level optimization problems since the set of minimizers for the inner-level objective is not given explicitly. In this paper, we propose new projection-free methods for convex bilevel optimization which require only a linear optimization oracle over the base domain. We provide convergence guarantees for both inner- and outer-level objectives that hold under our proposed projection-free methods. In particular, we highlight how our guarantees are affected by the presence or absence of an optimal dual solution. Lastly, we conduct numerical experiments that demonstrate the performance of the proposed methods.


title: Machine Learning for Polaritonic Chemistry: Accessing chemical kinetics

abstract: Altering chemical reactivity and material structure in confined optical environments is on the rise, and yet, a conclusive understanding of the microscopic mechanisms remains elusive. This originates mostly from the fact that accurately predicting vibrational and reactive dynamics for soluted ensembles of realistic molecules is no small endeavor, and adding (collective) strong light-matter interaction does not simplify matters. Here, we establish a framework based on a combination of machine learning (ML) models, trained using density-functional theory calculations, and molecular dynamics to accelerate such simulations. We then apply this approach to evaluate strong coupling, changes in reaction rate constant, and their influence on enthalpy and entropy for the deprotection reaction of 1-phenyl-2-trimethylsilylacetylene, which has been studied previously both experimentally and using ab initio simulations. While we find qualitative agreement with critical experimental observations, especially with regard to the changes in kinetics, we also find differences in comparison with previous theoretical predictions. The features for which the ML-accelerated and ab initio simulations agree show the experimentally estimated kinetic behavior. Conflicting features indicate that a contribution of dynamic electronic polarization to the reaction process is more relevant then currently believed. Our work demonstrates the practical use of ML for polaritonic chemistry, discusses limitations of common approximations and paves the way for a more holistic description of polaritonic chemistry.

categories: physics.chem-ph physics.comp-ph physics.optics quant-ph


title: Redefining Super-Resolution: Fine-mesh PDE predictions without classical simulations

abstract: In Computational Fluid Dynamics (CFD), coarse mesh simulations offer computational efficiency but often lack precision. Applying conventional super-resolution to these simulations poses a significant challenge due to the fundamental contrast between downsampling high-resolution images and authentically emulating low-resolution physics. The former method conserves more of the underlying physics, surpassing the usual constraints of real-world scenarios. We propose a novel definition of super-resolution tailored for PDE-based problems. Instead of simply downsampling from a high-resolution dataset, we use coarse-grid simulated data as our input and predict fine-grid simulated outcomes. Employing a physics-infused UNet upscaling method, we demonstrate its efficacy across various 2D-CFD problems such as discontinuity detection in Burger's equation, Methane combustion, and fouling in Industrial heat exchangers. Our method enables the generation of fine-mesh solutions bypassing traditional simulation, ensuring considerable computational saving and fidelity to the original ground truth outcomes. Through diverse boundary conditions during training, we further establish the robustness of our method, paving the way for its broad applications in engineering and scientific CFD solvers.

categories: physics.flu-dyn cs.AI cs.LG physics.comp-ph


title: P^3SUM: Preserving Author's Perspective in News Summarization with Diffusion Language Models

abstract: In this work, we take a first step towards designing summarization systems that are faithful to the author's intent, not only the semantic content of the article. Focusing on a case study of preserving political perspectives in news summarization, we find that existing approaches alter the political opinions and stances of news articles in more than 50% of summaries, misrepresenting the intent and perspectives of the news authors. We thus propose P^3SUM, a diffusion model-based summarization approach controlled by political perspective classifiers. In P^3SUM, the political leaning of a generated summary is iteratively evaluated at each decoding step, and any drift from the article's original stance incurs a loss back-propagated to the embedding layers, steering the political stance of the summary at inference time. Extensive experiments on three news summarization datasets demonstrate that P^3SUM outperforms state-of-the-art summarization systems and large language models by up to 13.7% in terms of the success rate of stance preservation, with competitive performance on standard metrics of summarization quality. Our findings present a first analysis of preservation of pragmatic features in summarization, highlight the lacunae in existing summarization models -- that even state-of-the-art models often struggle to preserve author's intents -- and develop new summarization systems that are more faithful to author's perspectives.


title: Observation of zero-energy modes in Gd atomic chains on superconducting Nb(110)

abstract: In this experimental study, we use scanning tunneling microscopy and spectroscopy to investigate Yu-Shiba-Rusinov states induced by 4f-shell rare-earth Gd adatoms on a superconducting Nb(110) surface. We engineer Gd atom chains along the substrate's $[1\overline{1}0]$ and $[001]$ directions, revealing distinct behaviors in differently oriented chains. $[1\overline{1}0]$-oriented Gd chains exhibit spectroscopic features at their ends, identifying them as trivial edge states, while $[001]$-oriented Gd chains display zero-energy edge states, suggesting non-trivial nature. Notably, Gd chains with four atoms--independent of their particular orientation--exhibit a uniform zero-energy mode along the entire chain. These findings call for further research and a theoretical framework to describe rare-earth-based structures on superconductors.


title: Capturing Perspectives of Crowdsourced Annotators in Subjective Learning Tasks

abstract: Supervised classification heavily depends on datasets annotated by humans. However, in subjective tasks such as toxicity classification, these annotations often exhibit low agreement among raters. Annotations have commonly been aggregated by employing methods like majority voting to determine a single ground truth label. In subjective tasks, aggregating labels will result in biased labeling and, consequently, biased models that can overlook minority opinions. Previous studies have shed light on the pitfalls of label aggregation and have introduced a handful of practical approaches to tackle this issue. Recently proposed multi-annotator models, which predict labels individually per annotator, are vulnerable to under-determination for annotators with few samples. This problem is exacerbated in crowdsourced datasets. In this work, we propose \textbf{Annotator Aware Representations for Texts (AART)} for subjective classification tasks. Our approach involves learning representations of annotators, allowing for exploration of annotation behaviors. We show the improvement of our method on metrics that assess the performance on capturing individual annotators' perspectives. Additionally, we demonstrate fairness metrics to evaluate our model's equability of performance for marginalized annotators compared to others.


title: Redefining the Laparoscopic Spatial Sense: AI-based Intra- and Postoperative Measurement from Stereoimages

abstract: A significant challenge in image-guided surgery is the accurate measurement task of relevant structures such as vessel segments, resection margins, or bowel lengths. While this task is an essential component of many surgeries, it involves substantial human effort and is prone to inaccuracies. In this paper, we develop a novel human-AI-based method for laparoscopic measurements utilizing stereo vision that has been guided by practicing surgeons. Based on a holistic qualitative requirements analysis, this work proposes a comprehensive measurement method, which comprises state-of-the-art machine learning architectures, such as RAFT-Stereo and YOLOv8. The developed method is assessed in various realistic experimental evaluation environments. Our results outline the potential of our method achieving high accuracies in distance measurements with errors below 1 mm. Furthermore, on-surface measurements demonstrate robustness when applied in challenging environments with textureless regions. Overall, by addressing the inherent challenges of image-guided surgery, we lay the foundation for a more robust and accurate solution for intra- and postoperative measurements, enabling more precise, safe, and efficient surgical procedures.


title: Application-Centric Benchmarking of Distributed FaaS Platforms using BeFaaS

abstract: Due to the popularity of the FaaS programming model, there is now a wide variety of commercial and open-source FaaS systems. Hence, for comparison of different FaaS systems and their configuration options, FaaS application developers rely on FaaS benchmarking frameworks. Existing frameworks, however, tend to evaluate only single isolated aspects, a more holistic application-centric benchmarking framework is still missing. In previous work, we proposed BeFaaS, an extensible application-centric benchmarking framework for FaaS environments that focuses on the evaluation of FaaS platforms through realistic and typical examples of FaaS applications. In this extended paper, we (i) enhance our benchmarking framework with additional features for distributed FaaS setups, (ii) design application benchmarks reflecting typical FaaS use cases, and (iii) use them to run extensive experiments with commercial cloud FaaS platforms (AWS Lambda, Azure Functions, Google Cloud Functions) and the tinyFaaS edge serverless platform. BeFaaS now includes four FaaS application-centric benchmarks, is extensible for additional workload profiles and platforms, and supports federated benchmark runs in which the benchmark application is distributed over multiple FaaS systems while collecting fine-grained measurement results for drill-down analysis. Our experiment results show that (i) network transmission is a major contributor to response latency for function chains, (ii) this effect is exacerbated in hybrid edge-cloud deployments, (iii) the trigger delay between a published event and the start of the triggered function ranges from about 100ms for AWS Lambda to 800ms for Google Cloud Functions, and (iv) Azure Functions shows the best cold start behavior for our workloads.


title: OFDM-based Waveforms for Joint Sensing and Communications Robust to Frequency Selective IQ Imbalance

abstract: Orthogonal frequency-division multiplexing (OFDM) is a promising waveform candidate for future joint sensing and communication systems. It is well known that the OFDM waveform is vulnerable to in-phase and quadrature-phase (IQ) imbalance, which increases the noise floor in a range-Doppler map (RDM). A state-of-the-art method for robustifying the OFDM waveform against IQ imbalance avoids an increased noise floor, but it generates additional ghost objects in the RDM [1]. A consequence of these additional ghost objects is a reduction of the maximum unambiguous range. In this work, a novel OFDM-based waveform robust to IQ imbalance is proposed, which neither increases the noise floor nor reduces the maximum unambiguous range. The latter is achieved by shifting the ghost objects in the RDM to different velocities such that their range variations observed over several consecutive RDMs do not correspond to the observed velocity. This allows tracking algorithms to identify them as ghost objects and eliminate them for the follow-up processing steps. Moreover, we propose complete communication systems for both the proposed waveform as well as for the state-of-the-art waveform, including methods for channel estimation, synchronization, and data estimation that are specifically designed to deal with frequency selective IQ imbalance which occurs in wideband systems. The effectiveness of these communication systems is demonstrated by means of bit error ratio (BER) simulations.


title: Stick-slip-to-stick transition of liquid oscillation in a U-tube

abstract: The nonlinear decay of oscillations of a liquid column in a U-shaped tube is investigated within the theoretical framework of the projection method formalized by Bongarzone et al. (2021) [1]. Starting from the full hydrodynamic system supplemented by a phenomenological contact line model, this physics-inspired method uses successive linear eigenmode projections to simulate the relaxation dynamics of liquid oscillations in the presence of sliding triple lines. Each projection is shown to eventually induce a rapid loss of total energy in the liquid motion, thus contributing to its nonlinear damping. A thorough quantitative comparison with experiments by Dollet et al. (2020) [2] demonstrates that, in contradistinction with their simplistic one-degree-of-freedom model, the present approach not only describes well the transient stick-slip dynamics, but it also correctly captures the global stick-slip to stick transition, as well as the secondary bulk motion following the arrest of the contact line, which has been so far overlooked by existing theoretical analyses. This study offers a further contribution to rationalizing the impact of contact angle hysteresis and its associated solidlike friction on the decay of liquid oscillations in the presence of sliding triple lines.


title: Translation Aligned Sentence Embeddings for Turkish Language

abstract: Due to the limited availability of high quality datasets for training sentence embeddings in Turkish, we propose a training methodology and a regimen to develop a sentence embedding model. The central idea is simple but effective : is to fine-tune a pretrained encoder-decoder model in two consecutive stages, where the first stage involves aligning the embedding space with translation pairs. Thanks to this alignment, the prowess of the main model can be better projected onto the target language in a sentence embedding setting where it can be fine-tuned with high accuracy in short duration with limited target language dataset.


title: Commuting Jordan derivations on triangular rings are zero

abstract: The main purpose of this article is to show that every commuting Jordan derivation on triangular rings (unital or not) is identically zero. Using this result, we prove that if $\mathcal{A}$ is a 2-torsion free ring such that it is either semiprime or satisfies Condition (P), then every commuting Jordan derivation from $\mathcal{A}$ into itself, under certain conditions, is identically zero.


title: Ensembles of Quantum Classifiers

abstract: In the current era, known as Noisy Intermediate-Scale Quantum (NISQ), encoding large amounts of data in the quantum devices is challenging and the impact of noise significantly affects the quality of the obtained results. A viable approach for the execution of quantum classification algorithms is the introduction of a well-known machine learning paradigm, namely, the ensemble methods. Indeed, the ensembles combine multiple internal classifiers, which are characterized by compact sizes due to the smaller data subsets used for training, to achieve more accurate and robust prediction performance. In this way, it is possible to reduce the qubits requirements with respect to a single larger classifier while achieving comparable or improved performance. In this work, we present an implementation and an extensive empirical evaluation of ensembles of quantum classifiers for binary classification, with the purpose of providing insights into their effectiveness, limitations, and potential for enhancing the performance of basic quantum models. In particular, three classical ensemble methods and three quantum classifiers have been taken into account here. Hence, the scheme that has been implemented (in Python) has a hybrid nature. The results (obtained on real-world datasets) have shown an accuracy advantage for the ensemble techniques with respect to the single quantum classifiers, and also an improvement in robustness. In fact, the ensembles have turned out to be able to mitigate both unsuitable data normalizations and repeated measurement inaccuracies, making quantum classifiers more stable.


title: Folding median graphs

abstract: Extending Stallings' foldings of trees, we show in this article that every parallel-preserving map between median graphs factors as an isometric embedding through a sequence of elementary transformations which we call foldings and swellings. This new construction proposes a unified point of view on Beeker and Lazarovich's work on folding pocsets and on Ben-Zvi, Kropholler, and Lyman's work on folding nonpositively curved cube complexes.


title: The Distribution of Semi-Detached Binaries. I.An Efficient Pipeline

abstract: Semi-detached binaries are in the stage of mass transfer and play a crucial role in studying mass transfer physics between interacting binaries. Large-scale time-domain surveys provide massive light curves of binary systems, while Gaia offers high-precision astrometric data. In this paper, we develop, validate, and apply a pipeline that combines the MCMC method with a forward model and DBSCAN clustering to search for semi-detached binary and estimate its inclination, relative radius, mass ratio, and temperature ratio using light curve. We train our model on the mock light curves from PHOEBE, which provides broad coverage of light curve simulations for semi-detached binaries. Applying our pipeline to TESS sectors 1-26, we have identified 77 semi-detached binary candidates. Utilizing the distance from Gaia, we determine their masses and radii with median fractional uncertainties of ~26% and ~7%, respectively. With the added 77 candidates, the catalog of semi-detached binaries with orbital parameters has been expanded by approximately 20%. The comparison and statistical results show that our semi-detached binary candidates align well with the compiled samples and the PARSEC model in Teff-L and M-R relations. Combined with the literature samples, comparative analysis with stability criteria for conserved mass transfer indicates that ~97.4% of samples are undergoing nuclear-timescale mass transfer, and two samples (GO Cyg and TIC 454222105) are located within the limits of stability criteria for dynamical- and thermal-timescale mass transfer, which are currently undergoing thermal-timescale mass transfer. Additionally, one system (IR Lyn) is very close to the upper limit of delayed dynamical-timescale mass transfer.


title: DIFFNAT: Improving Diffusion Image Quality Using Natural Image Statistics

abstract: Diffusion models have advanced generative AI significantly in terms of editing and creating naturalistic images. However, efficiently improving generated image quality is still of paramount interest. In this context, we propose a generic "naturalness" preserving loss function, viz., kurtosis concentration (KC) loss, which can be readily applied to any standard diffusion model pipeline to elevate the image quality. Our motivation stems from the projected kurtosis concentration property of natural images, which states that natural images have nearly constant kurtosis values across different band-pass versions of the image. To retain the "naturalness" of the generated images, we enforce reducing the gap between the highest and lowest kurtosis values across the band-pass versions (e.g., Discrete Wavelet Transform (DWT)) of images. Note that our approach does not require any additional guidance like classifier or classifier-free guidance to improve the image quality. We validate the proposed approach for three diverse tasks, viz., (1) personalized few-shot finetuning using text guidance, (2) unconditional image generation, and (3) image super-resolution. Integrating the proposed KC loss has improved the perceptual quality across all these tasks in terms of both FID, MUSIQ score, and user evaluation.


title: Efficacy of Wolbachia-mediated sterility to suppress dengue: a synthetic control study

abstract: In a study conducted in Singapore, a country prone to dengue outbreaks due to its climate and urban population, researchers examined the effectiveness of releasing male Aedes aegypti mosquitoes infected with Wolbachia (wAlbB strain) to reduce dengue transmission. These infected males, when mating with wild-type females, produced non-viable eggs, leading to vector suppression. Extensive field trials involving over 600,000 residents in four townships were conducted from 2018 to 2022. The results showed a 57% decline in total dengue incidence and a 64% decline in clustered dengue incidence. This approach offers promise for large-scale dengue control in regions facing rising dengue cases, providing a critical solution in combating the disease.


title: How Does Calibration Data Affect the Post-training Pruning and Quantization of Large Language Models?

abstract: Pruning and quantization form the foundation of model compression for neural networks, enabling efficient inference for large language models (LLMs). Recently, various quantization and pruning techniques have demonstrated state-of-the-art performance in a post-training setting. They rely upon calibration data, a small set of unlabeled examples, to generate layer activations. However, no prior work has systematically investigated how the calibration data impacts the effectiveness of model compression methods. In this paper, we present the first extensive empirical study on the effect of calibration data upon LLM performance. We trial a variety of pruning and quantization methods, tasks, models, and datasets. Surprisingly, we find substantial variations in downstream task performance, contrasting existing work that suggests a greater level of robustness to the calibration data. Finally, we make a series of recommendations for the effective use of calibration data in LLM quantization and pruning.


title: FairytaleCQA: Integrating a Commonsense Knowledge Graph into Children's Storybook Narratives

abstract: AI models (including LLM) often rely on narrative question-answering (QA) datasets to provide customized QA functionalities to support downstream children education applications; however, existing datasets only include QA pairs that are grounded within the given storybook content, but children can learn more when teachers refer the storybook content to real-world knowledge (e.g., commonsense knowledge). We introduce the FairytaleCQA dataset, which is annotated by children education experts, to supplement 278 storybook narratives with educationally appropriate commonsense knowledge. The dataset has 5,868 QA pairs that not only originate from the storybook narrative but also contain the commonsense knowledge grounded by an external knowledge graph (i.e., ConceptNet). A follow-up experiment shows that a smaller model (T5-large) fine-tuned with FairytaleCQA reliably outperforms much larger prompt-engineered LLM (e.g., GPT-4) in this new QA-pair generation task (QAG). This result suggests that: 1) our dataset brings novel challenges to existing LLMs, and 2) human experts' data annotation are still critical as they have much nuanced knowledge that LLMs do not know in the children educational domain.


title: UFPS: A unified framework for partially-annotated federated segmentation in heterogeneous data distribution

abstract: Partially supervised segmentation is a label-saving method based on datasets with fractional classes labeled and intersectant. However, it is still far from landing on real-world medical applications due to privacy concerns and data heterogeneity. As a remedy without privacy leakage, federated partially supervised segmentation (FPSS) is formulated in this work. The main challenges for FPSS are class heterogeneity and client drift. We propose a Unified Federated Partially-labeled Segmentation (UFPS) framework to segment pixels within all classes for partially-annotated datasets by training a totipotential global model without class collision. Our framework includes Unified Label Learning and sparsed Unified Sharpness Aware Minimization for unification of class and feature space, respectively. We find that vanilla combinations for traditional methods in partially supervised segmentation and federated learning are mainly hampered by class collision through empirical study. Our comprehensive experiments on real medical datasets demonstrate better deconflicting and generalization ability of UFPS compared with modified methods.


title: OrchestraLLM: Efficient Orchestration of Language Models for Dialogue State Tracking

abstract: Large language models (LLMs) have revolutionized the landscape of Natural Language Processing systems, but are computationally expensive. To reduce the cost without sacrificing performance, previous studies have explored various approaches to harness the potential of Small Language Models (SLMs) as cost-effective alternatives to their larger counterparts. Driven by findings that SLMs and LLMs exhibit complementary strengths in a structured knowledge extraction task, this work presents a novel SLM/LLM routing framework designed to improve computational efficiency and enhance task performance. First, exemplar pools are created to represent the types of contexts where each LM provides a more reliable answer, leveraging a sentence embedding fine-tuned so that context similarity is close to dialogue state similarity. Then, during inference, the k-nearest exemplars to the testing instance are retrieved, and the instance is routed according to majority vote. In dialogue state tracking tasks, the proposed routing framework enhances performance substantially compared to relying solely on LLMs, while reducing the computational costs by over 50%.


title: Scene Text Image Super-resolution based on Text-conditional Diffusion Models

abstract: Scene Text Image Super-resolution (STISR) has recently achieved great success as a preprocessing method for scene text recognition. STISR aims to transform blurred and noisy low-resolution (LR) text images in real-world settings into clear high-resolution (HR) text images suitable for scene text recognition. In this study, we leverage text-conditional diffusion models (DMs), known for their impressive text-to-image synthesis capabilities, for STISR tasks. Our experimental results revealed that text-conditional DMs notably surpass existing STISR methods. Especially when texts from LR text images are given as input, the text-conditional DMs are able to produce superior quality super-resolution text images. Utilizing this capability, we propose a novel framework for synthesizing LR-HR paired text image datasets. This framework consists of three specialized text-conditional DMs, each dedicated to text image synthesis, super-resolution, and image degradation. These three modules are vital for synthesizing distinct LR and HR paired images, which are more suitable for training STISR methods. Our experiments confirmed that these synthesized image pairs significantly enhance the performance of STISR methods in the TextZoom evaluation.


title: Eventually Lattice-Linear Algorithms

abstract: Lattice-linear systems allow nodes to execute asynchronously. We introduce eventually lattice-linear algorithms, where lattices are induced only among the states in a subset of the state space. The algorithm guarantees that the system transitions to a state in one of the lattices. Then, the algorithm behaves lattice linearly while traversing to an optimal state through that lattice. We present a lattice-linear self-stabilizing algorithm for service demand based minimal dominating set (SDMDS) problem. Using this as an example, we elaborate the working of, and define, eventually lattice-linear algorithms. Then, we present eventually lattice-linear self-stabilizing algorithms for minimal vertex cover (MVC), maximal independent set (MIS), graph colouring (GC) and 2-dominating set problems (2DS). Algorithms for SDMDS, MVCc and MIS converge in 1 round plus $n$ moves (within $2n$ moves), GC in $n+4m$ moves, and 2DS in 1 round plus $2n$ moves (within $3n$ moves). These results are an improvement over the existing literature. We also present experimental results to show performance gain demonstrating the benefit of lattice-linearity.


title: MAFALDA: A Benchmark and Comprehensive Study of Fallacy Detection and Classification

abstract: We introduce MAFALDA, a benchmark for fallacy classification that merges and unites previous fallacy datasets. It comes with a taxonomy that aligns, refines, and unifies existing classifications of fallacies. We further provide a manual annotation of a part of the dataset together with manual explanations for each annotation. We propose a new annotation scheme tailored for subjective NLP tasks, and a new evaluation method designed to handle subjectivity. We then evaluate several language models under a zero-shot learning setting and human performances on MAFALDA to assess their capability to detect and classify fallacies.


title: Graph Elicitation for Guiding Multi-Step Reasoning in Large Language Models

abstract: Chain-of-Thought (CoT) prompting along with sub-question generation and answering has enhanced multi-step reasoning capabilities of Large Language Models (LLMs). However, prompting the LLMs to directly generate sub-questions is suboptimal since they sometimes generate redundant or irrelevant questions. To deal with them, we propose a GE-Reasoning method, which directs LLMs to generate proper sub-questions and corresponding answers. Concretely, given an input question, we first prompt the LLM to generate knowledge triplets, forming a graph representation of the question. Unlike conventional knowledge triplets, our approach allows variables as head or tail entities, effectively representing a question as knowledge triplets. Second, for each triplet, the LLM generates a corresponding sub-question and answer along with using knowledge retrieval. If the prediction confidence exceeds a threshold, the sub-question and prediction are incorporated into the prompt for subsequent processing. This approach encourages that sub-questions are grounded in the extracted knowledge triplets, reducing redundancy and irrelevance. Our experiments demonstrate that our approach outperforms previous CoT prompting methods and their variants on multi-hop question answering benchmark datasets.


title: Test-time Backdoor Mitigation for Black-Box Large Language Models with Defensive Demonstrations

abstract: Existing studies in backdoor defense have predominantly focused on the training phase, overlooking the critical aspect of testing time defense. This gap becomes particularly pronounced in the context of Large Language Models (LLMs) deployed as Web Services, which typically offer only black-box access, rendering training-time defenses impractical. To bridge this gap, our work introduces defensive demonstrations, an innovative backdoor defense strategy for blackbox large language models. Our method involves identifying the task and retrieving task-relevant demonstrations from an uncontaminated pool. These demonstrations are then combined with user queries and presented to the model during testing, without requiring any modifications/tuning to the black-box model or insights into its internal mechanisms. Defensive demonstrations are designed to counteract the adverse effects of triggers, aiming to recalibrate and correct the behavior of poisoned models during test-time evaluations. Extensive experiments show that defensive demonstrations are effective in defending both instance-level and instruction-level backdoor attacks, not only rectifying the behavior of poisoned models but also surpassing existing baselines in most scenarios.


title: Dancing with the stars: a review on stellar multiplicity

abstract: Stars like company. They are mostly formed in clusters and their lives are often altered by the presence of one or more companions. Interaction processes between components may lead to complex outcomes like Algols, blue stragglers, chemically altered stars, type Ia supernovae, as well as progenitors of gravitational wave sources, to cite a few. Observational astronomy has entered the era of big data, and thanks to large surveys like spatial missions Kepler, TESS, Gaia, and ground-based spectroscopic surveys like RAVE, Gaia-ESO, APOGEE, LAMOST, GALAH (to name a few) the field is going through a true revolution, as illustrated by the recent detection of stellar black holes and neutron stars as companions of massive but also low-mass stars. In this review, I will present why it is important to care about stellar multiples, what are the main large surveys in which many binaries are harvested, and finally present some features related to the largest catalogue of astrometric, spectroscopic and eclipsing binaries provided by the Non-Single Star catalogue of Gaia, which is, to date, the largest homogeneous catalogue of stellar binaries.


title: Back to Basics: A Simple Recipe for Improving Out-of-Domain Retrieval in Dense Encoders

abstract: Prevailing research practice today often relies on training dense retrievers on existing large datasets such as MSMARCO and then experimenting with ways to improve zero-shot generalization capabilities to unseen domains. While prior work has tackled this challenge through resource-intensive steps such as data augmentation, architectural modifications, increasing model size, or even further base model pretraining, comparatively little investigation has examined whether the training procedures themselves can be improved to yield better generalization capabilities in the resulting models. In this work, we recommend a simple recipe for training dense encoders: Train on MSMARCO with parameter-efficient methods, such as LoRA, and opt for using in-batch negatives unless given well-constructed hard negatives. We validate these recommendations using the BEIR benchmark and find results are persistent across choice of dense encoder and base model size and are complementary to other resource-intensive strategies for out-of-domain generalization such as architectural modifications or additional pretraining. We hope that this thorough and impartial study around various training techniques, which augments other resource-intensive methods, offers practical insights for developing a dense retrieval model that effectively generalizes, even when trained on a single dataset.


title: LLMs as Narcissistic Evaluators: When Ego Inflates Evaluation Scores

abstract: Automatic evaluation of generated textual content presents an ongoing challenge within the field of NLP. Given the impressive capabilities of modern language models (LMs) across diverse NLP tasks, there is a growing trend to employ these models in creating innovative evaluation metrics for automated assessment of generation tasks. This paper investigates a pivotal question: Do language model-driven evaluation metrics inherently exhibit bias favoring texts generated by the same underlying language model? Specifically, we assess whether prominent LM-based evaluation metrics (e.g. BARTScore, T5Score, and GPTScore) demonstrate a favorable bias toward their respective underlying LMs in the context of summarization tasks. Our findings unveil a latent bias, particularly pronounced when such evaluation metrics are used in a reference-free manner without leveraging gold summaries. These results underscore that assessments provided by generative evaluation models can be influenced by factors beyond the inherent text quality, highlighting the necessity of developing more reliable evaluation protocols in the future.


title: New advancements, challenges and opportunities of nanophotonics for neuromorphic computing: A state-of-the-art review

abstract: The expansion of optoelectronic devices on photonic integration platforms has led to significant growth in the field of photonic computing. Photonic integrated circuits have facilitated the creation of ultrafast artificial neural networks, forming the basis for a novel category of information processing devices. Their application extends to diverse domains such as medical diagnosis, language models, telecommunications, quantum computing, and the metaverse, addressing the escalating demands of machine learning and artificial intelligence (AI). In contrast, conventional electronics faces challenges in latency, crosstalk, and energy consumption. Neuromorphic photonics emerges as a compelling solution, featuring sub-nanosecond latencies, minimal heat dissipation, and high parallelism, expanding the scope of AI and Optical Neural Networks. This review explores recent advances in integrated photonic neuromorphic systems, focusing on materials and device engineering breakthroughs needed to overcome existing challenges. Examining various technologies in AI accelerators, from traditional optics to PICs, we assess energy efficiency through operations per joule and compute density in operations per squared millimeter per second. A comparative analysis highlights crucial technical aspects, emphasizing nanophotonic components like VCSEL lasers, optical interconnects, nanocavity resonators, and frequency microcombs. These components showcase recent breakthroughs in photonic engineering and materials science, enabling the creation of customized neuromorphic systems for AI tasks. Despite progress, current technologies face obstacles in achieving photonic AI accelerators with computing speed and energy efficiencies reaching the petaOPS range. The review explores potential future approaches in new devices, fabrication, materials, scalability, and integration to enhance critical performance metrics.


title: Utilizing dataset affinity prediction in object detection to assess training data

abstract: Data pooling offers various advantages, such as increasing the sample size, improving generalization, reducing sampling bias, and addressing data sparsity and quality, but it is not straightforward and may even be counterproductive. Assessing the effectiveness of pooling datasets in a principled manner is challenging due to the difficulty in estimating the overall information content of individual datasets. Towards this end, we propose incorporating a data source prediction module into standard object detection pipelines. The module runs with minimal overhead during inference time, providing additional information about the data source assigned to individual detections. We show the benefits of the so-called dataset affinity score by automatically selecting samples from a heterogeneous pool of vehicle datasets. The results show that object detectors can be trained on a significantly sparser set of training samples without losing detection accuracy.


title: 1953: Fermi's "little discovery" and the birth of the numerical experiment

abstract: The year 1953 is pivotal for computational physics: the first application of the Monte-Carlo method is published and calculations of the so-called Fermi-Pasta-Ulam-Tsingou experiment are started. It is the beginning of the massive use in the physical sciences of numerical methods implemented on electronic computers and a decisive step in the development of modern nonlinear dynamics. This will lead to an unpredictable development during the following 70 years. We briefly review the unfolding of these events and present some recent results that show how the issues raised are still relevant today


title: DINO-VITS: Data-Efficient Zero-Shot TTS with Self-Supervised Speaker Verification Loss for Noise Robustness

abstract: We address zero-shot TTS systems' noise-robustness problem by proposing a dual-objective training for the speaker encoder using self-supervised DINO loss. This approach enhances the speaker encoder with the speech synthesis objective, capturing a wider range of speech characteristics beneficial for voice cloning. At the same time, the DINO objective improves speaker representation learning, ensuring robustness to noise and speaker discriminability. Experiments demonstrate significant improvements in subjective metrics under both clean and noisy conditions, outperforming traditional speaker-encoderbased TTS systems. Additionally, we explore training zeroshot TTS on noisy, unlabeled data. Our two-stage training strategy, leveraging self-supervised speech models to distinguish between noisy and clean speech, shows notable advances in similarity and naturalness, especially with noisy training datasets, compared to the ASR-transcription-based approach.


title: Essential self-adjointness of even-order, strongly singular, homogeneous half-line differential operators

abstract: We consider essential self-adjointness on the space $C_0^{\infty}((0,\infty))$ of even order, strongly singular, homogeneous differential operators associated with differential expressions of the type \[ \tau_{2n}(c) = (-1)^n \frac{d^{2n}}{d x^{2n}} + \frac{c}{x^{2n}}, \quad x > 0, \; n \in \mathbb{N}, \; c \in \mathbb{R}, \] in $L^2((0,\infty);dx)$. While the special case $n=1$ is classical and it is well-known that $\tau_2(c)\big|_{C_0^\infty((0,\infty))}$ is essentially self-adjoint if and only if $c \geq 3/4$, the case $n \in \mathbb{N}$, $n \geq 2$, is far from obvious. In particular, it is not at all clear from the outset that \[ \text{ there exists } c_n \in \mathbb{R}, \, n \in \mathbb{N}, \text{ such that } \tau_{2n}(c)\big|_{C_0^\infty((0,\infty))} \, \text{ is essentially self-adjoint if and only if } c \geq c_n. \tag{*}\label{0.1} \] As one of the principal results of this paper we indeed establish the existence of $c_n$, satisfying $c_n \geq (4n-1)!!\big/2^{2n}$, such that property \eqref{0.1} holds. In sharp contrast to the analogous lower semiboundedness question, \[ \text{ for which values of } c \, \text{\it is } \tau_{2n}(c)\big|_{C_0^{\infty}((0,\infty))} \, \text{ bounded from below?}, \] which permits the sharp (and explicit) answer $c \geq [(2n -1)!!]^{2}\big/2^{2n}$, $n \in \mathbb{N}$, the answer for \eqref{0.1} is surprisingly complex and involves various aspects of the geometry and analytical theory of polynomials. For completeness we record explicitly, \[ c_1 = 3/4, \quad c_2= 45, \quad c_3 = 2240 \big(214+7 \sqrt{1009}\,\big)\big/27, \] and remark that $c_n$ is the root of a polynomial of degree $n-1$. We demonstrate that for $n=6,7$, $c_n$ are algebraic numbers not expressible as radicals over $\mathbb{Q}$ (and conjecture this is in fact true for general $n \geq 6$).


title: Properties of Nb\_xTi\_{(1-x)}N thin films deposited on 300 mm silicon wafers for upscaling superconducting digital circuits

abstract: Scaling superconducting digital circuits requires fundamental changes in the current material set and fabrication process. The transition to 300 mm wafers and the implementation of advanced lithography are instrumental in facilitating mature CMOS processes, ensuring uniformity, and optimizing the yield. This study explores the properties of NbxTi(1-x)N films fabricated by magnetron DC sputtering on 300 mm Si wafers. As a promising alternative to traditional Nb in device manufacturing, NbxTi(1-x)N offers numerous advantages, including enhanced stability and scalability to smaller dimensions, in both processing and design. As a ternary material, NbxTi(1-x)N allows engineering material parameters by changing deposition conditions. The engineered properties can be used to modulate device parameters through the stack and mitigate failure modes. We report characterization of NbxTi(1-x)N films at less than 2% thickness variability, 2.4% Tc variability and 3% composition variability. The films material properties such as resistivity (140-375 {\Omega}cm) and critical temperature Tc (4.6 K - 14.1 K) are correlated with stoichiometry and morphology of the films. Our results highlight the significant influence of deposition conditions on crystallographic texture along the films and its correlation with Tc.


title: To be or not to be? an exploration of continuously controllable prompt engineering

abstract: As the use of large language models becomes more widespread, techniques like parameter-efficient fine-tuning and other methods for controlled generation are gaining traction for customizing models and managing their outputs. However, the challenge of precisely controlling how prompts influence these models is an area ripe for further investigation. In response, we introduce ControlPE (Continuously Controllable Prompt Engineering). ControlPE enables finer adjustments to prompt effects, complementing existing prompt engineering, and effectively controls continuous targets. This approach harnesses the power of LoRA (Low-Rank Adaptation) to create an effect akin to prompt weighting, enabling fine-tuned adjustments to the impact of prompts. Our methodology involves generating specialized datasets for prompt distillation, incorporating these prompts into the LoRA model, and carefully adjusting LoRA merging weight to regulate the influence of prompts. This provides a dynamic and adaptable tool for prompt control. Through our experiments, we have validated the practicality and efficacy of ControlPE. It proves to be a promising solution for control a variety of prompts, ranging from generating short responses prompts, refusal prompts to chain-of-thought prompts.


title: HuatuoGPT-II, One-stage Training for Medical Adaption of LLMs

abstract: Adapting a language model into a specific domain, a.k.a `domain adaption', is a common practice when specialized knowledge, e.g. medicine, is not encapsulated in a general language model like Llama2. The challenge lies in the heterogeneity of data across the two training stages, as it varies in languages, genres, or formats. To tackle this and simplify the learning protocol, we propose to transform heterogeneous data, from the both pre-training and supervised stages, into a unified, simple input-output pair format. We validate the new protocol in the domains where proprietary LLMs like ChatGPT perform relatively poorly, such as Traditional Chinese Medicine. The developed model, HuatuoGPT-II, has shown state-of-the-art performance in Chinese medicine domain on a number of benchmarks, e.g. medical licensing exams. It even outperforms proprietary models like ChatGPT and GPT-4 in some aspects, especially in Traditional Chinese Medicine. Expert manual evaluations further validate HuatuoGPT-II's advantages over existing LLMs. Notably, HuatuoGPT-II was benchmarked in a fresh Chinese National Medical Licensing Examination where it achieved the best performance, showcasing not only its effectiveness but also its generalization capabilities.


title: MEGA: A Memory-Efficient GNN Accelerator Exploiting Degree-Aware Mixed-Precision Quantization

abstract: Graph Neural Networks (GNNs) are becoming a promising technique in various domains due to their excellent capabilities in modeling non-Euclidean data. Although a spectrum of accelerators has been proposed to accelerate the inference of GNNs, our analysis demonstrates that the latency and energy consumption induced by DRAM access still significantly impedes the improvement of performance and energy efficiency. To address this issue, we propose a Memory-Efficient GNN Accelerator (MEGA) through algorithm and hardware co-design in this work. Specifically, at the algorithm level, through an in-depth analysis of the node property, we observe that the data-independent quantization in previous works is not optimal in terms of accuracy and memory efficiency. This motivates us to propose the Degree-Aware mixed-precision quantization method, in which a proper bitwidth is learned and allocated to a node according to its in-degree to compress GNNs as much as possible while maintaining accuracy. At the hardware level, we employ a heterogeneous architecture design in which the aggregation and combination phases are implemented separately with different dataflows. In order to boost the performance and energy efficiency, we also present an Adaptive-Package format to alleviate the storage overhead caused by the fine-grained bitwidth and diverse sparsity, and a Condense-Edge scheduling method to enhance the data locality and further alleviate the access irregularity induced by the extremely sparse adjacency matrix in the graph. We implement our MEGA accelerator in a 28nm technology node. Extensive experiments demonstrate that MEGA can achieve an average speedup of 38.3x, 7.1x, 4.0x, 3.6x and 47.6x, 7.2x, 5.4x, 4.5x energy savings over four state-of-the-art GNN accelerators, HyGCN, GCNAX, GROW, and SGCN, respectively, while retaining task accuracy.


title: What to tell when? -- Information Provision as a Game

abstract: Constantly informing systems (CIS), that is technical systems that provide us with information over a long period of time, face the challenge of providing us with helpful information. The information base of a human model changes over time but also his mood and his ability to accept information. An information provision strategy should hence take such aspects into account. In this paper, we describe our vision of an approach to aid the design of CIS. We envision using psychological models of the human mind and emotions in an information provision game. Its analysis gives comparative insights into design variants.