title: Improving Large-scale Deep Biasing with Phoneme Features and Text-only Data in Streaming Transducer

abstract: Deep biasing for the Transducer can improve the recognition performance of rare words or contextual entities, which is essential in practical applications, especially for streaming Automatic Speech Recognition (ASR). However, deep biasing with large-scale rare words remains challenging, as the performance drops significantly when more distractors exist and there are words with similar grapheme sequences in the bias list. In this paper, we combine the phoneme and textual information of rare words in Transducers to distinguish words with similar pronunciation or spelling. Moreover, the introduction of training with text-only data containing more rare words benefits large-scale deep biasing. The experiments on the LibriSpeech corpus demonstrate that the proposed method achieves state-of-the-art performance on rare word error rate for different scales and levels of bias lists.


title: Homomorphic Polynomial Public Key Cryptography for Quantum-secure Digital Signature

abstract: In their 2022 study, Kuang et al. introduced Multivariable Polynomial Public Key (MPPK) cryptography, leveraging the inversion relationship between multiplication and division for quantum-safe public key systems. They extended MPPK into Homomorphic Polynomial Public Key (HPPK), employing homomorphic encryption for large hidden ring operations. Originally designed for key encapsulation (KEM), HPPK's security relies on homomorphic encryption of public polynomials. This paper expands HPPK KEM to a digital signature scheme, facing challenges due to the distinct nature of verification compared to decryption. To adapt HPPK KEM to digital signatures, the authors introduce an extension of the Barrett reduction algorithm, transforming modular multiplications into divisions in the verification equation over a prime field. The extended algorithm non-linearly embeds the signature into public polynomial coefficients, addressing vulnerabilities in earlier MPPK DS schemes. Security analysis demonstrates exponential complexity for private key recovery and forged signature attacks, considering ring bit length twice that of the prime field size.


title: Identifying Linear Relational Concepts in Large Language Models

abstract: Transformer language models (LMs) have been shown to represent concepts as directions in the latent space of hidden activations. However, for any human-interpretable concept, how can we find its direction in the latent space? We present a technique called linear relational concepts (LRC) for finding concept directions corresponding to human-interpretable concepts by first modeling the relation between subject and object as a linear relational embedding (LRE). We find that inverting the LRE and using earlier object layers results in a powerful technique for finding concept directions that outperforms standard black-box probing classifiers. We evaluate LRCs on their performance as concept classifiers as well as their ability to causally change model output.


title: PDU-set Scheduling Algorithm for XR Traffic in Multi-Service 5G-Advanced Networks

abstract: In this paper, we investigate a dynamic packet scheduling algorithm designed to enhance the eXtended Reality (XR) capacity of fifth-generation (5G)-Advanced networks with multiple cells, multiple users, and multiple services. The scheduler exploits the newly defined protocol data unit (PDU)-set information for XR traffic flows to enhance its quality-of-service awareness. To evaluate the performance of the proposed solution, advanced dynamic system-level simulations are conducted. The findings reveal that the proposed scheduler offers a notable improvement in increasing XR capacity up to 45%, while keeping the same enhanced mobile broadband (eMBB) cell throughput as compared to the well-known baseline schedulers.


title: SDSS-IV from 2014 to 2016: A Detailed Demographic Comparison over Three Years

abstract: The Sloan Digital Sky Survey (SDSS) is one of the largest international astronomy organizations. We present demographic data based on surveys of its members from 2014, 2015 and 2016, during the fourth phase of SDSS (SDSS-IV). We find about half of SDSS-IV collaboration members were based in North America, a quarter in Europe, and the remainder in Asia and Central and South America. Overall, 26-36% are women (from 2014 to 2016), up to 2% report non-binary genders. 11-14% report that they are racial or ethnic minorities where they live. The fraction of women drops with seniority, and is also lower among collaboration leadership. Men in SDSS-IV were more likely to report being in a leadership role, and for the role to be funded and formally recognized. SDSS-IV collaboration members are twice as likely to have a parent with a college degree, than the general population, and are ten times more likely to have a parent with a PhD. This trend is slightly enhanced for female collaboration members. Despite this, the fraction of first generation college students (FGCS) is significant (31%). This fraction increased among collaboration members who are racial or ethnic minorities (40-50%), and decreased among women (15-25%). SDSS-IV implemented many inclusive policies and established a dedicated committee, the Committee on INclusiveness in SDSS (COINS). More than 60% of the collaboration agree that the collaboration is inclusive; however, collaboration leadership more strongly agree with this than the general membership. In this paper, we explain these results in full, including the history of inclusive efforts in SDSS-IV. We conclude with a list of suggested recommendations based on our findings, which can be used to improve equity and inclusion in large astronomical collaborations, which we argue is not only moral, but will also optimize their scientific output.


title: Conservation Laws Reveal the Quantumness of Gravity

abstract: Adopting a general framework for quantum-classical dynamics, we analyze the interaction between quantum matter and a classical gravitational field. We point out that, assuming conservation of momentum or energy, and assuming that the dynamics obeys a particular decomposition property set out in the paper, the classical gravitational field cannot change the momentum or energy of the quantum system, whereas the quantum gravitational field can do so. Drawing upon the fundamental relationship between conservation laws and the quantum properties of objects, our analysis offers new perspectives for the study of quantum gravity and provides a novel interpretation of existing experimental observations, such as free fall.


title: Unsupervised approaches based on optimal transport and convex analysis for inverse problems in imaging

abstract: Unsupervised deep learning approaches have recently become one of the crucial research areas in imaging owing to their ability to learn expressive and powerful reconstruction operators even when paired high-quality training data is scarcely available. In this chapter, we review theoretically principled unsupervised learning schemes for solving imaging inverse problems, with a particular focus on methods rooted in optimal transport and convex analysis. We begin by reviewing the optimal transport-based unsupervised approaches such as the cycle-consistency-based models and learned adversarial regularization methods, which have clear probabilistic interpretations. Subsequently, we give an overview of a recent line of works on provably convergent learned optimization algorithms applied to accelerate the solution of imaging inverse problems, alongside their dedicated unsupervised training schemes. We also survey a number of provably convergent plug-and-play algorithms (based on gradient-step deep denoisers), which are among the most important and widely applied unsupervised approaches for imaging problems. At the end of this survey, we provide an overview of a few related unsupervised learning frameworks that complement our focused schemes. Together with a detailed survey, we provide an overview of the key mathematical results that underlie the methods reviewed in the chapter to keep our discussion self-contained.


title: Transport theory in non-Hermitian systems

abstract: Non-Hermitian systems have garnered significant attention due to the emergence of novel topology of complex spectra and skin modes. However, investigating transport phenomena in such systems faces obstacles stemming from the non-unitary nature of time evolution. Here, we establish the continuity equation for a general non-Hermitian Hamiltonian in the Schr\"odinger picture. It attributes the universal non-conservativity to the anti-commutation relationship between particle number and non-Hermitian terms. Our work derives a comprehensive current formula for non-Hermitian systems using Green's function, applicable to both time-dependent and steady-state responses. To demonstrate the validity of our approach, we calculate the local current in models with one-dimensional and two-dimensional settings, incorporating scattering potentials. The spatial distribution of local current highlights the widespread non-Hermitian phenomena, including skin modes, non-reciprocal quantum dots, and corner states. Our findings offer valuable insights for advancing theoretical and experimental research in the transport of non-Hermitian systems.


title: Transport properties of strongly correlated Fermi systems

abstract: In our short review, we consider the transport properties of strongly correlated Fermi systems like heavy fermion metals and high-$T_c$ superconductors. Their transport properties are defined by strong inter-particle interaction forming flat bands in these compounds. Indeed, in contrast to the behavior of the transport properties of conventional metals, the strongly correlated compounds exhibit the linear in temperature resistivity, $\rho(T)\propto T$. We analyze the magnetoresistance and show that it under the application of magnetic field becomes negative. It is shown that near a quantum phase transition, when the density of electronic states diverges, semiclassical physics remains applicable to describe the resistivity $\rho$ of strongly correlated metals due to the presence of a transverse zero-sound collective mode, representing the phonon mode in solids. We demonstrate that when $T$ exceeds the extremely low Debye temperature $T_D$, the resistivity $\rho(T)$ changes linearly with $T$, since the mechanism of formation of the $T$-dependence $\rho(T)$ is similar electron-phonon mechanism, which predominates at high temperatures in ordinary metals. Thus, in the region of $T$-linear resistance, electron-phonon scattering leads to a lifetime of $\tau$ quasiparticles practically independent of the material, which is expressed as the ratio of the Planck constant $\hbar$ to the Boltzmann constant constant $k_B$, $T\tau\sim \hbar/k_B$. We explain that due to the non-Fermi-liquid behavior the real part of the frequency-dependent optical conductivity $\sigma^R_{opt}(\omega)$ exhibits a scaling behavior, and demonstrates the unusual power law behavior $\sigma^R_{opt}(\omega)\propto\omega^{-1}$, rather than the well-known one shown by conventional metals, $\sigma^R_{opt}(\omega)\propto\omega^{-2}$.


title: Constraints on cosmic star formation history via a new modeling of the radio luminosity function of star-forming galaxies

abstract: Radio wavelengths offer a unique possibility to trace the total star-formation rate (SFR) in galaxies, both obscured and unobscured. To probe the dust-unbiased star-formation history, an accurate measurement of the radio luminosity function (LF) for star-forming galaxies (SFGs) is crucial. We make use of an SFG sample (5900 sources) from the Very Large Array (VLA) COSMOS 3 GHz data to perform a new modeling of the radio LF. By integrating the analytical LF, we aim to calculate the history of the cosmic SFR density (SFRD) from $z\sim5$ onwards. For the first time, we use both models of the pure luminosity evolution (PLE) and joint luminosity+density evolution (LADE) to fit the LFs directly to the radio data using a full maximum-likelihood analysis, considering the sample completeness correction. We also incorporate updated observations of local radio LFs and radio source counts into the fitting process to obtain additional constraints. We find that the PLE model cannot be used to describe the evolution of the radio LF at high redshift ($z>2$). By construct, our LADE models can successfully fit a large amount of data on radio LFs and source counts of SFGs from recent observations. We therefore conclude that density evolution is genuinely indispensable in modeling the evolution of SFG radio LFs. Our SFRD curve shows a good fit to the SFRD points derived by previous radio estimates. In view of the fact that our radio LFs are not biased, as opposed those of previous studies performed by fitting the $1/V_{\rm max}$ LF points, our SFRD results should be an improvement on these previous estimates. Below $z\sim1.5$, our SFRD matches a published multiwavelength compilation, while our SFRD turns over at a slightly higher redshift ($2<z<2.5$) and falls more rapidly out to high redshift.


title: Statistical mechanics of mean-field disordered systems: a Hamilton-Jacobi approach

abstract: The goal of this book is to present new mathematical techniques for studying the behaviour of mean-field systems with disordered interactions. We mostly focus on certain problems of statistical inference in high dimension, and on spin glasses. The techniques we present aim to determine the free energy of these systems, in the limit of large system size, by showing that they asymptotically satisfy a Hamilton-Jacobi equation. The first chapter is a general introduction to statistical mechanics, with a focus on the Curie-Weiss model. We give a brief introduction to convex analysis and large deviation principles in Chapter 2, and identify the limit free energy of the Curie-Weiss model using these tools. In Chapter 3, we define the notion of viscosity solution to a Hamilton-Jacobi equation, and use it to recover the limit free energy of the Curie-Weiss model. We discover technical challenges to applying the same method to generalized versions of the Curie-Weiss model, and develop a new selection principle based on convexity to overcome these. We then turn to statistical inference in Chapter 4, focusing on the problem of recovering a large symmetric rank-one matrix from a noisy observation, and we see that the tools developed in the previous chapter apply to this setting as well. Chapter 5 is preparatory work for a discussion of the more challenging case of spin glasses. The first half of this chapter is a self-contained introduction to Poisson point processes, including limit theorems on extreme values of independent and identically distributed random variables, which we believe to be of independent interest. We finally turn to the setting of spin glasses in Chapter 6. For the Sherrington-Kirkpatrick model, we show how to relate the Parisi formula with the Hamilton-Jacobi approach. We conclude with a more informal discussion on the status of current research for more challenging models.


title: A Hodge-theoretic proof of Hwang's theorem on base manifolds of Lagrangian fibrations

abstract: We give a Hodge-theoretic proof of Hwang's theorem, which says that if the base of a Lagrangian fibration of an irreducible holomorphic symplectic manifold is smooth, it must be projective space.


title: Probability of Collision of satellites and space debris for short-term encounters: Rederivation and fast-to-compute upper and lower bounds

abstract: The proliferation of space debris in LEO has become a major concern for the space industry. With the growing interest in space exploration, the prediction of potential collisions between objects in orbit has become a crucial issue. It is estimated that, in orbit, there are millions of fragments a few millimeters in size and thousands of inoperative satellites and discarded rocket stages. Given the high speeds that these fragments can reach, even fragments a few millimeters in size can cause fractures in a satellite's hull or put a serious crack in the window of a space shuttle. The conventional method proposed by Akella and Alfriend in 2000 remains widely used to estimate the probability of collision in short-term encounters. Given the small period of time, it is assumed that, during the encounter: (1) trajectories are represented by straight lines with constant velocity; (2) there is no velocity uncertainty and the position exhibits a stationary distribution throughout the encounter; and (3) position uncertainties are independent and represented by Gaussian distributions. This study introduces a novel derivation based on first principles that naturally allows for tight and fast upper and lower bounds for the probability of collision. We tested implementations of both probability and bound computations with the original and our formulation on a real CDM dataset used in ESA's Collision Avoidance Challenge. Our approach reduces the calculation of the probability to two one-dimensional integrals and has the potential to significantly reduce the processing time compared to the traditional method, from 80% to nearly real-time.


title: A Multimodal Dataset of 21,412 Recorded Nights for Sleep and Respiratory Research

abstract: This study introduces a novel, rich dataset obtained from home sleep apnea tests using the FDA-approved WatchPAT-300 device, collected from 7,077 participants over 21,412 nights. The dataset comprises three levels of sleep data: raw multi-channel time-series from sensors, annotated sleep events, and computed summary statistics, which include 447 features related to sleep architecture, sleep apnea, and heart rate variability (HRV). We present reference values for Apnea/Hypopnea Index (AHI), sleep efficiency, Wake After Sleep Onset (WASO), and HRV sample entropy, stratified by age and sex. Moreover, we demonstrate that the dataset improves the predictive capability for various health related traits, including body composition, bone density, blood sugar levels and cardiovascular health. These results illustrate the dataset's potential to advance sleep research, personalized healthcare, and machine learning applications in biomedicine.


title: On the free energy of vector spin glasses with non-convex interactions

abstract: The limit free energy of spin-glass models with convex interactions can be represented as a variational problem involving an explicit functional. Models with non-convex interactions are much less well-understood, and simple variational formulas involving the same functional are known to be invalid in general. We show here that a slightly weaker property of the limit free energy does extend to non-convex models. Indeed, under the assumption that the limit free energy exists, we show that this limit can always be represented as a critical value of the said functional. Up to a small perturbation of the parameters defining the model, we also show that any subsequential limit of the law of the overlap matrix is a critical point of this functional. We believe that these results capture the fundamental conclusions of the non-rigorous replica method.


title: Speculative Contrastive Decoding

abstract: Large language models~(LLMs) exhibit exceptional performance in language tasks, yet their auto-regressive inference is limited due to high computational requirements and is sub-optimal due to the exposure bias. Inspired by speculative decoding and contrastive decoding, we introduce Speculative Contrastive Decoding~(SCD), a straightforward yet powerful decoding approach that leverages predictions from smaller language models~(LMs) to achieve both decoding acceleration and quality improvement. Extensive evaluations and analyses on four diverse language tasks demonstrate the effectiveness of SCD, showing that decoding efficiency and quality can compatibly benefit from one smaller LM.


title: SentAlign: Accurate and Scalable Sentence Alignment

abstract: We present SentAlign, an accurate sentence alignment tool designed to handle very large parallel document pairs. Given user-defined parameters, the alignment algorithm evaluates all possible alignment paths in fairly large documents of thousands of sentences and uses a divide-and-conquer approach to align documents containing tens of thousands of sentences. The scoring function is based on LaBSE bilingual sentence representations. SentAlign outperforms five other sentence alignment tools when evaluated on two different evaluation sets, German-French and English-Icelandic, and on a downstream machine translation task.


title: Edge Accelerated Robot Navigation With Collaborative Motion Planning

abstract: Low-cost distributed robots suffer from limited onboard computing power, resulting in excessive computation time when navigating in cluttered environments. This paper presents Edge Accelerated Robot Navigation (EARN), to achieve real-time collision avoidance by adopting collaborative motion planning (CMP). As such, each robot can dynamically switch between a conservative motion planner executed locally to guarantee safety (e.g., path-following) and an aggressive motion planner executed non-locally to guarantee efficiency (e.g., overtaking). In contrast to existing motion planning approaches that ignore the interdependency between low-level motion planning and high-level resource allocation, EARN adopts model predictive switching (MPS) that maximizes the expected switching gain with respect to robot states and actions under computation and communication resource constraints. The MPS problem is solved by a tightly-coupled decision making and motion planning framework based on bilevel mixed-integer nonlinear programming and penalty dual decomposition. We validate the performance of EARN in indoor simulation, outdoor simulation, and real-world environments. Experiments show that EARN achieves significantly smaller navigation time and higher success rates than state-of-the-art navigation approaches.


title: Low voltage local strain enhanced switching of magnetic tunnel junctions

abstract: Strain-controlled modulation of the magnetic switching behavior in magnetic tunnel junctions (MTJs) could provide the energy efficiency needed to accelerate the use of MTJs in memory, logic, and neuromorphic computing, as well as an additional way to tune MTJ properties for these applications. State-of-the-art CoFeB-MgO based MTJs still require too high voltages to alter their magnetic switching behavior with strain. In this study, we demonstrate strain-enhanced field switching of nanoscale MTJs through electric field control via voltage applied across local gates. The results show that record-low voltage down to 200 mV can be used to control the switching field of the MTJ through enhancing the magnetic anisotropy, and that tunnel magnetoresistance is linearly enhanced with voltage through straining the crystal structure of the tunnel barrier. These findings underscore the potential of electric field manipulation and strain engineering as effective strategies for tailoring the properties and functionality of nanoscale MTJs.


title: Post-Lie algebra structures for perfect Lie algebras

abstract: We study the existence of post-Lie algebra structures on pairs of Lie algebras $(\mathfrak{g},\mathfrak{n})$, where one of the algebras is perfect non-semisimple, and the other one is abelian, nilpotent non-abelian, solvable non-nilpotent, simple, semisimple non-simple, reductive non-semisimple or complete non-perfect. We prove several non-existence results, but also provide examples in some cases for the existence of a post-Lie algebra structure. Among other results we show that there is no post-Lie algebra structure on $(\mathfrak{g},\mathfrak{n})$, where $\mathfrak{g}$ is perfect non-semisimple, and $\mathfrak{n}$ is $\mathfrak{sl}_3(\mathbb{C})$. We also show that there is no post-Lie algebra structure on $(\mathfrak{g},\mathfrak{n})$, where $\mathfrak{g}$ is perfect and $\mathfrak{n}$ is reductive with a $1$-dimensional center.


title: Physical scale adiabatic regularization in cosmological spacetimes

abstract: We develop a new regularization method for the stress-energy tensor and the two-point function of free quantum scalar fields propagating in cosmological spacetimes. We proceed by extending the adiabatic regularization scheme with the introduction of two additional mass scales. By setting them to the order of the physical scale of the studied scenario, we obtain ultraviolet-regularized quantities that do not distort the power spectra amplitude at the infrared scales amplified by the expansion of the universe. This is not ensured by the standard adiabatic approach. We also show how our proposed subtraction terms can be interpreted as a renormalization of coupling constants in the Einstein equations. We finally illustrate our proposed regularization method in two scenarios of cosmological interest: de Sitter inflation and geometric reheating.


title: Proceedings Fifth International Workshop on Formal Methods for Autonomous Systems

abstract: This EPTCS volume contains the proceedings for the Fifth International Workshop on Formal Methods for Autonomous Systems (FMAS 2023), which was held on the 15th and 16th of November 2023. FMAS 2023 was co-located with 18th International Conference on integrated Formal Methods (iFM) (iFM'22), organised by Leiden Institute of Advanced Computer Science of Leiden University. The workshop itself was held at Scheltema Leiden, a renovated 19th Century blanket factory alongside the canal. FMAS 2023 received 25 submissions. We received 11 regular papers, 3 experience reports, 6 research previews, and 5 vision papers. The researchers who submitted papers to FMAS 2023 were from institutions in: Australia, Canada, Colombia, France, Germany, Ireland, Italy, the Netherlands, Sweden, the United Kingdom, and the United States of America. Increasing our number of submissions for the third year in a row is an encouraging sign that FMAS has established itself as a reputable publication venue for research on the formal modelling and verification of autonomous systems. After each paper was reviewed by three members of our Programme Committee we accepted a total of 15 papers: 8 long papers and 7 short papers.


title: Counting Small Induced Subgraphs with Edge-monotone Properties

abstract: We study the parameterized complexity of #IndSub($\Phi$), where given a graph $G$ and an integer $k$, the task is to count the number of induced subgraphs on $k$ vertices that satisfy the graph property $\Phi$. Focke and Roth [STOC 2022] completely characterized the complexity for each $\Phi$ that is a hereditary property (that is, closed under vertex deletions): #IndSub($\Phi$) is #W[1]-hard except in the degenerate cases when every graph satisfies $\Phi$ or only finitely many graphs satisfy $\Phi$. We complement this result with a classification for each $\Phi$ that is edge monotone (that is, closed under edge deletions): #IndSub($\Phi$) is #W[1]-hard except in the degenerate case when there are only finitely many integers $k$ such that $\Phi$ is nontrivial on $k$-vertex graphs. Our result generalizes earlier results for specific properties $\Phi$ that are related to the connectivity or density of the graph. Further, we extend the #W[1]-hardness result by a lower bound which shows that #IndSub($\Phi$) cannot be solved in time $f(k) \cdot |V(G)|^{o(\sqrt{\log k/\log\log k})}$ for any function $f$, unless the Exponential-Time Hypothesis (ETH) fails. For many natural properties, we obtain even a tight bound $f(k) \cdot |V(G)|^{o(k)}$; for example, this is the case for every property $\Phi$ that is nontrivial on $k$-vertex graphs for each $k$ greater than some $k_0$.


title: EMF-Aware Power Control for Massive MIMO: Cell-Free versus Cellular Networks

abstract: The impressive growth of wireless data networks has recently led to increased attention to the issue of electromagnetic pollution. Specific absorption rates and incident power densities have become popular indicators for measuring electromagnetic field (EMF) exposure. This paper tackles the problem of power control in user-centric cell-free massive multiple-input-multiple-output (CF-mMIMO) systems under EMF constraints. Specifically, the power allocation maximizing the minimum data rate across users is derived for both the uplink and the downlink under EMF constraints. The developed solution is also applied to a cellular mMIMO system and compared to other benchmark strategies. Simulation results prove that EMF safety restrictions can be easily met without jeopardizing the minimum data rate, that the CF-mMIMO outperforms the multi-cell massive MIMO deployment, and that the proposed power control strategy greatly improves the system fairness.


title: sQUlearn -- A Python Library for Quantum Machine Learning

abstract: sQUlearn introduces a user-friendly, NISQ-ready Python library for quantum machine learning (QML), designed for seamless integration with classical machine learning tools like scikit-learn. The library's dual-layer architecture serves both QML researchers and practitioners, enabling efficient prototyping, experimentation, and pipelining. sQUlearn provides a comprehensive toolset that includes both quantum kernel methods and quantum neural networks, along with features like customizable data encoding strategies, automated execution handling, and specialized kernel regularization techniques. By focusing on NISQ-compatibility and end-to-end automation, sQUlearn aims to bridge the gap between current quantum computing capabilities and practical machine learning applications. The library provides substantial flexibility, enabling quick transitions between the underlying quantum frameworks Qiskit and PennyLane, as well as between simulation and running on actual hardware.


title: Scale-separated AdS$_3\times$S$^1$ vacua from IIA orientifolds

abstract: We study supersymmetric AdS$_3$ flux vacua of massive type-IIA supergravity on anisotropic G2 orientifolds. Depending on the value of the $F_4$ flux the seven-dimensional compact space can either have six small and one large dimension such that the external space is scale-separated and effectively four-dimensional, or all seven compact dimensions small and parametrically scale-separated from the three external ones. Within this setup we also discuss the Distance Conjecture (including appropriate D4-branes), and highlight that such vacua provide a non-trivial example of the so-called Strong Spin-2 Conjecture.


title: Lifting iso-dual algebraic geometry codes

abstract: In this work we investigate the problem of producing iso-dual algebraic geometry (AG) codes over a finite field $\mathbb{F}_q$ with $q$ elements. Given a finite separable extension $\mathcal{M}/\mathcal{F}$ of function fields and an iso-dual AG-code $\mathcal{C}$ defined over $\mathcal{F}$, we provide a general method to lift the code $\mathcal{C}$ to another iso-dual AG-code $\tilde{\mathcal{C}}$ defined over $\mathcal{M}$ under some assumptions on the parity of the involved different exponents. We apply this method to lift iso-dual AG-codes over the rational function field to elementary abelian $p$-extensions, like the maximal function fields defined by the Hermitian, Suzuki, and one covered by the $GGS$ function field. We also obtain long binary and ternary iso-dual AG-codes defined over cyclotomic extensions.


title: When does In-context Learning Fall Short and Why? A Study on Specification-Heavy Tasks

abstract: In-context learning (ICL) has become the default method for using large language models (LLMs), making the exploration of its limitations and understanding the underlying causes crucial. In this paper, we find that ICL falls short of handling specification-heavy tasks, which are tasks with complicated and extensive task specifications, requiring several hours for ordinary humans to master, such as traditional information extraction tasks. The performance of ICL on these tasks mostly cannot reach half of the state-of-the-art results. To explore the reasons behind this failure, we conduct comprehensive experiments on 18 specification-heavy tasks with various LLMs and identify three primary reasons: inability to specifically understand context, misalignment in task schema comprehension with humans, and inadequate long-text understanding ability. Furthermore, we demonstrate that through fine-tuning, LLMs can achieve decent performance on these tasks, indicating that the failure of ICL is not an inherent flaw of LLMs, but rather a drawback of existing alignment methods that renders LLMs incapable of handling complicated specification-heavy tasks via ICL. To substantiate this, we perform dedicated instruction tuning on LLMs for these tasks and observe a notable improvement. We hope the analyses in this paper could facilitate advancements in alignment methods enabling LLMs to meet more sophisticated human demands.


title: Thickness dependent mechanical properties of soft ferromagnetic two-dimensional CoTe2

abstract: Two dimensional (2D) layered transition-metal-based tellurides (chalcogens) are known to harness their surface atoms characteristics to enhance topographical activities for energy conversion, storage, and magnetic applications. High surface energy due to unsaturated dangling bonds and larger lateral size than the thickness (volume) makes them a potential candidate for emerging electronics. Nevertheless, the gradual stacking of each sheet alters the surface atoms' subtle features, such as lattice expansion, leading to several phenomena and rendering tunable properties. In the present work, we have monitored thickness-dependent properties of the 2D CoTe2 sheets from nanoscale mechanics, tribology, surface potential distributions, interfacial interaction and magnetism using atomically resolved spectroscopy and different surface probe techniques, in conjunction with theoretical investigations: density functional theory (DFT) and molecular dynamics (MD). The variation in properties observed in theoretical investigation unleashes the crucial role of crystal planes of the CoTe2. The presented results are beneficial in expanding the use of 2D telluride family in flexible electronics, piezo sensors, tribo-generator, and next-generation memory devices.


title: Simple but Effective Unsupervised Classification for Specified Domain Images: A Case Study on Fungi Images

abstract: High-quality labeled datasets are essential for deep learning. Traditional manual annotation methods are not only costly and inefficient but also pose challenges in specialized domains where expert knowledge is needed. Self-supervised methods, despite leveraging unlabeled data for feature extraction, still require hundreds or thousands of labeled instances to guide the model for effective specialized image classification. Current unsupervised learning methods offer automatic classification without prior annotation but often compromise on accuracy. As a result, efficiently procuring high-quality labeled datasets remains a pressing challenge for specialized domain images devoid of annotated data. Addressing this, an unsupervised classification method with three key ideas is introduced: 1) dual-step feature dimensionality reduction using a pre-trained model and manifold learning, 2) a voting mechanism from multiple clustering algorithms, and 3) post-hoc instead of prior manual annotation. This approach outperforms supervised methods in classification accuracy, as demonstrated with fungal image data, achieving 94.1% and 96.7% on public and private datasets respectively. The proposed unsupervised classification method reduces dependency on pre-annotated datasets, enabling a closed-loop for data classification. The simplicity and ease of use of this method will also bring convenience to researchers in various fields in building datasets, promoting AI applications for images in specialized domains.


title: Channel Estimation for mmWave MIMO using sub-6 GHz Out-of-Band Information

abstract: Future wireless multiple-input multiple-output (MIMO) communication systems will employ sub-6 GHz and millimeter wave (mmWave) frequency bands working cooperatively. Establishing a MIMO communication link usually relies on estimating channel state information (CSI) which is difficult to acquire at mmWave frequencies due to a low signal-to-noise ratio (SNR). In this paper, we propose three novel methods to estimate mmWave MIMO channels using out-of-band information obtained from the sub-6GHz band. We compare the proposed channel estimation methods with a conventional one utilizing only in-band information. Simulation results show that the proposed methods outperform the conventional mmWave channel estimation method in terms of achievable spectral efficiency, especially at low SNR and high K-factor.


title: Topics in elliptic problems: from semilinear equations to shape optimization

abstract: In this paper, which corresponds to an updated version of the author's Habilitation lecture in Mathematics, we do an overview of several topics in elliptic problems. We review some old and new results regarding the Lane-Emden equation, both under Dirichlet and Neumann boundary conditions, then focus on sign-changing solutions for Lane-Emden systems. We also survey some results regarding fully nontrivial solutions to gradient elliptic systems with mixed cooperative and competitive interactions. We conclude by exhibiting results on optimal partition problems, with cost functions either related to Dirichlet eigenvalues or to the Yamabe equation. Several open problems are referred along the text.


title: A Low Rank Approach to Minimize Sensor-to-Actuator Communication in Finite Horizon Output Feedback

abstract: Many modern controllers are composed of different components that communicate in real-time over some network with limited resources. In this work, we are interested in designing a controller that can be implemented with a minimum number of sensor-to-actuator messages, while satisfying safety constraints over a finite horizon. For finite horizon problems, a linear time-varying controller with memory can be represented as a block-lower-triangular matrix. We show that the rank of this matrix exactly captures the minimum number of messages needed to be sent from the sensors to actuators to implement such a controller. Moreover, we introduce a novel matrix factorization called causal factorization that gives the required implementation. Finally, we show that the rank of the controller is the same as the rank of the Youla parameter, enabling the Youla parametrization (or analogous parametrizations) to be used to design the controller, which reduces the overall design problem into a rank minimization one over a convex set. Finally, convex relaxations for rank are used to demonstrate that our approach leads to 20-50% less messages on a simulation than a benchmark method.


title: Leveraging AI for Natural Disaster Management : Takeaways From The Moroccan Earthquake

abstract: The devastating 6.8-magnitude earthquake in Al Haouz, Morocco in 2023 prompted critical reflections on global disaster management strategies, resulting in a post-disaster hackathon, using artificial intelligence (AI) to improve disaster preparedness, response, and recovery. This paper provides (i) a comprehensive literature review, (ii) an overview of winning projects, (iii) key insights and challenges, namely real-time open-source data, data scarcity, and interdisciplinary collaboration barriers, and (iv) a community-call for further action.


title: Factcheck-Bench: Fine-Grained Evaluation Benchmark for Automatic Fact-checkers

abstract: The increased use of large language models (LLMs) across a variety of real-world applications calls for mechanisms to verify the factual accuracy of their outputs. In this work, we present a holistic end-to-end solution for annotating the factuality of LLM-generated responses, which encompasses a multi-stage annotation scheme designed to yield detailed labels concerning the verifiability and factual inconsistencies found in LLM outputs. We further construct an open-domain document-level factuality benchmark in three-level granularity: claim, sentence and document, aiming to facilitate the evaluation of automatic fact-checking systems. Preliminary experiments show that FacTool, FactScore and Perplexity.ai are struggling to identify false claims, with the best F1=0.63 by this annotation solution based on GPT-4. Annotation tool, benchmark and code are available at https://github.com/yuxiaw/Factcheck-GPT.


title: Non-geometric distance-regular graphs of diameter at least $3$ with smallest eigenvalue at least $-3$

abstract: In this paper, we classify non-geometric distance-regular graphs of diameter at least $3$ with smallest eigenvalue at least $-3$. This is progress towards what is hoped to be an eventual complete classification of distance-regular graphs with smallest eigenvalue at least $-3$, analogous to existing classification results available in the case that the smallest eigenvalue is at least $-2$.


title: Parallel Quantum Hough Transform

abstract: Few of the known quantum algorithms can be reliably executed on a quantum computer. Therefore, as an extension, we propose a Parallel Quantum Hough transform (PQHT) algorithm that we execute on a quantum computer. We give its implementation and discuss the results obtained. The PQHT algorithm is conceptually divided into a parallel rotation stage consisting of a set of connected programmable $\texttt{RZ}$ rotation gates, with adjustable node connections of coincidence detectors realized with quantum logic gates. The modules were developed using IBM Quantum Composer and tested using the IBM QASM simulator. Finally, the modules were programmed using the Python package Qiskit and the jobs were sent to distributed IBM Q System One quantum computers. The successful run results on Fraunhofer Q System One in Ehningen will be presented as a proof of concept for the PQHT algorithm.


title: Taming under isoperimetry

abstract: In this article we propose a novel taming Langevin-based scheme called $\mathbf{sTULA}$ to sample from distributions with superlinearly growing log-gradient which also satisfy a Log-Sobolev inequality. We derive non-asymptotic convergence bounds in $KL$ and consequently total variation and Wasserstein-$2$ distance from the target measure. Non-asymptotic convergence guarantees are provided for the performance of the new algorithm as an optimizer. Finally, some theoretical results on isoperimertic inequalities for distributions with superlinearly growing gradients are provided. Key findings are a Log-Sobolev inequality with constant independent of the dimension, in the presence of a higher order regularization and a Poincare inequality with constant independent of temperature and dimension under a novel non-convex theoretical framework.

categories: math.PR cs.NA math.NA math.OC math.ST stat.ML stat.TH


title: Incremental Object-Based Novelty Detection with Feedback Loop

abstract: Object-based Novelty Detection (ND) aims to identify unknown objects that do not belong to classes seen during training by an object detection model. The task is particularly crucial in real-world applications, as it allows to avoid potentially harmful behaviours, e.g. as in the case of object detection models adopted in a self-driving car or in an autonomous robot. Traditional approaches to ND focus on one time offline post processing of the pretrained object detection output, leaving no possibility to improve the model robustness after training and discarding the abundant amount of out-of-distribution data encountered during deployment. In this work, we propose a novel framework for object-based ND, assuming that human feedback can be requested on the predicted output and later incorporated to refine the ND model without negatively affecting the main object detection performance. This refinement operation is repeated whenever new feedback is available. To tackle this new formulation of the problem for object detection, we propose a lightweight ND module attached on top of a pre-trained object detection model, which is incrementally updated through a feedback loop. We also propose a new benchmark to evaluate methods on this new setting and test extensively our ND approach against baselines, showing increased robustness and a successful incorporation of the received feedback.


title: Leptogenesis driven by majoron

abstract: We propose a leptogenesis scenario where baryon asymmetry generation is assisted by the kinetic motion of the majoron, $J$, in the process of lepton-number violating inverse decays of a right-handed neutrino, $N$. We investigate two distinct scenarios depending on the sources of majoron kinetic motion: 1) the misalignment mechanism, and 2) the kinetic misalignment mechanism. The former case can naturally generate the observed baryon asymmetry for the majoron mass $m_J \gtrsim \,{\rm TeV}$ and the right-handed neutrino's mass $M_{N} \gtrsim 10^{11}\,{\rm GeV}$. However, an additional decay channel of the majoron is required to avoid the overclosure problem of the majoron oscillation. The later scenario works successfully for $m_J \lesssim 100\,{\rm keV}$, and $M_{N} \lesssim 10^9\,{\rm GeV}$ while $M_N$ can be even far below the temperature of the electroweak phase transition as long as sufficiently large kinetic misalignment is provided. We also find that a sub-$100\,{\rm keV}$ majoron is a viable candidate for dark matter.


title: Data Similarity is Not Enough to Explain Language Model Performance

abstract: Large language models achieve high performance on many but not all downstream tasks. The interaction between pretraining data and task data is commonly assumed to determine this variance: a task with data that is more similar to a model's pretraining data is assumed to be easier for that model. We test whether distributional and example-specific similarity measures (embedding-, token- and model-based) correlate with language model performance through a large-scale comparison of the Pile and C4 pretraining datasets with downstream benchmarks. Similarity correlates with performance for multilingual datasets, but in other benchmarks, we surprisingly find that similarity metrics are not correlated with accuracy or even each other. This suggests that the relationship between pretraining data and downstream tasks is more complex than often assumed.


title: Determining cosmological growth parameter for stellar-mass black holes

abstract: It has recently been suggested that black holes (BHs) may grow with time, so that their mass is proportional to the cosmological scale factor to the power $n$, with suggested values $n \approx 3$ for supermassive BHs in elliptical galaxies. Here we test these predictions with stellar mass BHs in X-ray binaries using their masses and ages. We perform two sets of tests to assess the compatible values of $n$. First, we assume that no compact object grows over the Tolman-Oppenheimer-Volkof limit which marks the borderline between neutron stars and BHs. We show that half of BHs would be born with a mass below this limit if $n=3$ applies. The possibility that all BHs were born above the limit is rejected at $4\,\sigma$ if $n=3$ applies. In the second test, we assume that masses of BHs at their formation stay the same over cosmic history. We compare the mass distribution of the youngest BHs, which could have not grown yet, to their older counterparts. Distributions are compatible for $n = -0.9^{+1.3}_{-4.6}$, with $n=3$ excluded formally with 87 % confidence. This result may be biased, because massive BHs tend to have a massive companion. Correcting for this bias yields $n\approx 0$. We can therefore conclude that while our results are not a clear rejection of BH scaling with $n=3$, we show that $n=0$ is much more consistent with the data.


title: End-to-end Task-oriented Dialogue: A Survey of Tasks, Methods, and Future Directions

abstract: End-to-end task-oriented dialogue (EToD) can directly generate responses in an end-to-end fashion without modular training, which attracts escalating popularity. The advancement of deep neural networks, especially the successful use of large pre-trained models, has further led to significant progress in EToD research in recent years. In this paper, we present a thorough review and provide a unified perspective to summarize existing approaches as well as recent trends to advance the development of EToD research. The contributions of this paper can be summarized: (1) \textbf{\textit{First survey}}: to our knowledge, we take the first step to present a thorough survey of this research field; (2) \textbf{\textit{New taxonomy}}: we first introduce a unified perspective for EToD, including (i) \textit{Modularly EToD} and (ii) \textit{Fully EToD}; (3) \textbf{\textit{New Frontiers}}: we discuss some potential frontier areas as well as the corresponding challenges, hoping to spur breakthrough research in EToD field; (4) \textbf{\textit{Abundant resources}}: we build a public website\footnote{We collect the related papers, baseline projects, and leaderboards for the community at \url{https://etods.net/}.}, where EToD researchers could directly access the recent progress. We hope this work can serve as a thorough reference for the EToD research community.


title: Josephson Diode Effect in Topological Superconductor

abstract: We investigate the Josephson diode effect in topological Josephson junctions. By both analytic and numerical calculations, we find that while a Josephson junction in the topological phase may exhibit higher diode efficiency compared to that in the trivial phase, this behavior is not universal. The presence of Majorana bound states is not a sufficient condition for a large diode effect. Furthermore, the diode efficiency undergoes substantial changes only in specific regions along the topological phase transition boundary, and a significant diode effect does coincide with the topological phases. Thereby our paper suggests the utilization of topological superconductivity for enhanced JDE, and also the Josephson diode effect may serve as an indicator for topological superconductor phase. These results suggest a nuanced relationship between the topological aspects of Josephson junctions and Josephson diode effect.


title: Analysis of sum-of-squares relaxations for the quantum rotor model

abstract: The noncommutative sum-of-squares (ncSoS) hierarchy was introduced by Navascu\'{e}s-Pironio-Ac\'{i}n as a sequence of semidefinite programming relaxations for approximating values of noncommutative polynomial optimization problems, which were originally intended to generalize quantum values of nonlocal games. Recent work has started to analyze the hierarchy for approximating ground energies of local Hamiltonians, initially through rounding algorithms which output product states for degree-2 ncSoS applied to Quantum Max-Cut. Some rounding methods are known which output entangled states, but they use degree-4 ncSoS. Based on this, Hwang-Neeman-Parekh-Thompson-Wright conjectured that degree-2 ncSoS cannot beat product state approximations for Quantum Max-Cut and gave a partial proof relying on a conjectural generalization of Borrell's inequality. In this work we consider a family of Hamiltonians (called the quantum rotor model in condensed matter literature or lattice $O(k)$ vector model in quantum field theory) with infinite-dimensional local Hilbert space $L^{2}(S^{k - 1})$, and show that a degree-2 ncSoS relaxation approximates the ground state energy better than any product state.


title: Algorithmic Cheap Talk

abstract: The literature on strategic communication originated with the influential cheap talk model, which precedes the Bayesian persuasion model by three decades. This model describes an interaction between two agents: sender and receiver. The sender knows some state of the world which the receiver does not know, and tries to influence the receiver's action by communicating a cheap talk message to the receiver. This paper initiates the algorithmic study of cheap talk in a finite environment (i.e., a finite number of states and receiver's possible actions). We first prove that approximating the sender-optimal or the welfare-maximizing cheap talk equilibrium up to a certain additive constant or multiplicative factor is NP-hard. Fortunately, we identify three naturally-restricted cases that admit efficient algorithms for finding a sender-optimal equilibrium. These include a state-independent sender's utility structure, a constant number of states or a receiver having only two actions.


title: Estimation of the chances to find new phenomena at the LHC in a model-agnostic combinatorial analysis

abstract: In this paper, we estimate the number of event topologies that have the potential to be produced in $pp$ collisions at the Large Hadron Collider (LHC) without violating kinematic and other constraints. We use numerical calculations and combinatorics, guided by large-scale Monte Carlo simulations of Standard Model (SM) processes. Then, we set the upper limit on the probability that new physics may escape detection, assuming a model-agnostic approach. The calculated probability is unexpectedly large, and the fact that the LHC has not found new physics until now is not entirely surprising. We argue that the optimal direction for maximizing the chances of finding new physics is to use unsupervised machine learning for anomaly detection or algorithms designed for event classification.


title: Exact first-order effect of interactions on the ground-state energy of harmonically-confined fermions

abstract: We consider a system of $N$ spinless fermions, interacting with each other via a power-law interaction $\epsilon/r^n$, and trapped in an external harmonic potential $V(r) = r^2/2$, in $d=1,2,3$ dimensions. For any $0 < n < d+2$, we obtain the ground-state energy $E_N$ of the system perturbatively in $\epsilon$, $E_{N}=E_{N}^{\left(0\right)}+\epsilon E_{N}^{\left(1\right)}+O\left(\epsilon^{2}\right)$. We calculate $E_{N}^{\left(1\right)}$ exactly, assuming that $N$ is such that the "outer shell" is filled. For the case of $n=1$ (corresponding to a Coulomb interaction for $d=3$), we extract the $N \gg 1$ behavior of $E_{N}^{\left(1\right)}$, focusing on the corrections to the exchange term with respect to the leading-order term that is predicted from the local density approximation applied to the Thomas-Fermi approximate density distribution. The leading correction contains a logarithmic divergence, and is of particular importance in the context of density functional theory. We also study the effect of the interactions on the fermions' spatial density. Finally, we find that our result for $E_{N}^{\left(1\right)}$ significantly simplifies in the case where $n$ is even.

categories: cond-mat.stat-mech cond-mat.quant-gas math-ph math.MP physics.chem-ph


title: Adversarial Attacks to Reward Machine-based Reinforcement Learning

abstract: In recent years, Reward Machines (RMs) have stood out as a simple yet effective automata-based formalism for exposing and exploiting task structure in reinforcement learning settings. Despite their relevance, little to no attention has been directed to the study of their security implications and robustness to adversarial scenarios, likely due to their recent appearance in the literature. With my thesis, I aim to provide the first analysis of the security of RM-based reinforcement learning techniques, with the hope of motivating further research in the field, and I propose and evaluate a novel class of attacks on RM-based techniques: blinding attacks.


title: Identification and Estimation for Nonignorable Missing Data: A Data Fusion Approach

abstract: We consider the task of identifying and estimating a parameter of interest in settings where data is missing not at random (MNAR). In general, such parameters are not identified without strong assumptions on the missing data model. In this paper, we take an alternative approach and introduce a method inspired by data fusion, where information in an MNAR dataset is augmented by information in an auxiliary dataset subject to missingness at random (MAR). We show that even if the parameter of interest cannot be identified given either dataset alone, it can be identified given pooled data, under two complementary sets of assumptions. We derive an inverse probability weighted (IPW) estimator for identified parameters, and evaluate the performance of our estimation strategies via simulation studies, and a data application.


title: The Chromatic Number of Kneser Hypergraphs via Consensus Division

abstract: We show that the Consensus Division theorem implies lower bounds on the chromatic number of Kneser hypergraphs, offering a novel proof for a result of Alon, Frankl, and Lov\'{a}sz (Trans. Amer. Math. Soc., 1986) and for its generalization by Kriz (Trans. Amer. Math. Soc., 1992). Our approach is applied to study the computational complexity of the total search problem Kneser$^p$, which given a succinct representation of a coloring of a $p$-uniform Kneser hypergraph with fewer colors than its chromatic number, asks to find a monochromatic hyperedge. We prove that for every prime $p$, the Kneser$^p$ problem with an extended access to the input coloring is efficiently reducible to a quite weak approximation of the Consensus Division problem with $p$ shares. In particular, for $p=2$, the problem is efficiently reducible to any non-trivial approximation of the Consensus Halving problem on normalized monotone functions. We further show that for every prime $p$, the Kneser$^p$ problem lies in the complexity class $\mathsf{PPA}$-$p$. As an application, we establish limitations on the complexity of the Kneser$^p$ problem, restricted to colorings with a bounded number of colors.


title: Semidefinite programs simulate approximate message passing robustly

abstract: Approximate message passing (AMP) is a family of iterative algorithms that generalize matrix power iteration. AMP algorithms are known to optimally solve many average-case optimization problems. In this paper, we show that a large class of AMP algorithms can be simulated in polynomial time by \emph{local statistics hierarchy} semidefinite programs (SDPs), even when an unknown principal minor of measure $1/\mathrm{polylog}(\mathrm{dimension})$ is adversarially corrupted. Ours are the first robust guarantees for many of these problems. Further, our results offer an interesting counterpoint to strong lower bounds against less constrained SDP relaxations for average-case max-cut-gain (a.k.a. "optimizing the Sherrington-Kirkpatrick Hamiltonian") and other problems.


title: On the Foundation of Distributionally Robust Reinforcement Learning

abstract: Motivated by the need for a robust policy in the face of environment shifts between training and the deployment, we contribute to the theoretical foundation of distributionally robust reinforcement learning (DRRL). This is accomplished through a comprehensive modeling framework centered around distributionally robust Markov decision processes (DRMDPs). This framework obliges the decision maker to choose an optimal policy under the worst-case distributional shift orchestrated by an adversary. By unifying and extending existing formulations, we rigorously construct DRMDPs that embraces various modeling attributes for both the decision maker and the adversary. These attributes include adaptability granularity, exploring history-dependent, Markov, and Markov time-homogeneous decision maker and adversary dynamics. Additionally, we delve into the flexibility of shifts induced by the adversary, examining SA and S-rectangularity. Within this DRMDP framework, we investigate conditions for the existence or absence of the dynamic programming principle (DPP). From an algorithmic standpoint, the existence of DPP holds significant implications, as the vast majority of existing data and computationally efficiency RL algorithms are reliant on the DPP. To study its existence, we comprehensively examine combinations of controller and adversary attributes, providing streamlined proofs grounded in a unified methodology. We also offer counterexamples for settings in which a DPP with full generality is absent.


title: Closed-Loop Identification of Stabilized Models Using Dual Input-Output Parameterization

abstract: This paper introduces a dual input-output parameterization (dual IOP) for the identification of linear time-invariant systems from closed-loop data. It draws inspiration from the recent input-output parameterization developed to synthesize a stabilizing controller. The controller is parameterized in terms of closed-loop transfer functions, from the external disturbances to the input and output of the system, constrained to lie in a given subspace. Analogously, the dual IOP method parameterizes the unknown plant with analogous closed-loop transfer functions, also referred to as dual parameters. In this case, these closed-loop transfer functions are constrained to lie in an affine subspace guaranteeing that the identified plant is \emph{stabilized} by the known controller. Compared with existing closed-loop identification techniques guaranteeing closed-loop stability, such as the dual Youla parameterization, the dual IOP neither requires a doubly-coprime factorization of the controller nor a nominal plant that is stabilized by the controller. The dual IOP does not depend on the order and the state-space realization of the controller either, as in the dual system-level parameterization. Simulation shows that the dual IOP outperforms the existing benchmark methods.


title: Explaining Explanation: An Empirical Study on Explanation in Code Reviews

abstract: Code review is an important process for quality assurance in software development. For an effective code review, the reviewers must explain their feedback to enable the authors of the code change to act on them. However, the explanation needs may differ among developers, who may require different types of explanations. It is therefore crucial to understand what kind of explanations reviewers usually use in code reviews. To the best of our knowledge, no study published to date has analyzed the types of explanations used in code review. In this study, we present the first analysis of explanations in useful code reviews. We extracted a set of code reviews based on their usefulness and labeled them based on whether they contained an explanation, a solution, or both a proposed solution and an explanation thereof. Based on our analysis, we found that a significant portion of the code review comments (46%) only include solutions without providing an explanation. We further investigated the remaining 54% of code review comments containing an explanation and conducted an open card sorting to categorize the reviewers' explanations. We distilled seven distinct categories of explanations based on the expression forms developers used. Then, we utilize large language models, specifically ChatGPT, to assist developers in getting a code review explanation that suits their preferences. Specifically, we created prompts to transform a code review explanation into a specific type of explanation. Our evaluation results show that ChatGPT correctly generated the specified type of explanation in 88/90 cases and that 89/90 of the cases have the correct explanation. Overall, our study provides insights into the types of explanations that developers use in code review and showcases how ChatGPT can be leveraged during the code review process to generate a specific type of explanation.


title: Approximation of polynomials from Walsh tail spaces

abstract: We derive various bounds for the $L_p$ distance of polynomials on the hypercube from Walsh tail spaces, extending some of Oleszkiewicz's results (2017) for Rademacher sums.


title: Exploring the Potential of Large Language Models in Computational Argumentation

abstract: Computational argumentation has become an essential tool in various fields, including artificial intelligence, law, and public policy. It is an emerging research field in natural language processing that attracts increasing attention. Research on computational argumentation mainly involves two types of tasks: argument mining and argument generation. As large language models have demonstrated strong abilities in understanding context and generating natural language, it is worthwhile to evaluate the performance of LLMs on various computational argumentation tasks. This work aims to embark on an assessment of LLMs, such as ChatGPT, Flan models and LLaMA2 models, under zero-shot and few-shot settings within the realm of computational argumentation. We organize existing tasks into six main categories and standardise the format of fourteen open-sourced datasets. In addition, we present a new benchmark dataset on counter speech generation, that aims to holistically evaluate the end-to-end performance of LLMs on argument mining and argument generation. Extensive experiments show that LLMs exhibit commendable performance across most of these datasets, demonstrating their capabilities in the field of argumentation. Our analysis offers valuable suggestions for evaluating computational argumentation and its integration with LLMs in future research endeavors.


title: Single- and two-particle observables in the Emery model: a dynamical mean-field perspective

abstract: We compare the dynamical mean-field descriptions of the single-band Hubbard model and the three-band Emery model at the one- and two-particle level for parameters relevant to high-Tc superconductors. We show that even within dynamical mean-field theory, accounting solely for temporal fluctuations, the intrinsic multi-orbital nature of the Emery model introduces effective non-local correlations. These lead to a non-Curie-like temperature-dependence of the magnetic susceptibility, also seen in nuclear magnetic resonance experiments in the pseudogap regime by M. Avramovska, et al. [Journal of Superconductivity and Novel Magnetism 33, 2621 (2020)]. We demonstrate the agreement of our results with these experiments for a large range of dopings and trace back the effective non-local correlations to an emerging oxygen-copper singlet by analyzing a minimal finite-size cluster model. Despite this correct description of the hallmark of the pseudogap at the two-particle level, i.e., the drop in the Knight shift of nuclear magnetic resonance, dynamical mean-field theory fails to properly describe the spectral properties of the pseudogap.


title: Fast Certification of Vision-Language Models Using Incremental Randomized Smoothing

abstract: A key benefit of deep vision-language models such as CLIP is that they enable zero-shot open vocabulary classification; the user has the ability to define novel class labels via natural language prompts at inference time. However, while CLIP-based zero-shot classifiers have demonstrated competitive performance across a range of domain shifts, they remain highly vulnerable to adversarial attacks. Therefore, ensuring the robustness of such models is crucial for their reliable deployment in the wild. In this work, we introduce Open Vocabulary Certification (OVC), a fast certification method designed for open-vocabulary models like CLIP via randomized smoothing techniques. Given a base "training" set of prompts and their corresponding certified CLIP classifiers, OVC relies on the observation that a classifier with a novel prompt can be viewed as a perturbed version of nearby classifiers in the base training set. Therefore, OVC can rapidly certify the novel classifier using a variation of incremental randomized smoothing. By using a caching trick, we achieve approximately two orders of magnitude acceleration in the certification process for novel prompts. To achieve further (heuristic) speedups, OVC approximates the embedding space at a given input using a multivariate normal distribution bypassing the need for sampling via forward passes through the vision backbone. We demonstrate the effectiveness of OVC on through experimental evaluation using multiple vision-language backbones on the CIFAR-10 and ImageNet test datasets.


title: Gravitational bremsstrahlung and the Fulling-Davies-Unruh thermal bath

abstract: The electromagnetic radiation emitted by an accelerated charged particle can be described theoretically as the interaction of the charge with the so-called Fulling-Davies-Unruh thermal bath in the coordinate frame co-accelerated with the charge. We present a similar analysis on the gravitational radiation from a classical point mass uniformly accelerated, being pulled by a string satisfying the weak energy condition. In particular, we derive the interaction rate (with fixed transverse momentum) of this system of the point mass and string in the Fulling-Davies-Unruh thermal bath in the co-accelerated frame and show that it equals the graviton emission rate calculated in the standard method in Minkowski spacetime.


title: Metal-free Stoner and Mott-Hubbard magnetism in 2D polymers with honeycomb lattice

abstract: We computationally demonstrate Stoner-ferromagnetic half-metals and antiferromagnetic Mott-Hubbard insulators in metal-free 2D polymers. Coupling radicaloid (hetero)triangulene monomers via strong covalent bonds preserving the in-plane conjugation of the electronic {\pi} system yields 2D crystals with long-range magnetic order and magnetic couplings above the Landauer limit. Dual-site honeycomb lattices produce both flat bands and Dirac cones. Depending on the monomers, electron correlations lead to either a bandgap at the Dirac points for antiferromagnetic Mott insulators, or Stoner ferromagnetism with both spin-polarized Dirac cones and flat bands at the Fermi level. These results pioneer a new type of Stoner and Mott-Hubbard magnetism emerging in the electronic pi system of crystalline conjugated 2D polymers.


title: Assessing the Robustness of Intelligence-Driven Reinforcement Learning

abstract: Robustness to noise is of utmost importance in reinforcement learning systems, particularly in military contexts where high stakes and uncertain environments prevail. Noise and uncertainty are inherent features of military operations, arising from factors such as incomplete information, adversarial actions, or unpredictable battlefield conditions. In RL, noise can critically impact decision-making, mission success, and the safety of personnel. Reward machines offer a powerful tool to express complex reward structures in RL tasks, enabling the design of tailored reinforcement signals that align with mission objectives. This paper considers the problem of the robustness of intelligence-driven reinforcement learning based on reward machines. The preliminary results presented suggest the need for further research in evidential reasoning and learning to harden current state-of-the-art reinforcement learning approaches before being mission-critical-ready.


title: Integrating Sensing, Communication, and Power Transfer: Multiuser Beamforming Design

abstract: In the sixth-generation (6G) networks, massive low-power devices are expected to sense environment and deliver tremendous data. To enhance the radio resource efficiency, the integrated sensing and communication (ISAC) technique exploits the sensing and communication functionalities of signals, while the simultaneous wireless information and power transfer (SWIPT) techniques utilizes the same signals as the carriers for both information and power delivery. The further combination of ISAC and SWIPT leads to the advanced technology namely integrated sensing, communication, and power transfer (ISCPT). In this paper, a multi-user multiple-input multiple-output (MIMO) ISCPT system is considered, where a base station equipped with multiple antennas transmits messages to multiple information receivers (IRs), transfers power to multiple energy receivers (ERs), and senses a target simultaneously. The sensing target can be regarded as a point or an extended surface. When the locations of IRs and ERs are separated, the MIMO beamforming designs are optimized to improve the sensing performance while meeting the communication and power transfer requirements. The resultant non-convex optimization problems are solved based on a series of techniques including Schur complement transformation and rank reduction. Moreover, when the IRs and ERs are co-located, the power splitting factors are jointly optimized together with the beamformers to balance the performance of communication and power transfer. To better understand the performance of ISCPT, the target positioning problem is further investigated. Simulations are conducted to verify the effectiveness of our proposed designs, which also reveal a performance tradeoff among sensing, communication, and power transfer.


title: Self-Annotated 3D Geometric Learning for Smeared Points Removal

abstract: There has been significant progress in improving the accuracy and quality of consumer-level dense depth sensors. Nevertheless, there remains a common depth pixel artifact which we call smeared points. These are points not on any 3D surface and typically occur as interpolations between foreground and background objects. As they cause fictitious surfaces, these points have the potential to harm applications dependent on the depth maps. Statistical outlier removal methods fare poorly in removing these points as they tend also to remove actual surface points. Trained network-based point removal faces difficulty in obtaining sufficient annotated data. To address this, we propose a fully self-annotated method to train a smeared point removal classifier. Our approach relies on gathering 3D geometric evidence from multiple perspectives to automatically detect and annotate smeared points and valid points. To validate the effectiveness of our method, we present a new benchmark dataset: the Real Azure-Kinect dataset. Experimental results and ablation studies show that our method outperforms traditional filters and other self-annotated methods. Our work is publicly available at https://github.com/wangmiaowei/wacv2024_smearedremover.git.


title: AI-based soundscape analysis: Jointly identifying sound sources and predicting annoyance

abstract: Soundscape studies typically attempt to capture the perception and understanding of sonic environments by surveying users. However, for long-term monitoring or assessing interventions, sound-signal-based approaches are required. To this end, most previous research focused on psycho-acoustic quantities or automatic sound recognition. Few attempts were made to include appraisal (e.g., in circumplex frameworks). This paper proposes an artificial intelligence (AI)-based dual-branch convolutional neural network with cross-attention-based fusion (DCNN-CaF) to analyze automatic soundscape characterization, including sound recognition and appraisal. Using the DeLTA dataset containing human-annotated sound source labels and perceived annoyance, the DCNN-CaF is proposed to perform sound source classification (SSC) and human-perceived annoyance rating prediction (ARP). Experimental findings indicate that (1) the proposed DCNN-CaF using loudness and Mel features outperforms the DCNN-CaF using only one of them. (2) The proposed DCNN-CaF with cross-attention fusion outperforms other typical AI-based models and soundscape-related traditional machine learning methods on the SSC and ARP tasks. (3) Correlation analysis reveals that the relationship between sound sources and annoyance is similar for humans and the proposed AI-based DCNN-CaF model. (4) Generalization tests show that the proposed model's ARP in the presence of model-unknown sound sources is consistent with expert expectations and can explain previous findings from the literature on sound-scape augmentation.


title: Integrating Sensing, Communication, and Power Transfer: From Theory to Practice

abstract: To support the development of internet-of-things applications, an enormous population of low-power devices are expected to be incorporated in wireless networks performing sensing and communication tasks. As a key technology for improving the data collection efficiency, integrated sensing and communication (ISAC) enables simultaneous data transmission and radar sensing by reusing the same radio signals. In addition to information carriers, wireless signals can also serve as energy delivers, which enables simultaneous wireless information and power transfer (SWIPT). To improve the energy and spectrum efficiency, the advantages of ISAC and SWIPT are expected to be exploited, leading to the emerging technology of integrating sensing, communication, and power transfer (ISCPT). In this article, a timely overview of ISCPT is provided with the description of the fundamentals, the characterization of the theoretical boundary, the discussion on the key technologies, and the demonstration of the implementation platform.


title: Nahida: In-Band Distributed Tracing with eBPF

abstract: Microservices are commonly used in modern cloud-native applications to achieve agility. However, the complexity of service dependencies in large-scale microservices systems can lead to anomaly propagation, making fault troubleshooting a challenge. To address this issue, distributed tracing systems have been proposed to trace complete request execution paths, enabling developers to troubleshoot anomalous services. However, existing distributed tracing systems have limitations such as invasive instrumentation, trace loss, or inaccurate trace correlation. To overcome these limitations, we propose a new tracing system based on eBPF (extended Berkeley Packet Filter), named Nahida, that can track complete requests in the kernel without intrusion, regardless of programming language or implementation. Our evaluation results show that Nahida can track over 92% of requests with stable accuracy, even under the high concurrency of user requests, while the state-of-the-art non-invasive approaches can not track any of the requests. Importantly, Nahida can track requests served by a multi-threaded application that none of the existing invasive tracing systems can handle by instrumenting tracing codes into libraries. Moreover, the overhead introduced by Nahida is negligible, increasing service latency by only 1.55%-2.1%. Overall, Nahida provides an effective and non-invasive solution for distributed tracing.


title: MELA: Multilingual Evaluation of Linguistic Acceptability

abstract: In this work, we present the largest benchmark to date on linguistic acceptability: Multilingual Evaluation of Linguistic Acceptability -- MELA, with 46K samples covering 10 languages from a diverse set of language families. We establish LLM baselines on this benchmark, and investigate cross-lingual transfer in acceptability judgements with XLM-R. In pursuit of multilingual interpretability, we conduct probing experiments with fine-tuned XLM-R to explore the process of syntax capability acquisition. Our results show that GPT-4o exhibits a strong multilingual ability, outperforming fine-tuned XLM-R, while open-source multilingual models lag behind by a noticeable gap. Cross-lingual transfer experiments show that transfer in acceptability judgment is non-trivial: 500 Icelandic fine-tuning examples lead to 23 MCC performance in a completely unrelated language -- Chinese. Results of our probing experiments indicate that training on MELA improves the performance of XLM-R on syntax-related tasks. Our data is available at https://github.com/sjtu-compling/MELA.


title: Weak and strong solutions for polymeric fluid-structure interaction of Oldroyd-B type

abstract: We prove the existence of weak solutions and a unique strong solution to the Oldroyd-B dumbbell model describing the evolution of a two-dimensional dilute polymer fluid interacting with a one-dimensional viscoelastic shell. The polymer fluid consists of a mixture of an incompressible viscous solvent and a solute comprising two massless beads connected with Hookean springs. This solute-solvent mixture then interacts with a flexible structure that evolves in time. An arbitrary nondegenerate reference domain for the polymer fluid is allowed and both solutions exist globally in time provided no self-intersection of the structure occurs.


title: Strengthening our grip on food security by encoding physics into AI

abstract: Climate change will jeopardize food security. Food security involves the robustness of the global agri-food system. This agri-food system is intricately connected to systems centering around health, economy, social-cultural diversity, and global political stability. A systematic way to determine acceptable interventions in the global agri-food systems involves analyses at different spatial and temporal scales. Such multi-scale analyses are common within physics. Unfortunately, physics alone is not sufficient. Machine learning techniques may aid. We focus on neural networks (NN) into which physics-based information is encoded (PeNN) and apply it to a sub-problem within the agri-food system. We show that the mean squared error of the PeNN is always smaller than that of the NNs, in the order of a factor of thousand. Furthermore, the PeNNs capture extra and interpolation very well, contrary to the NNs. It is shown that PeNNs need a much smaller data set size than the NNs to achieve a similar mse. Our results suggest that the incorporation of physics into neural networks architectures yields promise for addressing food security.


title: Local near-field scattering data enables unique reconstruction of rough electric potentials

abstract: The focus of this paper is the study of the inverse point-source scattering problem, specifically in relation to a certain class of electric potentials. Our research provides a novel uniqueness result for the inverse problem with local data, obtained from the near field pattern. Our work improves the work of Caro and Garcia, who investigated both the direct problem and the inverse problem with global near field data for critically singular and $\delta$-shell potentials. The primary contribution of our research is the introduction of a Runge approximation result for the near field data on the scattering problem which, in combination with an interior regularity argument, enables us to establish a uniqueness result for the inverse problem with local data. Additionaly, we manage to consider a slightly wider class of potentials.


title: Cyclic model for the dg dual of the BV operad

abstract: We describe a new small cyclic operad model QBV for the dg dual operad of the Batalin-Vilkovisky operad. As an application, we show that the Feynman transform of BV is quasi-isomorphic to the amputated Feynman transform of the dg dual, in complementary weights and degrees.


title: Skew Hecke Algebras

abstract: Let $G$ be a finite group, $H \le G$ a subgroup, $R$ a commutative ring, $A$ an $R$-algebra, and $\alpha$ an action of $G$ on $A$ by $R$-algebra automorphisms. Following Baker, we associate to this data the \emph{skew Hecke algebra} $\mathcal{H}_{R}(G,H,A,\alpha)$, which is the convolution algebra of $H$-invariant functions from $G/H$ to $A$. In this paper we study the basic structure of these algebras, proving for skew Hecke algebras a number of common generalisations of results about skew group algebras and results about Hecke algebras of finite groups. We show that skew Hecke algebras admit a certain double coset decomposition. We construct an isomorphism from $\mathcal{H}_{R}(G,H,A,\alpha)$ to the algebra of $G$-invariants in the tensor product $A \otimes \mathrm{End}_{R} ( \mathrm{Ind}_{H}^{G} R )$. We show that if $|G|$ is a unit in $A$, then $\mathcal{H}_{R}(G,H,A,\alpha)$ is isomorphic to a corner ring inside the skew group algebra $A \rtimes G$. Alongside our main results, we show that the construction of skew Hecke algebras is compatible with certain group-theoretic operations, restriction and extension of scalars, certain cocycle perturbations of the action, gradings and filtrations, and the formation of opposite algebras. The main results are illustrated in the case where $G = S_3$, $H = S_2$, and $\alpha$ is the natural permutation action of $S_3$ on the polynomial algebra $R[x_1,x_2,x_3]$.


title: RG Flows and Fixed Points of $O(N)^r$ Models

abstract: By means of $\epsilon$ and large $N$ expansions, we study generalizations of the $O(N)$ model where the fundamental fields are tensors of rank $r$ rather than vectors, and where the global symmetry (up to additional discrete symmetries and quotients) is $O(N)^r$, focusing on the cases $r\leq 5$. Owing to the distinct ways of performing index contractions, these theories contain multiple quartic operators, which mix under the RG flow. At all large $N$ fixed points, melonic operators are absent and the leading Feynman diagrams are bubble diagrams, so that all perturbative fixed points can be readily matched to full large $N$ solutions obtained from Hubbard-Stratonovich transformations. The family of fixed points we uncover extend to arbitrary higher values of $r$, and as their number grows superexponentially with $r$, these theories offer a vast generalization of the critical $O(N)$ model. We also study sextic $O(N)^r$ theories, whose large $N$ limits are obscured by the fact that the dominant Feynman diagrams are not restricted to melonic or bubble diagrams. For these theories the large $N$ dynamics differ qualitatively across different values of $r$, and we demonstrate that the RG flows possess a numerous and diverse set of perturbative fixed points beginning at rank four.


title: Modeling Health Video Consumption Behaviors on Social Media: Activities, Challenges, and Characteristics

abstract: Many people now watch health videos, such as diet, exercise, mental health, COVID-19, and chronic disease videos, on social media. Most existing studies focused on video creators, leaving the motivations and practices of viewers underexplored. We interviewed 18 participants, surveyed 121 respondents, and derived a model characterizing consumers' video consumption practices on social media. The practices include five main activities: deciding to watch videos driven by various motivations, accessing videos on social media through a socio-technical ecosystem, watching videos to meet informational, emotional, and entertainment needs, evaluating the credibility and interestingness of videos, and using videos to achieve health goals. Through an iterative video consumption process, individuals strategically navigate across multiple platforms, seeking better accessibility, higher reliability, and cultivating a stronger motivation. They actively look for longer and more in-depth videos. We further identified challenges consumers face while consuming health videos on social media and discussed design implications and directions for future research.


title: Flame spread over thin hollow cylindrical fuels in microgravity

abstract: This work presents experimental study on opposed flow flame spread over thin hollow cylindrical cellulosic fuel of diameters varying from 10 mm to 49 mm in microgravity environment. To understand the effect of flow and geometry on flame spread, experiments are conducted in low convective opposed flow conditions ranging from 10 cm/s to 30 cm/s for both hollow cylindrical and planar fuels at oxygen concentration of 21% and 1 atm pressure. In the microgravity environment the flame length and the flame spread rate are seen to increase with increase in hollow cylindrical fuel diameter over the flow range studied here. The flame spread rate exhibited a non-monotonic trend with flow speed, for flow of large diameter whereas a monotonic increasing trend is noted for small diameters. The flame spread rate over hollow cylindrical fuel is noted to be higher or at most equal compared to planar fuels over the matrix of experiments conducted in this study. A simplified analysis is carried out to arrive at an expression for flame spread rate over thin hollow cylindrical fuels. The analysis shows that the radiation heat transfer from the hot char to the inner surface of hollow virgin fuel dictates flame spread rate trend with fuel diameter of the hollow cylindrical fuels. Higher overall equivalence ratio in the inner section of the hollow fuels is responsible for higher char length in hollow fuels and also influence the flame spread rate for smaller fuel diameters.


title: A necessary and sufficient condition for the existence of a properly coloured $f$-factor in an edge-coloured graph

abstract: The main result of this paper is an edge-coloured version of Tutte's $f$-factor theorem. We give a necessary and sufficient condition for an edge-coloured graph $G^c$ to have a properly coloured $f$-factor. We state and prove our result in terms of an auxiliary graph $G_f^c$ which has a 1-factor if and only if $G^c$ has a properly coloured $f$-factor; this is analogous to the "short proof" of the $f$-factor theorem given by Tutte in 1954. An alternative statement, analogous to the original $f$-factor theorem, is also given. We show that our theorem generalises the $f$-factor theorem; that is, the former implies the latter. We consider other properties of edge-coloured graphs, and show that similar results are unlikely for $f$-factors with rainbow components and distance-$d$-coloured $f$-factors, even when $d=2$ and the number of colours used is asymptotically minimal.


title: Measurement-induced transitions beyond Gaussianity: a single particle description

abstract: Repeated measurements can induce entanglement phase transitions in the dynamics of quantum systems. Interacting models, both chaotic and integrable, generically show a stable volume-law entangled phase at low measurement rates which disappears for free, Gaussian fermions. Interactions break the Gaussianity of a dynamical map in its unitary part, but non-Gaussianity can be introduced through measurements as well. By comparing the entanglement and non-Gaussianity structure of different protocols, we propose a new single-particle indicator of the measurement-induced phase transition and we use it to argue in favour of the stability of the transition when non-Gaussianity is purely provided by measurements


title: Decoding Fermion Mass Pattern from Mass Hierarchy

abstract: Building an organized Yukawa structure of quarks and leptons is an essential mission to understand fermion mass hierarchy and flavor mixing in particle physics. Inspired by the similarity of CKM and PMNS mixings, a common mass pattern for up-type and down-type quarks, charged leptons, and Dirac neutrinos is realized in terms of hierarchal masses. An organized structure of Yukawa couplings can be expressed on a Yukawa basis. The CKM mixing and PMNS mixing have the same mathematical forms due to $SO(2)$ family symmetry. By fitting the CKM/PMNS mixing experiment, the flat pattern becomes a successful flavor structure. The fundamental fermions can be explained by a new picture to show the relationship between gauge structure and flavor structure.


title: On a conjecture of Feigin, Wang and Yoshinaga

abstract: We settled a conjecture of Feigin, Wang and Yoshinaga, appeared in the preprint "Integral expressions for derivations of multiarrangements" (arXiv: 2309.01287v2).


title: Measurements of evaporation residue cross-sections and evaporation residue-gated $\gamma$-ray fold distributions for $^{32}$S+$^{154}$Sm system

abstract: Evaporation Residue (ER) cross-sections and ER-gated $\gamma$-ray fold distributions are measured for the $^{32}$S + $^{154}$Sm nuclear reaction above the Coulomb barrier at six different beam energies from 148 to 191 MeV. $\gamma$-ray multiplicities and spin distributions are extracted from the ER-gated fold distributions. The ER cross-sections measured in the present work are found to be much higher than what was reported in a previous work using a very different target-projectile ($^{48}$Ti + $^{138}$Ba) combination, leading to the same compound nucleus $^{186}$Pt, with much less mass asymmetry in the entrance channel than the present reaction. This clearly demonstrates the effect of the entrance channel on ER production cross-section. The ER cross-sections measured in the present work are compared with the results of both the statistical model calculations and the dynamical model calculations. Statistical model calculations have been performed to generate a range of parameter space for both the barrier height and Kramers' viscosity parameter over which the ER cross-section data can be reproduced. The calculations performed using the dinuclear system (DNS) model reproduce the data considering both complete and incomplete fusion processes. DNS calculations indicate the need for the inclusion of incomplete fusion channel at higher energies to reproduce the ER cross-sections.


title: 6G Non-Terrestrial Networks Enabled Low-Altitude Economy: Opportunities and Challenges

abstract: The unprecedented development of non-terrestrial networks (NTN) utilizes the low-altitude airspace for commercial and social flying activities. The integration of NTN and terrestrial networks leads to the emergence of low-altitude economy (LAE). A series of LAE application scenarios are enabled by the sensing, communication, and transportation functionalities of the aircrafts. The prerequisite technologies supporting LAE are introduced in this paper, including the network coverage and aircrafts detection. The LAE functionalities assisted by aircrafts with respect to sensing and communication are then summarized, including the terrestrial and non-terrestrial targets sensing, ubiquitous coverage, relaying, and traffic offloading. Finally, several future directions are identified, including aircrafts collaboration, energy efficiency, and artificial intelligence enabled LAE.


title: GRASP: A novel benchmark for evaluating language GRounding And Situated Physics understanding in multimodal language models

abstract: This paper presents GRASP, a novel benchmark to evaluate the language grounding and physical understanding capabilities of video-based multimodal large language models (LLMs). This evaluation is accomplished via a two-tier approach leveraging Unity simulations. The first level tests for language grounding by assessing a model's ability to relate simple textual descriptions with visual information. The second level evaluates the model's understanding of "Intuitive Physics" principles, such as object permanence and continuity. In addition to releasing the benchmark, we use it to evaluate several state-of-the-art multimodal LLMs. Our evaluation reveals significant shortcomings in the language grounding and intuitive physics capabilities of these models. Although they exhibit at least some grounding capabilities, particularly for colors and shapes, these capabilities depend heavily on the prompting strategy. At the same time, all models perform below or at the chance level of 50% in the Intuitive Physics tests, while human subjects are on average 80% correct. These identified limitations underline the importance of using benchmarks like GRASP to monitor the progress of future models in developing these competencies.


title: Adapting Large Language Models by Integrating Collaborative Semantics for Recommendation

abstract: Recently, large language models (LLMs) have shown great potential in recommender systems, either improving existing recommendation models or serving as the backbone. However, there exists a large semantic gap between LLMs and recommender systems, since items to be recommended are often indexed by discrete identifiers (item ID) out of the LLM's vocabulary. In essence, LLMs capture language semantics while recommender systems imply collaborative semantics, making it difficult to sufficiently leverage the model capacity of LLMs for recommendation. To address this challenge, in this paper, we propose a new LLM-based recommendation model called LC-Rec, which can better integrate language and collaborative semantics for recommender systems. Our approach can directly generate items from the entire item set for recommendation, without relying on candidate items. Specifically, we make two major contributions in our approach. For item indexing, we design a learning-based vector quantization method with uniform semantic mapping, which can assign meaningful and non-conflicting IDs (called item indices) for items. For alignment tuning, we propose a series of specially designed tuning tasks to enhance the integration of collaborative semantics in LLMs. Our fine-tuning tasks enforce LLMs to deeply integrate language and collaborative semantics (characterized by the learned item indices), so as to achieve an effective adaptation to recommender systems. Extensive experiments demonstrate the effectiveness of our method, showing that our approach can outperform a number of competitive baselines including traditional recommenders and existing LLM-based recommenders. Our code is available at https://github.com/RUCAIBox/LC-Rec/.


title: Improving Zero-shot Visual Question Answering via Large Language Models with Reasoning Question Prompts

abstract: Zero-shot Visual Question Answering (VQA) is a prominent vision-language task that examines both the visual and textual understanding capability of systems in the absence of training data. Recently, by converting the images into captions, information across multi-modalities is bridged and Large Language Models (LLMs) can apply their strong zero-shot generalization capability to unseen questions. To design ideal prompts for solving VQA via LLMs, several studies have explored different strategies to select or generate question-answer pairs as the exemplar prompts, which guide LLMs to answer the current questions effectively. However, they totally ignore the role of question prompts. The original questions in VQA tasks usually encounter ellipses and ambiguity which require intermediate reasoning. To this end, we present Reasoning Question Prompts for VQA tasks, which can further activate the potential of LLMs in zero-shot scenarios. Specifically, for each question, we first generate self-contained questions as reasoning question prompts via an unsupervised question edition module considering sentence fluency, semantic integrity and syntactic invariance. Each reasoning question prompt clearly indicates the intent of the original question. This results in a set of candidate answers. Then, the candidate answers associated with their confidence scores acting as answer heuristics are fed into LLMs and produce the final answer. We evaluate reasoning question prompts on three VQA challenges, experimental results demonstrate that they can significantly improve the results of LLMs on zero-shot setting and outperform existing state-of-the-art zero-shot methods on three out of four data sets. Our source code is publicly released at \url{https://github.com/ECNU-DASE-NLP/RQP}.