title: The Problem of Alignment

abstract: Large Language Models produce sequences learned as statistical patterns from large corpora. In order not to reproduce corpus biases, after initial training models must be aligned with human values, preferencing certain continuations over others. Alignment, which can be viewed as the superimposition of normative structure onto a statistical model, reveals a conflicted and complex interrelationship between language and technology. This relationship shapes theories of language, linguistic practice and subjectivity, which are especially relevant to the current sophistication in artificially produced text. We examine this practice of structuration as a two-way interaction between users and models by analysing how ChatGPT4 redacts perceived `anomalous' language in fragments of Joyce's Ulysses and the new linguistic practice of prompt engineering. We then situate this alignment problem historically, revisiting earlier postwar linguistic debates which counterposed two views of meaning: as discrete structures, and as continuous probability distributions. We discuss the largely occluded work of the Moscow Linguistic School, which sought to reconcile this opposition. Our attention to the Moscow School and later related arguments by Searle and Kristeva casts the problem of alignment in a new light: as one involving attention to the social structuration of linguistic practice, including structuration of anomalies that, like the Joycean text, exist in defiance of expressive conventions. These debates around the communicative orientation toward language can help explain some of the contemporary behaviours and interdependencies that take place between users and LLMs.


title: Open-TI: Open Traffic Intelligence with Augmented Language Model

abstract: Transportation has greatly benefited the cities' development in the modern civilization process. Intelligent transportation, leveraging advanced computer algorithms, could further increase people's daily commuting efficiency. However, intelligent transportation, as a cross-discipline, often requires practitioners to comprehend complicated algorithms and obscure neural networks, bringing a challenge for the advanced techniques to be trusted and deployed in practical industries. Recognizing the expressiveness of the pre-trained large language models, especially the potential of being augmented with abilities to understand and execute intricate commands, we introduce Open-TI. Serving as a bridge to mitigate the industry-academic gap, Open-TI is an innovative model targeting the goal of Turing Indistinguishable Traffic Intelligence, it is augmented with the capability to harness external traffic analysis packages based on existing conversations. Marking its distinction, Open-TI is the first method capable of conducting exhaustive traffic analysis from scratch - spanning from map data acquisition to the eventual execution in complex simulations. Besides, Open-TI is able to conduct task-specific embodiment like training and adapting the traffic signal control policies (TSC), explore demand optimizations, etc. Furthermore, we explored the viability of LLMs directly serving as control agents, by understanding the expected intentions from Open-TI, we designed an agent-to-agent communication mode to support Open-TI conveying messages to ChatZero (control agent), and then the control agent would choose from the action space to proceed the execution. We eventually provide the formal implementation structure, and the open-ended design invites further community-driven enhancements.


title: Physics-Informed Multi-Agent Reinforcement Learning for Distributed Multi-Robot Problems

abstract: The networked nature of multi-robot systems presents challenges in the context of multi-agent reinforcement learning. Centralized control policies do not scale with increasing numbers of robots, whereas independent control policies do not exploit the information provided by other robots, exhibiting poor performance in cooperative-competitive tasks. In this work we propose a physics-informed reinforcement learning approach able to learn distributed multi-robot control policies that are both scalable and make use of all the available information to each robot. Our approach has three key characteristics. First, it imposes a port-Hamiltonian structure on the policy representation, respecting energy conservation properties of physical robot systems and the networked nature of robot team interactions. Second, it uses self-attention to ensure a sparse policy representation able to handle time-varying information at each robot from the interaction graph. Third, we present a soft actor-critic reinforcement learning algorithm parameterized by our self-attention port-Hamiltonian control policy, which accounts for the correlation among robots during training while overcoming the need of value function factorization. Extensive simulations in different multi-robot scenarios demonstrate the success of the proposed approach, surpassing previous multi-robot reinforcement learning solutions in scalability, while achieving similar or superior performance (with averaged cumulative reward up to x2 greater than the state-of-the-art with robot teams x6 larger than the number of robots at training time).


title: On the Ground State Quantum Droplet for Large Chemical Potentials

abstract: In the present work we revisit the problem of the quantum droplet in atomic Bose-Einstein condensates with an eye towards describing its ground state in the large density, so-called Thomas-Fermi limit. We consider the problem as being separable into 3 distinct regions: an inner one, where the Thomas-Fermi approximation is valid, a sharp transition region where the density abruptly drops towards the (vanishing) background value and an outer region which asymptotes to the background value. We analyze the spatial extent of each of these regions, and develop a systematic effective description of the rapid intermediate transition region. Accordingly, we derive a uniformly valid description of the ground state that is found to very accurately match our numerical computations. As an additional application of our considerations, we show that this formulation allows for an analytical approximation of excited states such as the (trapped) dark soliton in the large density limit.


title: Evolutionary Dynamics with Randomly Distributed Benevolent Individuals

abstract: Understanding the evolution of cooperation is pivotal in biology and social science. Public resources sharing is a common scenario in the real world. In our study, we explore the evolutionary dynamics of cooperation on a regular graph with degree $k$, introducing the presence of a third strategy, namely the benevolence, who does not evolve over time, but provides a fixed benefit to all its neighbors. We find that the presence of the benevolence can foster the development of cooperative behavior and it follows a simple rule: $b/c > k - p_S(k-1)$. Our results provide new insights into the evolution of cooperation in structured populations.


title: On families of elliptic curves $E_{p,q}:y^2=x^3-pqx$ that intersect the same line $L_{a,b}:y=\frac{a}{b}x$ of rational slope

abstract: Let $p$ and $q$ be two distinct odd primes, $p<q$ and $E_{p,q}:y^2=x^3-pqx$ be an elliptic curve. Fix a line $L_{a.b}:y=\frac{a}{b}x$ where $a\in \mathbb{Z},b\in \mathbb{N}$ and $(a,b)=1$. We study sufficient conditions that $p$ and $q$ must satisfy so that there are infinitely many elliptic curves $E_{p,q}$ that intersect $L_{a,b}$.


title: Heavy Wilson Quarks and O($a$) Improvement: Nonperturbative Results for $b_{\rm g}$

abstract: With Wilson quarks, on-shell O($a$) improvement of the lattice QCD action is achieved by including the Sheikholeslami-Wohlert term and two further operators of mass dimension 5, which amount to a mass-dependent rescaling of the bare parameters. We here focus on the rescaled bare coupling, $\tilde{g}_0^2 = g_0^2(1 + b_{\rm g} am_{\rm q})$, and the determination of $b_{\rm g}(g_0^2)$, which is currently only known to 1-loop order of perturbation theory. We derive suitable improvement conditions in the chiral limit and in a finite space-time volume and evaluate these for different gluonic observables, both with and without the gradient flow. The choice of $\beta$-values and the line of constant physics are motivated by the ALPHA collaboration's decoupling strategy to determine $\alpha_s(m_Z)$. However, the improvement conditions and some insight into systematic effects may prove useful in other contexts, too.


title: Discretization-Based Solution Approaches for the Circle Packing Problem

abstract: The problem of packing a set of circles into the smallest surrounding container is considered. This problem arises in different application areas such as automobile, textile, food, and chemical industries. The so-called circle packing problem can be cast as a nonconvex quadratically constrained program, and is difficult to solve in general. An iterative solution approach based on a bisection-type algorithm on the radius of the larger circle is provided. The present algorithm discretizes the container into small cells and solves two different integer linear programming formulations proposed for a restricted and a relaxed version of the original problem. The present algorithm is enhanced with solution space reduction, bound tightening and variable elimination techniques. Then, a computational study is performed to evaluate the performance of the algorithm. The present algorithm is compared with BARON and Gurobi that solve the original nonlinear formulation and heuristic methods from literature, and obtain promising results.


title: Comment on "Multiparty quantum mutual information: An alternative definition"

abstract: We show that, contrary to the claim by Kumar [Phys. Rev. A 96, 012332 (2017)], the quantum dual total correlation of an $n$-partite quantum state cannot be represented as the quantum relative entropy between $n-1$ copies of the quantum state and the product of $n$ different reduced quantum states for $n \geq 3$. Specifically, we argue that the latter fails to yield a finite value for generalized $n$-partite Greenberger-Horne-Zeilinger states.


title: Entanglement Entropy via Double Cone Regularization

abstract: This paper proposes an alternative regularization method for handling the ultraviolet behavior of entanglement entropy. Utilizing an $i\epsilon$ prescription in the Euclidean double cone geometry, it accurately reproduces the universal behavior of entanglement entropy. The method is demonstrated in the free boson theory in arbitrary dimensions and two-dimensional conformal field theories. The findings highlight the effectiveness of the $i\epsilon$ regularization method in addressing ultraviolet issues in quantum field theory and gravity, suggesting potential applications to other calculable quantities.


title: Evidence of grain alignment by magnetically enhanced radiative torques from multi-wavelength dust polarization modeling of HL Tau

abstract: Atacama Large Millimeter/Submillimeter Array (ALMA) has revolutionized the field of dust polarization in protoplanetary disks across multiple wavelengths. Previous observations and empirical modeling suggested multiple mechanisms of dust polarization toward HL Tau, including grain alignment and dust scattering. However, a detailed modeling of dust polarization based on grain alignment physics is not yet available. Here, using our updated POLARIS code, we perform numerical modeling of dust polarization arising from both grain alignment by Magnetically Enhanced Radiative Torque (MRAT) mechanism and self-scattering to reproduce the HL Tau polarization observed at three wavelengths 0.87, 1.3, and 3.1$\,$mm. Our modeling results show that the observed multi-wavelength polarization could be reproduced only when large grains contain embedded iron inclusions and those with slow internal relaxation must have wrong internal alignment (i.e., the grain's major axis parallel to its angular momentum). The abundance of iron embedded inside grains in the form of clusters is constrained to be $\gtrsim 16$%, and the number of iron atoms per cluster is $N_{\rm cl} \sim 9\times10^2$. Maximum grain sizes probed at wavelengths $\lambda$ = 0.87, 1.3, and 3.1$\,$mm are constrained at $\sim$ 60, 80, and 90$\,\mu$m, respectively.


title: Structural Insights and an IP-based Solution Method for Patient-to-room Assignment under Consideration of Single Room Entitlements

abstract: Patient-to-room assignment (PRA) is a scheduling problem in decision support for hospitals. It consists of assigning patients to rooms according to certain objectives, e.g., avoiding transfers and respecting single-room requests. This work presents combinatorial insights about the feasibility of PRA and about the assignment of patients to single rooms. We further compare different IP-formulations for PRA as well as the influence of different objectivs on the runtime. Based on these results, we develop a fast IP-based solution approach which obtains high quality solution. The applicability is verified through a computational study with instances derived from real-world data. Results indicate that large, real world instances can be solved to a high degree of optimality within (fractions of) seconds.


title: Optimization of muonium yield in perforated silica aerogel

abstract: A muonium consists of a positive muon associated with an orbital electron, and the spontaneous conversion to antimuonium serves as a clear indication of new physics beyond the Standard Model in particle physics.One of the most important aspects in muonium-to-antimuonium conversion experiment (MACE) is to increase the muonium yield in vacuum to challenge the latest limit obtained in 1999. This study focuses on a simulation of the muonium formation and diffusion in the perforated silica aerogel. The independent simulation results can be well validated by experimental data. By optimizing the target geometry, we find a maximum muonium emission efficiency of $7.92(2)\%$ and a maximum vacuum yield of $1.134(2)\%$ with a typical surface muon beam, indicating a 2.6 times and a 2.1 times enhancement, respectively. Our results will pave the way for muonium experiments.


title: On Performance of Integrated Satellite HAPS Ground Communication: Aerial IRS Node vs Terrestrial IRS Node

abstract: With a motive of ubiquitous connectivity over the globe with enhanced spectral efficiency, intelligent reflecting surfaces (IRS) integrated satellite-terrestrial communications is a topic of research interest in an infrastructure-deficient remote terrains. In line with this vision, this paper entails the performance analysis of satellite-terrestrial networks leveraging both aerial and terrestrial IRS nodes, with the support of high altitude platforms over diverse fading channels including shadowed Rician, Rician, and Nakagami-$m$ fading channels. The merits of IRS in enhancing spectral efficiency is analyzed through closed-form expressions of outage probability and ergodic rate. Further, the average symbol error rate analysis for the higher-order quadrature amplitude modulation (QAM) schemes such as hexagonal QAM, rectangular QAM, cross QAM, and square QAM is performed. Practical constraints like antenna gains, path loss, and link fading are considered to characterize the satellite terrestrial links. Finally, a comparison between the high-altitude platforms based IRS node and terrestrial IRS nodes is performed and various insights are drawn under various fading scenarios and path loss conditions. This paper contribute towards understanding and potential implementation of IRS-integrated satellite-terrestrial networks for efficient and reliable communication.


title: Edge and bulk states in Weyl-orbit quantum Hall effect as studied by Corbino measurements

abstract: We investigate edge and bulk states in Weyl-orbit based quantum Hall effect by measuring a Corbino-type device fabricated from a topological Dirac semimetal (Cd1-xZnx)3As2 film. Clear quantum Hall plateaus are observed when measuring one-sided terminals of the Corbino-type device. This indicates that edge states of the Weyl-orbit quantum Hall effect form closed trajectories consisting of Fermi arcs and chiral zero modes independently on inner and outer sides. On the other hand, the bulk resistance does not diverge at fields where the quantum Hall plateau appears, suggesting that the Weyl orbits in the bulk region are not completely localized when applying electric current through the bulk region.


title: Enhancing dysarthria speech feature representation with empirical mode decomposition and Walsh-Hadamard transform

abstract: Dysarthria speech contains the pathological characteristics of vocal tract and vocal fold, but so far, they have not yet been included in traditional acoustic feature sets. Moreover, the nonlinearity and non-stationarity of speech have been ignored. In this paper, we propose a feature enhancement algorithm for dysarthria speech called WHFEMD. It combines empirical mode decomposition (EMD) and fast Walsh-Hadamard transform (FWHT) to enhance features. With the proposed algorithm, the fast Fourier transform of the dysarthria speech is first performed and then followed by EMD to get intrinsic mode functions (IMFs). After that, FWHT is used to output new coefficients and to extract statistical features based on IMFs, power spectral density, and enhanced gammatone frequency cepstral coefficients. To evaluate the proposed approach, we conducted experiments on two public pathological speech databases including UA Speech and TORGO. The results show that our algorithm performed better than traditional features in classification. We achieved improvements of 13.8% (UA Speech) and 3.84% (TORGO), respectively. Furthermore, the incorporation of an imbalanced classification algorithm to address data imbalance has resulted in a 12.18% increase in recognition accuracy. This algorithm effectively addresses the challenges of the imbalanced dataset and non-linearity in dysarthric speech and simultaneously provides a robust representation of the local pathological features of the vocal folds and tracts.


title: The Intrinsic Energy Resolution of LaBr$_3$(Ce) Crystal for GECAM

abstract: The intrinsic resolution is the primary limitation on the total energy resolution of LaBr$_3$(Ce) crystal. This intrinsic resolution arises from two effects: fluctuations occurring in the process of energy transfer to luminescent centers within the LaBr$_3$(Ce) crystal and the LaBr$_3$(Ce) crystal's non-proportional luminescence. Presently, experimental measurements regarding the intrinsic resolution of LaBr$_3$(Ce) crystal are scarce, and the underlying physical mechanisms remain incompletely understood. In this paper, we aim to elucidate the concept of intrinsic resolution. We investigated the entire physical process of luminescence following energy deposition in the LaBr$_3$(Ce) crystal, quantifying the various components in the total energy resolution. We conducted a series of experimental measurements and Geant4 simulations, determining the intrinsic resolution of LaBr$_3$(Ce) crystal to 100 keV electrons as 2.12%. The non-proportionality contributes significantly at 1.43%, while fluctuations in the energy transfer process accounted for 0.27%. It is evident that non-proportionality in light output constitutes the primary source of intrinsic resolution. Horizontal and vertical unevenness in light collection contributed 0.25% and 0.07%, respectively. Statistical fluctuations showed the largest impact on the total energy resolution, at 2.86%. The contribution from fluctuations in single-photoelectron events was 0.77%. Furthermore, we reconstructed the photon response using Geant4, and the consistency between the simulated relative light yield and the experimentally measured one confirmed the reliability of the LaBr$_3$(Ce) detector mass model employed in the simulation.

categories: physics.ins-det astro-ph.IM hep-ex nucl-ex


title: Does the World Bank's Ease of Doing Business Index Matter for FDI? Findings from Africa

abstract: This paper investigates whether foreign investment (FDI) into Africa is at least partially responsive to World Bank-measured market friendliness. Specifically, I conducted analyses of four countries between 2009 and 2017, using cases that represent two of the highest scorers on the bank's Doing Business index as of 2008 (Mauritius and South Africa) and the two lowest scorers (DRC and CAR), and subsequently traced all four for growths or declines in FDI in relation to their scores in the index. The findings show that there is a moderate association between decreased costs of starting a business and growth of FDI. Mauritius, South Africa and the DRC reduced their total cost of starting a business by 71.7%, 143.7% and 122.9% for the entire period, and saw inward FDI increases of 167.6%, 79.8% and 152.21%, respectively. The CAR increased the cost of starting businesses but still saw increases in FDI. However, the country also saw the least amount of growth in FDI at only 13.3%.


title: Parallel-in-time Multilevel Krylov Methods: A Prototype

abstract: This paper presents a parallel-in-time multilevel iterative method for solving differential algebraic equation, arising from a discretization of linear time-dependent partial differential equation. The core of the method is the multilevel Krylov method, introduced by Erlangga and Nabben~{\it [SIAM J. Sci. Comput., 30(2008), pp. 1572--1595]}. In the method, special time restriction and interpolation operators are proposed to coarsen the time grid and to map functions between fine and coarse time grids. The resulting Galerkin coarse-grid system can be interpreted as time integration of an equivalent differential algebraic equation associated with a larger time step and a modified $\theta$-scheme. A perturbed coarse time-grid matrix is used on the coarsest level to decouple the coarsest-level system, allowing full parallelization of the method. Within this framework, spatial coarsening can be included in a natural way, reducing further the size of the coarsest grid problem to solve. Numerical results are presented for the 1- and 2-dimensional heat equation using {\it simulated} parallel implementation, suggesting the potential computational speed-up of up to 9 relative to the single-processor implementation and the speed-up of about 3 compared to the sequential $\theta$-scheme.


title: Thermal leptogenesis in nonextensive cosmology

abstract: Thermal leptogenesis is a mechanism that explains the observed asymmetry between matter and antimatter in the early universe. In this study, we review the impact of nonextensive Tsallis statistical mechanics on the early universe and study its effect on thermal leptogenesis. The study has found that the use of nonextensive statistical mechanics can affect the production of baryon asymmetry in thermal leptogenesis by modifying the equilibrium abundance of particles, decay, and washout parameters. Also, we show that nonextensive statistical mechanics potentially reduce the required right-handed neutrino mass scale.


title: Transformer Multivariate Forecasting: Less is More?

abstract: In the domain of multivariate forecasting, transformer models stand out as powerful apparatus, displaying exceptional capabilities in handling messy datasets from real-world contexts. However, the inherent complexity of these datasets, characterized by numerous variables and lengthy temporal sequences, poses challenges, including increased noise and extended model runtime. This paper focuses on reducing redundant information to elevate forecasting accuracy while optimizing runtime efficiency. We propose a novel transformer forecasting framework enhanced by Principal Component Analysis (PCA) to tackle this challenge. The framework is evaluated by five state-of-the-art (SOTA) models and four diverse real-world datasets. Our experimental results demonstrate the framework's ability to minimize prediction errors across all models and datasets while significantly reducing runtime. From the model perspective, one of the PCA-enhanced models: PCA+Crossformer, reduces mean square errors (MSE) by 33.3% and decreases runtime by 49.2% on average. From the dataset perspective, the framework delivers 14.3% MSE and 76.6% runtime reduction on Electricity datasets, as well as 4.8% MSE and 86.9% runtime reduction on Traffic datasets. This study aims to advance various SOTA models and enhance transformer-based time series forecasting for intricate data. Code is available at: https://github.com/jingjing-unilu/PCA_Transformer.


title: Survivability of Amorphous Ice in Comets Depends on the Latent Heat of Crystallization of Impure Water Ice

abstract: Comets would have amorphous ice rather than crystalline one at the epoch of their accretion. Cometary ice contains some impurities that govern the latent heat of ice crystallization, $L_{\rm cry}$. However, it is still controversial whether the crystallization process is exothermic or endothermic. In this study, we perform one-dimensional simulations of the thermal evolution of km-sized comets and investigate the effect of the latent heat. We find that the depth where amorphous ice can survive significantly depends on the latent heat of ice crystallization. Assuming the cometary radius of 2 km, the depth of the amorphous ice mantle is approximately 100 m when the latent heat is positive (i.e., the exothermic case with $L_{\rm cry} = + 9 \times 10^{4}$ J/kg). In contrast, when we consider the impure ice representing the endothermic case with $L_{\rm cry} = - 9 \times 10^{4}$ J/kg, the depth of the amorphous ice mantle could exceed 1 km. Although our numerical results indicate that these depths depend on the size and the accretion age of comets, the depth in a comet with the negative latent heat is a few to several times larger than the positive case for a given comet size. This work suggests that the spatial distribution of the ice crystallinity in a comet nucleus depends on the latent heat, which can be different from the previous estimates assuming pure water ice.


title: A Review on Low-Dose Emission Tomography Post-Reconstruction Denoising with Neural Network Approaches

abstract: Low-dose emission tomography (ET) plays a crucial role in medical imaging, enabling the acquisition of functional information for various biological processes while minimizing the patient dose. However, the inherent randomness in the photon counting process is a source of noise which is amplified in low-dose ET. This review article provides an overview of existing post-processing techniques, with an emphasis on deep neural network (NN) approaches. Furthermore, we explore future directions in the field of NN-based low-dose ET. This comprehensive examination sheds light on the potential of deep learning in enhancing the quality and resolution of low-dose ET images, ultimately advancing the field of medical imaging.


title: Induced electrical field in a magnetized cylinder with a radial heat flux

abstract: A conducting cylinder with a central source of electrons, in a uniform magnetic field along its axis, and radial temperature gradient, is considered at the stationary state. Interaction of heat flux, magnetic field and charge distribution is discussed. Four different models are considered, regarding of the electronic supply and possibility of electrons to leave the cylinder.


title: An experiment to measure electromagnetic memory

abstract: We describe an experiment to measure the electromagnetic analog of gravitational wave memory, the so-called electromagnetic memory. Whereas gravitational wave memory is a residual displacement of test masses, electromagnetic memory is a residual velocity (i.e. kick) of test charges. The source of gravitational wave memory is energy that is not confined to any bounded spatial region: in the case of binary black hole mergers the emitted energy of gravitational radiation as well as the recoil energy of the final black hole. Similarly, electromagnetic memory requires a source whose charges are not confined to any bounded spatial region. While particle beams can provide unbounded charges, their currents are too small to be practical for such an experiment. Instead we propose a short microwave pulse applied to the center of a long dipole antenna. In this way the measurement of the kick can be done quickly enough that the finite size of the antenna does not come into play and it acts for our purposes the same as if it were an infinite antenna.


title: Analytic capacities in Besov spaces

abstract: We derive new estimates on analytic capacities of finite sequences in the unit disc in Besov spaces with zero smoothness, which sharpen the estimates obtained by N.K.Nikolski in 2005 and, for a range of parameters, are optimal. The work is motivated both from the perspective of complex analysis by the description of sets of zeros/uniqueness, and from the one of matrix analysis/operator theory by estimates on norms of inverses.


title: Simultaneously determine elastic impedance and shape by a Newton-type iterative method

abstract: This paper focuses on the inverse elastic impedance and the geometry problem by a Cauchy data pair on the access part of the boundary in a two-dimensional case. Through the decomposition of the displacement, the problem is transform the solution of into a coupled boundary value problem that involves two scalar Helmholtz equations. Firstly, a uniqueness result is given, and a non-iterative algorithm is proposed to solve the data completion problem using a Cauchy data pair on a known part of the solution domain's boundary. Next, we introduce a Newton-type iterative method for reconstructing the boundary and the impedance function using the completion data on the unknown boundary, which is governed by a specific type of boundary conditions. Finally, we provide several examples to demonstrate the effectiveness and accuracy of the proposed method.


title: A Novel Approach for Defect Detection of Wind Turbine Blade Using Virtual Reality and Deep Learning

abstract: Wind turbines are subjected to continuous rotational stresses and unusual external forces such as storms, lightning, strikes by flying objects, etc., which may cause defects in turbine blades. Hence, it requires a periodical inspection to ensure proper functionality and avoid catastrophic failure. The task of inspection is challenging due to the remote location and inconvenient reachability by human inspection. Researchers used images with cropped defects from the wind turbine in the literature. They neglected possible background biases, which may hinder real-time and autonomous defect detection using aerial vehicles such as drones or others. To overcome such challenges, in this paper, we experiment with defect detection accuracy by having the defects with the background using a two-step deep-learning methodology. In the first step, we develop virtual models of wind turbines to synthesize the near-reality images for four types of common defects - cracks, leading edge erosion, bending, and light striking damage. The Unity perception package is used to generate wind turbine blade defects images with variations in background, randomness, camera angle, and light effects. In the second step, a customized U-Net architecture is trained to classify and segment the defect in turbine blades. The outcomes of U-Net architecture have been thoroughly tested and compared with 5-fold validation datasets. The proposed methodology provides reasonable defect detection accuracy, making it suitable for autonomous and remote inspection through aerial vehicles.


title: How to Evaluate Coreference in Literary Texts?

abstract: In this short paper, we examine the main metrics used to evaluate textual coreference and we detail some of their limitations. We show that a unique score cannot represent the full complexity of the problem at stake, and is thus uninformative, or even misleading. We propose a new way of evaluating coreference, taking into account the context (in our case, the analysis of fictions, esp. novels). More specifically, we propose to distinguish long coreference chains (corresponding to main characters), from short ones (corresponding to secondary characters), and singletons (isolated elements). This way, we hope to get more interpretable and thus more informative results through evaluation.


title: Strain induced electronic and magnetic transition in S = 3/2 antiferromagnetic spin chain compound LaCrS3

abstract: Exploring the physics of low-dimensional spin systems and their pressure-driven electronic and magnetic transitions are thriving research field in modern condensed matter physics. In this context, recently antiferromagnetic Cr-based compounds such as CrI3, CrBr3, CrGeTe3 have been investigated experimentally and theoretically for their possible spintronics applications. Motivated by the fundamental and industrial importance of these materials, we theoretically studied the electronic and magnetic properties of a relatively less explored Cr-based chalcogenide, namely LaCrS3 where 2D layers of magnetic Cr3+ ions form a rectangular lattice. We employed density functional theory + Hubbard U approach in conjunction with constrained random-phase approximation (cRPA) where the later was used to estimate the strength of U. Our findings at ambient pressure show that the system exhibits semiconducting antiferromagnetic ground state with a gap of 0.5 eV and large Cr moments that corresponds to nominal S=3/2 spin-state. The 1st nearest neighbor (NN) interatomic exchange coupling (J1) is found to be strongly antiferromagnetic (AFM), while 2nd NN couplings are relatively weaker ferromagnetic (FM), making this system a candidate for 1D non-frustrated antiferromagnetic spin-chain family of materials. Based on orbital resolved interactions, we demonstrated the reason behind two different types of interactions among 1st and 2nd NN despite their very similar bond lengths. We observe a significant spin-orbit coupling effect, giving rise to a finite magneto crystalline anisotropy, and Dzyaloshinskii-Moriya (DM) interaction. Further, we found that by applying uniaxial tensile strain along crystallographic a and b-axis, LaCrS3 exhibits a magnetic transition to a semi-conducting FM ground state, while compression gives rise to the realization of novel gapless semiconducting antiferromagnetic ground state.


title: Evaluation of the Leggett-Garg inequality by means of the neutrino oscillations observed in reactor and accelerator experiments

abstract: We revisit the study of the violation of the Leggett-Garg inequality in neutrino oscillation data as a mean to test some of the fundamental aspects of quantum mechanics. In particular, we consider the results by the Daya Bay and RENO reactor experiments, and the MINOS and NOvA accelerator experiments. We find that DB and MINOS exhibit a strong manifestation of Leggett-Garg violation, while for RENO and NOvA data the indication is weaker. Considering the particular baselines and energy ranges explored by each experiment, our results demonstrate that the Leggett-Garg violation is more evident for smaller baseline-to-energy ratio in all the data sets considered, a relevant aspect to be considered when searching for evidences of quantum mechanical decoherence on neutrino oscillations.


title: Image Super-resolution Reconstruction Network based on Enhanced Swin Transformer via Alternating Aggregation of Local-Global Features

abstract: The Swin Transformer image super-resolution reconstruction network only relies on the long-range relationship of window attention and shifted window attention to explore features. This mechanism has two limitations. On the one hand, it only focuses on global features while ignoring local features. On the other hand, it is only concerned with spatial feature interactions while ignoring channel features and channel interactions, thus limiting its non-linear mapping ability. To address the above limitations, this paper proposes enhanced Swin Transformer modules via alternating aggregation of local-global features. In the local feature aggregation stage, we introduce a shift convolution to realize the interaction between local spatial information and channel information. Then, a block sparse global perception module is introduced in the global feature aggregation stage. In this module, we reorganize the spatial information first, then send the recombination information into a dense layer to implement the global perception. After that, a multi-scale self-attention module and a low-parameter residual channel attention module are introduced to realize information aggregation at different scales. Finally, the proposed network is validated on five publicly available datasets. The experimental results show that the proposed network outperforms the other state-of-the-art super-resolution networks.


title: Laboratory Experiments of Model-based Reinforcement Learning for Adaptive Optics Control

abstract: Direct imaging of Earth-like exoplanets is one of the most prominent scientific drivers of the next generation of ground-based telescopes. Typically, Earth-like exoplanets are located at small angular separations from their host stars, making their detection difficult. Consequently, the adaptive optics (AO) system's control algorithm must be carefully designed to distinguish the exoplanet from the residual light produced by the host star. A new promising avenue of research to improve AO control builds on data-driven control methods such as Reinforcement Learning (RL). RL is an active branch of the machine learning research field, where control of a system is learned through interaction with the environment. Thus, RL can be seen as an automated approach to AO control, where its usage is entirely a turnkey operation. In particular, model-based reinforcement learning (MBRL) has been shown to cope with both temporal and misregistration errors. Similarly, it has been demonstrated to adapt to non-linear wavefront sensing while being efficient in training and execution. In this work, we implement and adapt an RL method called Policy Optimization for AO (PO4AO) to the GHOST test bench at ESO headquarters, where we demonstrate a strong performance of the method in a laboratory environment. Our implementation allows the training to be performed parallel to inference, which is crucial for on-sky operation. In particular, we study the predictive and self-calibrating aspects of the method. The new implementation on GHOST running PyTorch introduces only around 700 microseconds in addition to hardware, pipeline, and Python interface latency. We open-source well-documented code for the implementation and specify the requirements for the RTC pipeline. We also discuss the important hyperparameters of the method, the source of the latency, and the possible paths for a lower latency implementation.


title: Uncertainty-Penalized Reinforcement Learning from Human Feedback with Diverse Reward LoRA Ensembles

abstract: Reinforcement learning from human feedback (RLHF) emerges as a promising paradigm for aligning large language models (LLMs). However, a notable challenge in RLHF is overoptimization, where beyond a certain threshold, the pursuit of higher rewards leads to a decline in human preferences. In this paper, we observe the weakness of KL regularization which is commonly employed in existing RLHF methods to address overoptimization. To mitigate this limitation, we scrutinize the RLHF objective in the offline dataset and propose uncertainty-penalized RLHF (UP-RLHF), which incorporates uncertainty regularization during RL-finetuning. To enhance the uncertainty quantification abilities for reward models, we first propose a diverse low-rank adaptation (LoRA) ensemble by maximizing the nuclear norm of LoRA matrix concatenations. Then we optimize policy models utilizing penalized rewards, determined by both rewards and uncertainties provided by the diverse reward LoRA ensembles. Our experimental results, based on two real human preference datasets, showcase the effectiveness of diverse reward LoRA ensembles in quantifying reward uncertainty. Additionally, uncertainty regularization in UP-RLHF proves to be pivotal in mitigating overoptimization, thereby contributing to the overall performance.


title: Non-smoothable $\mathbb{Z}/p$-actions on nuclei

abstract: In this article we construct examples of non-smoothable $\mathbb{Z}/p$-actions on indefinite spin 4-manifolds with boundary for all primes $p\geq 5$. For example, we show that for each prime $p\geq 5$ and each $n\geq 1$ there exists a locally linear $\mathbb{Z}/p$-action on the Gompf nucleus $N(2pn)$ which is not smoothable with respect to any smooth structure on $N(2pn)$. Furthermore we investigate the behavior of these actions under two different types of equivariant stabilizations with $S^{2}\times S^{2}$, namely \emph{free} and \emph{homologically trivial} stabilizations -- in particular we show that our non-smoothable $\mathbb{Z}/p$-action on $N(2pn)$ remains non-smoothable after $2n-2$ free stabilizations, and after arbitrarily many homologically trivial stabilizations. We also show that free stabilizations satisfy a Wall stabilization principle in the sense that any non-smoothable $\mathbb{Z}/p$-action becomes smoothable after some finite number free stabilizations (under certain assumptions), whereas our aforementioned result implies that homologically trivial stabilizations do not satisfy this property. The proofs of these results use equivariant $\kappa$-invariants defined by the author in \cite{Mon22}, calculations of equivariant $\eta$-invariants for the odd signature and Dirac operators on Seifert-fibered spaces, as well as an analysis of the geometric $S^{1}$-action on the Seiberg-Witten moduli spaces of Seifert-fibered spaces induced by rotation in the fibers, which may be of independent interest.


title: Alternative Approaches for Estimating Highest-Density Regions

abstract: Among the variety of statistical intervals, highest-density regions (HDRs) stand out for their ability to effectively summarize a distribution or sample, unveiling its distinctive and salient features. An HDR represents the minimum size set that satisfies a certain probability coverage, and current methods for their computation require knowledge or estimation of the underlying probability distribution or density $f$. In this work, we illustrate a broader framework for computing HDRs, which generalizes the classical density quantile method introduced in the seminal paper of Hyndman (1996). The framework is based on neighbourhood measures, i.e., measures that preserve the order induced in the sample by $f$, and include the density $f$ as a special case. We explore a number of suitable distance-based measures, such as the $k$-nearest neighborhood distance, and some probabilistic variants based on copula models. An extensive comparison is provided, showing the advantages of the copula-based strategy, especially in those scenarios that exhibit complex structures (e.g., multimodalities or particular dependencies). Finally, we discuss the practical implications of our findings for estimating HDRs in real-world applications.


title: Boosting Large Language Model for Speech Synthesis: An Empirical Study

abstract: Large language models (LLMs) have made significant advancements in natural language processing and are concurrently extending the language ability to other modalities, such as speech and vision. Nevertheless, most of the previous work focuses on prompting LLMs with perception abilities like auditory comprehension, and the effective approach for augmenting LLMs with speech synthesis capabilities remains ambiguous. In this paper, we conduct a comprehensive empirical exploration of boosting LLMs with the ability to generate speech, by combining pre-trained LLM LLaMA/OPT and text-to-speech synthesis model VALL-E. We compare three integration methods between LLMs and speech synthesis models, including directly fine-tuned LLMs, superposed layers of LLMs and VALL-E, and coupled LLMs and VALL-E using LLMs as a powerful text encoder. Experimental results show that, using LoRA method to fine-tune LLMs directly to boost the speech synthesis capability does not work well, and superposed LLMs and VALL-E can improve the quality of generated speech both in speaker similarity and word error rate (WER). Among these three methods, coupled methods leveraging LLMs as the text encoder can achieve the best performance, making it outperform original speech synthesis models with a consistently better speaker similarity and a significant (10.9%) WER reduction.


title: Probing the Limits and Capabilities of Diffusion Models for the Anatomic Editing of Digital Twins

abstract: Numerical simulations can model the physical processes that govern cardiovascular device deployment. When such simulations incorporate digital twins; computational models of patient-specific anatomy, they can expedite and de-risk the device design process. Nonetheless, the exclusive use of patient-specific data constrains the anatomic variability which can be precisely or fully explored. In this study, we investigate the capacity of Latent Diffusion Models (LDMs) to edit digital twins to create anatomic variants, which we term digital siblings. Digital twins and their corresponding siblings can serve as the basis for comparative simulations, enabling the study of how subtle anatomic variations impact the simulated deployment of cardiovascular devices, as well as the augmentation of virtual cohorts for device assessment. However, while diffusion models have been characterized in their ability to edit natural images, their capacity to anatomically edit digital twins has yet to be studied. Using a case example centered on 3D digital twins of cardiac anatomy, we implement various methods for generating digital siblings and characterize them through morphological and topological analyses. We specifically edit digital twins to introduce anatomic variation at different spatial scales and within localized regions, demonstrating the existence of bias towards common anatomic features. We further show that such anatomic bias can be leveraged for virtual cohort augmentation through selective editing, partially alleviating issues related to dataset imbalance and lack of diversity. Our experimental framework thus delineates the limits and capabilities of using latent diffusion models in synthesizing anatomic variation for in silico trials.


title: Promoting Segment Anything Model towards Highly Accurate Dichotomous Image Segmentation

abstract: The Segment Anything Model (SAM) represents a significant breakthrough into foundation models for computer vision, providing a large-scale image segmentation model. However, despite SAM's zero-shot performance, its segmentation masks lack fine-grained details, particularly in accurately delineating object boundaries. We have high expectations regarding whether SAM, as a foundation model, can be improved towards highly accurate object segmentation, which is known as dichotomous image segmentation (DIS). To address this issue, we propose DIS-SAM, which advances SAM towards DIS with extremely accurate details. DIS-SAM is a framework specifically tailored for highly accurate segmentation, maintaining SAM's promptable design. DIS-SAM employs a two-stage approach, integrating SAM with a modified IS-Net dedicated to DIS. Despite its simplicity, DIS-SAM demonstrates significantly enhanced segmentation accuracy compared to SAM and HQ-SAM.


title: Forecasting CPI inflation under economic policy and geo-political uncertainties

abstract: Forecasting a key macroeconomic variable, consumer price index (CPI) inflation, for BRIC countries using economic policy uncertainty and geopolitical risk is a difficult proposition for policymakers at the central banks. This study proposes a novel filtered ensemble wavelet neural network (FEWNet) that can produce reliable long-term forecasts for CPI inflation. The proposal applies a maximum overlapping discrete wavelet transform to the CPI inflation series to obtain high-frequency and low-frequency signals. All the wavelet-transformed series and filtered exogenous variables are fed into downstream autoregressive neural networks to make the final ensemble forecast. Theoretically, we show that FEWNet reduces the empirical risk compared to single, fully connected neural networks. We also demonstrate that the rolling-window real-time forecasts obtained from the proposed algorithm are significantly more accurate than benchmark forecasting methods. Additionally, we use conformal prediction intervals to quantify the uncertainty associated with the forecasts generated by the proposed approach. The excellent performance of FEWNet can be attributed to its capacity to effectively capture non-linearities and long-range dependencies in the data through its adaptable architecture.


title: In-medium mass shift of two-flavored heavy mesons, $B_c$, $B^*_c$, $B_s$, $B^*_s$, $D_s$ and $D^*_s$

abstract: For the first time, we estimate the in-medium mass shift of the two-flavored heavy mesons $B_c, B_c^*, B_s, B_s^*, D_s$ and $D_s^*$ in symmetric nuclear matter. The estimates are made by evaluating the lowest order one-loop self-energies. The enhanced excitations of intermediate state heavy-light mesons in symmetric nuclear matter are the origin of their negative mass shift. Our results show that the magnitude of the mass shift for the $B_c$ meson ($\bar{b} c$ or $b \bar{c}$) is larger than those of the $\eta_c (\bar{c} c)$ and $\eta_b (\bar{b} b)$, different from a naive expectation that it would be in-between of them. While, that of the $B_c^*$ shows the in-between of the $J/\psi$ and $\Upsilon$. We observe that the lighter vector meson excitation in each meson self-energy gives a dominant contribution for the corresponding meson mass shift, $B_c, B_s,$ and $D_s$.


title: The Impact of Thermosolutal Convection on Melting Dynamics of Nano-enhanced Phase Change Materials (NePCM)

abstract: Nanoparticle-Enhanced Phase Change Materials (NePCM) have been a subject of intensive research owing to their potential for enhanced thermo-physical properties. However, their behavior during phase change processes, such as melting or solidification, remains inadequately understood\@. This investigation focuses on the melting process of NePCM in a square cavity, exploring distinct cases of melting from both the top and bottom sides. The NePCM comprises copper nanoparticles (2 nm in size) suspended in water. Our study involves different combinations of constant temperature boundary conditions and particle volume fractions\@. Utilizing a numerical model based on the one-fluid mixture approach combined with the single-domain enthalpy-porosity model, we account for the phase change process and particles' interaction with the solid-liquid interface. When melting NePCM from the top side, convection effects are suppressed, resulting in a melting process primarily governed by conduction. Both NePCM and pure water melt at the same rate under these conditions. However, melting NePCM from the bottom side induces convection-dominated melting. For pure water, thermal convection leads to the formation of convection cells during melting. Contrastingly, melting NePCM triggers thermosolutal convection due to temperature and particle concentration gradients. The flow cells formed from thermosolutal convection in NePCM differ from those in pure water driven by pure thermal convection. Our simulations reveal that thermosolutal convection contributes to decelerating the solid-liquid interface, thereby prolonging NePCM melting compared to pure water. Surprisingly, the viscosity increase in NePCM plays a minimal role in the deceleration process, contrary to prior literature attributing slow-downs of the melting process of the NePCM primarily to increased viscosity.


title: Cluster algebras and monotone Lagrangian tori

abstract: Motivated by recent developments in the construction of Newton--Okounkov bodies and toric degenerations via cluster algebras in [GHKK18, FO20], we consider a family of Newton--Okounkov polytopes of a complex smooth projective variety $X$ related by a composition of tropicalized cluster mutations. According to the work of [HK15], the toric degeneration associated with each Newton--Okounkov polytope $\Delta$ in the family produces a Lagrangian torus fibration of $X$ over $\Delta$. We investigate circumstances in which each Lagrangian torus fibration possesses a monotone Lagrangian torus fiber. We provide a sufficient condition, based on the data of tropical integer points and exchange matrices, for the family of constructed monotone Lagrangian tori to contain infinitely many monotone Lagrangian tori, no two of which are related by any symplectomorphisms. By employing this criterion and exploiting the correspondence between the tropical integer points and the dual canonical basis elements, we generate infinitely many distinct monotone Lagrangian tori on flag manifolds of arbitrary type except in a few cases.


title: The maximum sum of sizes of non-empty cross $t$-intersecting families

abstract: Let $[n]:=\lbrace 1,2,\ldots,n \rbrace$, and $M$ be a set of positive integers. Denote the family of all subsets of $[n]$ with sizes in $M$ by $\binom{\left[n\right]}{M}$. The non-empty families $\mathcal{A}\subseteq\binom{\left[n\right]}{R}$ and $\mathcal{B}\subseteq \binom{\left[n\right]}{S}$ are said to be cross $t$-intersecting if $|A\cap B|\geq t$ for all $A\in \mathcal{A}$ and $B\in \mathcal{B}$. In this paper, we determine the maximum sum of sizes of non-empty cross $t$-intersecting families, and characterize the extremal families. Similar result for finite vector spaces is also proved.


title: Morphing Tokens Draw Strong Masked Image Models

abstract: Masked image modeling (MIM) is a promising option for training Vision Transformers among various self-supervised learning (SSL) methods. The essence of MIM lies in token-wise masked token predictions, with targets tokenized from images or generated by pre-trained models such as vision-language models. While tokenizers or pre-trained models are plausible MIM targets, they often offer spatially inconsistent targets even for neighboring tokens, complicating models to learn unified discriminative representations. Our pilot study confirms that addressing spatial inconsistencies has the potential to enhance representation quality. Motivated by the findings, we introduce a novel self-supervision signal called Dynamic Token Morphing (DTM), which dynamically aggregates contextually related tokens to yield contextualized targets. DTM is compatible with various SSL frameworks; we showcase an improved MIM by employing DTM, barely introducing extra training costs. Our experiments on ImageNet-1K and ADE20K demonstrate the superiority of our methods compared with state-of-the-art, complex MIM methods. Furthermore, the comparative evaluation of the iNaturalists and fine-grained visual classification datasets further validates the transferability of our method on various downstream tasks. Code is available at https://github.com/naver-ai/dtm


title: Adaptive Rank-based Tests for High Dimensional Mean Problems

abstract: The Wilcoxon signed-rank test and the Wilcoxon-Mann-Whitney test are commonly employed in one sample and two sample mean tests for one-dimensional hypothesis problems. For high-dimensional mean test problems, we calculate the asymptotic distribution of the maximum of rank statistics for each variable and suggest a max-type test. This max-type test is then merged with a sum-type test, based on their asymptotic independence offered by stationary and strong mixing assumptions. Our numerical studies reveal that this combined test demonstrates robustness and superiority over other methods, especially for heavy-tailed distributions.


title: Hypergeometric-Type Sequences

abstract: We introduce hypergeometric-type sequences. They are linear combinations of interlaced hypergeometric sequences (of arbitrary interlacements). We prove that they form a subring of the ring of holonomic sequences. An interesting family of sequences in this class are those defined by trigonometric functions with linear arguments in the index and $\pi$, such as Chebyshev polynomials, $\left(\sin^2\left(n\,\pi/4\right)\cdot\cos\left(n\,\pi/6\right)\right)_n$, and compositions like $\left(\sin\left(\cos(n\pi/3)\pi\right)\right)_n$. We describe an algorithm that computes a hypergeometric-type normal form of a given holonomic $n\text{th}$ term whenever it exists. Our implementation enables us to generate several identities for terms defined via trigonometric functions.


title: Assessing replication success via skeptical mixture priors

abstract: There is a growing interest in the analysis of replication studies of original findings across many disciplines. When testing a hypothesis for an effect size, two Bayesian approaches stand out for their principled use of the Bayes factor (BF), namely the replication BF and the skeptical BF. In particular, the latter BF is based on the skeptical prior, which represents the opinion of an investigator who is unconvinced by the original findings and wants to challenge them. We embrace the skeptical perspective, and elaborate a novel mixture prior which incorporates skepticism while at the same time controlling for prior-data conflict within the original data. Consistency properties of the resulting skeptical mixture BF are provided together with an extensive analysis of the main features of our proposal. Finally, we apply our methodology to data from the Social Sciences Replication Project. In particular we show that, for some case studies where prior-data conflict is an issue, our method uses a more realistic prior and leads to evidence-classification for replication success which differs from the standard skeptical approach.


title: Phase diagram and critical behavior of Hubbard model on the square-hexagon-octagon lattice

abstract: Employing the projective formalism of determinant quantum Monte Carlo (DQMC) simulations, we meticulously explore the ground-state phase diagram and critical behavior of the half-filled Hubbard model on a square-hexagon-octagon (SHO) lattice. This lattice, a two-dimensional (2D) structure comprising squares, hexagons, and octagons, is representative of the biphenylene network (BPN). Our findings reveal an intriguing ground-state phase diagram, featuring an antiferromagnetic (AFM) Mott insulating phase enveloped by three valence-bond solid-like (VBS-like) insulating phases. Analyzing the single-particle gap, spin gap, and single-particle spectral function, we observe that the metallic state in the noninteracting case becomes unstable under the influence of Hubbard U. This interaction drives the system into a hexagon insulating phase before transitioning into an AFM Mott insulating phase. To quantify the critical exponents, we use finite-size scaling techniques. The critical exponents of quantum critical points between the AFM Mott insulating phase and two insulating phases, plaquette insulator and ethylene insulator, closely align with the 3D O(3) universality class. However, the critical exponents of quantum critical points between the hexagon insulating phase and the AFM Mott insulating phase deviate from the 3D O(3) universality class. This deviation is a finite-size effect and can be attributed to the coupling between the fluctuations of magnetic order parameter and very low-energy fermionic excitations. Our comprehensive study not only advances the understanding of correlation effects on the SHO lattice but also sheds light on the less-explored critical exponents in weakly insulating quantum critical point.


title: Ultrafast X-ray Diffraction Probe of Coherent Spin-state Dynamics in Molecules

abstract: We propose an approach to probe coherent spin-state dynamics of molecules using circularly polarized hard x-ray pulses. For the dynamically aligned nitric oxide molecules in a coherent superposition spin-orbit coupled electronic state that can be prepared through stimulated Raman scattering, we demonstrate the capability of ultrafast x-ray diffraction to not only reveal the quantum beating of the coherent spin-state wave packet, but also image the spatial spin density of the molecule. With circularly polarized ultrafast x-ray diffraction signal, we show that the electronic density matrix can be retrieved. The spatio-temporal resolving power of ultrafast x-ray diffraction paves the way for tracking transient spatial wave function in molecular dynamics involving spin degree of freedom.


title: GazeCLIP: Towards Enhancing Gaze Estimation via Text Guidance

abstract: Over the past decade, visual gaze estimation has garnered increasing attention within the research community, owing to its wide-ranging application scenarios. While existing estimation approaches have achieved remarkable success in enhancing prediction accuracy, they primarily infer gaze from single-image signals, neglecting the potential benefits of the currently dominant text guidance. Notably, visual-language collaboration has been extensively explored across various visual tasks, such as image synthesis and manipulation, leveraging the remarkable transferability of large-scale Contrastive Language-Image Pre-training (CLIP) model. Nevertheless, existing gaze estimation approaches overlook the rich semantic cues conveyed by linguistic signals and the priors embedded in CLIP feature space, thereby yielding performance setbacks. To address this gap, we delve deeply into the text-eye collaboration protocol and introduce a novel gaze estimation framework, named GazeCLIP. Specifically, we intricately design a linguistic description generator to produce text signals with coarse directional cues. Additionally, a CLIP-based backbone that excels in characterizing text-eye pairs for gaze estimation is presented. This is followed by the implementation of a fine-grained multi-modal fusion module aimed at modeling the interrelationships between heterogeneous inputs. Extensive experiments on three challenging datasets demonstrate the superiority of the proposed GazeCLIP which achieves the state-of-the-art accuracy.


title: Robust fluctuation-based super-resolution microscopy in a confocal architecture

abstract: Record-holding super-resolution microscopy (SRM) techniques, e.g. localization microscopy (LM) and stimulated-emission-depletion (STED) microscopy, require significant resources and effort from life-science researchers. In comparison with confocal microscopy, apart from relying on extensive sample-staining procedures and long acquisition times, applying LM for 3D and multicolor imaging poses a considerable experimental challenge. In the current work, we provide a complete demonstration of an entry-level SRM technique - providing super-resolving capabilities with an experimental complexity level akin to that of confocal microscopy. Exchanging the confocal pinhole with a small pixelated detector, we use the inherent fluctuations of dye molecules as contrast for SRM. This contrast is processed into a super-resolved image through a process of pixel reassignment, a robust and deterministic algorithm. Since the fluctuation contrast is ubiquitous to organic markers, it does not require engineering of the blinking statistics through the sample buffer. Together with the built-in capabilities for multi-color and 3D imaging, shown in our work, it can become a natural extension to confocal microscopy - a straightforward first step into the realm of SRM.


title: Finiteness conjecture for 3-manifolds obtained from handlebodies by attaching 2-handles

abstract: We study a generalized Witten's finiteness conjecture for the skein modules of oriented compact 3-manifolds with boundary. We formulate an equivalent version of the generalized finiteness conjecture using handlebodies and 2-handles, and prove the conjecture for some classes with the handlebodies of genus 2 and 3 using the equivalent version.


title: A framework for the valuation of insurance liabilities by production cost

abstract: This paper sets out a framework for the valuation of insurance liabilities that is intended to be economically realistic, elementary, reasonably practically applicable, and as a special case to provide a basis for the valuation in regulatory solvency systems such as Solvency II and the SST. The valuation framework is based on the cost of producing the liabilities to an insurance company that is subject to solvency regulation (regulatory solvency capital requirements) and insolvency laws (consequences of failure) in finite discrete time. Starting from the replication approach of classical no-arbitrage theory, the framework additionally considers the nature and cost of capital (expressed by a ``financiability condition"), that the liabilities may be required to be fulfilled only ``in sufficiently many cases" (expressed by a ``fulfillment condition"), production using ``fully illiquid" assets in addition to tradables, and the asymmetry between assets and liabilities. We identify necessary and sufficient conditions on the capital investment under which the framework recovers the market prices of tradables, investigate extending production to take account of insolvency, implications of using illiquid assets in the production, and show how Solvency II and SST valuation can be derived with specific assumptions.


title: Identification of Nonlinear Dynamic Panels under Partial Stationarity

abstract: This paper studies identification for a wide range of nonlinear panel data models, including binary choice, ordered response, and other types of limited dependent variable models. Our approach accommodates dynamic models with any number of lagged dependent variables as well as other types of (potentially contemporary) endogeneity. Our identification strategy relies on a partial stationarity condition, which not only allows for an unknown distribution of errors but also for temporal dependencies in errors. We derive partial identification results under flexible model specifications and provide additional support conditions for point identification. We demonstrate the robust finite-sample performance of our approach using Monte Carlo simulations, and apply the approach to analyze the empirical application of income categories using various ordered choice models.


title: An unconventional platform for two-dimensional Kagome flat bands on semiconductor surfaces

abstract: In condensed matter physics, the Kagome lattice and its inherent flat bands have attracted considerable attention for their potential to host a variety of exotic physical phenomena. Despite extensive efforts to fabricate thin films of Kagome materials aimed at modulating the flat bands through electrostatic gating or strain manipulation, progress has been limited. Here, we report the observation of a novel $d$-orbital hybridized Kagome-derived flat band in Ag/Si(111) $\sqrt{3}\times\sqrt{3}$ as revealed by angle-resolved photoemission spectroscopy. Our findings indicate that silver atoms on a silicon substrate form a Kagome-like structure, where a delicate balance in the hopping parameters of the in-plane $d$-orbitals leads to destructive interference, resulting in a flat band. These results not only introduce a new platform for Kagome physics but also illuminate the potential for integrating metal-semiconductor interfaces into Kagome-related research, thereby opening a new avenue for exploring ideal two-dimensional Kagome systems.


title: Two-cardinal derived topologies, indescribability and Ramseyness

abstract: We introduce a natural two-cardinal version of Bagaria's sequence of derived topologies on ordinals. We prove that for our sequence of two-cardinal derived topologies, limit points of sets can be characterized in terms of a new iterated form of pairwise simultaneous reflection of certain kinds of stationary sets, the first few instances of which are often equivalent to notions related to strong stationarity, which has been studied previously in the context of strongly normal ideals. The non-discreteness of these two-cardinal derived topologies can be obtained from certain two-cardinal indescribability hypotheses, which follow from local instances of supercompactness. Additionally, we answer several questions posed by the first author, Peter Holy and Philip White on the relationship between Ramseyness and indescribability in both the cardinal context and in the two-cardinal context.


title: Hidden Conformal Symmetry from Eight Flavors

abstract: This proceedings paper extends the scope of our conference talk, where we presented a comprehensive analysis of newly expanded and refined lattice data concerning the SU(3) gauge theory with Nf = 8 light Dirac fermions - a theory positioned near the conformal window boundary. The analysis presented here makes use of a dilaton effective field theory and we delve deeper into the intricacies of the dilaton potential. We aim to clarify the connection between parameters appearing the potential and properties of the underlying gauge theory.


title: COMMA: Co-Articulated Multi-Modal Learning

abstract: Pretrained large-scale vision-language models such as CLIP have demonstrated excellent generalizability over a series of downstream tasks. However, they are sensitive to the variation of input text prompts and need a selection of prompt templates to achieve satisfactory performance. Recently, various methods have been proposed to dynamically learn the prompts as the textual inputs to avoid the requirements of laboring hand-crafted prompt engineering in the fine-tuning process. We notice that these methods are suboptimal in two aspects. First, the prompts of the vision and language branches in these methods are usually separated or uni-directionally correlated. Thus, the prompts of both branches are not fully correlated and may not provide enough guidance to align the representations of both branches. Second, it's observed that most previous methods usually achieve better performance on seen classes but cause performance degeneration on unseen classes compared to CLIP. This is because the essential generic knowledge learned in the pretraining stage is partly forgotten in the fine-tuning process. In this paper, we propose Co-Articulated Multi-Modal Learning (COMMA) to handle the above limitations. Especially, our method considers prompts from both branches to generate the prompts to enhance the representation alignment of both branches. Besides, to alleviate forgetting about the essential knowledge, we minimize the feature discrepancy between the learned prompts and the embeddings of hand-crafted prompts in the pre-trained CLIP in the late transformer layers. We evaluate our method across three representative tasks of generalization to novel classes, new target datasets and unseen domain shifts. Experimental results demonstrate the superiority of our method by exhibiting a favorable performance boost upon all tasks with high efficiency.


title: Sample Robust Scheduling of Electricity-Gas Systems Under Wind Power Uncertainty

abstract: This paper adopts a two-stage sample robust optimization (SRO) model to address the wind power penetrated unit commitment optimal energy flow (UC-OEF) problem for IEGSs. The two-stage SRO model can be approximately transformed into a computationally efficient form. Specifically, we employ linear decision rules to simplify the proposed UC-OEF model. Moreover, we further enhance the tractability of the simplified model by exploring its structural features and, accordingly, develop a solution method.


title: A number-theoretic problem concerning pseudo-real Riemann surfaces

abstract: Motivated by their research on automorphism groups of pseudo-real Riemann surfaces, Bujalance, Cirre and Conder have conjectured that there are infinitely many primes $p$ such that $p+2$ has all its prime factors $q\equiv -1$ mod~$(4)$. We use theorems of Landau and Raikov to prove that the number of integers $n\le x$ with only such prime factors $q$ is asymptotic to $cx/\sqrt{\ln x}$ for a specific constant $c=0.4865\ldots$. Heuristic arguments, following Hardy and Littlewood, then yield a conjecture that the number of such primes $p\le x$ is asymptotic to $c'\int_2^x(\ln t)^{-3/2}dt$ for a constant $c'=0.8981\ldots$. The theorem, the conjecture and a similar conjecture applying the Bateman--Horn Conjecture to other pseudo-real Riemann surfaces are supported by evidence from extensive computer searches.


title: HybridGait: A Benchmark for Spatial-Temporal Cloth-Changing Gait Recognition with Hybrid Explorations

abstract: Existing gait recognition benchmarks mostly include minor clothing variations in the laboratory environments, but lack persistent changes in appearance over time and space. In this paper, we propose the first in-the-wild benchmark CCGait for cloth-changing gait recognition, which incorporates diverse clothing changes, indoor and outdoor scenes, and multi-modal statistics over 92 days. To further address the coupling effect of clothing and viewpoint variations, we propose a hybrid approach HybridGait that exploits both temporal dynamics and the projected 2D information of 3D human meshes. Specifically, we introduce a Canonical Alignment Spatial-Temporal Transformer (CA-STT) module to encode human joint position-aware features, and fully exploit 3D dense priors via a Silhouette-guided Deformation with 3D-2D Appearance Projection (SilD) strategy. Our contributions are twofold: we provide a challenging benchmark CCGait that captures realistic appearance changes across an expanded and space, and we propose a hybrid framework HybridGait that outperforms prior works on CCGait and Gait3D benchmarks. Our project page is available at https://github.com/HCVLab/HybridGait.


title: Dual-space Hierarchical Learning for Goal-guided Conversational Recommendation

abstract: Proactively and naturally guiding the dialog from the non-recommendation context (e.g., Chit-chat) to the recommendation scenario (e.g., Music) is crucial for the Conversational Recommender System (CRS). Prior studies mainly focus on planning the next dialog goal~(e.g., chat on a movie star) conditioned on the previous dialog. However, we find the dialog goals can be simultaneously observed at different levels, which can be utilized to improve CRS. In this paper, we propose Dual-space Hierarchical Learning (DHL) to leverage multi-level goal sequences and their hierarchical relationships for conversational recommendation. Specifically, we exploit multi-level goal sequences from both the representation space and the optimization space. In the representation space, we propose the hierarchical representation learning where a cross attention module derives mutually enhanced multi-level goal representations. In the optimization space, we devise the hierarchical weight learning to reweight lower-level goal sequences, and introduce bi-level optimization for stable update. Additionally, we propose a soft labeling strategy to guide optimization gradually. Experiments on two real-world datasets verify the effectiveness of our approach. Code and data are available here.


title: Investigating Zero-Shot Generalizability on Mandarin-English Code-Switched ASR and Speech-to-text Translation of Recent Foundation Models with Self-Supervision and Weak Supervision

abstract: This work evaluated several cutting-edge large-scale foundation models based on self-supervision or weak supervision, including SeamlessM4T, SeamlessM4T v2, and Whisper-large-v3, on three code-switched corpora. We found that self-supervised models can achieve performances close to the supervised model, indicating the effectiveness of multilingual self-supervised pre-training. We also observed that these models still have room for improvement as they kept making similar mistakes and had unsatisfactory performances on modeling intra-sentential code-switching. In addition, the validity of several variants of Whisper was explored, and we concluded that they remained effective in a code-switching scenario, and similar techniques for self-supervised models are worth studying to boost the performance of code-switched tasks.


title: Quadratic scaling path integral molecular dynamics for fictitious identical particles and its application to fermion systems

abstract: Recently, fictitious identical particles have provided a promising way to overcome the fermion sign problem and have been used in path integral Monte Carlo (PIMC) to accurately simulate warm dense matter with up to 1000 electrons (T. Dornheim et al., arXiv:2311.08098 (2023)). The inclusion of fictitious identical particles in path integral molecular dynamics (PIMD) can provide another way to simulate fermion systems. In a recent paper (J. Chem. Phys. 159, 154107 (2023)), Feldman and Hirshberg improved the recursive formula for PIMD of N identical bosons, significantly reducing the computational complexity from $O(PN^3)$ to $O(N^2+PN)$. In this paper, we extend this latest recursive formula for bosons to PIMD of fictitious identical particles to improve the efficiency of simulating fermion systems. We also provide the virial estimator for calculating energy by using the recursive technique. As an example, we use the quadratic scaling PIMD for fictitious identical particles to study the simulation of hundreds of fermions in a two-dimensional periodic potential, in the hope of providing a simulation tool for two-dimensional Fermi-Hubbard model and other strongly correlated fermion systems, such as the simulation of ultracold fermionic gases in optical lattices.

categories: cond-mat.quant-gas cond-mat.str-el physics.chem-ph physics.comp-ph


title: An $\ell^1$-Plug-and-Play Approach for MPI Using a Zero Shot Denoiser with Evaluation on the 3D Open MPI Dataset

abstract: Objective: Magnetic particle imaging (MPI) is an emerging medical imaging modality which has gained increasing interest in recent years. Among the benefits of MPI are its high temporal resolution, and that the technique does not expose the specimen to any kind of ionizing radiation. It is based on the non-linear response of magnetic nanoparticles to an applied magnetic field. From the electric signal measured in receive coils, the particle concentration has to be reconstructed. Due to the ill-posedness of the reconstruction problem, various regularization methods have been proposed for reconstruction ranging from early stopping methods, via classical Tikhonov regularization and iterative methods to modern machine learning approaches. In this work, we contribute to the latter class: we propose a plug-and-play approach based on a generic zero-shot denoiser with an $\ell^1$-prior. Approach: We validate the reconstruction parameters of the method on a hybrid dataset and compare it with the baseline Tikhonov, DIP and the previous PP-MPI, which is a plug-and-play method with denoiser trained on MPI-friendly data. Main results: We offer a quantitative and qualitative evaluation of the zero-shot plug-and-play approach on the 3D Open MPI dataset. Moreover, we show the quality of the approach with different levels of preprocessing of the data. Significance: The proposed method employs a zero-shot denoiser which has not been trained for the MPI task and therefore saves the cost for training. Moreover, it offers a method that can be potentially applied in future MPI contexts.


title: Second-Order Uncertainty Quantification: Variance-Based Measures

abstract: Uncertainty quantification is a critical aspect of machine learning models, providing important insights into the reliability of predictions and aiding the decision-making process in real-world applications. This paper proposes a novel way to use variance-based measures to quantify uncertainty on the basis of second-order distributions in classification problems. A distinctive feature of the measures is the ability to reason about uncertainties on a class-based level, which is useful in situations where nuanced decision-making is required. Recalling some properties from the literature, we highlight that the variance-based measures satisfy important (axiomatic) properties. In addition to this axiomatic approach, we present empirical results showing the measures to be effective and competitive to commonly used entropy-based measures.


title: Ultracold Neutrons in the Low Curvature Limit: Remarks on the post-Newtonian effects

abstract: Ultracold neutrons are great experimental tools to explore the gravitational interaction in the regime of quantized states. From a theoretical perspective, starting from a Dirac equation in curved spacetime, we applied a perturbative scheme to systematically derive the non-relativistic Schr\"odinger equation that governs the evolution of the neutron's wave function in the Earth's gravitational field. At the lowest order, this procedure reproduces a Schr\"odinger system affected by a linear Newtonian potential, but corrections due to both curvature and relativistic effects are present. Here, we argue that one should be very careful when going one step further in the perturbative expansion. Proceeding methodically with the help of the Foldy-Wouthuysen transformation and a formal post-Newtonian $c^{-2}-$expansion, we derive the non-relativistic Hamiltonian for a generic static spacetime. By employing Fermi coordinates within this framework, we calculate the next-to-leading order corrections to the neutron's energy spectrum. Finally, we evaluate them for typical experimental configurations, such as that of qBOUNCE, and note that, while the current precision for observations of ultracold neutrons may not yet enable to probe them, they could still be relevant in the future or in alternative circumstances.


title: Intrinsic Shear and Galaxy Alignments: A Quantitative Study Using the TATT model

abstract: The intrinsic alignment (IA) of galaxies acts as a systematic effect in weak lensing measurements and tends to introduce biases. It mimics the gravitational lensing signal which makes it difficult to distinguish it from the true gravitational weak lensing effect. Hence, it is critical to account for the noise for correctly interpreting the results. This study aims at a quantitative analysis of IA using the Tidal Alignment and Tidal Torquing (TATT) model. We also investigate how the signals for shear and galaxy-galaxy lensing behave upon changing the parameters of the TATT model. The data for this study was prepared with a computational pipeline based on the Cocoa model to explore the parameter space of the intrinsic shape signal. Through this work, we identify that linear terms of the intrinsic shape signal are dominant in the case of GGL while the higher-order terms dictate the shear signal.


title: Dimension of the singular set for $2$-valued stationary Lipschitz graphs

abstract: We prove that the singular set of a $2$-valued Lipschitz graph that is stationary for the area is of codimension $1$.


title: Advancing TTP Analysis: Harnessing the Power of Encoder-Only and Decoder-Only Language Models with Retrieval Augmented Generation

abstract: Tactics, Techniques, and Procedures (TTPs) outline the methods attackers use to exploit vulnerabilities. The interpretation of TTPs in the MITRE ATT&CK framework can be challenging for cybersecurity practitioners due to presumed expertise, complex dependencies, and inherent ambiguity. Meanwhile, advancements with Large Language Models (LLMs) have led to recent surge in studies exploring its uses in cybersecurity operations. This leads us to question how well encoder-only (e.g., RoBERTa) and decoder-only (e.g., GPT-3.5) LLMs can comprehend and summarize TTPs to inform analysts of the intended purposes (i.e., tactics) of a cyberattack procedure. The state-of-the-art LLMs have shown to be prone to hallucination by providing inaccurate information, which is problematic in critical domains like cybersecurity. Therefore, we propose the use of Retrieval Augmented Generation (RAG) techniques to extract relevant contexts for each cyberattack procedure for decoder-only LLMs (without fine-tuning). We further contrast such approach against supervised fine-tuning (SFT) of encoder-only LLMs. Our results reveal that both the direct-use of decoder-only LLMs (i.e., its pre-trained knowledge) and the SFT of encoder-only LLMs offer inaccurate interpretation of cyberattack procedures. Significant improvements are shown when RAG is used for decoder-only LLMs, particularly when directly relevant context is found. This study further sheds insights on the limitations and capabilities of using RAG for LLMs in interpreting TTPs.


title: Dynamics of oscillator populations with disorder in the coupling phase shifts

abstract: We study populations of oscillators, all-to-all coupled by means of quenched disordered phase shifts. While there is no traditional synchronization transition with a nonvanishing Kuramoto order parameter, the system demonstrates a specific order as the coupling strength increases. This order is characterized by partial phase locking, which is put into evidence by the introduced correlation order parameter and via frequency entrainment. Simulations with phase oscillators, Stuart-Landau oscillators, and chaotic Roessler oscillators demonstrate similar scaling of the correlation order parameter with the coupling and the system size and also similar behavior of the frequencies with maximal entrainment at some finite coupling.


title: Deep Generative Symbolic Regression

abstract: Symbolic regression (SR) aims to discover concise closed-form mathematical equations from data, a task fundamental to scientific discovery. However, the problem is highly challenging because closed-form equations lie in a complex combinatorial search space. Existing methods, ranging from heuristic search to reinforcement learning, fail to scale with the number of input variables. We make the observation that closed-form equations often have structural characteristics and invariances (e.g., the commutative law) that could be further exploited to build more effective symbolic regression solutions. Motivated by this observation, our key contribution is to leverage pre-trained deep generative models to capture the intrinsic regularities of equations, thereby providing a solid foundation for subsequent optimization steps. We show that our novel formalism unifies several prominent approaches of symbolic regression and offers a new perspective to justify and improve on the previous ad hoc designs, such as the usage of cross-entropy loss during pre-training. Specifically, we propose an instantiation of our framework, Deep Generative Symbolic Regression (DGSR). In our experiments, we show that DGSR achieves a higher recovery rate of true equations in the setting of a larger number of input variables, and it is more computationally efficient at inference time than state-of-the-art RL symbolic regression solutions.


title: Near-Space Communications: the Last Piece of 6G Space-Air-Ground-Sea Integrated Network Puzzle

abstract: This article presents a comprehensive study on the emerging near-space communications (NS-COM) within the context of space-air-ground-sea integrated network (SAGSIN). Specifically, we firstly explore the recent technical developments of NS-COM, followed by the discussions about motivations behind integrating NS-COM into SAGSIN. To further demonstrate the necessity of NS-COM, a comparative analysis between the NS-COM network and other counterparts in SAGSIN is conducted, covering aspects of deployment, coverage, channel characteristics and unique problems of NS-COM network. Afterwards, the technical aspects of NS-COM, including channel modeling, random access, channel estimation, array-based beam management and joint network optimization, are examined in detail. Furthermore, we explore the potential applications of NS-COM, such as structural expansion in SAGSIN communication, civil aviation communication, remote and urgent communication, weather monitoring and carbon neutrality. Finally, some promising research avenues are identified, including stratospheric satellite (StratoSat) -to-ground direct links for mobile terminals, reconfigurable multiple-input multiple-output (MIMO) and holographic MIMO, federated learning in NS-COM networks, maritime communication, electromagnetic spectrum sensing and adversarial game, integrated sensing and communications, StratoSat-based radar detection and imaging, NS-COM assisted enhanced global navigation system, NS-COM assisted intelligent unmanned system and free space optical (FSO) communication. Overall, this paper highlights that the NS-COM plays an indispensable role in the SAGSIN puzzle, providing substantial performance and coverage enhancement to the traditional SAGSIN architecture.


title: Evaluation is all you need. Prompting Generative Large Language Models for Annotation Tasks in the Social Sciences. A Primer using Open Models

abstract: This paper explores the use of open generative Large Language Models (LLMs) for annotation tasks in the social sciences. The study highlights the challenges associated with proprietary models, such as limited reproducibility and privacy concerns, and advocates for the adoption of open (source) models that can be operated on independent devices. Two examples of annotation tasks, sentiment analysis in tweets and identification of leisure activities in childhood aspirational essays are provided. The study evaluates the performance of different prompting strategies and models (neural-chat-7b-v3-2, Starling-LM-7B-alpha, openchat_3.5, zephyr-7b-alpha and zephyr-7b-beta). The results indicate the need for careful validation and tailored prompt engineering. The study highlights the advantages of open models for data privacy and reproducibility.


title: BusReF: Infrared-Visible images registration and fusion focus on reconstructible area using one set of features

abstract: In a scenario where multi-modal cameras are operating together, the problem of working with non-aligned images cannot be avoided. Yet, existing image fusion algorithms rely heavily on strictly registered input image pairs to produce more precise fusion results, as a way to improve the performance of downstream high-level vision tasks. In order to relax this assumption, one can attempt to register images first. However, the existing methods for registering multiple modalities have limitations, such as complex structures and reliance on significant semantic information. This paper aims to address the problem of image registration and fusion in a single framework, called BusRef. We focus on Infrared-Visible image registration and fusion task (IVRF). In this framework, the input unaligned image pairs will pass through three stages: Coarse registration, Fine registration and Fusion. It will be shown that the unified approach enables more robust IVRF. We also propose a novel training and evaluation strategy, involving the use of masks to reduce the influence of non-reconstructible regions on the loss functions, which greatly improves the accuracy and robustness of the fusion task. Last but not least, a gradient-aware fusion network is designed to preserve the complementary information. The advanced performance of this algorithm is demonstrated by


title: Autonomous Threat Hunting: A Future Paradigm for AI-Driven Threat Intelligence

abstract: The evolution of cybersecurity has spurred the emergence of autonomous threat hunting as a pivotal paradigm in the realm of AI-driven threat intelligence. This review navigates through the intricate landscape of autonomous threat hunting, exploring its significance and pivotal role in fortifying cyber defense mechanisms. Delving into the amalgamation of artificial intelligence (AI) and traditional threat intelligence methodologies, this paper delineates the necessity and evolution of autonomous approaches in combating contemporary cyber threats. Through a comprehensive exploration of foundational AI-driven threat intelligence, the review accentuates the transformative influence of AI and machine learning on conventional threat intelligence practices. It elucidates the conceptual framework underpinning autonomous threat hunting, spotlighting its components, and the seamless integration of AI algorithms within threat hunting processes.. Insightful discussions on challenges encompassing scalability, interpretability, and ethical considerations in AI-driven models enrich the discourse. Moreover, through illuminating case studies and evaluations, this paper showcases real-world implementations, underscoring success stories and lessons learned by organizations adopting AI-driven threat intelligence. In conclusion, this review consolidates key insights, emphasizing the substantial implications of autonomous threat hunting for the future of cybersecurity. It underscores the significance of continual research and collaborative efforts in harnessing the potential of AI-driven approaches to fortify cyber defenses against evolving threats.


title: The Art of Defending: A Systematic Evaluation and Analysis of LLM Defense Strategies on Safety and Over-Defensiveness

abstract: As Large Language Models (LLMs) play an increasingly pivotal role in natural language processing applications, their safety concerns become critical areas of NLP research. This paper presents Safety and Over-Defensiveness Evaluation (SODE) benchmark: a collection of diverse safe and unsafe prompts with carefully designed evaluation methods that facilitate systematic evaluation, comparison, and analysis over 'safety' and 'over-defensiveness.' With SODE, we study a variety of LLM defense strategies over multiple state-of-the-art LLMs, which reveals several interesting and important findings, such as (a) the widely popular 'self-checking' techniques indeed improve the safety against unsafe inputs, but this comes at the cost of extreme over-defensiveness on the safe inputs, (b) providing a safety instruction along with in-context exemplars (of both safe and unsafe inputs) consistently improves safety and also mitigates undue over-defensiveness of the models, (c) providing contextual knowledge easily breaks the safety guardrails and makes the models more vulnerable to generating unsafe responses. Overall, our work reveals numerous such critical findings that we believe will pave the way and facilitate further research in improving the safety of LLMs.


title: Deep Learning for Code Intelligence: Survey, Benchmark and Toolkit

abstract: Code intelligence leverages machine learning techniques to extract knowledge from extensive code corpora, with the aim of developing intelligent tools to improve the quality and productivity of computer programming. Currently, there is already a thriving research community focusing on code intelligence, with efforts ranging from software engineering, machine learning, data mining, natural language processing, and programming languages. In this paper, we conduct a comprehensive literature review on deep learning for code intelligence, from the aspects of code representation learning, deep learning techniques, and application tasks. We also benchmark several state-of-the-art neural models for code intelligence, and provide an open-source toolkit tailored for the rapid prototyping of deep-learning-based code intelligence models. In particular, we inspect the existing code intelligence models under the basis of code representation learning, and provide a comprehensive overview to enhance comprehension of the present state of code intelligence. Furthermore, we publicly release the source code and data resources to provide the community with a ready-to-use benchmark, which can facilitate the evaluation and comparison of existing and future code intelligence models (https://xcodemind.github.io). At last, we also point out several challenging and promising directions for future research.


title: ASL Champ!: A Virtual Reality Game with Deep-Learning Driven Sign Recognition

abstract: We developed an American Sign Language (ASL) learning platform in a Virtual Reality (VR) environment to facilitate immersive interaction and real-time feedback for ASL learners. We describe the first game to use an interactive teaching style in which users learn from a fluent signing avatar and the first implementation of ASL sign recognition using deep learning within the VR environment. Advanced motion-capture technology powers an expressive ASL teaching avatar within an immersive three-dimensional environment. The teacher demonstrates an ASL sign for an object, prompting the user to copy the sign. Upon the user's signing, a third-party plugin executes the sign recognition process alongside a deep learning model. Depending on the accuracy of a user's sign production, the avatar repeats the sign or introduces a new one. We gathered a 3D VR ASL dataset from fifteen diverse participants to power the sign recognition model. The proposed deep learning model's training, validation, and test accuracy are 90.12%, 89.37%, and 86.66%, respectively. The functional prototype can teach sign language vocabulary and be successfully adapted as an interactive ASL learning platform in VR.


title: Red Teaming for Large Language Models At Scale: Tackling Hallucinations on Mathematics Tasks

abstract: We consider the problem of red teaming LLMs on elementary calculations and algebraic tasks to evaluate how various prompting techniques affect the quality of outputs. We present a framework to procedurally generate numerical questions and puzzles, and compare the results with and without the application of several red teaming techniques. Our findings suggest that even though structured reasoning and providing worked-out examples slow down the deterioration of the quality of answers, the gpt-3.5-turbo and gpt-4 models are not well suited for elementary calculations and reasoning tasks, also when being red teamed.