title: Robust Multi-Modal Speech In-Painting: A Sequence-to-Sequence Approach

abstract: The process of reconstructing missing parts of speech audio from context is called speech in-painting. Human perception of speech is inherently multi-modal, involving both audio and visual (AV) cues. In this paper, we introduce and study a sequence-to-sequence (seq2seq) speech in-painting model that incorporates AV features. Our approach extends AV speech in-painting techniques to scenarios where both audio and visual data may be jointly corrupted. To achieve this, we employ a multi-modal training paradigm that boosts the robustness of our model across various conditions involving acoustic and visual distortions. This makes our distortion-aware model a plausible solution for real-world challenging environments. We compare our method with existing transformer-based and recurrent neural network-based models, which attempt to reconstruct missing speech gaps ranging from a few milliseconds to over a second. Our experimental results demonstrate that our novel seq2seq architecture outperforms the state-of-the-art transformer solution by 38.8% in terms of enhancing speech quality and 7.14% in terms of improving speech intelligibility. We exploit a multi-task learning framework that simultaneously performs lip-reading (transcribing video components to text) while reconstructing missing parts of the associated speech.


title: Tau Data-Based Evaluations of the hadronic vacuum polarization contribution to the muon $g-2$

abstract: We review the tau data-driven computation of Euclidean windows for the hadronic vacuum polarization contribution to the muon anomalous magnetic moment (a_mu), which agree with the lattice results, making the difference of the $e^+e^-$ data-driven methods with them more intriguing. This conundrum needs to be solved by next year, when the final FNAL a_mu measurement will be published, in order to extract firm conclusions on possible new physics effects.


title: Revisiting Gamma-Ray Emission of the Supernova Remnant RCW 103

abstract: We analyze more than 15 years of the \gr\ data, obtained with the Large Area Telescope (LAT) onboard {\it the Fermi Gamma-ray Space Telescope (Fermi)}, for the region of the young supernova remnant (SNR) RCW~103, since the nearby source 4FGL J1616.2$-$5054e, counterpart to HESS~J1616$-$518 and $\simeq$13\,arcmin away from the SNR, is determined to be extended in the more recent Fermi-LAT source catalog. Different templates for 4FGL J1616.2$-$5054e and RCW~103 are tested, and we find that a point source with a power-law (PL) spectrum at the southern limb of the SNR best describes the detected gamma-ray emission. The photon index of the PL emission is $\Gamma\simeq 2.31$(or $\alpha\simeq 2.4$ in a Log-Parabola model) , softer than the previously reported $\Gamma\simeq 2.0$ when the counterpart to HESS~J1616$-$518 was considered to be a point source (which likely caused mis-identification of extended emission at RCW~103). In order to produce the \gr\ emission in a hadronic scenario, we estimate that protons with an index$\sim$2.4 PL energy distribution are needed. These results fit with those from multi-wavelength observations that have indicated the remnant at the southern limb is interacting with a molecular cloud.


title: The Behavior of a Three-Term Hofstadter-Like Recurrence with Linear Initial Conditions

abstract: In this paper, we study the three-term nested recurrence relation $B(n)=B(n-B(n-1))+B(n-B(n-2))+B(n-B(n-3))$ subject to initial conditions where the first $N$ terms are the integers $1$ through $N$. This recurrence is the three-term analog of Hofstadter's famous $Q$-recurrence $Q(n)=Q(n-Q(n-1))+Q(n-Q(n-2))$. Nested recurrences are highly sensitive to their initial conditions. Some initial conditions lead to finite sequences, others lead to predictable sequences, and yet others lead to sequences that appear to be chaotic and infinite. A corresponding study to this one was previously carried out on the $Q$-recurrence. As with that work, we consider two families of sequences, one where terms with nonpositive indices are undefined and a second where terms with nonpositive indices are defined to be zero. We find similar results here as with the $Q$-recurrence, as we can completely characterize the sequences for sufficiently large $N$. The results here are, in a sense, simpler, as our sequences are all finite for sufficiently large $N$.


title: Exploration of mass splitting and muon/tau mixing parameters for an eV-scale sterile neutrino with IceCube

abstract: We present the first three-parameter fit to a 3+1 sterile neutrino model using 7.634 years of data from the IceCube Neutrino Observatory on $\nu_\mu+\overline{\nu}_\mu$ charged-current interactions in the energy range 500-9976 GeV. Our analysis is sensitive to the mass-squared splitting between the heaviest and lightest mass state ($\Delta m_{41}^2$), the mixing matrix element connecting muon flavor to the fourth mass state ($|U_{\mu4}|^2$), and the element connecting tau flavor to the fourth mass state ($|U_{\tau4}|^2$). Predicted propagation effects in matter enhance the signature through a resonance as atmospheric neutrinos from the Northern Hemisphere traverse the Earth to the IceCube detector at the South Pole. The result is consistent with the no-sterile neutrino hypothesis with a probability of 4.3 %. Profiling the likelihood of each parameter yields the 90 % confidence levels: $ 2.4\,\mathrm{eV}^{2} < \Delta m_{41}^2 <9.6\,\mathrm{eV}^{2} $ , $0.0081 < |U_{\mu4}|^2 < 0.10$ , and $|U_{\tau4}|^2< 0.035$, which narrows the allowed parameter-space for $|U_{\tau4}|^2$. However, the primary result of this analysis is the first map of the 3+1 parameter space exploring the interdependence of $\Delta m_{41}^2$, $|U_{\mu4}|^2$, and $|U_{\tau4}|^2$.


title: A Bayesian Generalized Bridge Regression Approach to Covariance Estimation in the Presence of Covariates

abstract: A hierarchical Bayesian approach that permits simultaneous inference for the regression coefficient matrix and the error precision (inverse covariance) matrix in the multivariate linear model is proposed. Assuming a natural ordering of the elements of the response, the precision matrix is reparameterized so it can be estimated with univariate-response linear regression techniques. A novel generalized bridge regression prior that accommodates both sparse and dense settings and is competitive with alternative methods for univariate-response regression is proposed and used in this framework. Two component-wise Markov chain Monte Carlo algorithms are developed for sampling, including a data augmentation algorithm based on a scale mixture of normals representation. Numerical examples demonstrate that the proposed method is competitive with comparable joint mean-covariance models, particularly in estimation of the precision matrix. The method is also used to estimate the 253 by 253 precision matrices of two classes of spectra extracted from images taken by the Hubble Space Telescope. Some interesting structural patterns in the estimates are discussed.


title: DDA: Dimensionality Driven Augmentation Search for Contrastive Learning in Laparoscopic Surgery

abstract: Self-supervised learning (SSL) has potential for effective representation learning in medical imaging, but the choice of data augmentation is critical and domain-specific. It remains uncertain if general augmentation policies suit surgical applications. In this work, we automate the search for suitable augmentation policies through a new method called Dimensionality Driven Augmentation Search (DDA). DDA leverages the local dimensionality of deep representations as a proxy target, and differentiably searches for suitable data augmentation policies in contrastive learning. We demonstrate the effectiveness and efficiency of DDA in navigating a large search space and successfully identifying an appropriate data augmentation policy for laparoscopic surgery. We systematically evaluate DDA across three laparoscopic image classification and segmentation tasks, where it significantly improves over existing baselines. Furthermore, DDA's optimised set of augmentations provides insight into domain-specific dependencies when applying contrastive learning in medical applications. For example, while hue is an effective augmentation for natural images, it is not advantageous for laparoscopic images.


title: ZeroSmooth: Training-free Diffuser Adaptation for High Frame Rate Video Generation

abstract: Video generation has made remarkable progress in recent years, especially since the advent of the video diffusion models. Many video generation models can produce plausible synthetic videos, e.g., Stable Video Diffusion (SVD). However, most video models can only generate low frame rate videos due to the limited GPU memory as well as the difficulty of modeling a large set of frames. The training videos are always uniformly sampled at a specified interval for temporal compression. Previous methods promote the frame rate by either training a video interpolation model in pixel space as a postprocessing stage or training an interpolation model in latent space for a specific base video model. In this paper, we propose a training-free video interpolation method for generative video diffusion models, which is generalizable to different models in a plug-and-play manner. We investigate the non-linearity in the feature space of video diffusion models and transform a video model into a self-cascaded video diffusion model with incorporating the designed hidden state correction modules. The self-cascaded architecture and the correction module are proposed to retain the temporal consistency between key frames and the interpolated frames. Extensive evaluations are preformed on multiple popular video models to demonstrate the effectiveness of the propose method, especially that our training-free method is even comparable to trained interpolation models supported by huge compute resources and large-scale datasets.


title: A model of umbral oscillations inherited from subphotospheric fast-body modes

abstract: Recently, complex horizontal patterns of umbral oscillations have been reported, but their physical nature and origin are still not fully understood. Here we show that the two-dimensional patterns of umbral oscillations of slow waves are inherited from the subphotospheric fast-body modes. Using a simple analytic model, we successfully reproduced the temporal evolution of oscillation patterns with a finite number of fast-body modes. In this model, the radial apparent propagation of the pattern is associated with the appropriate combination of the amplitudes in radial modes. We also find that the oscillation patterns are dependent on the oscillation period. This result indicates that there is a cutoff radial mode, which is a unique characteristic of the model of fast-body modes. In principle, both internal and external sources can excite these fast-body modes and produce horizontal patterns of umbral oscillations.


title: Stability of phase diagram for a gradient ODE with memory

abstract: We consider the problem governed by the gradient ODE $x'=\nabla F(x)$ in $\mathbb{R}^d$ on which we assume that it has a finite number of hyperbolic equilibria whose stable and unstable manifolds intersect transversally. This problem is perturbed by the memory term $x'(t)=\nabla F(x(t))+\varepsilon\int_{-\infty}^t M(t-s)x(s)\, ds$ where $\varepsilon>0$ is a small constant. The key result is that the structure of connections between the equlibria of the unperturbed problem is exactly preserved for a small $\varepsilon>0$.


title: Characterization and thermometry of dissapatively stabilized steady states

abstract: In this work we study the properties of dissipatively stabilized steady states of noisy quantum algorithms, exploring the extent to which they can be well approximated as thermal distributions, and proposing methods to extract the effective temperature T. We study an algorithm called the Relaxational Quantum Eigensolver (RQE), which is one of a family of algorithms that attempt to find ground states and balance error in noisy quantum devices. In RQE, we weakly couple a second register of auxiliary "shadow" qubits to the primary system in Trotterized evolution, thus engineering an approximate zero-temperature bath by periodically resetting the auxiliary qubits during the algorithm's runtime. Balancing the infinite temperature bath of random gate error, RQE returns states with an average energy equal to a constant fraction of the ground state. We probe the steady states of this algorithm for a range of base error rates, using several methods for estimating both T and deviations from thermal behavior. In particular, we both confirm that the steady states of these systems are often well-approximated by thermal distributions, and show that the same resources used for cooling can be adopted for thermometry, yielding a fairly reliable measure of the temperature. These methods could be readily implemented in near-term quantum hardware, and for stabilizing and probing Hamiltonians where simulating approximate thermal states is hard for classical computers.


title: Definable convolution and idempotent Keisler measures III. Generic stability, generic transitivity, and revised Newelski's conjecture

abstract: We study idempotent measures and the structure of the convolution semigroups of measures over definable groups. We isolate the property of generic transitivity and demonstrate that it is sufficient (and necessary) to develop stable group theory localizing on a generically stable type, including invariant stratified ranks and connected components. We establish generic transitivity of generically stable idempotent types in important new cases, including abelian groups in arbitrary theories and arbitrary groups in rosy theories, and characterize them as generics of connected type-definable subgroups. Using tools from Keisler's randomization theory, we generalize some of these results from types to generically stable Keisler measures, and classify idempotent generically stable measures in abelian groups as (unique) translation-invariant measures on type-definable fsg subgroups. This provides a partial definable counterpart to the classical work of Rudin, Cohen and Pym for locally compact topological groups. Finally, we provide an explicit construction of a minimal left ideal in the convolution semigroup of measures for an arbitrary countable NIP group, from a minimal left ideal in the corresponding semigroup on types and a canonical measure constructed on its ideal subgroup. In order to achieve it, we in particular prove the revised Ellis group conjecture of Newelski for countable NIP groups.


title: Boosting Sortition via Proportional Representation

abstract: Sortition is based on the idea of choosing randomly selected representatives for decision making. The main properties that make sortition particularly appealing are fairness -- all the citizens can be selected with the same probability -- and proportional representation -- a randomly selected panel probably reflects the composition of the whole population. When a population lies on a representation metric, we formally define proportional representation by using a notion called the core. A panel is in the core if no group of individuals is underrepresented proportional to its size. While uniform selection is fair, it does not always return panels that are in the core. Thus, we ask if we can design a selection algorithm that satisfies fairness and ex post core simultaneously. We answer this question affirmatively and present an efficient selection algorithm that is fair and provides a constant-factor approximation to the optimal ex post core. Moreover, we show that uniformly random selection satisfies a constant-factor approximation to the optimal ex ante core. We complement our theoretical results by conducting experiments with real data.


title: Wasserstein gradient flow for optimal probability measure decomposition

abstract: We examine the infinite-dimensional optimization problem of finding a decomposition of a probability measure into K probability sub-measures to minimize specific loss functions inspired by applications in clustering and user grouping. We analytically explore the structures of the support of optimal sub-measures and introduce algorithms based on Wasserstein gradient flow, demonstrating their convergence. Numerical results illustrate the implementability of our algorithms and provide further insights.


title: Molecular-Resolution Imaging of Ice Crystallized from Liquid Water

abstract: Despite the ubiquity of ice, a molecular-resolution image of ice crystallized from liquid water or the resulting defect structure has never been obtained. Here, we report the stabilization and angstrom-resolution electron imaging of ice Ih crystallized from liquid water. We combine lattice mapping with molecular dynamics simulations to reveal that ice formation is highly tolerant to nanoscale defects such as misoriented subdomains and trapped gas bubbles, which are stabilized by molecular-scale structural motifs. Importantly, bubble surfaces adopt low-energy nanofacets and create negligible strain fields in the surrounding crystal. These bubbles can dynamically nucleate, grow, migrate, dissolve, and coalesce under electron irradiation and be monitored in situ near a steady state. This work opens the door to understanding water crystallization behaviors at an unprecedented spatial resolution.


title: Relations in Twisted Quantum K-Rings

abstract: We introduce twisted quantum $K$-rings, defined via twisted $K$-theoretic Gromov-Witten invariants. We develop a toolkit for computing relations by adapting some results about ordinary quantum K rings to our setting, and discuss some applications, including Ruan-Zhang's quantum $K$-theory with level structure, and complete intersections inside projective space, confirming some predictions coming from physics. In addition, we formulate a ring-theoretic abelian/non-abelian correspondence conjecture, relating the quantum K-ring of a GIT quotient $X//G$ to a certain twist of the quantum K-ring of $X//T$, the quotient by the maximal torus. We prove this conjecture for the case of Grassmanians, and use this to give another proof of the Whitney relations of Mihalcea-Gu-Sharpe-Zhou.


title: Alignment-Free RGBT Salient Object Detection: Semantics-guided Asymmetric Correlation Network and A Unified Benchmark

abstract: RGB and Thermal (RGBT) Salient Object Detection (SOD) aims to achieve high-quality saliency prediction by exploiting the complementary information of visible and thermal image pairs, which are initially captured in an unaligned manner. However, existing methods are tailored for manually aligned image pairs, which are labor-intensive, and directly applying these methods to original unaligned image pairs could significantly degrade their performance. In this paper, we make the first attempt to address RGBT SOD for initially captured RGB and thermal image pairs without manual alignment. Specifically, we propose a Semantics-guided Asymmetric Correlation Network (SACNet) that consists of two novel components: 1) an asymmetric correlation module utilizing semantics-guided attention to model cross-modal correlations specific to unaligned salient regions; 2) an associated feature sampling module to sample relevant thermal features according to the corresponding RGB features for multi-modal feature integration. In addition, we construct a unified benchmark dataset called UVT2000, containing 2000 RGB and thermal image pairs directly captured from various real-world scenes without any alignment, to facilitate research on alignment-free RGBT SOD. Extensive experiments on both aligned and unaligned datasets demonstrate the effectiveness and superior performance of our method. The dataset and code are available at https://github.com/Angknpng/SACNet.


title: Assessing the Adversarial Security of Perceptual Hashing Algorithms

abstract: Perceptual hashing algorithms (PHAs) are utilized extensively for identifying illegal online content. Given their crucial role in sensitive applications, understanding their security strengths and weaknesses is critical. This paper compares three major PHAs deployed widely in practice: PhotoDNA, PDQ, and NeuralHash, and assesses their robustness against three typical attacks: normal image editing attacks, malicious adversarial attacks, and hash inversion attacks. Contrary to prevailing studies, this paper reveals that these PHAs exhibit resilience to black-box adversarial attacks when realistic constraints regarding the distortion and query budget are applied, attributed to the unique property of random hash variations. Moreover, this paper illustrates that original images can be reconstructed from the hash bits, raising significant privacy concerns. By comprehensively exposing their security vulnerabilities, this paper contributes to the ongoing efforts aimed at enhancing the security of PHAs for effective deployment.


title: Advancing Weakly-Supervised Audio-Visual Video Parsing via Segment-wise Pseudo Labeling

abstract: The Audio-Visual Video Parsing task aims to identify and temporally localize the events that occur in either or both the audio and visual streams of audible videos. It often performs in a weakly-supervised manner, where only video event labels are provided, \ie, the modalities and the timestamps of the labels are unknown. Due to the lack of densely annotated labels, recent work attempts to leverage pseudo labels to enrich the supervision. A commonly used strategy is to generate pseudo labels by categorizing the known video event labels for each modality. However, the labels are still confined to the video level, and the temporal boundaries of events remain unlabeled. In this paper, we propose a new pseudo label generation strategy that can explicitly assign labels to each video segment by utilizing prior knowledge learned from the open world. Specifically, we exploit the large-scale pretrained models, namely CLIP and CLAP, to estimate the events in each video segment and generate segment-level visual and audio pseudo labels, respectively. We then propose a new loss function to exploit these pseudo labels by taking into account their category-richness and segment-richness. A label denoising strategy is also adopted to further improve the visual pseudo labels by flipping them whenever abnormally large forward losses occur. We perform extensive experiments on the LLP dataset and demonstrate the effectiveness of each proposed design and we achieve state-of-the-art video parsing performance on all types of event parsing, \ie, audio event, visual event, and audio-visual event. We also examine the proposed pseudo label generation strategy on a relevant weakly-supervised audio-visual event localization task and the experimental results again verify the benefits and generalization of our method.


title: Demystifying SGD with Doubly Stochastic Gradients

abstract: Optimization objectives in the form of a sum of intractable expectations are rising in importance (e.g., diffusion models, variational autoencoders, and many more), a setting also known as "finite sum with infinite data." For these problems, a popular strategy is to employ SGD with doubly stochastic gradients (doubly SGD): the expectations are estimated using the gradient estimator of each component, while the sum is estimated by subsampling over these estimators. Despite its popularity, little is known about the convergence properties of doubly SGD, except under strong assumptions such as bounded variance. In this work, we establish the convergence of doubly SGD with independent minibatching and random reshuffling under general conditions, which encompasses dependent component gradient estimators. In particular, for dependent estimators, our analysis allows fined-grained analysis of the effect correlations. As a result, under a per-iteration computational budget of $b \times m$, where $b$ is the minibatch size and $m$ is the number of Monte Carlo samples, our analysis suggests where one should invest most of the budget in general. Furthermore, we prove that random reshuffling (RR) improves the complexity dependence on the subsampling noise.


title: Towards Effective Detection of Ponzi schemes on Ethereum with Contract Runtime Behavior Graph

abstract: Ponzi schemes, a form of scam, have been discovered in Ethereum smart contracts in recent years, causing massive financial losses. Existing detection methods primarily focus on rule-based approaches and machine learning techniques that utilize static information as features. However, these methods have significant limitations. Rule-based approaches rely on pre-defined rules with limited capabilities and domain knowledge dependency. Using static information like opcodes for machine learning fails to effectively characterize Ponzi contracts, resulting in poor reliability and interpretability. Moreover, relying on static information like transactions for machine learning requires a certain number of transactions to achieve detection, which limits the scalability of detection and hinders the identification of 0-day Ponzi schemes. In this paper, we propose PonziGuard, an efficient Ponzi scheme detection approach based on contract runtime behavior. Inspired by the observation that a contract's runtime behavior is more effective in disguising Ponzi contracts from the innocent contracts, PonziGuard establishes a comprehensive graph representation called contract runtime behavior graph (CRBG), to accurately depict the behavior of Ponzi contracts. Furthermore, it formulates the detection process as a graph classification task on CRBG, enhancing its overall effectiveness. The experiment results show that PonziGuard surpasses the current state-of-the-art approaches in the ground-truth dataset. We applied PonziGuard to Ethereum Mainnet and demonstrated its effectiveness in real-world scenarios. Using PonziGuard, we identified 805 Ponzi contracts on Ethereum Mainnet, which have resulted in an estimated economic loss of 281,700 Ether or approximately $500 million USD. We also found 0-day Ponzi schemes in the recently deployed 10,000 smart contracts.


title: MEDIQ: Question-Asking LLMs for Adaptive and Reliable Clinical Reasoning

abstract: In high-stakes domains like clinical reasoning, AI assistants powered by large language models (LLMs) are yet to be reliable and safe. We identify a key obstacle towards reliability: existing LLMs are trained to answer any question, even with incomplete context in the prompt or insufficient parametric knowledge. We propose to change this paradigm to develop more careful LLMs that ask follow-up questions to gather necessary and sufficient information and respond reliably. We introduce MEDIQ, a framework to simulate realistic clinical interactions, which incorporates a Patient System and an adaptive Expert System. The Patient may provide incomplete information in the beginning; the Expert refrains from making diagnostic decisions when unconfident, and instead elicits missing details from the Patient via follow-up questions. To evaluate MEDIQ, we convert MEDQA and CRAFT-MD -- medical benchmarks for diagnostic question answering -- into an interactive setup. We develop a reliable Patient system and prototype several Expert systems, first showing that directly prompting state-of-the-art LLMs to ask questions degrades the quality of clinical reasoning, indicating that adapting LLMs to interactive information-seeking settings is nontrivial. We then augment the Expert with a novel abstention module to better estimate model confidence and decide whether to ask more questions, thereby improving diagnostic accuracy by 20.3%; however, performance still lags compared to an (unrealistic in practice) upper bound when full information is given upfront. Further analyses reveal that interactive performance can be improved by filtering irrelevant contexts and reformatting conversations. Overall, our paper introduces a novel problem towards LLM reliability, a novel MEDIQ framework, and highlights important future directions to extend the information-seeking abilities of LLM assistants in critical domains.


title: A high-velocity star recently ejected by an intermediate-mass black hole in M15

abstract: The existence of intermediate-mass black holes (IMBHs) is crucial for understanding various astrophysical phenomena, yet their existence remains elusive, except for the LIGO-Virgo detection. We report the discovery of a high-velocity star J0731+3717, whose backward trajectory about 21 Myr ago intersects that of globular cluster M15 within the cluster tidal radius. Both its metallicity [Fe/H] and its alpha-to-iron abundance ratio [$\alpha$/Fe] are consistent with those of M15. Furthermore, its location falls right on the fiducial sequence of the cluster M15 on the color-absolute magnitude diagram, suggesting similar ages. These support that J0731+3717 is originally associated with M15 at a confidence level of $5.4\sigma$. We find that such a high-velocity star ($V_{\rm ej} = 548^{+6}_{-5}$ km s$^{-1}$) was most likely tidally ejected from as close as one astronomical unit to the center of M15, confirming an IMBH ($\ge 100 M_{\odot}$ with a credibility of 98%) as the exclusive nature of the central unseen mass proposed previously.


title: Faster Diffusion-based Sampling with Randomized Midpoints: Sequential and Parallel

abstract: In recent years, there has been a surge of interest in proving discretization bounds for diffusion models. These works show that for essentially any data distribution, one can approximately sample in polynomial time given a sufficiently accurate estimate of its score functions at different noise levels. In this work, we propose a new discretization scheme for diffusion models inspired by Shen and Lee's randomized midpoint method for log-concave sampling~\cite{ShenL19}. We prove that this approach achieves the best known dimension dependence for sampling from arbitrary smooth distributions in total variation distance ($\widetilde O(d^{5/12})$ compared to $\widetilde O(\sqrt{d})$ from prior work). We also show that our algorithm can be parallelized to run in only $\widetilde O(\log^2 d)$ parallel rounds, constituting the first provable guarantees for parallel sampling with diffusion models. As a byproduct of our methods, for the well-studied problem of log-concave sampling in total variation distance, we give an algorithm and simple analysis achieving dimension dependence $\widetilde O(d^{5/12})$ compared to $\widetilde O(\sqrt{d})$ from prior work.


title: Dimers for Type D Relativistic Toda Model

abstract: We construct dimer graphs for type D relativistic Toda models by introducing impurities to the $Y^{2N,0}$ square dimer graphs. By properly placing the impurities and change of canonical variables assigned to the 1-loops on the dimer graph, we introduce the "folding" of the graphs and get the type D relativistic Toda lattice Hamiltonian and monodromy matrix.


title: Quantum turbulence, superfluidity, non-Markovian dynamics, and wave function thermalization

abstract: While quantum turbulence has been addressed both experimentally (predominantly for superfluid $^4$He and $^3$He) and theoretically, the dynamics of various ensembles of quantized vortices was followed in time only until the vortices decay into phonons. How this ``thermalization'' is achieved is still an unelucidated question. Here, we report on the microscopic treatment of the real-time dynamics of an initial ensemble of quantized vortices and anti-vortices, with no phonons, at zero temperature, in a Unitary Fermi Gas (UFG). We follow the system in time until ``thermalization'' is achieved, and a clear non-Markovian evolution of the single particle occupation probabilities is observed.


title: Double, triple, and quadruple magic wavelengths for cesium ground, excited, and Rydberg states

abstract: Dynamic polarizabilities of cesium Rydberg states, explicitly $nS_{1/2}$, $nP_{1/2}$, $nP_{3/2}$, $nD_{3/2}$, and $nD_{5/2}$, where the principal quantum number $n$ is $40$ to $70$, are presented for linearly polarized light. The dynamic polarizability is calculated using the sum-over-states approach. We identify double magic wavelengths in the range of $1,000-2,000$~nm for simultaneous trapping of the ground state and a Rydberg state, which are, respectively, red-detuned and blue-detuned with respect to a low-lying excited auxiliary state. Based on calculations of the radiative lifetime, blackbody radiation induced transitions, and population transfer out of the Rydberg and auxiliary states (estimated within two-state as well as master equation models), we conclude that magic wavelength trapping is particularly promising experimentally for the $nD_{J,|M_J|}$ Rydberg series with angular momentum $J=3/2$ and projection quantum numbers $M_J=\pm 1/2$ (auxiliary state $8P_{1/2}$) and $M_J=\pm 3/2$ (auxiliary state $8P_{3/2}$), using trap depths as large as $10$~$\mu$K. Moreover, by tuning the angle between the quantization axis and the polarization vector of the light, we identify triple and quadruple magic wavelengths, for which the polarizabilities of the ground state, a Rydberg state, and, respectively, one and two low-lying excited states are equal. Our comprehensive theoretical study provides much needed guidance for on-going experimental efforts on cesium Rydberg-state based quantum simulations that operate on time scales up to several $\mu$s.


title: Progenitor and explosion properties of SN 2023ixf estimated based on a light-curve model grid of Type II supernovae

abstract: We estimate the progenitor and explosion properties of the nearby Type II SN 2023ixf using a synthetic model grid of Type II supernova light curves. By comparing the light curves of SN 2023ixf with the pre-existing grid of Type II supernovae containing about 228,000 models with different combinations of the progenitor and explosion properties, we obtain the chi2 value for every model and evaluate the properties of the models providing small values of chi2. We found that the light-curve models with the progenitor zero-age main-sequence mass of 10 Msun, the explosion energy of (2-3)e51 erg, the 56Ni mass of 0.04-0.06 Msun, the mass-loss rate of 1e-3 - 1e-2 Msun/yr with a wind velocity of 10 km/s, and the dense, confined circumstellar matter radius of (6-10)e14 cm match well to the observed light curves of SN 2023ixf. The photospheric velocity evolution of these models is also consistent with the observed velocity evolution. Although our parameter estimation is based on a pre-existing model grid and we do not perform any additional computations, the estimated parameters are consistent with those obtained by the detailed modeling of SN 2023ixf previously reported. This result shows that comparing the pre-existing model grid is a reasonable way to obtain a rough estimate for the properties of Type II supernovae. This simple way to estimate the properties of Type II supernovae will be essential in the Vera C. Rubin Observatory's Legacy Survey of Space and Time (LSST) era when thousands of Type II supernovae are expected to be discovered yearly.


title: Self-Supervised Geometry-Guided Initialization for Robust Monocular Visual Odometry

abstract: Monocular visual odometry is a key technology in a wide variety of autonomous systems. Relative to traditional feature-based methods, that suffer from failures due to poor lighting, insufficient texture, large motions, etc., recent learning-based SLAM methods exploit iterative dense bundle adjustment to address such failure cases and achieve robust accurate localization in a wide variety of real environments, without depending on domain-specific training data. However, despite its potential, learning-based SLAM still struggles with scenarios involving large motion and object dynamics. In this paper, we diagnose key weaknesses in a popular learning-based SLAM model (DROID-SLAM) by analyzing major failure cases on outdoor benchmarks and exposing various shortcomings of its optimization process. We then propose the use of self-supervised priors leveraging a frozen large-scale pre-trained monocular depth estimation to initialize the dense bundle adjustment process, leading to robust visual odometry without the need to fine-tune the SLAM backbone. Despite its simplicity, our proposed method demonstrates significant improvements on KITTI odometry, as well as the challenging DDAD benchmark. Code and pre-trained models will be released upon publication.


title: A class of sequential multi-hypothesis tests

abstract: In this paper, we deal with sequential testing of multiple hypotheses. In the general scheme of construction of optimal tests based on the backward induction, we propose a modification which provides a simplified (generally speaking, suboptimal) version of the optimal test, for any particular criterion of optimization. We call this DBC version (the one with Dropped Backward Control) of the optimal test. In particular, for the case of two simple hypotheses, dropping backward control in the Bayesian test produces the classical sequential probability ratio test (SPRT). Similarly, dropping backward control in the modified Kiefer-Weiss solutions produces Lorden's 2-SPRTs . In the case of more than two hypotheses, we obtain in this way new classes of sequential multi-hypothesis tests, and investigate their properties. The efficiency of the DBC-tests is evaluated with respect to the optimal Bayesian multi-hypothesis test and with respect to the matrix sequential probability ratio test (MSPRT) by Armitage. In a multihypothesis variant of the Kiefer-Weiss problem for binomial proportions the performance of the DBC-test is numerically compared with that of the exact solution. In a model of normal observations with a linear trend, the performance of of the DBC-test is numerically compared with that of the MSPRT. Some other numerical examples are presented. In all the cases the proposed tests exhibit a very high efficiency with respect to the optimal tests (more than 99.3\% when sampling from Bernoulli populations) and/or with respect to the MSPRT (even outperforming the latter in some scenarios).


title: Cohomological splitting over rationally connected bases

abstract: We prove a cohomological splitting result for Hamiltonian fibrations over enumeratively rationally connected symplectic manifolds. As a key application, we prove that the cohomology of a smooth, projective family over a smooth stably rational projective variety splits additively over any field. The main ingredient in our arguments is the theory of Fukaya-Parker-Ono (FOP) perturbations developed by the first and third author, which allows one to define integer-valued Gromov-Witten type invariants.


title: Cosmological constant as an integration constant

abstract: The discrepancy between the observed value of the cosmological constant (CC) and its expected value from quantum field theoretical considerations motivates the search for a theory in which the CC is decoupled from the vacuum energy. In this article, we consider theories in which the CC is regarded as an integration constant. These theories include trace-free Einstein gravity, theories constructed from the Codazzi equation (which includes Cotton gravity and a gauge-gravity inspired theory), and conformal Killing gravity. We remark on a recent debate regarding the viability of Cotton gravity and find that while the Codazzi equation is indeed underdetermined, the solutions of the Codazzi equation trivialize to $\lambda g_{ab}$ on generic backgrounds, and that in principle, one can close the system with the divergence-free condition and an appropriate choice of initial data. We also propose a full variational principle (full in the sense that variations in all variables are considered) for each of the aforementioned theories that can incorporate the matter sector; in this manner, we can obtain the trace-free Einstein equations without a unimodular constraint.


title: Refined Thermodynamic Uncertainty Relation for Chemical Reactions

abstract: Thermodynamic uncertainty relations elucidate the intricate balance between the precision of current and the thermodynamic costs or dissipation, marking a recent and enthralling advancement at the confluence of statistical mechanics, thermodynamics, and information theory. In this study, we derive a time-energy uncertainty relation tailored for chemical reactions, expressed in terms of the Gibbs free energy and chemical potential. This inequality holds true irrespective of whether the total substance of chemical species is conserved during the reaction. Furthermore, it supports the general thermodynamic framework by ensuring the spontaneous decrease in Gibbs free energy. We present two formulations of the thermodynamic uncertainty relation: one based on chemical species concentrations and the other on molar fractions. The validity of our inequalities is numerically demonstrated using model systems of the Belousov-Zhabotinsky and Michaelis-Menten reactions. Our uncertainty relation may find practical applications in measuring and optimizing thermodynamic properties relevant to chemical reaction systems out of equilibrium.


title: LanEvil: Benchmarking the Robustness of Lane Detection to Environmental Illusions

abstract: Lane detection (LD) is an essential component of autonomous driving systems, providing fundamental functionalities like adaptive cruise control and automated lane centering. Existing LD benchmarks primarily focus on evaluating common cases, neglecting the robustness of LD models against environmental illusions such as shadows and tire marks on the road. This research gap poses significant safety challenges since these illusions exist naturally in real-world traffic situations. For the first time, this paper studies the potential threats caused by these environmental illusions to LD and establishes the first comprehensive benchmark LanEvil for evaluating the robustness of LD against this natural corruption. We systematically design 14 prevalent yet critical types of environmental illusions (e.g., shadow, reflection) that cover a wide spectrum of real-world influencing factors in LD tasks. Based on real-world environments, we create 94 realistic and customizable 3D cases using the widely used CARLA simulator, resulting in a dataset comprising 90,292 sampled images. Through extensive experiments, we benchmark the robustness of popular LD methods using LanEvil, revealing substantial performance degradation (-5.37% Accuracy and -10.70% F1-Score on average), with shadow effects posing the greatest risk (-7.39% Accuracy). Additionally, we assess the performance of commercial auto-driving systems OpenPilot and Apollo through collaborative simulations, demonstrating that proposed environmental illusions can lead to incorrect decisions and potential traffic accidents. To defend against environmental illusions, we propose the Attention Area Mixing (AAM) approach using hard examples, which witness significant robustness improvement (+3.76%) under illumination effects. We hope our paper can contribute to advancing more robust auto-driving systems in the future. Website: https://lanevil.github.io/.


title: VERTECS: A COTS-based payload interface board to enable next generation astronomical imaging payloads

abstract: Due to advances in observation and imaging technologies, modern astronomical satellites generate large volumes of data. This necessitates efficient onboard data processing and high-speed data downlink. Reflecting this trend is the VERTECS 6U Astronomical Nanosatellite. Designed for the observation of Extragalactic Background Light (EBL), this mission is expected to generate a substantial amount of image data, particularly within the confines of CubeSat capabilities. This paper introduces the VERTECS Camera Control Board (CCB), an open-source payload interface board leveraging Commercial Off-The-Shelf (COTS) components, with a Raspberry Pi Compute Module 4 at its core. The VERTECS CCB hardware and software have been designed from the ground up to serve as the sole interface between the VERTECS bus system and astronomical imaging payload, while providing compute capability not usually seen in nanosatellites of this class. Responsible for mission data processing, it will facilitate high-speed data transfer from the imaging payload via gigabit Ethernet, while also providing a high-bitrate serial connection to the payload X-band transmitter for mission data downlink. Additional interfaces for secondary payloads are provided via USB-C and standard 15-pin camera connectors. The Raspberry Pi embedded within the VERTECS CCB operates on a standard Linux distribution, streamlining the software development process. Beyond addressing the current mission's payload control and data handling requirements, the CCB sets the stage for future missions with heightened data demands. Furthermore, it supports the adoption of machine learning and other compute-intensive applications in orbit. This paper delves into the development of the VERTECS CCB, offering insights into the design and validation of this next-generation payload interface, to ensure that it can survive the rigors of space flight.

categories: astro-ph.IM cs.AR cs.SY eess.SY physics.ins-det


title: A Survey of Useful LLM Evaluation

abstract: LLMs have gotten attention across various research domains due to their exceptional performance on a wide range of complex tasks. Therefore, refined methods to evaluate the capabilities of LLMs are needed to determine the tasks and responsibility they should undertake. Our study mainly discussed how LLMs, as useful tools, should be effectively assessed. We proposed the two-stage framework: from ``core ability'' to ``agent'', clearly explaining how LLMs can be applied based on their specific capabilities, along with the evaluation methods in each stage. Core ability refers to the capabilities that LLMs need in order to generate high-quality natural language texts. After confirming LLMs possess core ability, they can solve real-world and complex tasks as agent. In the "core ability" stage, we discussed the reasoning ability, societal impact, and domain knowledge of LLMs. In the ``agent'' stage, we demonstrated embodied action, planning, and tool learning of LLMs agent applications. Finally, we examined the challenges currently confronting the evaluation methods for LLMs, as well as the directions for future development.


title: Stochastic Variance-Reduced Forward-Reflected Methods for Root-Finding Problems

abstract: We develop two novel stochastic variance-reduction methods to approximate a solution of root-finding problems applicable to both equations and inclusions. Our algorithms leverage a new combination of ideas from the forward-reflected-backward splitting method and a class of unbiased variance-reduction estimators. We construct two new stochastic estimators within this class, inspired by the well-established SVRG and SAGA estimators. These estimators differ significantly from existing approaches used for root-finding algorithms. By appropriately selecting parameters, both algorithms achieve the state-of-the-art oracle complexity of $\mathcal{O}(n + n^{2/3} \epsilon^{-2})$ for achieving an $\epsilon$-solution in terms of the operator residual norm, where $n$ represents the number of summands and $\epsilon$ signifies the desired accuracy. This complexity aligns with the best-known results in stochastic nonconvex optimization without enhancements. We test our algorithms on two numerical examples and compare them with existing methods. The results demonstrate promising improvements offered by the new methods compared to their competitors.


title: A Synergistic Approach In Network Intrusion Detection By Neurosymbolic AI

abstract: The prevailing approaches in Network Intrusion Detection Systems (NIDS) are often hampered by issues such as high resource consumption, significant computational demands, and poor interpretability. Furthermore, these systems generally struggle to identify novel, rapidly changing cyber threats. This paper delves into the potential of incorporating Neurosymbolic Artificial Intelligence (NSAI) into NIDS, combining deep learning's data-driven strengths with symbolic AI's logical reasoning to tackle the dynamic challenges in cybersecurity, which also includes detailed NSAI techniques introduction for cyber professionals to explore the potential strengths of NSAI in NIDS. The inclusion of NSAI in NIDS marks potential advancements in both the detection and interpretation of intricate network threats, benefiting from the robust pattern recognition of neural networks and the interpretive prowess of symbolic reasoning. By analyzing network traffic data types and machine learning architectures, we illustrate NSAI's distinctive capability to offer more profound insights into network behavior, thereby improving both detection performance and the adaptability of the system. This merging of technologies not only enhances the functionality of traditional NIDS but also sets the stage for future developments in building more resilient, interpretable, and dynamic defense mechanisms against advanced cyber threats. The continued progress in this area is poised to transform NIDS into a system that is both responsive to known threats and anticipatory of emerging, unseen ones.


title: Bounds on f-Divergences between Distributions within Generalized Quasi-$\varepsilon$-Neighborhood

abstract: A general reverse Pinsker's inequality is derived to give an upper bound on f-divergences in terms of total variational distance when two distributions are close measured under our proposed generalized local information geometry framework. In addition, relationships between two f-divergences equipped with functions that are third order differentiable are established in terms of the lower and upper bounds of their ratio, when the underlying distributions are within a generalized quasi-$\varepsilon$-neighborhood.


title: Measurement Error-Robust Causal Inference via Constructed Instrumental Variables

abstract: Measurement error can often be harmful when estimating causal effects. Two scenarios in which this is the case are in the estimation of (a) the average treatment effect when confounders are measured with error and (b) the natural indirect effect when the exposure and/or confounders are measured with error. Methods adjusting for measurement error typically require external data or knowledge about the measurement error distribution. Here, we propose methodology not requiring any such information. Instead, we show that when the outcome regression is linear in the error-prone variables, consistent estimation of these causal effects can be recovered using constructed instrumental variables under certain conditions. These variables, which are functions of only the observed data, behave like instrumental variables for the error-prone variables. Using data from a study of the effects of prenatal exposure to heavy metals on growth and neurodevelopment in Bangladeshi mother-infant pairs, we apply our methodology to estimate (a) the effect of lead exposure on birth length while controlling for maternal protein intake, and (b) lead exposure's role in mediating the effect of maternal protein intake on birth length. Protein intake is calculated from food journal entries, and is suspected to be highly prone to measurement error.


title: A Robust Residual-Based Test for Structural Changes in Factor Models

abstract: In this paper, we propose an easy-to-implement residual-based specification testing procedure for detecting structural changes in factor models, which is powerful against both smooth and abrupt structural changes with unknown break dates. The proposed test is robust against the over-specified number of factors, and serially and cross-sectionally correlated error processes. A new central limit theorem is given for the quadratic forms of panel data with dependence over both dimensions, thereby filling a gap in the literature. We establish the asymptotic properties of the proposed test statistic, and accordingly develop a simulation-based scheme to select critical value in order to improve finite sample performance. Through extensive simulations and a real-world application, we confirm our theoretical results and demonstrate that the proposed test exhibits desirable size and power in practice.


title: Cheap and Easy Open-Ended Text Input for Interactive Emergent Narrative

abstract: We present a demonstration of Play What I Mean (PWIM): a novel, AI-supported interaction technique for interactive emergent narrative (IEN) games and play experiences. By assisting players in translating high-level gameplay intents (expressed as short, unstructured text strings) into concrete game actions, PWIM aims to support open-ended player input while mitigating the overwhelm that players sometimes feel when confronting the large action spaces that characterize IEN gameplay. In matching player intents to game actions, PWIM makes use of an off-the-shelf sentence embedding model that is lightweight enough to run locally on a player's device, and wraps this model in a simple user interface that allows the player to work around occasional classification errors.


title: State Space Models on Temporal Graphs: A First-Principles Study

abstract: Over the past few years, research on deep graph learning has shifted from static graphs to temporal graphs in response to real-world complex systems that exhibit dynamic behaviors. In practice, temporal graphs are formalized as an ordered sequence of static graph snapshots observed at discrete time points. Sequence models such as RNNs or Transformers have long been the predominant backbone networks for modeling such temporal graphs. Yet, despite the promising results, RNNs struggle with long-range dependencies, while transformers are burdened by quadratic computational complexity. Recently, state space models (SSMs), which are framed as discretized representations of an underlying continuous-time linear dynamical system, have garnered substantial attention and achieved breakthrough advancements in independent sequence modeling. In this work, we undertake a principled investigation that extends SSM theory to temporal graphs by integrating structural information into the online approximation objective via the adoption of a Laplacian regularization term. The emergent continuous-time system introduces novel algorithmic challenges, thereby necessitating our development of GraphSSM, a graph state space model for modeling the dynamics of temporal graphs. Extensive experimental results demonstrate the effectiveness of our GraphSSM framework across various temporal graph benchmarks.


title: Unveil the Duality of Retrieval-Augmented Generation: Theoretical Analysis and Practical Solution

abstract: Retrieval-augmented generation (RAG) utilizes retrieved texts to enhance large language models (LLMs). However, studies show that RAG is not consistently effective and can even mislead LLMs due to noisy or incorrect retrieved texts. This suggests that RAG possesses a duality including both benefit and detriment. Although many existing methods attempt to address this issue, they lack a theoretical explanation for the duality in RAG. The benefit and detriment within this duality remain a black box that cannot be quantified or compared in an explainable manner. This paper takes the first step in theoretically giving the essential explanation of benefit and detriment in RAG by: (1) decoupling and formalizing them from RAG prediction, (2) approximating the gap between their values by representation similarity and (3) establishing the trade-off mechanism between them, to make them explainable, quantifiable, and comparable. We demonstrate that the distribution difference between retrieved texts and LLMs' knowledge acts as double-edged sword, bringing both benefit and detriment. We also prove that the actual effect of RAG can be predicted at token level. Based on our theory, we propose a practical novel method, X-RAG, which achieves collaborative generation between pure LLM and RAG at token level to preserve benefit and avoid detriment. Experiments in real-world tasks based on LLMs including OPT, LLaMA-2, and Mistral show the effectiveness of our method and support our theoretical results.


title: General relativistic self-gravitating equilibrium disks around rotating neutron stars

abstract: In modeling a relativistic disk around a compact object, the self-gravity of the disk is often neglected while it needs to be incorporated for more accurate descriptions in several circumstances. Extending the Komatsu-Eriguchi-Hachisu self-consistent field method, we present numerical models of a rapidly rotating neutron star with a self-gravitating disk in stationary equilibrium. In particular, our approach allows us to obtain numerical solutions involving a massive disk with the rest mass $O(10^{-1})-O(10^0) M_\odot$ closely attached to a rotating neutron star. We also assess the impact of self-gravity on the internal structure of the disk and the neutron star. These axisymmetric, stationary solutions can be employed for simulations involving the neutron star-disk system in the context of high-energy transients and gravitational wave emissions.


title: Higgs boson decays $h\rightarrow MZ$ in the TNMSSM

abstract: We study the SM-like Higgs boson decays $h\rightarrow MZ$ in the Triplet extended NMSSM (TNMSSM),where M is a vector meson ($\rho$, $\omega$, $\phi$, $J/\Psi$, $\Upsilon$). Compared to the minimal supersymmetric standard model (MSSM), the TNMSSM includes two new SU(2) triplets with hypercharge $\pm 1$ and a SM gauge singlet which are coupled to each other. The indirect contributions to the decays $h \rightarrow MZ$ are produced from the effective $h\gamma Z$ vertex, and they are more important than the direct contributions. The results of this work would encourage a detection on $h \rightarrow Z\gamma$ at the future high energy colliders for exploring new physics beyond the SM.


title: Cross-Dimensional Medical Self-Supervised Representation Learning Based on a Pseudo-3D Transformation

abstract: Medical image analysis suffers from a shortage of data, whether annotated or not. This becomes even more pronounced when it comes to 3D medical images. Self-Supervised Learning (SSL) can partially ease this situation by using unlabeled data. However, most existing SSL methods can only make use of data in a single dimensionality (e.g. 2D or 3D), and are incapable of enlarging the training dataset by using data with differing dimensionalities jointly. In this paper, we propose a new cross-dimensional SSL framework based on a pseudo-3D transformation (CDSSL-P3D), that can leverage both 2D and 3D data for joint pre-training. Specifically, we introduce an image transformation based on the im2col algorithm, which converts 2D images into a format consistent with 3D data. This transformation enables seamless integration of 2D and 3D data, and facilitates cross-dimensional self-supervised learning for 3D medical image analysis. We run extensive experiments on 13 downstream tasks, including 2D and 3D classification and segmentation. The results indicate that our CDSSL-P3D achieves superior performance, outperforming other advanced SSL methods.


title: Real-space tilting method for atomic resolution STEM imaging of nanocrystalline materials

abstract: Atomic-resolution scanning transmission electron microscopy (STEM) characterization requires precise tilting of the specimen to high symmetric zone axis, which is usually processed in reciprocal space by following the diffraction patterns. However, for small-sized nanocrystalline materials, their diffraction patterns are too faint to guide the tilting process. Here, a simple and effective tilting method is developed based on the diffraction contrast change of the shadow image in the Ronchigram. We can calculate the misorientation angle of the specimen and tilt it to the zone axis based on the position of the shadow image with lowest intensity. This method requires no prior knowledge of the sample and the maximum misorientation angle we can correct is greater than +-6.9 degree with sub-mrad accuracy. It is processed in real space, without recording the diffraction patterns of the specimens, which can effectively apply to nanocrystalline materials. Combined with the scripting to control the microscope, we can automatically tilt the sample to the zone axis under low dose condition (<0.17 e-/A2/s), which could facilitate the imaging of beam sensitive materials such as zeolites or metal organic frameworks. This automated tilting method could contribute to the atomic-scale characterization of the nanocrystalline materials by STEM imaging.


title: Sharp dispersive estimates for the wave equation on the 5-dimensional lattice graph

abstract: Schultz \cite{S98} proved dispersive estimates for the wave equation on lattice graphs $\mathbb{Z}^d$ for $d=2,3,$ which was extended to $d=4$ in \cite{BCH23}. By Newton polyhedra and the algorithm introduced by Karpushkin \cite{K83}, we further extend the result to $d=5:$ the sharp decay rate of the fundamental solution of the wave equation on $\mathbb{Z}^5$ is $|t|^{-\frac{11}{6}}.$ Moreover, we prove Strichartz estimates and give applications to nonlinear equations.


title: A Sufficient Condition for Blowup of the Nonlinear Klein-Gordon Equation with Positive Initial Energy in FLRW Spacetimes

abstract: In this paper we demonstrate a sufficient condition for blowup of the nonlinear Klein-Gordon equation with arbitrarily positive initial energy in Friedmann-Lema\^itre-Robertson-Walker spacetimes. This is accomplished using an established concavity method that has been employed for similar PDEs in Minkowski space. This proof relies on the energy inequality associated with this equation, $E(t_0)\geq E(t)$, also proved herein using a geometric method.


title: How disinformation and fake news impact public policies?: A review of international literature

abstract: This study investigates the impact of disinformation on public policies. Using 28 sets of keywords in eight databases, a systematic review was carried out following the Prisma 2020 model (Page et al., 2021). After applying filters and inclusion and exclusion criteria to 4,128 articles and materials found, 46 publications were analyzed, resulting in 23 disinformation impact categories. These categories were organized into two main axes: State and Society and Actors and Dynamics, covering impacts on State actors, society actors, State dynamics and society dynamics. The results indicate that disinformation affects public decisions, adherence to policies, prestige of institutions, perception of reality, consumption, public health and other aspects. Furthermore, this study suggests that disinformation should be treated as a public problem and incorporated into the public policy research agenda, contributing to the development of strategies to mitigate its effects on government actions.


title: Block $\omega$-circulant preconditioners for parabolic optimal control problems

abstract: In this work, we propose a class of novel preconditioned Krylov subspace methods for solving an optimal control problem of parabolic equations. Namely, we develop a family of block $\omega$-circulant based preconditioners for the all-at-once linear system arising from the concerned optimal control problem, where both first order and second order time discretization methods are considered. The proposed preconditioners can be efficiently diagonalized by fast Fourier transforms in a parallel-in-time fashion, and their effectiveness is theoretically shown in the sense that the eigenvalues of the preconditioned matrix are clustered around $\pm 1$, which leads to rapid convergence when the minimal residual method is used. When the generalized minimal residual method is deployed, the efficacy of the proposed preconditioners are justified in the way that the singular values of the preconditioned matrices are proven clustered around unity. Numerical results are provided to demonstrate the effectiveness of our proposed solvers.


title: Viscosity solution to complex Hessian equations on compact Hermitian manifolds

abstract: We prove the existence of viscosity solutions to complex Hessian equations on a compact Hermitian manifold that satisfy a determinant domination condition. This viscosity solution is shown to be unique when the right hand is strictly monotone increasing in terms of the solution. When the right hand side does not depend on the solution, we reduces it to the strict monotonicity of the solvability constant.


title: Annotation Guidelines-Based Knowledge Augmentation: Towards Enhancing Large Language Models for Educational Text Classification

abstract: Various machine learning approaches have gained significant popularity for the automated classification of educational text to identify indicators of learning engagement -- i.e. learning engagement classification (LEC). LEC can offer comprehensive insights into human learning processes, attracting significant interest from diverse research communities, including Natural Language Processing (NLP), Learning Analytics, and Educational Data Mining. Recently, Large Language Models (LLMs), such as ChatGPT, have demonstrated remarkable performance in various NLP tasks. However, their comprehensive evaluation and improvement approaches in LEC tasks have not been thoroughly investigated. In this study, we propose the Annotation Guidelines-based Knowledge Augmentation (AGKA) approach to improve LLMs. AGKA employs GPT 4.0 to retrieve label definition knowledge from annotation guidelines, and then applies the random under-sampler to select a few typical examples. Subsequently, we conduct a systematic evaluation benchmark of LEC, which includes six LEC datasets covering behavior classification (question and urgency level), emotion classification (binary and epistemic emotion), and cognition classification (opinion and cognitive presence). The study results demonstrate that AGKA can enhance non-fine-tuned LLMs, particularly GPT 4.0 and Llama 3 70B. GPT 4.0 with AGKA few-shot outperforms full-shot fine-tuned models such as BERT and RoBERTa on simple binary classification datasets. However, GPT 4.0 lags in multi-class tasks that require a deep understanding of complex semantic information. Notably, Llama 3 70B with AGKA is a promising combination based on open-source LLM, because its performance is on par with closed-source GPT 4.0 with AGKA. In addition, LLMs struggle to distinguish between labels with similar names in multi-class classification.


title: How Video Meetings Change Your Expression

abstract: Do our facial expressions change when we speak over video calls? Given two unpaired sets of videos of people, we seek to automatically find spatio-temporal patterns that are distinctive of each set. Existing methods use discriminative approaches and perform post-hoc explainability analysis. Such methods are insufficient as they are unable to provide insights beyond obvious dataset biases, and the explanations are useful only if humans themselves are good at the task. Instead, we tackle the problem through the lens of generative domain translation: our method generates a detailed report of learned, input-dependent spatio-temporal features and the extent to which they vary between the domains. We demonstrate that our method can discover behavioral differences between conversing face-to-face (F2F) and on video-calls (VCs). We also show the applicability of our method on discovering differences in presidential communication styles. Additionally, we are able to predict temporal change-points in videos that decouple expressions in an unsupervised way, and increase the interpretability and usefulness of our model. Finally, our method, being generative, can be used to transform a video call to appear as if it were recorded in a F2F setting. Experiments and visualizations show our approach is able to discover a range of behaviors, taking a step towards deeper understanding of human behaviors.


title: Improving Segment Anything on the Fly: Auxiliary Online Learning and Adaptive Fusion for Medical Image Segmentation

abstract: The current variants of the Segment Anything Model (SAM), which include the original SAM and Medical SAM, still lack the capability to produce sufficiently accurate segmentation for medical images. In medical imaging contexts, it is not uncommon for human experts to rectify segmentations of specific test samples after SAM generates its segmentation predictions. These rectifications typically entail manual or semi-manual corrections employing state-of-the-art annotation tools. Motivated by this process, we introduce a novel approach that leverages the advantages of online machine learning to enhance Segment Anything (SA) during test time. We employ rectified annotations to perform online learning, with the aim of improving the segmentation quality of SA on medical images. To improve the effectiveness and efficiency of online learning when integrated with large-scale vision models like SAM, we propose a new method called Auxiliary Online Learning (AuxOL). AuxOL creates and applies a small auxiliary model (specialist) in conjunction with SAM (generalist), entails adaptive online-batch and adaptive segmentation fusion. Experiments conducted on eight datasets covering four medical imaging modalities validate the effectiveness of the proposed method. Our work proposes and validates a new, practical, and effective approach for enhancing SA on downstream segmentation tasks (e.g., medical image segmentation).


title: The light quarkonium and charmonium mass shifts in an unquenched quark model

abstract: The unquenched quark model for the light quarkonium and the charmonium states is explored in the present work. The quark-pair creation operator in the $^3P_0$ model, which mix the two-quark and four-quark components is modified by considering the effects of the created quark pair's energy, as well as the separation between the created quark pair and the valence quark pair. All the wave functions needed including the mesons and the relative motion between two mesons are all obtained by solving the corresponding Schr\"{o}dinger equation with the help of the Gaussian expansion method. Our aim of the present work is to find a new set of parameters which can give a good description of the mass spectrum of the low-lying light quarkonium and charmonium states. Moreover, some exotic states, for example $X(3872)$ can be described well in the unquenched quark model.


title: Navigating Conflicting Views: Harnessing Trust for Learning

abstract: Resolving conflicts is essential to make the decisions of multi-view classification more reliable. Much research has been conducted on learning consistent informative representations among different views, assuming that all views are identically important and strictly aligned. However, real-world multi-view data may not always conform to these assumptions, as some views may express distinct information. To address this issue, we develop a computational trust-based discounting method to enhance the existing trustworthy framework in scenarios where conflicts between different views may arise. Its belief fusion process considers the trustworthiness of predictions made by individual views via an instance-wise probability-sensitive trust discounting mechanism. We evaluate our method on six real-world datasets, using Top-1 Accuracy, AUC-ROC for Uncertainty-Aware Prediction, Fleiss' Kappa, and a new metric called Multi-View Agreement with Ground Truth that takes into consideration the ground truth labels. The experimental results show that computational trust can effectively resolve conflicts, paving the way for more reliable multi-view classification models in real-world applications.


title: Ta2Pd3Te5 topological thermometer

abstract: In recent decades, there has been a persistent pursuit of applications for surface/edge states in topological systems, driven by their dissipationless transport effects. However, there have been limited tangible breakthroughs in this field. This work demonstrates the remarkable properties of the topological insulator Ta2Pd3Te5, as a thermometer. This material exhibits a power-law correlation in temperature-dependent resistance at low temperatures, stemming from its Luttinger liquid behavior of edge states, while exhibiting semiconductor behavior at high temperatures. The power-law behavior effectively addresses the issue of infinite resistance in semiconductor thermometers at ultra-low temperatures, thereby playing a crucial role in enabling efficient thermometry in refrigerators supporting millikelvin temperatures or below. By employing chemical doping, adjusting thickness, and controlling gate voltage, its power-law behavior and semiconductor behavior can be effectively modulated. This enables efficient thermometry spanning from millikelvin temperatures to room temperature, and allows for precise local temperature measurement. Furthermore, this thermometer exhibits excellent temperature sensitivity and resolution, and can be fine-tuned to show small magnetoresistance. In summary, the Ta2Pd3Te5 thermometer, also referred to as a topological thermometer, exhibits outstanding performance and significant potential for measuring a wider range of temperatures compared to conventional low-temperature thermometers.


title: PDP: Physics-Based Character Animation via Diffusion Policy

abstract: Generating diverse and realistic human motion that can physically interact with an environment remains a challenging research area in character animation. Meanwhile, diffusion-based methods, as proposed by the robotics community, have demonstrated the ability to capture highly diverse and multi-modal skills. However, naively training a diffusion policy often results in unstable motions for high-frequency, under-actuated control tasks like bipedal locomotion due to rapidly accumulating compounding errors, pushing the agent away from optimal training trajectories. The key idea lies in using RL policies not just for providing optimal trajectories but for providing corrective actions in sub-optimal states, giving the policy a chance to correct for errors caused by environmental stimulus, model errors, or numerical errors in simulation. Our method, Physics-Based Character Animation via Diffusion Policy (PDP), combines reinforcement learning (RL) and behavior cloning (BC) to create a robust diffusion policy for physics-based character animation. We demonstrate PDP on perturbation recovery, universal motion tracking, and physics-based text-to-motion synthesis.


title: Kronecker-product random matrices and a matrix least squares problem

abstract: We study the eigenvalue distribution and resolvent of a Kronecker-product random matrix model $A \otimes I_{n \times n}+I_{n \times n} \otimes B+\Theta \otimes \Xi \in \mathbb{C}^{n^2 \times n^2}$, where $A,B$ are independent Wigner matrices and $\Theta,\Xi$ are deterministic and diagonal. For fixed spectral arguments, we establish a quantitative approximation for the Stieltjes transform by that of an approximating free operator, and a diagonal deterministic equivalent approximation for the resolvent. We further obtain sharp estimates in operator norm for the $n \times n$ resolvent blocks, and show that off-diagonal resolvent entries fall on two differing scales of $n^{-1/2}$ and $n^{-1}$ depending on their locations in the Kronecker structure. Our study is motivated by consideration of a matrix-valued least-squares optimization problem $\min_{X \in \mathbb{R}^{n \times n}} \frac{1}{2}\|XA+BX\|_F^2+\frac{1}{2}\sum_{ij} \xi_i\theta_j x_{ij}^2$ subject to a linear constraint. For random instances of this problem defined by Wigner inputs $A,B$, our analyses imply an asymptotic characterization of the minimizer $X$ and its associated minimum objective value as $n \to \infty$.


title: A Point-cloud Clustering & Tracking Algorithm for Radar Interferometry

abstract: In data mining, density-based clustering, which entails classifying datapoints according to their distributions in some space, is an essential method to extract information from large datasets. With the advent of software-based radio, ionospheric radars are capable of producing unprecedentedly large datasets of plasma turbulence backscatter observations, and new automatic techniques are needed to sift through them. We present an algorithm to automatically identify and track clusters of radar echoes through time, using dbscan, a celebrated density-based clustering method for noisy point-clouds. We demonstrate its efficiency by tracking turbulent structures in the E-region ionosphere, the so-called radar aurora. Through conjugate auroral imagery, as well as in-situ satellite observations, we demonstrate that the observed turbulent structures generally track the motion of the aurora. We discuss instances when this prediction is brought to fruition and when it ostensibly is not. Through case studies, we highlight the important instances when the radar echo bulk motions vary considerably around discrete auroral arcs, an effect we argue is produced by strong electric field modulations caused by energetic particle precipitation.

categories: physics.space-ph physics.data-an physics.geo-ph physics.ins-det physics.plasm-ph


title: Permanental inequalities for totally positive matrices

abstract: We characterize ratios of permanents of (generalized) submatrices which are bounded on the set of all totally positive matrices. This provides a permanental analog of results of Fallat, Gekhtman, and Johnson [{\em Adv.\ Appl.\ Math.} {\bf 30} no.\ 3, (2003) pp.\ 442--470] concerning ratios of matrix minors. We also extend work of Drake, Gerrish, and the first author [{\em Electron.\ J.\ Combin.,} {\bf 11} no.\ 1, (2004) Note 6] by characterizing the differences of monomials in $\mathbb{Z}[x_{1,1},x_{1,2},...,x_{n,n}]$ which evaluate positively on the set of all totally positive $n \times n$ matrices.


title: Elliptic Quantum Toroidal Algebra U_{t_1,t_2,p}(gl_{1,tor}), Vertex Operators and L-operators

abstract: We propose new vertex operators, both the type I and the type II dual, of the elliptic quantum toroidal algebra U_{t_1,t_2,p}(gl_{1,tor}) by combining representations of U_{t_1,t_2,p}(gl_{1,tor}) and the notions of the elliptic stable envelopes for the instanton moduli space M(n,r). The vertex operators reproduce the shuffle product formula of the elliptic stable envelopes by their composition. We also show that the vacuum expectation value of a composition of the vertex operators gives a correct formula of the K-theoretic vertex function for M(n,r). We then derive exchange relations among the vertex operators and construct a L-operator satisfying the RLL=LLR^* relation with R and R^* being elliptic dynamical instanton R-matrices defined as transition matrices of the elliptic stable envelopes. Assuming a universal form of L, we define a comultiplication \Delta in terms of it. It turns out that the new vertex operators are intertwining operators of the U_{t_1,t_2,p}(gl_{1,tor})-modules w.r.t \Delta.


title: Efficient Behavior Tree Planning with Commonsense Pruning and Heuristic

abstract: Behavior Tree (BT) planning is crucial for autonomous robot behavior control, yet its application in complex scenarios is hampered by long planning times. Pruning and heuristics are common techniques to accelerate planning, but it is difficult to design general pruning strategies and heuristic functions for BT planning problems. This paper proposes improving BT planning efficiency for everyday service robots leveraging commonsense reasoning provided by Large Language Models (LLMs), leading to model-free pre-planning action space pruning and heuristic generation. This approach takes advantage of the modularity and interpretability of BT nodes, represented by predicate logic, to enable LLMs to predict the task-relevant action predicates and objects, and even the optimal path, without an explicit action model. We propose the Heuristic Optimal Behavior Tree Expansion Algorithm (HOBTEA) with two heuristic variants and provide a formal comparison and discussion of their efficiency and optimality. We introduce a learnable and transferable commonsense library to enhance the LLM's reasoning performance without fine-tuning. The action space expansion based on the commonsense library can further increase the success rate of planning. Experiments show the theoretical bounds of commonsense pruning and heuristic, and demonstrate the actual performance of LLM learning and reasoning with the commonsense library. Results in four datasets showcase the practical effectiveness of our approach in everyday service robot applications.


title: Guaranteeing Data Privacy in Federated Unlearning with Dynamic User Participation

abstract: Federated Unlearning (FU) is gaining prominence for its capacity to eliminate influences of Federated Learning (FL) users' data from trained global FL models. A straightforward FU method involves removing the unlearned users and subsequently retraining a new global FL model from scratch with all remaining users, a process that leads to considerable overhead. To enhance unlearning efficiency, a widely adopted strategy employs clustering, dividing FL users into clusters, with each cluster maintaining its own FL model. The final inference is then determined by aggregating the majority vote from the inferences of these sub-models. This method confines unlearning processes to individual clusters for removing a user, thereby enhancing unlearning efficiency by eliminating the need for participation from all remaining users. However, current clustering-based FU schemes mainly concentrate on refining clustering to boost unlearning efficiency but overlook the potential information leakage from FL users' gradients, a privacy concern that has been extensively studied. Typically, integrating secure aggregation (SecAgg) schemes within each cluster can facilitate a privacy-preserving FU. Nevertheless, crafting a clustering methodology that seamlessly incorporates SecAgg schemes is challenging, particularly in scenarios involving adversarial users and dynamic users. In this connection, we systematically explore the integration of SecAgg protocols within the most widely used federated unlearning scheme, which is based on clustering, to establish a privacy-preserving FU framework, aimed at ensuring privacy while effectively managing dynamic user participation. Comprehensive theoretical assessments and experimental results show that our proposed scheme achieves comparable unlearning effectiveness, alongside offering improved privacy protection and resilience in the face of varying user participation.


title: Realizations with five subsquares

abstract: Given an integer partition $(h_1,h_2,\dots,h_k)$ of $n$, is it possible to find an order $n$ latin square with $k$ disjoint subsquares of orders $h_1,\dots,h_k$? This question was posed by L.Fuchs and is only partially solved. Existence has been determined in general when $k\leq 4$, and in this paper we will complete the case when $k=5$. We also prove some less general results for partitions with $k=5$.


title: Evaluating MEDIRL: A Replication and Ablation Study of Maximum Entropy Deep Inverse Reinforcement Learning for Human Social Navigation

abstract: In this study, we enhance the Maximum Entropy Deep Inverse Reinforcement Learning (MEDIRL) framework, targeting its application in human robot interaction (HRI) for modeling pedestrian behavior in crowded environments. Our work is grounded in the pioneering research by Fahad, Chen, and Guo, and aims to elevate MEDIRL's efficacy in real world HRI settings. We replicated the original MEDIRL model and conducted detailed ablation studies, focusing on key model components like learning rates, state dimensions, and network layers. Our findings reveal the effectiveness of a two dimensional state representation over three dimensional approach, significantly improving model accuracy for pedestrian behavior prediction in HRI scenarios. These results not only demonstrate MEDIRL's enhanced performance but also offer valuable insights for future HRI system development, emphasizing the importance of model customization to specific environmental contexts. Our research contributes to advancing the field of socially intelligent navigation systems, promoting more intuitive and safer human robot interactions.


title: Using RL to Identify Divisive Perspectives Improves LLMs Abilities to Identify Communities on Social Media

abstract: The large scale usage of social media, combined with its significant impact, has made it increasingly important to understand it. In particular, identifying user communities, can be helpful for many downstream tasks. However, particularly when models are trained on past data and tested on future, doing this is difficult. In this paper, we hypothesize to take advantage of Large Language Models (LLMs), to better identify user communities. Due to the fact that many LLMs, such as ChatGPT, are fixed and must be treated as black-boxes, we propose an approach to better prompt them, by training a smaller LLM to do this. We devise strategies to train this smaller model, showing how it can improve the larger LLMs ability to detect communities. Experimental results show improvements on Reddit and Twitter data, on the tasks of community detection, bot detection, and news media profiling.


title: Limits of manifolds with boundary

abstract: In this paper, as a continuation of \cite{YZ:inrdius},we develop the geometry of the limit spaces of compact Riemannian manifolds with boundary, where we assume a lower sectional curvature bound,two sides bounds on the second fundamental forms of boundaries and an upper diameter bound. We mainly focus on the general case of non inradius collapse/convergence, where inradii of manifolds are uniformly bounded away from zero. In this case, many limit spaces have wild geometry, which arise from the boundary behavior of manifolds.Therefore the study of boundary singular points is a key to understand such limit spaces. We also present some global convergence/collapsing results.


title: MiniGPT-Reverse-Designing: Predicting Image Adjustments Utilizing MiniGPT-4

abstract: Vision-Language Models (VLMs) have recently seen significant advancements through integrating with Large Language Models (LLMs). The VLMs, which process image and text modalities simultaneously, have demonstrated the ability to learn and understand the interaction between images and texts across various multi-modal tasks. Reverse designing, which could be defined as a complex vision-language task, aims to predict the edits and their parameters, given a source image, an edited version, and an optional high-level textual edit description. This task requires VLMs to comprehend the interplay between the source image, the edited version, and the optional textual context simultaneously, going beyond traditional vision-language tasks. In this paper, we extend and fine-tune MiniGPT-4 for the reverse designing task. Our experiments demonstrate the extensibility of off-the-shelf VLMs, specifically MiniGPT-4, for more complex tasks such as reverse designing. Code is available at this \href{https://github.com/VahidAz/MiniGPT-Reverse-Designing}


title: All-sky Guide Star Catalog for CSST

abstract: The China Space Station Telescope (CSST) is a two-meter space telescope with multiple back-end instruments. The Fine Guidance Sensor (FGS) is an essential subsystem of the CSST Precision Image Stability System to ensure the required absolute pointing accuracy and line-of-sight stabilization. In this study, we construct the Main Guide Star Catalog for FGS. To accomplish this, we utilize the information about the FGS and object information from the Gaia Data Release 3. We provide an FGS instrument magnitude and exclude variables, binaries, and high proper motion stars from the catalog to ensure uniform FGS guidance capabilities. Subsequently, we generate a HEALPix index, which provides a hierarchical tessellation of the celestial sphere, and employ the Voronoi algorithm to achieve a homogeneous distribution of stars across the catalog. This distribution ensures adequate coverage and sampling of the sky. The performance of the CSST guide star catalog was assessed by simulating the field of view of the FGS according to the CSST mock survey strategy catalog. The analysis of the results indicates that this catalog provides adequate coverage and accuracy. The catalog's performance meets the FGS requirements, ensuring the functioning of the FGS and its guidance capabilities.


title: Cold-start Recommendation by Personalized Embedding Region Elicitation

abstract: Rating elicitation is a success element for recommender systems to perform well at cold-starting, in which the systems need to recommend items to a newly arrived user with no prior knowledge about the user's preference. Existing elicitation methods employ a fixed set of items to learn the user's preference and then infer the users' preferences on the remaining items. Using a fixed seed set can limit the performance of the recommendation system since the seed set is unlikely optimal for all new users with potentially diverse preferences. This paper addresses this challenge using a 2-phase, personalized elicitation scheme. First, the elicitation scheme asks users to rate a small set of popular items in a ``burn-in'' phase. Second, it sequentially asks the user to rate adaptive items to refine the preference and the user's representation. Throughout the process, the system represents the user's embedding value not by a point estimate but by a region estimate. The value of information obtained by asking the user's rating on an item is quantified by the distance from the region center embedding space that contains with high confidence the true embedding value of the user. Finally, the recommendations are successively generated by considering the preference region of the user. We show that each subproblem in the elicitation scheme can be efficiently implemented. Further, we empirically demonstrate the effectiveness of the proposed method against existing rating-elicitation methods on several prominent datasets.


title: Large Language Model Assisted Optimal Bidding of BESS in FCAS Market: An AI-agent based Approach

abstract: To incentivize flexible resources such as Battery Energy Storage Systems (BESSs) to offer Frequency Control Ancillary Services (FCAS), Australia's National Electricity Market (NEM) has implemented changes in recent years towards shorter-term bidding rules and faster service requirements. However, firstly, existing bidding optimization methods often overlook or oversimplify the key aspects of FCAS market procedures, resulting in an inaccurate depiction of the market bidding process. Thus, the BESS bidding problem is modeled based on the actual bidding records and the latest market specifications and then formulated as a deep reinforcement learning (DRL) problem. Secondly, the erratic decisions of the DRL agent caused by imperfectly predicted market information increases the risk of profit loss. Hence, a Conditional Value at Risk (CVaR)-based DRL algorithm is developed to enhance the risk resilience of bidding strategies. Thirdly, well-trained DRL models still face performance decline in uncommon scenarios during online operations. Therefore, a Large Language Models (LLMs)-assisted artificial intelligence (AI)-agent interactive decision-making framework is proposed to improve the strategy timeliness, reliability and interpretability in uncertain new scenarios, where conditional hybrid decision and self-reflection mechanisms are designed to address LLMs' hallucination challenge. The experiment results demonstrate that our proposed framework has higher bidding profitability compared to the baseline methods by effectively mitigating the profit loss caused by various uncertainties.


title: Luna: An Evaluation Foundation Model to Catch Language Model Hallucinations with High Accuracy and Low Cost

abstract: Retriever Augmented Generation (RAG) systems have become pivotal in enhancing the capabilities of language models by incorporating external knowledge retrieval mechanisms. However, a significant challenge in deploying these systems in industry applications is the detection and mitigation of hallucinations: instances where the model generates information that is not grounded in the retrieved context. Addressing this issue is crucial for ensuring the reliability and accuracy of responses generated by large language models (LLMs) in diverse industry settings. Current hallucination detection techniques fail to deliver accuracy, low latency, and low cost simultaneously. We introduce Luna: a DeBERTA-large (440M) encoder, finetuned for hallucination detection in RAG settings. We demonstrate that Luna outperforms GPT-3.5 and commercial evaluation frameworks on the hallucination detection task, with 97% and 91% reduction in cost and latency, respectively. Luna is lightweight and generalizes across multiple industry verticals and out-of-domain data, making it an ideal candidate for industry LLM applications.


title: Generative Pre-trained Speech Language Model with Efficient Hierarchical Transformer

abstract: While recent advancements in speech language models have achieved significant progress, they face remarkable challenges in modeling the long acoustic sequences of neural audio codecs. In this paper, we introduce \textbf{G}enerative \textbf{P}re-trained \textbf{S}peech \textbf{T}ransformer (GPST), a hierarchical transformer designed for efficient speech language modeling. GPST quantizes audio waveforms into two distinct types of discrete speech representations and integrates them within a hierarchical transformer architecture, allowing for a unified one-stage generation process and enhancing Hi-Res audio generation capabilities. By training on large corpora of speeches in an end-to-end unsupervised manner, GPST can generate syntactically consistent speech with diverse speaker identities. Given a brief 3-second prompt, GPST can produce natural and coherent personalized speech, demonstrating in-context learning abilities. Moreover, our approach can be easily extended to spoken cross-lingual speech generation by incorporating multi-lingual semantic tokens and universal acoustic tokens. Experimental results indicate that GPST significantly outperforms the existing speech language models in terms of word error rate, speech quality, and speaker similarity. See \url{https://youngsheen.github.io/GPST/demo} for demo samples.


title: Dragonfly: Multi-Resolution Zoom Supercharges Large Visual-Language Model

abstract: Recent advances in large multimodal models (LMMs) suggest that higher image resolution enhances the fine-grained understanding of image details, crucial for tasks such as visual commonsense reasoning and analyzing biomedical images. However, increasing input resolution poses two main challenges: 1) It extends the context length required by the language model, leading to inefficiencies and hitting the model's context limit; 2) It increases the complexity of visual features, necessitating more training data or more complex architecture. We introduce Dragonfly, a new LMM architecture that enhances fine-grained visual understanding and reasoning about image regions to address these challenges. Dragonfly employs two key strategies: multi-resolution visual encoding and zoom-in patch selection. These strategies allow the model to process high-resolution images efficiently while maintaining reasonable context length. Our experiments on eight popular benchmarks demonstrate that Dragonfly achieves competitive or better performance compared to other architectures, highlighting the effectiveness of our design. Additionally, we finetuned Dragonfly on biomedical instructions, achieving state-of-the-art results on multiple biomedical tasks requiring fine-grained visual understanding, including 92.3% accuracy on the Path-VQA dataset (compared to 83.3% for Med-Gemini) and the highest reported results on biomedical image captioning. To support model training, we curated a visual instruction-tuning dataset with 5.5 million image-instruction samples in the general domain and 1.4 million samples in the biomedical domain. We also conducted ablation studies to characterize the impact of various architectural designs and image resolutions, providing insights for future research on visual instruction alignment. The codebase and model are available at https://github.com/togethercomputer/Dragonfly.


title: Design of a High-Performance Tomographic Tactile Sensor by Manipulating the Detector Conductivity

abstract: Recent advancements in soft robots, human-machine interfaces, and wearable electronics have led to an increased demand for high-performance soft tactile sensors. Tomographic tactile sensor based on resistive coupling is a novel contact pressure imaging method that allows the use of an arbitrary conductive material in a detector. However, the influence of material properties on the sensing performance remains unclear and the efficient and appropriate selection of materials is difficult. In this study, the relationship between the conductivity distribution of the material used as a detector and the sensing performance including sensitivity, force range, spatial resolution, and position accuracy is clarified to develop a high-performance tomographic tactile sensor. The performance maps reveal that a material with a conductivity of approximately 0.2 S/m can serve as an effective detector for touch interactions involving a force range of several Newtons. Additionally, incorporating gradient conductivity in the cross-section of the detector and multi-layer conductive porous media with anisotropic conductive bonding can help expand the design flexibility for enhanced performance. Based on these findings, various tomographic tactile sensors for soft grippers, tangible input interfaces, flexible touch displays, and wearable electronics are demonstrated by using a conductive porous media.