title: Faster Sampling without Isoperimetry via Diffusion-based Monte Carlo

abstract: To sample from a general target distribution $p_*\propto e^{-f_*}$ beyond the isoperimetric condition, Huang et al. (2023) proposed to perform sampling through reverse diffusion, giving rise to Diffusion-based Monte Carlo (DMC). Specifically, DMC follows the reverse SDE of a diffusion process that transforms the target distribution to the standard Gaussian, utilizing a non-parametric score estimation. However, the original DMC algorithm encountered high gradient complexity, resulting in an exponential dependency on the error tolerance $\epsilon$ of the obtained samples. In this paper, we demonstrate that the high complexity of DMC originates from its redundant design of score estimation, and proposed a more efficient algorithm, called RS-DMC, based on a novel recursive score estimation method. In particular, we first divide the entire diffusion process into multiple segments and then formulate the score estimation step (at any time step) as a series of interconnected mean estimation and sampling subproblems accordingly, which are correlated in a recursive manner. Importantly, we show that with a proper design of the segment decomposition, all sampling subproblems will only need to tackle a strongly log-concave distribution, which can be very efficient to solve using the Langevin-based samplers with a provably rapid convergence rate. As a result, we prove that the gradient complexity of RS-DMC only has a quasi-polynomial dependency on $\epsilon$, which significantly improves exponential gradient complexity in Huang et al. (2023). Furthermore, under commonly used dissipative conditions, our algorithm is provably much faster than the popular Langevin-based algorithms. Our algorithm design and theoretical framework illuminate a novel direction for addressing sampling problems, which could be of broader applicability in the community.


title: Optimal linear prediction with functional observations: Why you can use a simple post-dimension reduction estimator

abstract: This paper investigates optimal linear prediction for a random function in an infinite-dimensional Hilbert space. We analyze the mean square prediction error (MSPE) associated with a linear predictor, revealing that non-unique solutions that minimize the MSPE generally exist, and consistent estimation is often impossible even if a unique solution exists. However, this paper shows that it is still feasible to construct an asymptotically optimal linear operator, for which the empirical MSPE approaches the minimal achievable level. Remarkably, standard post-dimension reduction estimators, widely employed in the literature, serve as such estimators under minimal conditions. This finding affirms the use of standard post-dimension reduction estimators as a way to achieve the minimum MSPE without requiring a careful examination of various technical conditions commonly required in functional linear models.


title: Learning from Semi-Factuals: A Debiased and Semantic-Aware Framework for Generalized Relation Discovery

abstract: We introduce a novel task, called Generalized Relation Discovery (GRD), for open-world relation extraction. GRD aims to identify unlabeled instances in existing pre-defined relations or discover novel relations by assigning instances to clusters as well as providing specific meanings for these clusters. The key challenges of GRD are how to mitigate the serious model biases caused by labeled pre-defined relations to learn effective relational representations and how to determine the specific semantics of novel relations during classifying or clustering unlabeled instances. We then propose a novel framework, SFGRD, for this task to solve the above issues by learning from semi-factuals in two stages. The first stage is semi-factual generation implemented by a tri-view debiased relation representation module, in which we take each original sentence as the main view and design two debiased views to generate semi-factual examples for this sentence. The second stage is semi-factual thinking executed by a dual-space tri-view collaborative relation learning module, where we design a cluster-semantic space and a class-index space to learn relational semantics and relation label indices, respectively. In addition, we devise alignment and selection strategies to integrate two spaces and establish a self-supervised learning loop for unlabeled data by doing semi-factual thinking across three views. Extensive experimental results show that SFGRD surpasses state-of-the-art models in terms of accuracy by 2.36\% $\sim$5.78\% and cosine similarity by 32.19\%$\sim$ 84.45\% for relation label index and relation semantic quality, respectively. To the best of our knowledge, we are the first to exploit the efficacy of semi-factuals in relation extraction.


title: Non-Euclidean Erd\H{o}s-Anning Theorems

abstract: The Erd\H{o}s-Anning theorem states that every point set in the Euclidean plane with integer distances must be either collinear or finite. More strongly, for any (non-degenerate) triangle of diameter $\delta$, at most $O(\delta^2)$ points can have integer distances from all three triangle vertices. We prove the same results for any strictly convex distance function on the plane, and analogous results for every two-dimensional complete Riemannian manifold of bounded genus and for geodesic distance on the boundary of every three-dimensional Euclidean convex set. As a consequence, we resolve a 1983 question of Richard Guy on the equilateral dimension of Riemannian manifolds. Our proofs are based on the properties of additively weighted Voronoi diagrams of these distances.


title: Numerical simulation of type II primordial black hole formation

abstract: This study investigates the formation of primordial black holes (PBHs) resulting from extremely large amplitudes of initial fluctuations in a radiation-dominated universe. We find that, for a sufficiently large initial amplitude, the configuration of trapping horizons shows characteristic structure due to the existence of bifurcating trapping horizons. We call this structure of the trapping horizons "Type II PBH", while the structure without a bifurcating trapping horizon "Type I PBH", which is typically generated from a relatively small amplitude of the initial fluctuation. In Ref.[1], in the dust-dominated universe, the Type II PBH can be realized by the Type II initial fluctuation, which is characterized by a non-monotonic areal radius as a function of the radial coordinate (throat structure) in contrast with the standard case with a monotonic areal radius (Type I fluctuation). Our research reveals that a type II fluctuation does not necessarily result in a type II PBH in the case of the radiation fluid. We also find that for the initial amplitude well above the threshold value, the resulting PBH mass may either increase or decrease with the initial amplitude depending on its specific profile rather than its fluctuation type.


title: The abelianization of the elementary group of rank two

abstract: For an arbitrary ring $A$, we study the abelianization of the elementary group $\textrm{E}_2(A)$. In particular, we show that for a commutative ring $A$ there exists an exact sequence \[ K_2(2,A)/C(2,A) \to A/M \to \textrm{E}_2(A)^\textrm{ab} \to 1, \] where $C(2,A)$ is the subgroup of the Steinberg group $\textrm{St}(2,A)$ generated by the Steinberg symbols and $M$ is the additive subgroup of $A$ generated by $x(a^2-1)$ and $3(b+1)(c+1)$, with $x\in A$, $a,b,c \in A^{\times}$.


title: Application Of Vision-Language Models For Assessing Osteoarthritis Disease Severity

abstract: Osteoarthritis (OA) poses a global health challenge, demanding precise diagnostic methods. Current radiographic assessments are time consuming and prone to variability, prompting the need for automated solutions. The existing deep learning models for OA assessment are unimodal single task systems and they don't incorporate relevant text information such as patient demographics, disease history, or physician reports. This study investigates employing Vision Language Processing (VLP) models to predict OA severity using Xray images and corresponding reports. Our method leverages Xray images of the knee and diverse report templates generated from tabular OA scoring values to train a CLIP (Contrastive Language Image PreTraining) style VLP model. Furthermore, we incorporate additional contrasting captions to enforce the model to discriminate between positive and negative reports. Results demonstrate the efficacy of these models in learning text image representations and their contextual relationships, showcase potential advancement in OA assessment, and establish a foundation for specialized vision language models in medical contexts.


title: Distributed Solvers for Network Linear Equations with Scalarized Compression

abstract: In this paper, we study distributed solvers for network linear equations over a network with node-to-node communication messages compressed as scalar values. Our key idea lies in a dimension compression scheme including a dimension compressing vector that applies to individual node states to generate a real-valued message for node communication as an inner product, and a data unfolding step in the local computations where the scalar message is plotted along the subspace generated by the compression vector. We first present a compressed average consensus flow that relies only on such scalar communication, and show that exponential convergence can be achieved with well excited signals for the compression vector. We then employ such a compressed consensus flow as a fundamental consensus subroutine to develop distributed continuous-time and discrete-time solvers for network linear equations, and prove their exponential convergence properties under scalar node communications. With scalar communications, a direct benefit would be the reduced node-to-node communication channel capacity requirement for distributed computing. Numerical examples are presented to illustrate the effectiveness of the established theoretical results.


title: Direction dependent switching of carrier-type enabled by Fermi surface geometry

abstract: While charge carriers can typically be designated as either electron- or hole- type, depending on the sign of the Hall coefficient, some materials defy this straightforward classification. Here we find that LaRh$_6$Ge$_4$ goes beyond this dichotomy, where the Hall resistivity is electron-like for magnetic fields along the $c$-axis but hole-like in the basal plane. Together with first-principles calculations, we show that this direction-dependent switching of the carrier type arises within a single band, where the special geometry leads to charge carriers on the same Fermi surface orbiting as electrons along some directions, but holes along others. The relationship between the Fermi surface geometry and occurrence of a Hall sign reversal is further generalized by considering tight-binding model calculations, which show that this type of Fermi surface corresponds to a more robust means of realizing this phenomenon, suggesting an important route for tailoring direction dependent properties for advanced electronic device applications.


title: Unified Near-field and Far-field Localization with Holographic MIMO

abstract: Localization which uses holographic multiple input multiple output surface such as reconfigurable intelligent surface (RIS) has gained increasing attention due to its ability to accurately localize users in non-line-of-sight conditions. However, existing RIS-enabled localization methods assume the users at either the near-field (NF) or the far-field (FF) region, which results in high complexity or low localization accuracy, respectively, when they are applied in the whole area. In this paper, a unified NF and FF localization method is proposed for the RIS-enabled localization system to overcome the above issue. Specifically, the NF and FF regions are both divided into grids. The RIS reflects the signals from the user to the base station~(BS), and then the BS uses the received signals to determine the grid where the user is located. Compared with existing NF- or FF-only schemes, the design of the location estimation method and the RIS phase shift optimization algorithm is more challenging because they are based on a hybrid NF and FF model. To tackle these challenges, we formulate the optimization problems for location estimation and RIS phase shifts, and design two algorithms to effectively solve the formulated problems, respectively. The effectiveness of the proposed method is verified through simulations.


title: Symmetry Lowering Through Surface Engineering and Improved Thermoelectric Properties in MXenes

abstract: Despite ample evidence of their influences on the transport properties of two-dimensional solids, the interrelations of reduced symmetry, electronic and thermal transport, have rarely being discussed in the context of thermoelectric materials. With the motivation to design new thermoelectric materials with improved properties, we have addressed these by performing first-principles Density Functional Theory based calculations in conjunction with semi-classical Boltzmann transport theory on a number of compounds in the MXene family. The symmetry lowering in parent M$_{2}$CO$_{2}$ MXenes are done by replacing transition metal $M$ on one surface, resulting in Janus compounds MM$^{\prime}$CO$_{2}$. Our calculations show that the thermoelectric figure-of-merit can be improved significantly by such surface engineering. We discuss in detail, both qualitatively and quantitatively, the origin behind high thermoelectric parameters for these compounds. Our in-depth analysis shows that the modifications in the electronic band structures and degree of anharmonicity driven by the dispersions in the bond strengths due to lowering of symmetry, an artefact of surface engineering, are the factors behind the trends in the thermoelectric parameters of the MXenes considered. The results also substantiate that the compositional flexibility offered by the MXene family of compounds can generate complex interplay of symmetry, electronic structure, bond strengths and anharmonicity which can be exploited to engineer thermoelectric materials with improved properties.


title: TRACE: A Time-Relational Approximate Cubing Engine for Fast Data Insights

abstract: A large class of data questions can be modeled as identifying important slices of data driven by user defined metrics. This paper presents TRACE, a Time-Relational Approximate Cubing Engine that enables interactive analysis on such slices with a low upfront cost - both in space and computation. It does this by materializing the most important parts of the cube over time enabling interactive querying for a large class of analytical queries e.g. what part of my business has the highest revenue growth ([SubCategory=Sports Equipment, Gender=Female]), what slices are lagging in revenue per user ([State=CA, Age=20-30]). Many user defined metrics are supported including common aggregations such as SUM, COUNT, DISTINCT COUNT and more complex ones such as AVERAGE. We implemented and deployed TRACE for a variety of business use cases.


title: An ontology alignment method with user intervention using compact differential evolution with adaptive parameter control

abstract: User interaction is one of the most effective ways to improve the ontology alignment quality. However, this approach faces the challenge of how users can participate effectively in the matching process. To solve this challenge. In this paper, an interactive ontology alignment approach using compact differential evolution algorithm with adaptive parameter control (IOACDE) is proposed. In this method, the ontology alignment process is modeled as an interactive optimization problem and users are allowed to intervene in matching in two ways. One is that the mapping suggestions generated by IOACDE as a complete candidate alignment is evaluated by user during optimization process. The other is that the user ameliorates the alignment results by evaluating single mapping after the automatic matching process. To demonstrate the effectiveness of the proposed algorithm, the neural embedding model and K nearest neighbor (KNN) is employed to simulate user for the ontologies of the real world. The experimental results show that the proposed interactive approach can improve the alignment quality compared to the non-interactive. Compared with the state-of-the-art methods from OAEI, the results show that the proposed algorithm has a better performance under the same error rate.


title: Elliptical Pursuit and Evasion

abstract: When the evader travels around a circle and the pursuer moves at a speed equal to half that of the evader, the pursuer's trajectory converges to a circle with a radius half of that of the evader's. Nevertheless, this feature vanishes when the evader's trajectory shifts from a circle to an ellipse. We initially hypothesized that the cause was the angular velocity and speed is not constant. Then, we kept the evader's angular velocity or speed constant, shape of the pursuer's trajectory did not change. Although the cause is not yet fully understood, the findings demonstrate that the pursuer's trajectory remains unchanged even when the parameters of the evader are altered.


title: Analysis and operating diagram of an interspecific density-dependent model

abstract: This paper studies a two microbial species model in competition for a single resource in the chemostat including general interspecific density-dependent growth rates with distinct removal rates for each species. We give the necessary and sufficient conditions of existence, uniqueness, and local stability of all steady states. We show that a positive steady state, if it exists, then it is unique and unstable. In this case, the system exhibits a bi-stability where the behavior of the process depends on the initial condition. Our mathematical analysis proves that at most one species can survive which confirms the competitive exclusion principle. We conclude that adding only interspecific competition in the classical chemostat model is not sufficient to show the coexistence of two species even considering mortality in the dynamics of two species. Otherwise, we focus on the study, theoretically and numerically, of the operating diagram which depicts the existence and the stability of each steady state according to the two operating parameters of the process which are the dilution rate and the input concentration of the substrate. Using our mathematical analysis, we construct analytically the operating diagram by plotting the curves that separate their various regions. Our numerical method using MATCONT software validates these theoretical results but it reveals new bifurcations that occur by varying two parameters as Bogdanov-Takens and Zero-Hopf bifurcations. The bifurcation analysis shows that all steady states can appear or disappear only through transcritical bifurcations.


title: A Temporal-Spectral Fusion Transformer with Subject-specific Adapter for Enhancing RSVP-BCI Decoding

abstract: The Rapid Serial Visual Presentation (RSVP)-based Brain-Computer Interface (BCI) is an efficient technology for target retrieval using electroencephalography (EEG) signals. The performance improvement of traditional decoding methods relies on a substantial amount of training data from new test subjects, which increases preparation time for BCI systems. Several studies introduce data from existing subjects to reduce the dependence of performance improvement on data from new subjects, but their optimization strategy based on adversarial learning with extensive data increases training time during the preparation procedure. Moreover, most previous methods only focus on the single-view information of EEG signals, but ignore the information from other views which may further improve performance. To enhance decoding performance while reducing preparation time, we propose a Temporal-Spectral fusion transformer with Subject-specific Adapter (TSformer-SA). Specifically, a cross-view interaction module is proposed to facilitate information transfer and extract common representations across two-view features extracted from EEG temporal signals and spectrogram images. Then, an attention-based fusion module fuses the features of two views to obtain comprehensive discriminative features for classification. Furthermore, a multi-view consistency loss is proposed to maximize the feature similarity between two views of the same EEG signal. Finally, we propose a subject-specific adapter to rapidly transfer the knowledge of the model trained on data from existing subjects to decode data from new subjects. Experimental results show that TSformer-SA significantly outperforms comparison methods and achieves outstanding performance with limited training data from new subjects. This facilitates efficient decoding and rapid deployment of BCI systems in practical use.


title: AffordanceLLM: Grounding Affordance from Vision Language Models

abstract: Affordance grounding refers to the task of finding the area of an object with which one can interact. It is a fundamental but challenging task, as a successful solution requires the comprehensive understanding of a scene in multiple aspects including detection, localization, and recognition of objects with their parts, of geo-spatial configuration/layout of the scene, of 3D shapes and physics, as well as of the functionality and potential interaction of the objects and humans. Much of the knowledge is hidden and beyond the image content with the supervised labels from a limited training set. In this paper, we make an attempt to improve the generalization capability of the current affordance grounding by taking the advantage of the rich world, abstract, and human-object-interaction knowledge from pretrained large-scale vision language models. Under the AGD20K benchmark, our proposed model demonstrates a significant performance gain over the competing methods for in-the-wild object affordance grounding. We further demonstrate it can ground affordance for objects from random Internet images, even if both objects and actions are unseen during training. Project site: https://jasonqsy.github.io/AffordanceLLM/


title: Dualizing complexes on the moduli of parabolic bundles

abstract: For a non-archimedean local field $F$ and a connected reductive group $G$ over $F$ equipped with a parabolic subgroup $P$, we show that the dualizing complex on $\mathrm{Bun}_P$, the moduli stack of $P$-bundles on the Fargues--Fontaine curve, can be described explicitly in terms of the modulus character of $P$. As applications, we identify various characters appearing in the theory of local and global Shimura varieties, show the Harris--Viehmann conjecture in the Hodge--Newton reducible case, and carry out some computations of the geometric Eisenstein functors for general parabolics.


title: Observing the Sun with the Atacama Large Millimeter/submillimeter Array (ALMA): Polarization Observations at 3 mm

abstract: The Atacama Large Millimeter-submillimeter Array (ALMA) is a general purpose telescope that performs a broad program of astrophysical observations. Beginning in late-2016, solar observations with ALMA became available, thereby opening a new window onto solar physics. Since then, the number of solar observing capabilities has increased substantially but polarimetric observations, a community priority, have not been available. Weakly circularly polarized emission is expected from the chromosphere where magnetic fields are strong. Hence, maps of Stokes V provide critical new constraints on the longitudinal component of the chromospheric magnetic field. Between 2019-2022, an ALMA solar development effort dedicated to making solar polarimetry at millimeter wavelengths a reality was carried out. Here, we discuss the development effort to enable solar polarimetry in the 3 mm band (ALMA Band 3) in detail and present a number of results that emerge from the development program. These include tests that validate polarization calibration, including evaluation of instrumental polarization: both antenna based "leakage" terms and off-axis effects (termed "beam squint" for Stokes V). We also present test polarimetric observations of a magnetized source on the Sun, the following sunspot in a solar active region, which shows a significant Stokes V signature in line with expectations. Finally, we provide some cautions and guidance to users contemplating the use of polarization observations with ALMA.


title: Hyper-STTN: Social Group-aware Spatial-Temporal Transformer Network for Human Trajectory Prediction with Hypergraph Reasoning

abstract: Predicting crowded intents and trajectories is crucial in varouls real-world applications, including service robots and autonomous vehicles. Understanding environmental dynamics is challenging, not only due to the complexities of modeling pair-wise spatial and temporal interactions but also the diverse influence of group-wise interactions. To decode the comprehensive pair-wise and group-wise interactions in crowded scenarios, we introduce Hyper-STTN, a Hypergraph-based Spatial-Temporal Transformer Network for crowd trajectory prediction. In Hyper-STTN, crowded group-wise correlations are constructed using a set of multi-scale hypergraphs with varying group sizes, captured through random-walk robability-based hypergraph spectral convolution. Additionally, a spatial-temporal transformer is adapted to capture pedestrians' pair-wise latent interactions in spatial-temporal dimensions. These heterogeneous group-wise and pair-wise are then fused and aligned though a multimodal transformer network. Hyper-STTN outperformes other state-of-the-art baselines and ablation models on 5 real-world pedestrian motion datasets.


title: Seek for Incantations: Towards Accurate Text-to-Image Diffusion Synthesis through Prompt Engineering

abstract: The text-to-image synthesis by diffusion models has recently shown remarkable performance in generating high-quality images. Although performs well for simple texts, the models may get confused when faced with complex texts that contain multiple objects or spatial relationships. To get the desired images, a feasible way is to manually adjust the textual descriptions, i.e., narrating the texts or adding some words, which is labor-consuming. In this paper, we propose a framework to learn the proper textual descriptions for diffusion models through prompt learning. By utilizing the quality guidance and the semantic guidance derived from the pre-trained diffusion model, our method can effectively learn the prompts to improve the matches between the input text and the generated images. Extensive experiments and analyses have validated the effectiveness of the proposed method.


title: Towards better representation of Indian summer monsoon rainfall in CMIP6 models: Evaluation of MISO and MJO simulation

abstract: The seasonal prediction of the Indian summer monsoon (ISM) and Monsoon Intraseasonal Oscillations (MISO), as well as the Madden Julian Oscillations (MJO) that strongly modulate MISO, is important to the country for water and crop management. We have analyzed the precipitation, convection, and total cloud fraction (TCF) in the sixth Coupled Model Intercomparison Projects (CMIP6). This study highlights the significant differences in simulating MISO and MJO between the two groups of selected CMIP6 models and physical reasons behind them. The mean and intraseasonal features of MISO and MJO varied significantly in CMIP6 models, which are linked with a better depiction of convection and total cloud fraction. The probability distributions of rainfall and OLR in CMIP6 models indicate significant variations in simulating ISM precipitating clouds. TaiESM1 and IITM-ESM demonstrate improvements in capturing the MISO features. TaiESM1 depicts better eastward propagation of MJO during both summer and winter. The biases in OLR and TCF are also less in the IITM-ESM and TaiESM1 models than in CanESM5 and FGOALS-g3. The results demonstrate the importance of cloud and convection in CMIP6 models to depict realistic MISO and MJO and provide a road map for improving ISM climate prediction and projections. Keywords: ISM rainfall, CMIP6 models, MISO, MJO


title: Diagnostics for Regression Models with Semicontinuous Outcomes

abstract: Semicontinuous outcomes commonly arise in a wide variety of fields, such as insurance claims, healthcare expenditures, rainfall amounts, and alcohol consumption. Regression models, including Tobit, Tweedie, and two-part models, are widely employed to understand the relationship between semicontinuous outcomes and covariates. Given the potential detrimental consequences of model misspecification, after fitting a regression model, it is of prime importance to check the adequacy of the model. However, due to the point mass at zero, standard diagnostic tools for regression models (e.g., deviance and Pearson residuals) are not informative for semicontinuous data. To bridge this gap, we propose a new type of residuals for semicontinuous outcomes that are applicable to general regression models. Under the correctly specified model, the proposed residuals converge to being uniformly distributed, and when the model is misspecified, they significantly depart from this pattern. In addition to in-sample validation, the proposed methodology can also be employed to evaluate predictive distributions. We demonstrate the effectiveness of the proposed tool using health expenditure data from the US Medical Expenditure Panel Survey.


title: A Fully Bayesian Approach for Comprehensive Mapping of Magnitude and Phase Brain Activation in Complex-Valued fMRI Data

abstract: Functional magnetic resonance imaging (fMRI) plays a crucial role in neuroimaging, enabling the exploration of brain activity through complex-valued signals. These signals, composed of magnitude and phase, offer a rich source of information for understanding brain functions. Traditional fMRI analyses have largely focused on magnitude information, often overlooking the potential insights offered by phase data. In this paper, we propose a novel fully Bayesian model designed for analyzing single-subject complex-valued fMRI (cv-fMRI) data. Our model, which we refer to as the CV-M&P model, is distinctive in its comprehensive utilization of both magnitude and phase information in fMRI signals, allowing for independent prediction of different types of activation maps. We incorporate Gaussian Markov random fields (GMRFs) to capture spatial correlations within the data, and employ image partitioning and parallel computation to enhance computational efficiency. Our model is rigorously tested through simulation studies, and then applied to a real dataset from a unilateral finger-tapping experiment. The results demonstrate the model's effectiveness in accurately identifying brain regions activated in response to specific tasks, distinguishing between magnitude and phase activation.


title: ADAPT: Alzheimer Diagnosis through Adaptive Profiling Transformers

abstract: Automated diagnosis of Alzheimer Disease(AD) from brain imaging, such as magnetic resonance imaging (MRI), has become increasingly important and has attracted the community to contribute many deep learning methods. However, many of these methods are facing a trade-off that 3D models tend to be complicated while 2D models cannot capture the full 3D intricacies from the data. In this paper, we introduce a new model structure for diagnosing AD, and it can complete with performances of 3D models while essentially is a 2D method (thus computationally efficient). While the core idea lies in new perspective of cutting the 3D images into multiple 2D slices from three dimensions, we introduce multiple components that can further benefit the model in this new perspective, including adaptively selecting the number of sclices in each dimension, and the new attention mechanism. In addition, we also introduce a morphology augmentation, which also barely introduces new computational loads, but can help improve the diagnosis performances due to its alignment to the pathology of AD. We name our method ADAPT, which stands for Alzheimer Diagnosis through Adaptive Profiling Transformers. We test our model from a practical perspective (the testing domains do not appear in the training one): the diagnosis accuracy favors our ADAPT, while ADAPT uses less parameters than most 3D models use.


title: Optimal estimation of the null distribution in large-scale inference

abstract: The advent of large-scale inference has spurred reexamination of conventional statistical thinking. In a Gaussian model for $n$ many $z$-scores with at most $k < \frac{n}{2}$ nonnulls, Efron suggests estimating the location and scale parameters of the null distribution. Placing no assumptions on the nonnull effects, the statistical task can be viewed as a robust estimation problem. However, the best known robust estimators fail to be consistent in the regime $k \asymp n$ which is especially relevant in large-scale inference. The failure of estimators which are minimax rate-optimal with respect to other formulations of robustness (e.g. Huber's contamination model) might suggest the impossibility of consistent estimation in this regime and, consequently, a major weakness of Efron's suggestion. A sound evaluation of Efron's model thus requires a complete understanding of consistency. We sharply characterize the regime of $k$ for which consistent estimation is possible and further establish the minimax estimation rates. It is shown consistent estimation of the location parameter is possible if and only if $\frac{n}{2} - k = \omega(\sqrt{n})$, and consistent estimation of the scale parameter is possible in the entire regime $k < \frac{n}{2}$. Faster rates than those in Huber's contamination model are achievable by exploiting the Gaussian character of the data. The minimax upper bound is obtained by considering estimators based on the empirical characteristic function. The minimax lower bound involves constructing two marginal distributions whose characteristic functions match on a wide interval containing zero. The construction notably differs from those in the literature by sharply capturing a scaling of $n-2k$ in the minimax estimation rate of the location.


title: The augmented weak sharpness of solution sets in equilibrium problems

abstract: This study delves into equilibrium problems, focusing on the identification of finite solutions for feasible solution sequences. We introduce an innovative extension of the weak sharp minimum concept from convex programming to equilibrium problems, coining this as weak sharpness for solution sets. Recognizing situations where the solution set may not exhibit weak sharpness, we propose an augmented mapping approach to mitigate this limitation. The core of our research is the formulation of augmented weak sharpness for the solution set, a comprehensive concept that encapsulates both weak sharpness and strong non-degeneracy within feasible solution sequences. Crucially, we identify a necessary and sufficient condition for the finite termination of these sequences under the premise of augmented weak sharpness for the solution set in equilibrium problems. This condition significantly broadens the scope of existing literature, which often assumes the solution set to be weakly sharp or strongly non-degenerate, especially in the context of mathematical programming and variational inequality problems. Our findings not only shed light on the termination conditions in equilibrium problems but also introduce a less stringent sufficient condition for the finite termination of various optimization algorithms. This research, therefore, makes a substantial contribution to the field by enhancing our understanding of termination conditions in equilibrium problems and expanding the applicability of established theories to a wider range of optimization scenarios.


title: A Hamilton-Jacobi-Bellman Approach to Ellipsoidal Approximations of Reachable Sets for Linear Time-Varying Systems

abstract: Reachable sets for a dynamical system describe collections of system states that can be reached in finite time, subject to system dynamics. They can be used to guarantee goal satisfaction in controller design or to verify that unsafe regions will be avoided. However, general-purpose methods for computing these sets suffer from the curse of dimensionality, which typically prohibits their use for systems with more than a small number of states, even if they are linear. In this paper, we demonstrate that viscosity supersolutions and subsolutions of a Hamilton-Jacobi-Bellman equation can be used to generate, respectively, under-approximating and over-approximating reachable sets for time-varying nonlinear systems. Based on this observation, we derive dynamics for a union and intersection of ellipsoidal sets that, respectively, under-approximate and over-approximate the reachable set for linear time-varying systems subject to an ellipsoidal input constraint and an ellipsoidal terminal (or initial) set. We demonstrate that the dynamics for these ellipsoids can be selected to ensure that their boundaries coincide with the boundary of the exact reachable set along a solution of the system. The ellipsoidal sets can be generated with polynomial computational complexity in the number of states, making our approximation scheme computationally tractable for continuous-time linear time-varying systems of relatively high dimension.


title: Riemann zeta functions for Krull monoids

abstract: The primary purpose of this paper is to generalize the classical Riemann zeta function to the setting of Krull monoids with torsion class groups. We provide a first study of the same generalization by extending Euler's classical product formula to the more general scenario of Krull monoids with torsion class groups. In doing so, the Decay Theorem is fundamental as it allows us to use strong atoms instead of primes to obtain a weaker version of the Fundamental Theorem of Arithmetic in the more general setting of Krull monoids with torsion class groups. Several related examples are exhibited throughout the paper, in particular, algebraic number fields for which the generalized Riemann zeta function specializes to the Dedekind zeta function.


title: Initial Analysis of Data-Driven Haptic Search for the Smart Suction Cup

abstract: Suction cups offer a useful gripping solution, particularly in industrial robotics and warehouse applications. Vision-based grasp algorithms, like Dex-Net, show promise but struggle to accurately perceive dark or reflective objects, sub-resolution features, and occlusions, resulting in suction cup grip failures. In our prior work, we designed the Smart Suction Cup, which estimates the flow state within the cup and provides a mechanically resilient end-effector that can inform arm feedback control through a sense of touch. We then demonstrated how this cup's signals enable haptically-driven search behaviors for better grasping points on adversarial objects. This prior work uses a model-based approach to predict the desired motion direction, which opens up the question: does a data-driven approach perform better? This technical report provides an initial analysis harnessing the data previously collected. Specifically, we compare the model-based method with a preliminary data-driven approach to accurately estimate lateral pose adjustment direction for improved grasp success.


title: Self-consistent study of topological superconductivity in two-dimensional quasicrystals

abstract: We study two-dimensional $s$-wave topological superconductivity with Rashba spin-orbit coupling and Zeeman field in Penrose and Ammann-Beenker quasicrystals. By solving the Bogoliubov-de Gennes equations self-consistently for not only the superconducting order parameter, but also the spin-dependent Hartree potential, we show the stable occurrence of TSC with broken time-reversal symmetry in both Penrose and Ammann-Beenker quasicrystals. The topological nature of the quasicrystalline system is signified by the Bott index $B$. Topological phase transitions are found to occur, where $B$ changes between 0 and $\pm 1$, as the chemical potential or Zeeman field is varied. In terms of self-consistent solutions, we demonstrate the existence of a Majorana zero mode per edge or vortex when $B=\pm 1$, consistently with the bulk-edge/defect correspondence for periodic systems.


title: An Empirical Investigation into the Effect of Parameter Choices in Knowledge Distillation

abstract: We present a large-scale empirical study of how choices of configuration parameters affect performance in knowledge distillation (KD). An example of such a KD parameter is the measure of distance between the predictions of the teacher and the student, common choices for which include the mean squared error (MSE) and the KL-divergence. Although scattered efforts have been made to understand the differences between such options, the KD literature still lacks a systematic study on their general effect on student performance. We take an empirical approach to this question in this paper, seeking to find out the extent to which such choices influence student performance across 13 datasets from 4 NLP tasks and 3 student sizes. We quantify the cost of making sub-optimal choices and identify a single configuration that performs well across the board.


title: FeS2 monolayer: a high valence and high-$T_{\rm C}$ Ising ferromagnet

abstract: Two-dimensional (2D) magnetic materials are of current great interest for their promising applications in spintronics. Strong magnetic coupling and anisotropy are both highly desirable for the achievement of a high temperature magnetic order. Here we propose the unusual high valent FeS$_2$ hexagonal monolayer as such a candidate for a strong Ising 2D ferromagnet (FM), by spin-orbital state analyses, first-principles calculations, and the renormalized spin-wave theory (RSWT). We find that very importantly, the high valent Fe$^{4+}$ ion is in the low-spin state ($t_{2g}^{4}$, $S$=1) with degenerate $t_{2g}$ orbitals rather than the high-spin state ($t_{2g}^{3}e_g^{1}$, $S$=2). It is the low-spin state that allows to carry a large perpendicular orbital moment and then produces a huge single ion anisotropy (SIA) of 25 meV/Fe. Moreover, the negative charge transfer character associated with the unusual high valence, strong Fe $3d$-S $3p$ hybridization, wide bands, and a small band gap all help to establish a strong superexchange. Indeed, our first-principles calculations confirm the strong FM superexchange and the huge perpendicular SIA, both of which are further enhanced by a compressive strain. Then, our RSWT calculations predict that the FM $T_{\rm C}$ is 261 K for the pristine FeS$_2$ monolayer and could be increased to 409 K under the compressive --5\% strain. The high $T_{\rm C}$ is also reproduced by our Monte Carlo (MC) simulations. Therefore, it is worth exploring the high-$T_{\rm C}$ Ising FMs in the high valent 2D magnetic materials with degenerate orbitals.


title: Photonuclear reaction in ${67}^$Zn

abstract: Mono-energetic $\gamma$-beams ($\Delata \approx$ 10 eV) based on thermal neutron capture, in a nuclear reactor, using the Mn(n, $\gamma$) reaction were utilized for generating a fast neutron source from Zinc, via the ${67}^Zn(\gamma, n)$ reaction. One of the incident $\gamma$-lines of the Mn source at $E_\gamma$ = 7244 keV, photoexcites by chance a resonance level in ${67}^$Zn, with subsequent emission of neutrons at an energy of 191 keV. The cross-section for this process was measured and found to be $\sigma(\gamma, n)$ = 252 $\pm$ 41 mb with an intensity of the order of 104 n/s. The angular distribution of the 191 keV neutron group was also measured.


title: Time-resolved force microscopy using delay-time modulation method

abstract: We developed a time-resolved force microscopy technique by integrating atomic force microscopy using a tuning-fork-type cantilever with the delay time modulation method for optical pump-probe light. We successfully measured the dynamics of surface recombination and diffusion of photoexcited carriers in bulk WSe2, which is challenging owing to the effect of tunneling current in time-resolved scanning tunneling microscopy. The obtained results were comprehensively explained with the model based on the dipole-dipole interaction induced by photo illumination.


title: Recent developments from Feynman integrals

abstract: This talk reviews recent developments in the field of analytical Feynman integral calculations. The central theme is the geometry associated to a given Feynman integral. In the simplest case this is a complex curve of genus zero (aka the Riemann sphere). In this talk we discuss Feynman integrals related to more complicated geometries like curves of higher genus or manifolds of higher dimensions. In the latter case we encounter Calabi-Yau manifolds. We also discuss how to compute these Feynman integrals.


title: Visions Of Destruction: Exploring Human Impact on Nature by Navigating the Latent Space of a Diffusion Model via Gaze

abstract: This paper discusses the artwork "Visions of Destruction", with a primary conceptual focus on the Anthropocene, which is communicated through audience interaction and generative AI as artistic research methods. Gaze-based interaction transitions the audience from mere observers to agents of landscape transformation, fostering a profound, on-the-edge engagement with pressing issues such as climate change and planetary destruction. The paper looks into early references of interactive art history that deploy eye-tracking as a method for audience interaction, and presents recent AI-aided artworks that demonstrate interactive latent space navigation.


title: Attention, Distillation, and Tabularization: Towards Practical Neural Network-Based Prefetching

abstract: Attention-based Neural Networks (NN) have demonstrated their effectiveness in accurate memory access prediction, an essential step in data prefetching. However, the substantial computational overheads associated with these models result in high inference latency, limiting their feasibility as practical prefetchers. To close the gap, we propose a new approach based on tabularization that significantly reduces model complexity and inference latency without sacrificing prediction accuracy. Our novel tabularization methodology takes as input a distilled, yet highly accurate attention-based model for memory access prediction and efficiently converts its expensive matrix multiplications into a hierarchy of fast table lookups. As an exemplar of the above approach, we develop DART, a prefetcher comprised of a simple hierarchy of tables. With a modest 0.09 drop in F1-score, DART reduces 99.99% of arithmetic operations from the large attention-based model and 91.83% from the distilled model. DART accelerates the large model inference by 170x and the distilled model by 9.4x. DART has comparable latency and storage costs as state-of-the-art rule-based prefetcher BO but surpasses it by 6.1% in IPC improvement. DART outperforms state-of-the-art NN-based prefetchers TransFetch by 33.1% and Voyager by 37.2% in terms of IPC improvement, primarily due to its low prefetching latency.


title: Asymptotic behavior of global solutions to the complex Ginzburg--Landau type equation in the super Fujita-critical case

abstract: We present weighted estimates and higher order asymptotic expansions of global solutions to the complex Ginzburg--Landau (CGL) type equation in the super Fujita-critical case. Our approach is based on commutation relations between the CGL semigroup and monomial weights in $\mathbb{R}^{n}$ for the weighted estimates and on the Taylor expansions with respect to the both space and time variables for the asymptotic expansions. We also characterize the optimal decay rate in time of the remainder for the asymptotic expansion from the viewpoint of the moments of the initial data in space and those of the nonlinear term in spacetime.


title: Proper maps of ball complements & differences and rational sphere maps

abstract: We consider proper holomorphic maps of complements and differences of balls in complex euclidean space of dimension at least $2$. We prove that every proper map of ball complements gives a polynomial proper map of balls, and conversely, every polynomial proper map of balls whose norm goes to infinity at infinity is a proper map of ball complements. The case of ball differences is more complex and naturally leads to what we call rational $m$-fold sphere maps, that is, rational maps taking $m$ zero-centric spheres to $m$ zero-centric spheres. A proper map of the difference of zero-centric balls is automatically a rational $2$-fold sphere map. We show that a polynomial $m$-fold sphere map of degree $m$ or less is an $\infty$-fold sphere map, that is, a map that takes infinitely many (and hence every) zero-centric spheres to zero-centric spheres. Similarly, every rational $m$-fold sphere map of degree less than $m$ is an $\infty$-fold sphere map. We then show that $\infty$-fold sphere maps are up to a unitary transformation direct sums of a finite number of homogeneous sphere maps. We construct rational $m$-fold degree-$m$ sphere maps that do not take any other zero-centric sphere to a zero-centric sphere. In particular, every first-degree rational proper map of the difference of zero-centric balls is a unitary composed with an affine linear embedding; however, there exist nonpolynomial second-degree rational maps of a difference of balls.


title: Boundary phase transitions of two-dimensional quantum critical XXZ model

abstract: The boundary critical behavior of the two-dimensional (2D) quantum antiferromagnetic(AF) XXZ model coupled with either a dangling spin-1/2 XXZ chain or a dangling two-leg ladder on the boundary is studied with the bosonization and renormalization group analysis. A rich boundary phase diagram is obtained in each case. In the dangling chain case, the boundary either develops a long-range AF order in the easy-plane or the easy-axis direction with extraordinary critical behavior, or has a valence bond solid order with ordinary boundary critical behavior. In the case of a dangling two-leg ladder, besides the possible easy-plane or easy-axis AF ordered phases on the boundary with extraordinary critical behavior, the boundary can form a singlet phase with ordinary critical behavior without breaking any symmetry.


title: Network Anatomy and Real-Time Measurement of Nvidia GeForce NOW Cloud Gaming

abstract: Cloud gaming, wherein game graphics is rendered in the cloud and streamed back to the user as real-time video, expands the gaming market to billions of users who do not have gaming consoles or high-power graphics PCs. Companies like Nvidia, Amazon, Sony and Microsoft are investing in building cloud gaming platforms to tap this large unserved market. However, cloud gaming requires the user to have high bandwidth and stable network connectivity - whereas a typical console game needs about 100-200 kbps, a cloud game demands minimum 10-20 Mbps. This makes the Internet Service Provider (ISP) a key player in ensuring the end-user's good gaming experience. In this paper we develop a method to detect Nvidia's GeForce NOW cloud gaming sessions over their network infrastructure, and measure associated user experience. In particular, we envision ISPs taking advantage of our method to provision network capacity at the right time and in the right place to support growth in cloud gaming at the right experience level; as well as identify the role of contextual factors such as user setup (browser vs app) and connectivity type (wired vs wireless) in performance degradation. We first present a detailed anatomy of flow establishment and volumetric profiles of cloud gaming sessions over multiple platforms, followed by a method to detect gameplay and measure key experience aspects such as latency, frame rate and resolution via real-time analysis of network traffic. The insights and methods are also validated in the lab for XBox Cloud Gaming platform. We then implement and deploy our method in a campus network to capture gameplay behaviors and experience measures across various user setups and connectivity types which we believe are valuable for network operators.


title: Enhancing a Convolutional Autoencoder with a Quantum Approximate Optimization Algorithm for Image Noise Reduction

abstract: Image denoising is essential for removing noise in images caused by electric device malfunctions or other factors during image acquisition. It helps preserve image quality and interpretation. Many convolutional autoencoder algorithms have proven effective in image denoising. Owing to their promising efficiency, quantum computers have gained popularity. This study introduces a quantum convolutional autoencoder (QCAE) method for improved image denoising. This method was developed by substituting the representative latent space of the autoencoder with a quantum circuit. To enhance efficiency, we leveraged the advantages of the quantum approximate optimization algorithm (QAOA)-incorporated parameter-shift rule to identify an optimized cost function, facilitating effective learning from data and gradient computation on an actual quantum computer. The proposed QCAE method outperformed its classical counterpart as it exhibited lower training loss and a higher structural similarity index (SSIM) value. QCAE also outperformed its classical counterpart in denoising the MNIST dataset by up to 40% in terms of SSIM value, confirming its enhanced capabilities in real-world applications. Evaluation of QAOA performance across different circuit configurations and layer variations showed that our technique outperformed other circuit designs by 25% on average.


title: Arithmetic Siegel-Weil formula on $\mathcal{X}_0(N)$: singular terms

abstract: For arbitrary level $N$, we relate the generating series of codimension 2 special cycles on $\mathcal{X}_{0}(N)$ to the derivatives of a genus 2 Eisenstein series, especially the singular terms of both sides. On the analytic side, we use difference formulas of local densities to relate the singular Fourier coefficients of the genus 2 Eisenstein series to the nonsingular Fourier coefficients of a genus 1 Eisenstein series. On the geometric side, we study the reduction of cusps to compute the divisor class of the Hodge bundle and the heights of special divisors. When $N$ is square-free, this gives a different proof of the main results in the works of Du, Yang and Sankaran, Shi, and Yang.


title: Low-Loss Polarization-Maintaining Optical Router for Photonic Quantum Information Processing

abstract: In photonic quantum applications, optical routers are required to handle single photons with low loss, high speed, and preservation of their quantum states. Single-photon routing with maintained polarization states is particularly important for utilizing them as qubits. Here, we demonstrate a polarization-maintaining electro-optic router compatible with single photons. Our custom electro-optic modulator is embedded in a configuration of a Mach-Zehnder interferometer, where each optical component achieves polarization-maintaining operation. We observe the performance of the router with 2-4% loss, 20 dB switching extinction ratio, 2.9 ns rise time, and $>$ 99% polarization process fidelity to an ideal identity operation.


title: Graph Relation Distillation for Efficient Biomedical Instance Segmentation

abstract: Instance-aware embeddings predicted by deep neural networks have revolutionized biomedical instance segmentation, but its resource requirements are substantial. Knowledge distillation offers a solution by transferring distilled knowledge from heavy teacher networks to lightweight yet high-performance student networks. However, existing knowledge distillation methods struggle to extract knowledge for distinguishing instances and overlook global relation information. To address these challenges, we propose a graph relation distillation approach for efficient biomedical instance segmentation, which considers three essential types of knowledge: instance-level features, instance relations, and pixel-level boundaries. We introduce two graph distillation schemes deployed at both the intra-image level and the inter-image level: instance graph distillation (IGD) and affinity graph distillation (AGD). IGD constructs a graph representing instance features and relations, transferring these two types of knowledge by enforcing instance graph consistency. AGD constructs an affinity graph representing pixel relations to capture structured knowledge of instance boundaries, transferring boundary-related knowledge by ensuring pixel affinity consistency. Experimental results on a number of biomedical datasets validate the effectiveness of our approach, enabling student models with less than $ 1\%$ parameters and less than $10\%$ inference time while achieving promising performance compared to teacher models.


title: Exact Maxwell evolution equation of resonators dynamics: temporal coupled-mode theory revisited

abstract: Despite its widespread significance, the temporal coupled-mode theory (CMT) lacks a foundational validation based on electromagnetic principles and stands as a phenomenological theory relying on fitted coupling coefficients. We employ an ab initio Maxwellian approach using quasinormal-mode theory to derive an "exact" Maxwell evolution (EME) equation for resonator dynamics. While the resulting differential equation bears resemblance to the classical one, it introduces novel terms embodying distinct physics, suggesting that the CMT predictions could be faulted by dedicated experiments, for instance carried out with short and off-resonance pulses, or with resonators of sizes comparable to or greater than the wavelength. Nonetheless, our examination indicates that, despite its inherent lack of strictness, the CMT enables precise predictions for numerous experiments due to the flexibility provided by the fitted coupling coefficients. The new EME equation is anticipated to be applicable to all electromagnetic resonator geometries, and the theoretical approach we have taken can be extended to other wave physics.


title: Spectral fit residuals as an indicator to increase model complexity

abstract: Spectral fitting of X-ray data usually involves minimizing statistics like the chi-square and the Cash statistic. Here we discuss their limitations and introduce two measures based on the cumulative sum (CuSum) of model residuals to evaluate whether model complexity could be increased: the percentage of bins exceeding a nominal threshold in a CuSum array (pct$_{CuSum}$), and the excess area under the CuSum compared to the nominal (p$_\textit{area}$). We demonstrate their use with an application to a $\textit{Chandra}$ ACIS spectral fit.


title: How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMs

abstract: Most traditional AI safety research has approached AI models as machines and centered on algorithm-focused attacks developed by security experts. As large language models (LLMs) become increasingly common and competent, non-expert users can also impose risks during daily interactions. This paper introduces a new perspective to jailbreak LLMs as human-like communicators, to explore this overlooked intersection between everyday language interaction and AI safety. Specifically, we study how to persuade LLMs to jailbreak them. First, we propose a persuasion taxonomy derived from decades of social science research. Then, we apply the taxonomy to automatically generate interpretable persuasive adversarial prompts (PAP) to jailbreak LLMs. Results show that persuasion significantly increases the jailbreak performance across all risk categories: PAP consistently achieves an attack success rate of over $92\%$ on Llama 2-7b Chat, GPT-3.5, and GPT-4 in $10$ trials, surpassing recent algorithm-focused attacks. On the defense side, we explore various mechanisms against PAP and, found a significant gap in existing defenses, and advocate for more fundamental mitigation for highly interactive LLMs


title: SamLP: A Customized Segment Anything Model for License Plate Detection

abstract: With the emergence of foundation model, this novel paradigm of deep learning has encouraged many powerful achievements in natural language processing and computer vision. There are many advantages of foundation model, such as excellent feature extraction power, mighty generalization ability, great few-shot and zero-shot learning capacity, etc. which are beneficial to vision tasks. As the unique identity of vehicle, different countries and regions have diverse license plate (LP) styles and appearances, and even different types of vehicles have different LPs. However, recent deep learning based license plate detectors are mainly trained on specific datasets, and these limited datasets constrain the effectiveness and robustness of LP detectors. To alleviate the negative impact of limited data, an attempt to exploit the advantages of foundation model is implement in this paper. We customize a vision foundation model, i.e. Segment Anything Model (SAM), for LP detection task and propose the first LP detector based on vision foundation model, named SamLP. Specifically, we design a Low-Rank Adaptation (LoRA) fine-tuning strategy to inject extra parameters into SAM and transfer SAM into LP detection task. And then, we further propose a promptable fine-tuning step to provide SamLP with prompatable segmentation capacity. The experiments show that our proposed SamLP achieves promising detection performance compared to other LP detectors. Meanwhile, the proposed SamLP has great few-shot and zero-shot learning ability, which shows the potential of transferring vision foundation model. The code is available at https://github.com/Dinghaoxuan/SamLP


title: Cognitive BPM as an Equalizer: Improving Access and Efficiency for Employees with (and without) Cognitive Disabilities

abstract: We examine ProcessGPT, an AI model designed to automate, augment, and improve business processes, to study the challenges of managing business processes within the cognitive limitations of the human workforce, particularly individuals with cognitive disabilities. ProcessGPT provides a blueprint for designing efficient business processes that take into account human cognitive limitations. By viewing this through the lens of cognitive disabilities, we show that ProcessGPT improves process usability for individuals with and without cognitive disabilities. We also demonstrate that organizations implementing ProcessGPT-like capabilities will realize increased productivity, morale, and inclusion.


title: Synchronize your \textit{chrono-brane}: Testing a variable brane tension model with strong gravitational lensing

abstract: Brane world models have shown to be promising to understand the late cosmic acceleration, in particular because such acceleration can be naturally derived, mimicking the dark energy behaviour just with a five dimensional geometry. In this paper we present a strong lensing joint analysis using a compilation of early-type galaxies acting as a lenses, united with the power of the well studied strong lensing galaxy cluster Abell\,1689. We use the strong lensing constraints to investigate a brane model with variable brane tension as a function of the redshift. In our joint analysis we found a value $n = 7.8^{+0.9}_{-0.5}$, for the exponent related to the brane tension, showing that $n$ deviates from a Cosmological Constant (CC) scenario (n=6). We obtain a value for the deceleration parameter, $q(z)$ today, $q(0)=-1.2^{+0.6}_{-0.8}$, and a transition redshift, $z_t=0.60\pm0.06$ (when the Universe change from an decelerated phase to an accelerated one). These results are in contrast with previous work that favors CC scenario, nevertheless our lensing analysis is in agreement with a formerly reported conclusion suggesting that the variable brane tension model is able to source a late cosmic acceleration without an extra fluid as in the standard one.


title: Design and Nonlinear Modeling of a Modular Cable Driven Soft Robotic Arm

abstract: We propose a novel multi-section cable-driven soft robotic arm inspired by octopus tentacles along with a new modeling approach. Each section of the modular manipulator is made of a soft tubing backbone, a soft silicon arm body, and two rigid endcaps, which connect adjacent sections and decouple the actuation cables of different sections. The soft robotic arm is made with casting after the rigid endcaps are 3D-printed, achieving low-cost and convenient fabrication. To capture the nonlinear effect of cables pushing into the soft silicon arm body, which results from the absence of intermediate rigid cable guides for higher compliance, an analytical static model is developed to capture the relationship between the bending curvature and the cable lengths. The proposed model shows superior prediction performance in experiments over that of a baseline model, especially under large bending conditions. Based on the nonlinear static model, a kinematic model of a multi-section arm is further developed and used to derive a motion planning algorithm. Experiments show that the proposed soft arm has high flexibility and a large workspace, and the tracking errors under the algorithm based on the proposed modeling approach are up to 52$\%$ smaller than those with the algorithm derived from the baseline model. The presented modeling approach is expected to be applicable to a broad range of soft cable-driven actuators and manipulators.


title: New Lower Bounds in Merlin-Arthur Communication and Graph Streaming Verification

abstract: We show new lower bounds in the \emph{Merlin-Arthur} (MA) communication model and the related \emph{annotated streaming} or stream verification model. The MA communication model is an enhancement of the classical communication model, where in addition to the usual players Alice and Bob, there is an all-powerful but untrusted player Merlin who knows their inputs and tries to convince them about the output. Most functions have MA protocols with total communication significantly smaller than what would be needed without Merlin. We focus on the online MA (OMA) model, which is the MA analogue of one-way communication, and introduce the notion of \emph{non-trivial-OMA} complexity of a function. This is the minimum total communication needed by any non-trivial OMA protocol computing that function, where a trivial OMA protocol is one where Alice sends Bob roughly as many bits as she would have sent without Merlin. We prove a lower bound on the non-trivial-OMA complexity of a natural function \emph{Equals-Index} (basically the well-known Index problem on large domains) and identify it as a canonical problem for proving strong lower bounds on this complexity: reductions from it (i) reproduce and/or improve upon the lower bounds for all functions that were previously known to have large non-trivial-OMA complexity, (ii) exhibit the first explicit functions whose non-trivial-OMA complexity is superlinear, and even exponential, in their classical one-way complexity, and (iii) show functions on input size $n$ for which this complexity is as large as $n/\log n$. While exhibiting a function with $\omega(\sqrt{n})$ (standard) OMA complexity is a longstanding open problem, we did not even know of any function with $\omega(\sqrt{n})$ non-trivial-OMA complexity. We further extend the lower bounds to a related streaming model called annotated streaming.


title: Vehicle: Bridging the Embedding Gap in the Verification of Neuro-Symbolic Programs

abstract: Neuro-symbolic programs -- programs containing both machine learning components and traditional symbolic code -- are becoming increasingly widespread. However, we believe that there is still a lack of a general methodology for verifying these programs whose correctness depends on the behaviour of the machine learning components. In this paper, we identify the ``embedding gap'' -- the lack of techniques for linking semantically-meaningful ``problem-space'' properties to equivalent ``embedding-space'' properties -- as one of the key issues, and describe Vehicle, a tool designed to facilitate the end-to-end verification of neural-symbolic programs in a modular fashion. Vehicle provides a convenient language for specifying ``problem-space'' properties of neural networks and declaring their relationship to the ``embedding-space", and a powerful compiler that automates interpretation of these properties in the language of a chosen machine-learning training environment, neural network verifier, and interactive theorem prover. We demonstrate Vehicle's utility by using it to formally verify the safety of a simple autonomous car equipped with a neural network controller.


title: Time series prediction of open quantum system dynamics

abstract: Time series prediction (TSP) has been widely used in various fields, such as life sciences and finance, to forecast future trends based on historical data. However, to date, there has been relatively little research conducted on the TSP for quantum physics. In this paper, we explore the potential application of TSP in forecasting the dynamical evolution of open quantum systems. We employ deep learning techniques to train a TSP model and evaluate its performance by comparison with exact solution. We use the ratio of the prediction step length and the sequence length to define short and long-term forecasting. Our results show that the trained model has the ability to effectively capture the inherent characteristics of time series for both short-term and long-term forecasting. Accurate predictions for different coupling intensities and initial states are obtained. Furthermore, we use our method to train another model and find that it can successfully predict the steady state of the system. These findings suggests that TSP is a valuable tool for the prediction of the dynamics in open quantum systems.


title: Projective Averages for Summarizing Redistricting Ensembles

abstract: A recurring challenge in the application of redistricting simulation algorithms lies in extracting useful summaries and comparisons from a large ensemble of districting plans. Researchers often compute summary statistics for each district in a plan, and then study their distribution across the plans in the ensemble. This approach discards rich geographic information that is inherent in districting plans. We introduce the projective average, an operation that projects a district-level summary statistic back to the underlying geography and then averages this statistic across plans in the ensemble. Compared to traditional district-level summaries, projective averages are a powerful tool for geographically granular, sub-district analysis of districting plans along a variety of dimensions. However, care must be taken to account for variation within redistricting ensembles, to avoid misleading conclusions. We propose and validate a multiple-testing procedure to control the probability of incorrectly identifying outlier plans or regions when using projective averages.


title: What should I say? -- Interacting with AI and Natural Language Interfaces

abstract: As Artificial Intelligence (AI) technology becomes more and more prevalent, it becomes increasingly important to explore how we as humans interact with AI. The Human-AI Interaction (HAI) sub-field has emerged from the Human-Computer Interaction (HCI) field and aims to examine this very notion. Many interaction patterns have been implemented without fully understanding the changes in required cognition as well as the cognitive science implications of using these alternative interfaces that aim to be more human-like in nature. Prior research suggests that theory of mind representations are crucial to successful and effortless communication, however very little is understood when it comes to how theory of mind representations are established when interacting with AI.


title: Decomposition with Monotone B-splines: Fitting and Testing

abstract: A univariate continuous function can always be decomposed as the sum of a non-increasing function and a non-decreasing one. Based on this property, we propose a non-parametric regression method that combines two spline-fitted monotone curves. We demonstrate by extensive simulations that, compared to standard spline-fitting methods, the proposed approach is particularly advantageous in high-noise scenarios. Several theoretical guarantees are established for the proposed approach. Additionally, we present statistics to test the monotonicity of a function based on monotone decomposition, which can better control Type I error and achieve comparable (if not always higher) power compared to existing methods. Finally, we apply the proposed fitting and testing approaches to analyze the single-cell pseudotime trajectory datasets, identifying significant biological insights for non-monotonically expressed genes through Gene Ontology enrichment analysis. The source code implementing the methodology and producing all results is accessible at https://github.com/szcf-weiya/MonotoneDecomposition.jl.


title: Secure Targeted Message Dissemination in IoT Using Blockchain Enabled Edge Computing

abstract: Smart devices are considered as an integral part of Internet of Things (IoT), have an aim to make a dynamic network to exchange information, collect data, analysis, and make optimal decisions in an autonomous way to achieve more efficient, automatic, and economical services. Message dissemination among these smart devices allows adding new features, sending updated instructions, alerts or safety messages, informing the pricing information or billing amount, incentives, and installing security patches. On one hand, such message disseminations are directly beneficial to the all parties involved in the IoT system. On the other hand, due to remote procedure, smart devices, vendors, and other involved authorities might have to meet a number of security, privacy, and performance related concerns while disseminating messages among targeted devices. To this end, in this paper, we design STarEdgeChain, a security and privacy aware targeted message dissemination in IoT to show how blockchain along with advanced cryptographic techniques are devoted to address such concerns. In fact, the STarEdgeChain employs a permissioned blockchain assisted edge computing in order to expedite a single signcrypted message dissemination among targeted groups of devices, at the same time avoiding the dependency of utilizing multiple unicasting approaches. Finally, we develop a software prototype of STarEdgeChain and show it's practicability for smart devices. The codes are publicly available at https://github.com/mbaqer/Blockchain-IoT


title: SD-MVS: Segmentation-Driven Deformation Multi-View Stereo with Spherical Refinement and EM optimization

abstract: In this paper, we introduce Segmentation-Driven Deformation Multi-View Stereo (SD-MVS), a method that can effectively tackle challenges in 3D reconstruction of textureless areas. We are the first to adopt the Segment Anything Model (SAM) to distinguish semantic instances in scenes and further leverage these constraints for pixelwise patch deformation on both matching cost and propagation. Concurrently, we propose a unique refinement strategy that combines spherical coordinates and gradient descent on normals and pixelwise search interval on depths, significantly improving the completeness of reconstructed 3D model. Furthermore, we adopt the Expectation-Maximization (EM) algorithm to alternately optimize the aggregate matching cost and hyperparameters, effectively mitigating the problem of parameters being excessively dependent on empirical tuning. Evaluations on the ETH3D high-resolution multi-view stereo benchmark and the Tanks and Temples dataset demonstrate that our method can achieve state-of-the-art results with less time consumption.


title: Generative AI-enabled Mobile Tactical Multimedia Networks: Distribution, Generation, and Perception

abstract: Mobile multimedia networks (MMNs) demonstrate great potential in delivering low-latency and high-quality entertainment and tactical applications, such as short-video sharing, online conferencing, and battlefield surveillance. For instance, in tactical surveillance of battlefields, scalability and sustainability are indispensable for maintaining large-scale military multimedia applications in MMNs. Therefore, many data-driven networking solutions are leveraged to optimize streaming strategies based on real-time traffic analysis and resource monitoring. In addition, generative AI (GAI) can not only increase the efficiency of existing data-driven solutions through data augmentation but also develop potential capabilities for MMNs, including AI-generated content (AIGC) and AI-aided perception. In this article, we propose the framework of GAI-enabled MMNs that leverage the capabilities of GAI in data and content synthesis to distribute high-quality and immersive interactive content in wireless networks. Specifically, we outline the framework of GAI-enabled MMNs and then introduce its three main features, including distribution, generation, and perception. Furthermore, we propose a second-score auction mechanism for allocating network resources by considering GAI model values and other metrics jointly. The experimental results show that the proposed auction mechanism can effectively increase social welfare by allocating resources and models with the highest user satisfaction.


title: Towards High-Quality and Efficient Speech Bandwidth Extension with Parallel Amplitude and Phase Prediction

abstract: Speech bandwidth extension (BWE) refers to widening the frequency bandwidth range of speech signals, enhancing the speech quality towards brighter and fuller. This paper proposes a generative adversarial network (GAN) based BWE model with parallel prediction of Amplitude and Phase spectra, named AP-BWE, which achieves both high-quality and efficient wideband speech waveform generation. The proposed AP-BWE generator is entirely based on convolutional neural networks (CNNs). It features a dual-stream architecture with mutual interaction, where the amplitude stream and the phase stream communicate with each other and respectively extend the high-frequency components from the input narrowband amplitude and phase spectra. To improve the naturalness of the extended speech signals, we employ a multi-period discriminator at the waveform level and design a pair of multi-resolution amplitude and phase discriminators at the spectral level, respectively. Experimental results demonstrate that our proposed AP-BWE achieves state-of-the-art performance in terms of speech quality for BWE tasks targeting sampling rates of both 16 kHz and 48 kHz. In terms of generation efficiency, due to the all-convolutional architecture and all-frame-level operations, the proposed AP-BWE can generate 48 kHz waveform samples 292.3 times faster than real-time on a single RTX 4090 GPU and 18.1 times faster than real-time on a single CPU. Notably, to our knowledge, AP-BWE is the first to achieve the direct extension of the high-frequency phase spectrum, which is beneficial for improving the effectiveness of existing BWE methods.


title: Procedure for Obtaining the Analytical Distribution Function of Relaxation Times for the Analysis of Impedance Spectra using the Fox $H$-function

abstract: The interpretation of electrochemical impedance spectroscopy data by fitting it to equivalent circuit models has been a standard method of analysis in electrochemistry. However, the inversion of the data from the frequency domain to a distribution function of relaxation times (DFRT) has gained considerable attention for impedance data analysis, as it can reveal more detailed information about the underlying electrochemical processes without requiring a priori knowledge. The focus of this paper is to provide a general procedure for obtaining analytically the DFRT from an impedance model, assuming an elemental Debye relaxation model as the kernel. The procedure consists of first representing the impedance function in terms of the Fox $H$-function, which possesses many useful properties particularly that its Laplace transform is again an $H$-function. From there the DFRT is obtained by two successive iterations of inverse Laplace transforms. In the passage, one can easily obtain an expression for the response function to a step excitation. The procedure is tested and verified on some known impedance models.

categories: physics.chem-ph cond-mat.dis-nn math-ph math.MP physics.app-ph


title: Application of the projective truncation and randomized singular value decomposition to a higher dimension

abstract: We study the tensor renormalization group (TRG) in the dimension larger than two as the Higher-order TRG (HOTRG) with the randomized SVD method. The randomized SVD and the detailed discussion on the low order tensor representation, we can calculate the HOTRG with the reduced computational cost. We also represent our method by using the cost function, and the details of the cost function for the isometry determine the precision, stability, and calculation time. In our study, we show calculation order improvement using randomized SVD. We also propose that the internal line respect for any TRG method improves the calculation without changing the order of the computational cost.


title: LCB-net: Long-Context Biasing for Audio-Visual Speech Recognition

abstract: The growing prevalence of online conferences and courses presents a new challenge in improving automatic speech recognition (ASR) with enriched textual information from video slides. In contrast to rare phrase lists, the slides within videos are synchronized in real-time with the speech, enabling the extraction of long contextual bias. Therefore, we propose a novel long-context biasing network (LCB-net) for audio-visual speech recognition (AVSR) to leverage the long-context information available in videos effectively. Specifically, we adopt a bi-encoder architecture to simultaneously model audio and long-context biasing. Besides, we also propose a biasing prediction module that utilizes binary cross entropy (BCE) loss to explicitly determine biased phrases in the long-context biasing. Furthermore, we introduce a dynamic contextual phrases simulation to enhance the generalization and robustness of our LCB-net. Experiments on the SlideSpeech, a large-scale audio-visual corpus enriched with slides, reveal that our proposed LCB-net outperforms general ASR model by 9.4%/9.1%/10.9% relative WER/U-WER/B-WER reduction on test set, which enjoys high unbiased and biased performance. Moreover, we also evaluate our model on LibriSpeech corpus, leading to 23.8%/19.2%/35.4% relative WER/U-WER/B-WER reduction over the ASR model.


title: Teaching Code LLMs to Use Autocompletion Tools in Repository-Level Code Generation

abstract: Recent code large language models (LLMs) have shown promising performance in generating standalone functions but face limitations in repository-level code generation due to their lack of awareness of repository-level dependencies (e.g., user-defined attributes), resulting in dependency errors such as undefined-variable and no-member errors. In this work, we introduce ToolGen, an approach that integrates autocompletion tools into the code LLM generation process to address these dependencies. ToolGen comprises two main phases: Trigger Insertion and Model Fine-tuning (Offline), and Tool-integrated Code Generation (Online). During the offline phase, ToolGen augments functions within a given code corpus with a special mark token, indicating positions to trigger autocompletion tools. These augmented functions, along with their corresponding docstrings, are then used to fine-tune a selected code LLM. In the online phase, ToolGen iteratively generates functions by predicting tokens step-by-step using the fine-tuned LLM. Whenever a mark token is encountered, ToolGen invokes the autocompletion tool to suggest code completions and selects the most appropriate one. We conduct comprehensive experiments to evaluate ToolGen's effectiveness in repository-level code generation. To facilitate this evaluation, we create a benchmark comprising 680 real-world code repositories and introduce two new repository-level metrics: Dependency Coverage and Static Validity Rate. The results demonstrate that ToolGen significantly improves Dependency Coverage by 15.2% to 45.8% and Static Validity Rate by 10.9% to 42.2% across three distinct code LLMs, while maintaining competitive performance in widely-recognized similarity metrics. Furthermore, our generalizability evaluation confirms ToolGen's consistent performance when applied to diverse code LLMs, including various model architectures and scales.


title: Coupled cluster theory based on quantum electrodynamics: Physical aspects of closed shell and multi-reference open shell methods

abstract: Electrodynamical coupled cluster (CC) methodologies have been formulated employing standard QED Hamiltonian that is written in Coulomb gauge while using the DF and the MCDF pictures of the matter field for closed-shell and open-shell cases respectively. The general methodology employs a radiative cluster, pure matter clusters and their pair modifications, and a number state distribution of photons in thermal equilibrium. The closed-shell treatment relies on the customary CC approach. For open shells, QED and electron correlation through CC are treated on the same footing. An averaging over the radiation state is done to generate Lamb, Breit and hyperfine interactions from the radiative cluster. Because of the thermal distribution, it leaves a residual transverse interaction that may modify the static correlation in open shells. Dynamical correlation effects are determined next by using the exponential matter cluster in traditional ways of single- and multi-reference CC. When the matter cluster is extended to include de-excitations to negative-energy levels, vacuum polarization effects are generated from the pair part of Coulomb interaction. The dynamical correlation energy includes relativistic corrections as well as QED contributions, namely, Lamb, Breit, hyperfine and pair energy. This work has three novelties: (i) QED interactions (Lamb, Breit and hyperfine) are obtained from a single procedure based on the radiative cluster; (ii) pair energy is determined from an extended matter cluster formalism; and (iii) additional correlation energy can be had from radiative effects and pair terms, while the option for higher order pair energy in high-Z atoms is kept open. The open-shell formalism has one more novelty in finding an additional static correlation in certain cases when the radiation is not isotropic.


title: Switch and Phase Shift of Photon Polarization Qubits via Double Rydberg Electromagnetically Induced Transparency

abstract: We propose and analyze a scheme for manipulating the propagation of single photon pulses with two polarization components in a Rydberg atomic gas via double electromagnetically induced transparency. We show that by storing a gate photon in a Rydberg state a deep and tunable potential for a photon polarization qubit can be achieved based on strong Rydberg interaction. We also show that the scheme can be used to realize all-optical switch in dissipation regime and generate a large phase shift in dispersion regime for the photon polarization qubit. Moreover, we demonstrate that such a scheme can be utilized to detect weak magnetic fields. The results reported here are not only beneficial for understanding the quantum optical property of Rydberg atomic gases, but also promising for designing novel devices for quantum information processing.


title: Adaptive Data Augmentation for Aspect Sentiment Quad Prediction

abstract: Aspect sentiment quad prediction (ASQP) aims to predict the quad sentiment elements for a given sentence, which is a critical task in the field of aspect-based sentiment analysis. However, the data imbalance issue has not received sufficient attention in ASQP task. In this paper, we divide the issue into two-folds, quad-pattern imbalance and aspect-category imbalance, and propose an Adaptive Data Augmentation (ADA) framework to tackle the imbalance issue. Specifically, a data augmentation process with a condition function adaptively enhances the tail quad patterns and aspect categories, alleviating the data imbalance in ASQP. Following previous studies, we also further explore the generative framework for extracting complete quads by introducing the category prior knowledge and syntax-guided decoding target. Experimental results demonstrate that data augmentation for imbalance in ASQP task can improve the performance, and the proposed ADA method is superior to naive data oversampling.


title: ModaVerse: Efficiently Transforming Modalities with LLMs

abstract: Humans possess the capability to comprehend diverse modalities and seamlessly transfer information between them. In this work, we introduce ModaVerse, a Multi-modal Large Language Model (MLLM) capable of comprehending and transforming content across various modalities including images, videos, and audio. Predominant MLLM frameworks have largely relied on the alignment of latent spaces of textual and non-textual features. This alignment process, which synchronizes a language model trained on textual data with encoders and decoders trained on multi-modal data, often necessitates extensive training of several projection layers in multiple stages. Inspired by LLM-as-agent methodologies, we propose a novel Input/Output (I/O) alignment mechanism that operates directly at the level of natural language. It aligns the LLM's output with the input of generative models, avoiding the complexities associated with latent feature alignments, and simplifying the multiple training stages of existing MLLMs into a single, efficient process. This conceptual advancement leads to significant reductions in both data and computational costs. By conducting experiments on several benchmarks, we demonstrate that our approach attains comparable performance with the state of the art while achieving considerable efficiencies in data usage and training duration.


title: Dense Optical Flow Estimation Using Sparse Regularizers from Reduced Measurements

abstract: Optical flow is the pattern of apparent motion of objects in a scene. The computation of optical flow is a critical component in numerous computer vision tasks such as object detection, visual object tracking, and activity recognition. Despite a lot of research, efficiently managing abrupt changes in motion remains a challenge in motion estimation. This paper proposes novel variational regularization methods to address this problem since they allow combining different mathematical concepts into a joint energy minimization framework. In this work, we incorporate concepts from signal sparsity into variational regularization for motion estimation. The proposed regularization uses a robust l1 norm, which promotes sparsity and handles motion discontinuities. By using this regularization, we promote the sparsity of the optical flow gradient. This sparsity helps recover a signal even with just a few measurements. We explore recovering optical flow from a limited set of linear measurements using this regularizer. Our findings show that leveraging the sparsity of the derivatives of optical flow reduces computational complexity and memory needs.


title: UMG-CLIP: A Unified Multi-Granularity Vision Generalist for Open-World Understanding

abstract: Vision-language foundation models, represented by Contrastive language-image pre-training (CLIP), have gained increasing attention for jointly understanding both vision and textual tasks. However, existing approaches primarily focus on training models to match global image representations with textual descriptions, thereby overlooking the critical alignment between local regions and corresponding text tokens. This paper extends CLIP with multi-granularity alignment. Notably, we deliberately construct a new dataset comprising pseudo annotations at various levels of granularities, encompassing image-level, region-level, and pixel-level captions/tags. Accordingly, we develop a unified multi-granularity learning framework, named UMG-CLIP, that simultaneously empowers the model with versatile perception abilities across different levels of detail. Equipped with parameter efficient tuning, UMG-CLIP surpasses current widely used CLIP models and achieves state-of-the-art performance on diverse image understanding benchmarks, including open-world recognition, retrieval, semantic segmentation, and panoptic segmentation tasks. We hope UMG-CLIP can serve as a valuable option for advancing vision-language foundation models.


title: An approach for mistranslation removal from popular dataset for Indic MT Task

abstract: The conversion of content from one language to another utilizing a computer system is known as Machine Translation (MT). Various techniques have come up to ensure effective translations that retain the contextual and lexical interpretation of the source language. End-to-end Neural Machine Translation (NMT) is a popular technique and it is now widely used in real-world MT systems. Massive amounts of parallel datasets (sentences in one language alongside translations in another) are required for MT systems. These datasets are crucial for an MT system to learn linguistic structures and patterns of both languages during the training phase. One such dataset is Samanantar, the largest publicly accessible parallel dataset for Indian languages (ILs). Since the corpus has been gathered from various sources, it contains many incorrect translations. Hence, the MT systems built using this dataset cannot perform to their usual potential. In this paper, we propose an algorithm to remove mistranslations from the training corpus and evaluate its performance and efficiency. Two Indic languages (ILs), namely, Hindi (HIN) and Odia (ODI) are chosen for the experiment. A baseline NMT system is built for these two ILs, and the effect of different dataset sizes is also investigated. The quality of the translations in the experiment is evaluated using standard metrics such as BLEU, METEOR, and RIBES. From the results, it is observed that removing the incorrect translation from the dataset makes the translation quality better. It is also noticed that, despite the fact that the ILs-English and English-ILs systems are trained using the same corpus, ILs-English works more effectively across all the evaluation metrics.


title: Universality in coupled stochastic Burgers systems with degenerate flux Jacobian

abstract: In our contribution we study stochastic models in one space dimension with two conservation laws. One model is the coupled continuum stochastic Burgers equation, for which each current is a sum of quadratic non-linearities, linear diffusion, and spacetime white noise. The second model is a two-lane stochastic lattice gas. As distinct from previous studies, the two conserved densities are tuned such that the flux Jacobian, a $2 \times 2$ matrix, has coinciding eigenvalues. In the steady state, investigated are spacetime correlations of the conserved fields and the time-integrated currents at the origin. For a particular choice of couplings the dynamical exponent 3/2 is confirmed. Furthermore, at these couplings, continuum stochastic Burgers equation and lattice gas are demonstrated to be in the same universality class.

categories: cond-mat.stat-mech math-ph math.MP math.PR


title: Generalizing Visual Question Answering from Synthetic to Human-Written Questions via a Chain of QA with a Large Language Model

abstract: Visual question answering (VQA) is a task where an image is given, and a series of questions are asked about the image. To build an efficient VQA algorithm, a large amount of QA data is required which is very expensive. Generating synthetic QA pairs based on templates is a practical way to obtain data. However, VQA models trained on those data do not perform well on complex, human-written questions. To address this issue, we propose a new method called {\it chain of QA for human-written questions} (CoQAH). CoQAH utilizes a sequence of QA interactions between a large language model and a VQA model trained on synthetic data to reason and derive logical answers for human-written questions. We tested the effectiveness of CoQAH on two types of human-written VQA datasets for 3D-rendered and chest X-ray images and found that it achieved state-of-the-art accuracy in both types of data. Notably, CoQAH outperformed general vision-language models, VQA models, and medical foundation models with no finetuning.


title: DevEval: Evaluating Code Generation in Practical Software Projects

abstract: How to evaluate Large Language Models (LLMs) in code generation is an open question. Many benchmarks have been proposed but are inconsistent with practical software projects, e.g., unreal program distributions, insufficient dependencies, and small-scale project contexts. Thus, the capabilities of LLMs in practical projects are still unclear. In this paper, we propose a new benchmark named DevEval, aligned with Developers' experiences in practical projects. DevEval is collected through a rigorous pipeline, containing 2,690 samples from 119 practical projects and covering 10 domains. Compared to previous benchmarks, DevEval aligns to practical projects in multiple dimensions, e.g., real program distributions, sufficient dependencies, and enough-scale project contexts. We assess five popular LLMs on DevEval (e.g., gpt-4, gpt-3.5-turbo, CodeLLaMa, and StarCoder) and reveal their actual abilities in code generation. For instance, the highest Pass@1 of gpt-3.5-turbo only is 42 in our experiments. We also discuss the challenges and future directions of code generation in practical projects. We open-source DevEval and hope it can facilitate the development of code generation in practical projects.