title: Liouville Theorem for $k-$curvature equation with fully nonlinear boundary in half space

abstract: We obtain the Liouville theorem for constant $k$-curvature $\sigma_{k}(A_{g})$ in $\mathbb{R}_{+}^{n}$ with constant $\mathcal{B}_{k}^{g}$ curvature on $\partial\mathbb{R}_{+}^{n}$, where $\mathcal{B}_{k}^{g}$ is derived from the variational functional for $\sigma_{k}(A_{g})$, and specially represents the boundary term in the Gauss-Bonnet-Chern formula for $k=n/2$.


title: N$_2$H$^+$(1-0) as a tracer of dense gas in and between spiral arms

abstract: Recent advances in identifying giant molecular filaments in galactic surveys allow us to study the interstellar material and its dense, potentially star forming phase on scales comparable to resolved extragalactic clouds. Two large filaments detected in the CHIMPS $^{13}$CO(3-2) survey, one in the Sagittarius-arm and one in an inter-arm region, were mapped with dense gas tracers inside a 0.06 deg$^2$ area and with a spatial resolution of around 0.4 and 0.65 pc at the distance of the targets using the IRAM 30m telescope, to investigate the environmental dependence of the dense gas fraction. The N$_2$H$^+$(1-0) transition, an excellent tracer of the dense gas, was detected in parsec-scale, elliptical clumps and with a filling factor of around 8.5% in our maps. The N$_2$H$^+$-emitting areas appear to have higher dense gas fraction (e.g. the ratio of N$_2$H$^+$ and $^{13}$CO emission) in the inter-arm than in the arm which is opposite to the behaviour found by previous studies, using dust emission rather than N$_2$H$^+$ as a tracer of dense gas. However, the arm filament is brighter in $^{13}$CO and the infrared emission of dust, and the dense gas fraction determined as above is governed by the $^{13}$CO brightness. We caution that measurements regarding the distribution and fraction of dense gas on these scales may be influenced by many scale- and environment-dependent factors, as well as the chemistry and excitation of the particular tracers, then consider several scenarios that can reproduce the observed effect.


title: sDPO: Don't Use Your Data All at Once

abstract: As development of large language models (LLM) progresses, aligning them with human preferences has become increasingly important. We propose stepwise DPO (sDPO), an extension of the recently popularized direct preference optimization (DPO) for alignment tuning. This approach involves dividing the available preference datasets and utilizing them in a stepwise manner, rather than employing it all at once. We demonstrate that this method facilitates the use of more precisely aligned reference models within the DPO training framework. Furthermore, sDPO trains the final model to be more performant, even outperforming other popular LLMs with more parameters.


title: DeepSample: DNN sampling-based testing for operational accuracy assessment

abstract: Deep Neural Networks (DNN) are core components for classification and regression tasks of many software systems. Companies incur in high costs for testing DNN with datasets representative of the inputs expected in operation, as these need to be manually labelled. The challenge is to select a representative set of test inputs as small as possible to reduce the labelling cost, while sufficing to yield unbiased high-confidence estimates of the expected DNN accuracy. At the same time, testers are interested in exposing as many DNN mispredictions as possible to improve the DNN, ending up in the need for techniques pursuing a threefold aim: small dataset size, trustworthy estimates, mispredictions exposure. This study presents DeepSample, a family of DNN testing techniques for cost-effective accuracy assessment based on probabilistic sampling. We investigate whether, to what extent, and under which conditions probabilistic sampling can help to tackle the outlined challenge. We implement five new sampling-based testing techniques, and perform a comprehensive comparison of such techniques and of three further state-of-the-art techniques for both DNN classification and regression tasks. Results serve as guidance for best use of sampling-based testing for faithful and high-confidence estimates of DNN accuracy in operation at low cost.


title: Mil2: Efficient Cloth Simulation Using Non-distance Barriers and Subspace Reuse

abstract: Mil2 pushes the performance of high-resolution cloth simulation, making the simulation interactive (in milliseconds) for models with one million degrees of freedom (DOFs) while keeping every triangle untangled. The guarantee of being penetration-free is inspired by the interior-point method, which converts the inequality constraints to barrier potentials. Nevertheless, we propose a major overhaul of this modality by defining a novel and simple barrier formulation which does not depend on the distance between mesh primitives. Such a non-distance barrier model allows a new way to integrate collision detection into the simulation pipeline. Another contributor to the performance boost comes from the so-called subspace reuse strategy. This is based on the observation that low-frequency strain vibrations are near orthogonal to the deformation induced by collisions or self-collisions, often of high frequency. Subspace reuse then takes care of low-frequency residuals, while high-frequency residuals can also be effectively smoothed by GPU-based iterative solvers. We show that our method outperforms existing fast cloth simulators by nearly one order while keeping the entire simulation penetration-free and producing high-equality animations of high-resolution models.


title: A Machine Learning Approach for Crop Yield and Disease Prediction Integrating Soil Nutrition and Weather Factors

abstract: The development of an intelligent agricultural decision-supporting system for crop selection and disease forecasting in Bangladesh is the main objective of this work. The economy of the nation depends heavily on agriculture. However, choosing crops with better production rates and efficiently controlling crop disease are obstacles that farmers have to face. These issues are addressed in this research by utilizing machine learning methods and real-world datasets. The recommended approach uses a variety of datasets on the production of crops, soil conditions, agro-meteorological regions, crop disease, and meteorological factors. These datasets offer insightful information on disease trends, soil nutrition demand of crops, and agricultural production history. By incorporating this knowledge, the model first recommends the list of primarily selected crops based on the soil nutrition of a particular user location. Then the predictions of meteorological variables like temperature, rainfall, and humidity are made using SARIMAX models. These weather predictions are then used to forecast the possibilities of diseases for the primary crops list by utilizing the support vector classifier. Finally, the developed model makes use of the decision tree regression model to forecast crop yield and provides a final crop list along with associated possible disease forecast. Utilizing the outcome of the model, farmers may choose the best productive crops as well as prevent crop diseases and reduce output losses by taking preventive actions. Consequently, planning and decision-making processes are supported and farmers can predict possible crop yields. Overall, by offering a detailed decision support system for crop selection and disease prediction, this work can play a vital role in advancing agricultural practices in Bangladesh.


title: Extracting coherent sets in aperiodically driven flows from generators of Mather semigroups

abstract: Coherent sets are time-dependent regions in the physical space of nonautonomous flows that exhibit little mixing with their neighborhoods, robustly under small random perturbations of the flow. They thus characterize the global long-term transport behavior of the system. We propose a framework to extract such time-dependent families of coherent sets for nonautonomous systems with an ergodic driving dynamics and (small) Brownian noise in physical space. Our construction involves the assembly and analysis of an operator on functions over the augmented space of the associated skew product that, for each fixed state of the driving, propagates distributions on the corresponding physical-space fibre according to the dynamics. This time-dependent operator has the structure of a semigroup (it is called the Mather semigroup), and we show that a spectral analysis of its generator allows for a trajectory-free computation of coherent families, simultaneously for all states of the driving. Additionally, for quasi-periodically driven torus flows, we propose a tailored Fourier discretization scheme for this generator and demonstrate our method by means of three examples of two-dimensional flows.


title: Knowledge Boundary and Persona Dynamic Shape A Better Social Media Agent

abstract: Constructing personalized and anthropomorphic agents holds significant importance in the simulation of social networks. However, there are still two key problems in existing works: the agent possesses world knowledge that does not belong to its personas, and it cannot eliminate the interference of diverse persona information on current actions, which reduces the personalization and anthropomorphism of the agent. To solve the above problems, we construct the social media agent based on personalized knowledge and dynamic persona information. For personalized knowledge, we add external knowledge sources and match them with the persona information of agents, thereby giving the agent personalized world knowledge. For dynamic persona information, we use current action information to internally retrieve the persona information of the agent, thereby reducing the interference of diverse persona information on the current action. To make the agent suitable for social media, we design five basic modules for it: persona, planning, action, memory and reflection. To provide an interaction and verification environment for the agent, we build a social media simulation sandbox. In the experimental verification, automatic and human evaluations demonstrated the effectiveness of the agent we constructed.


title: Enhanced Bayesian Personalized Ranking for Robust Hard Negative Sampling in Recommender Systems

abstract: In implicit collaborative filtering, hard negative mining techniques are developed to accelerate and enhance the recommendation model learning. However, the inadvertent selection of false negatives remains a major concern in hard negative sampling, as these false negatives can provide incorrect information and mislead the model learning. To date, only a small number of studies have been committed to solve the false negative problem, primarily focusing on designing sophisticated sampling algorithms to filter false negatives. In contrast, this paper shifts its focus to refining the loss function. We find that the original Bayesian Personalized Ranking (BPR), initially designed for uniform negative sampling, is inadequate in adapting to hard sampling scenarios. Hence, we introduce an enhanced Bayesian Personalized Ranking objective, named as Hard-BPR, which is specifically crafted for dynamic hard negative sampling to mitigate the influence of false negatives. This method is simple yet efficient for real-world deployment. Extensive experiments conducted on three real-world datasets demonstrate the effectiveness and robustness of our approach, along with the enhanced ability to distinguish false negatives.


title: Influence of disorder at Insulator-Metal interface on spin transport

abstract: Motivated by experimental work showing enhancement of spin transport between Yttrium Iron Garnet and Platinum by a thin antiferromagnetic insulator between them, we consider spin transport through the interface of a non-magnetic metal and compensated antiferromagnetically ordered insulator and focus on the significance of the interface itself. The spin transport is carried by spin-polarized electrons in the metal and by magnons in the insulator. We compute the spin current in the presence of a spin accumulation in the metal, cause by the spin Hall effect, and a thermal gradient using Fermi's Golden Rule in the presence of interfacial disorder. For a perfectly clean interface, the in-plane momentum is conserved by the electron-magnon scattering events that govern the spin transport through the interface. We calculate how disorder-induced broadening of scattering matrix elements with respect to the in-plane momentum influences the spin current. As a general result, we observe that for many experimental setups, specifically for high temperatures, one should expect a rather small effect of interface disorder on the measured spin current, while for small temperatures there is a significant reduction of a spin current with increasing disorder.


title: CAT: Exploiting Inter-Class Dynamics for Domain Adaptive Object Detection

abstract: Domain adaptive object detection aims to adapt detection models to domains where annotated data is unavailable. Existing methods have been proposed to address the domain gap using the semi-supervised student-teacher framework. However, a fundamental issue arises from the class imbalance in the labelled training set, which can result in inaccurate pseudo-labels. The relationship between classes, especially where one class is a majority and the other minority, has a large impact on class bias. We propose Class-Aware Teacher (CAT) to address the class bias issue in the domain adaptation setting. In our work, we approximate the class relationships with our Inter-Class Relation module (ICRm) and exploit it to reduce the bias within the model. In this way, we are able to apply augmentations to highly related classes, both inter- and intra-domain, to boost the performance of minority classes while having minimal impact on majority classes. We further reduce the bias by implementing a class-relation weight to our classification loss. Experiments conducted on various datasets and ablation studies show that our method is able to address the class bias in the domain adaptation setting. On the Cityscapes to Foggy Cityscapes dataset, we attained a 52.5 mAP, a substantial improvement over the 51.2 mAP achieved by the state-of-the-art method.


title: Fine-Tuning Language Models with Reward Learning on Policy

abstract: Reinforcement learning from human feedback (RLHF) has emerged as an effective approach to aligning large language models (LLMs) to human preferences. RLHF contains three steps, i.e., human preference collecting, reward learning, and policy optimization, which are usually performed serially. Despite its popularity, however, (fixed) reward models may suffer from inaccurate off-distribution, since policy optimization continuously shifts LLMs' data distribution. Repeatedly collecting new preference data from the latest LLMs may alleviate this issue, which unfortunately makes the resulting system more complicated and difficult to optimize. In this paper, we propose reward learning on policy (RLP), an unsupervised framework that refines a reward model using policy samples to keep it on-distribution. Specifically, an unsupervised multi-view learning method is introduced to learn robust representations of policy samples. Meanwhile, a synthetic preference generation approach is developed to simulate high-quality preference data with policy outputs. Extensive experiments on three benchmark datasets show that RLP consistently outperforms the state-of-the-art. Our code is available at \url{https://github.com/AlibabaResearch/DAMO-ConvAI/tree/main/rlp}.


title: Quantum-thermodynamic enhancements in continuous thermal machines require energetic coherence

abstract: Quantum coherence has been shown to impact the operational capabilities of quantum systems performing thermodynamic tasks in a significant way, and yet the possibility of genuine coherence-enhanced thermodynamic operation remains unclear. Here we show that only the presence of energetic coherence -- coherence between levels with different energies -- in steady-state quantum thermal machines can lead to genuine thermodynamic advantage. On the other hand, engines showing coherence between degenerate levels, or subjected to noise-induced coherence, are shown to be systematically outperformed by classical stochastic engines using exactly the same set of (incoherent) resources. We illustrate our results with three prototypical models of heat engines and refrigerators and employ multi-objective optimization techniques to characterize quantum-enhanced regimes in connection with the thermodynamic uncertainty relation.


title: On potentials whose level sets are orbits

abstract: A level orbit of a mechanical Hamiltonian system is a solution of Newton equation that is contained in a level set of the potential energy. In 2003, Mark Levi asked for a characterization of the smooth potential energy functions on the plane with the property that any point on the plane lies on a level orbit; we call such functions Levi potentials. The basic examples are the radial monotone increasing smooth functions. In this paper we show that any Levi potential that is analytic or has totally path-disconnected critical set must be radial. Nevertheless, we show that every compact convex subset of the plane is the critical set of a Levi potential. A crucial observation for these theorems is that, outside the critical set, the family of level sets of a Levi potential forms a solution of the inverse curvature flow.


title: Cohen-Macaulay representations of invariant subrings

abstract: We investigate Cohen-Macaulay representations of quotient singularities $R:=l[[x_1,\cdots,x_d]]^G$ where $l$ is a field and $G$ is a finite group acting on $l[[x_1,\cdots,x_d]]$ as a ring, not necessarily as an $l$-algebra, with $|G|$ not divided by ${\rm char}\, l$. In fact, if we put $k:=l^G$, then we may assume that $G$ is a subgroup of $GL_d(l)\rtimes{\rm Gal}(l/k)$. We show that $R$ has a generator giving an NCCR and therefore when $d=2$, it is of finite Cohen-Macaulay type. Additionally, we completely describe its Auslander-Reiten quiver, which is often non-simply laced, as a quotient of a certain quiver. Moreover, we also prove that two-dimensional rings of finite Cohen-Macaulay type of equicharacteristic zero are precisely quotient singularities of this form, which generalizes Esnault and Auslander's result. Combining these results, we prove that the quivers that may arise as the Auslander-Reiten quiver of a two-dimensional Gorenstein ring of finite Cohen-Macaulay type of equicharacteristic zero are either doubles of extended Dynkin diagrams or ones having loops. To accomplish these, we establish two results which are of independent interest. First, we prove the existence of $(d-1)$-almost split sequences for arbitrary Cohen-Macaulay normal rings having NCCR which are not necessarily isolated singularities. Second, we make it possible to determine simple modules over skew group algebras by relating them to those over certain group algebras.


title: Ungrammatical-syntax-based In-context Example Selection for Grammatical Error Correction

abstract: In the era of large language models (LLMs), in-context learning (ICL) stands out as an effective prompting strategy that explores LLMs' potency across various tasks. However, applying LLMs to grammatical error correction (GEC) is still a challenging task. In this paper, we propose a novel ungrammatical-syntax-based in-context example selection strategy for GEC. Specifically, we measure similarity of sentences based on their syntactic structures with diverse algorithms, and identify optimal ICL examples sharing the most similar ill-formed syntax to the test input. Additionally, we carry out a two-stage process to further improve the quality of selection results. On benchmark English GEC datasets, empirical results show that our proposed ungrammatical-syntax-based strategies outperform commonly-used word-matching or semantics-based methods with multiple LLMs. This indicates that for a syntax-oriented task like GEC, paying more attention to syntactic information can effectively boost LLMs' performance. Our code will be publicly available after the publication of this paper.


title: Existence of solutions for a class of Kirchhoff-type equations with indefinite potential

abstract: In this paper, we consider the existence of solutions of the following Kirchhoff-type problem \[ \left\{ \begin{array} [c]{ll} -\left(a+b\int_{\mathbb{R}^3}|\nabla u|^2dx\right)\Delta u+ V(x)u=f(x,u),~{\rm{in}}~ \mathbb{R}^{3},\\ u\in H^1(\mathbb{R}^3), \end{array} \right. \] where $a,b$ are postive constants, and the potential $V(x)$ is continuous and indefinite in sign. Under some suitable assumptions on $V(x)$ and $f$, we obtain the existence of solutions by the Symmetric Mountain Pass Theorem.


title: Going Beyond Word Matching: Syntax Improves In-context Example Selection for Machine Translation

abstract: In-context learning (ICL) is the trending prompting strategy in the era of large language models (LLMs), where a few examples are demonstrated to evoke LLMs' power for a given task. How to select informative examples remains an open issue. Previous works on in-context example selection for machine translation (MT) focus on superficial word-level features while ignoring deep syntax-level knowledge. In this paper, we propose a syntax-based in-context example selection method for MT, by computing the syntactic similarity between dependency trees using Polynomial Distance. In addition, we propose an ensemble strategy combining examples selected by both word-level and syntax-level criteria. Experimental results between English and 6 common languages indicate that syntax can effectively enhancing ICL for MT, obtaining the highest COMET scores on 11 out of 12 translation directions.


title: Adaptive optimization of isogeometric multi-patch discretizations using artificial neural networks

abstract: In isogeometric analysis, isogeometric function spaces are employed for accurately representing the solution to a partial differential equation (PDE) on a parameterized domain. They are generated from a tensor-product spline space by composing the basis functions with the inverse of the parameterization. Depending on the geometry of the domain and on the data of the PDE, the solution might not have maximum Sobolev regularity, leading to a reduced convergence rate. In this case it is necessary to reduce the local mesh size close to the singularities. The classical approach is to perform adaptive h-refinement, which either leads to an unnecessarily large number of degrees of freedom or to a spline space that does not possess a tensor-product structure. Based on the concept of r-adaptivity we present a novel approach for finding a suitable isogeometric function space for a given PDE without sacrificing the tensor-product structure of the underlying spline space. In particular, we use the fact that different reparameterizations of the same computational domain lead to different isogeometric function spaces while preserving the geometry. Starting from a multi-patch domain consisting of bilinearly parameterized patches, we aim to find the biquadratic multi-patch parameterization that leads to the isogeometric function space with the smallest best approximation error of the solution. In order to estimate the location of the optimal control points, we employ a trained residual neural network that is applied to the graph surfaces of the approximated solution and its derivatives. In our experimental results, we observe that our new method results in a vast improvement of the approximation error for different PDE problems on multi-patch domains.


title: CoderUJB: An Executable and Unified Java Benchmark for Practical Programming Scenarios

abstract: In the evolving landscape of large language models (LLMs) tailored for software engineering, the need for benchmarks that accurately reflect real-world development scenarios is paramount. Current benchmarks are either too simplistic or fail to capture the multi-tasking nature of software development. To address this, we introduce CoderUJB, a new benchmark designed to evaluate LLMs across diverse Java programming tasks that are executable and reflective of actual development scenarios, acknowledging Java's prevalence in real-world software production. CoderUJB comprises 2,239 programming questions derived from 17 real open-source Java projects and spans five practical programming tasks. Our empirical study on this benchmark investigates the coding abilities of various open-source and closed-source LLMs, examining the effects of continued pre-training in specific programming languages code and instruction fine-tuning on their performance. The findings indicate that while LLMs exhibit strong potential, challenges remain, particularly in non-functional code generation (e.g., test generation and defect detection). Importantly, our results advise caution in the specific programming languages continued pre-training and instruction fine-tuning, as these techniques could hinder model performance on certain tasks, suggesting the need for more nuanced strategies. CoderUJB thus marks a significant step towards more realistic evaluations of programming capabilities in LLMs, and our study provides valuable insights for the future development of these models in software engineering.


title: Entanglement in multinucleon transfer reactions

abstract: Nuclear reactions present an interesting case for studies of the time-evolution of entanglement between complex quantum systems. In this work, the time-dependent nuclear density functional theory is employed to explore entanglement in multinucleon transfer reactions. As an illustrative example, for the reaction $^{40}$Ca $+$ $^{208}$Pb at $E_{\rm lab} = 249$ MeV, in the interval of impact parameters $4.65-7.40$ fm, and the relativistic density functional PC-PK1, we compute the von Neumann entropies, entanglement between fragments, nucleon-number fluctuations, and Shannon entropy for the nucleon-number observable. A simple linear correlation is established between the entanglement and nucleon-number fluctuation of the final fragments. The entanglement between the fragments can be related to the corresponding excitation energies and angular momenta. The relationship between the von Neumann entropy and the Shannon entropy for the nucleon-number observable is analyzed, as well as the time-evolution of the entanglement (nucleon-number fluctuation). The entanglement is also calculated for a range of incident energies and it is shown how, depending on the impact parameter, the entanglement increases with the collision energy.


title: Uplift Modeling Under Limited Supervision

abstract: Estimating causal effects in e-commerce tends to involve costly treatment assignments which can be impractical in large-scale settings. Leveraging machine learning to predict such treatment effects without actual intervention is a standard practice to diminish the risk. However, existing methods for treatment effect prediction tend to rely on training sets of substantial size, which are built from real experiments and are thus inherently risky to create. In this work we propose a graph neural network to diminish the required training set size, relying on graphs that are common in e-commerce data. Specifically, we view the problem as node regression with a restricted number of labeled instances, develop a two-model neural architecture akin to previous causal effect estimators, and test varying message-passing layers for encoding. Furthermore, as an extra step, we combine the model with an acquisition function to guide the creation of the training set in settings with extremely low experimental budget. The framework is flexible since each step can be used separately with other models or treatment policies. The experiments on real large-scale networks indicate a clear advantage of our methodology over the state of the art, which in many cases performs close to random, underlining the need for models that can generalize with limited supervision to reduce experimental risks.


title: Trivalent Feynman Diagrams as a Flag

abstract: We exploit the flag and Orlik-Solomon algebra to reconstruct the intersection number of twisted cocycles and obtain the bi-adjoint amplitude. By studying the pairing of the special flag, we find that it results to Cachao-He-Yuan representation of the bi-adjoint amplitude. Through identifying each standard flag with Feynman trivalent diagram, in which the propagatoris bilinear form of the flag $S^{(a)(F_m,F_m)}$, we also find the geometry interpretation of Bern-Carrasco-Johansson duality discovered by Mizera as the identity of flag with a gap. According to the definition of flag simplex, we also construct the Z-amplitude in the $\alpha^{\prime} \rightarrow 0 $ limit.


title: Non-reciprocal alignment induces asymmetric clustering in active repulsive mixtures

abstract: Heterogeneity is a ubiquitous feature in many biological and synthetic active matter systems that are inherently out of equilibrium. In addition to conservative interactions between active constituents, a non-equilibrium environment often induces effective non-reciprocal (NR) couplings. The full consequences, especially for systems with order parameters of different symmetries, still remain elusive. Here, we study a minimal active NR mixture exhibiting both, polar ordering and clustering using a combination of hydrodynamic theory, linear stability analysis, particle-based simulations and fluctuation analysis. We show that NR alignment interactions have profound influence on the density dynamics already far below the threshold related to spontaneous time dependency of polarization dynamics. In particular, NR alignment alone induces asymmetrical clustering, and thus, partial demixing with single-species clusters chasing more dilute accumulations of the other species. Extremely large NR alignment eventually leads to a disappearance of clustered states.


title: Deep Learning-based Modulation Classification of Practical OFDM Signals for Spectrum Sensing

abstract: In this study, the modulation of symbols on OFDM subcarriers is classified for transmissions following Wi-Fi~6 and 5G downlink specifications. First, our approach estimates the OFDM symbol duration and cyclic prefix length based on the cyclic autocorrelation function. We propose a feature extraction algorithm characterizing the modulation of OFDM signals, which includes removing the effects of a synchronization error. The obtained feature is converted into a 2D histogram of phase and amplitude and this histogram is taken as input to a convolutional neural network (CNN)-based classifier. The classifier does not require prior knowledge of protocol-specific information such as Wi-Fi preamble or resource allocation of 5G physical channels. The classifier's performance, evaluated using synthetic and real-world measured over-the-air (OTA) datasets, achieves a minimum accuracy of 97\% accuracy with OTA data when SNR is above the value required for data transmission.


title: Adaptive Preload Control of Cable-Driven Parallel Robots for Handling Task

abstract: This paper presents a method for dynamic adjustment of cable preloads based on the actuation redundancy of \acp{CDPR}, which allows increasing or decreasing the platform stiffness depending on task requirements. This is achieved by computing preload parameters with an extended nullspace formulation of the kinematics. The method facilitates the operator's ability to specify a defined preload within the operation space. The algorithms are implemented in a real-time environment, allowing for the use of optimization in hybrid position-force control. To validate the effectiveness of this approach, a simulation study is performed, and the obtained results are compared to existing methods. Furthermore, the method is investigated experimentally and compared with the conventional position-controlled operation of a cable robot. The results demonstrate the feasibility of adaptively adjusting cable preloads during platform motion and manipulation of additional objects.


title: FlowDepth: Decoupling Optical Flow for Self-Supervised Monocular Depth Estimation

abstract: Self-supervised multi-frame methods have currently achieved promising results in depth estimation. However, these methods often suffer from mismatch problems due to the moving objects, which break the static assumption. Additionally, unfairness can occur when calculating photometric errors in high-freq or low-texture regions of the images. To address these issues, existing approaches use additional semantic priori black-box networks to separate moving objects and improve the model only at the loss level. Therefore, we propose FlowDepth, where a Dynamic Motion Flow Module (DMFM) decouples the optical flow by a mechanism-based approach and warps the dynamic regions thus solving the mismatch problem. For the unfairness of photometric errors caused by high-freq and low-texture regions, we use Depth-Cue-Aware Blur (DCABlur) and Cost-Volume sparsity loss respectively at the input and the loss level to solve the problem. Experimental results on the KITTI and Cityscapes datasets show that our method outperforms the state-of-the-art methods.


title: The $\ell_1$ double-bubble problem in three dimensions

abstract: We characterize the unique minimizer of the three-dimensional double-bubble problem with respect to the $\ell_1$-norm for volume ratios between $1/2$ and $2$.


title: Theoretical analysis of chemical reactions using a variational quantum eigensolver method without specifying molecular charge

abstract: Quantum chemical calculations have attracted much attention as a practical application of quantum computing. Quantum computers can prepare superpositions of electronic states with various numbers of electrons on qubits. This special feature could be used to construct an efficient method for analyzing the structural variations of molecules and chemical reactions involving changes in molecular charge. The present work demonstrates a variational quantum eigensolver (VQE) algorithm based on a cost function ($L_{cost}$) having the same form as the grand potential of the grand canonical ensemble of electrons. The chemical potential of the electrons ($w$) is used as an input to these VQE calculations, whereas the molecular charge is not specified in advance but rather is a physical quantity that results from the calculations. Calculations involving model systems are carried out to show the viability of this new approach. Calculations for typical electron-donating and electron-accepting molecules using this technique yielded cationic, neutral or anionic species depending on the value of $w$. Models representing the adsorption of water or ammonia on copper-based catalysts predicted that oxidation would be associated with such adsorption. The molecular structures in which such reactions occurred were found to be dependent on the catalyst model, the adsorbed molecular species, and the value of $w$. These results arise because the electronic state that gives the lowest $L_{cost}$ value depends on the value of $w$ and the molecular structure. This behaviour was successfully simulated by the present VQE calculations.


title: Quantum asymptotic amplitude for quantum oscillatory systems from the Koopman operator viewpoint

abstract: We have recently proposed a fully quantum-mechanical definition of the asymptotic phase for quantum nonlinear oscillators, which is also applicable in the strong quantum regime [Kato and Nakao 2022 Chaos 32 063133]. In this study, we propose a definition of the quantum asymptotic amplitude for quantum oscillatory systems, which extends naturally the definition of the asymptotic amplitude for classical nonlinear oscillators on the basis of the Koopman operator theory. We introduce the asymptotic amplitude for quantum oscillatory systems by using the eigenoperator of the backward Liouville operator associated with the largest non-zero real eigenvalue. Using examples of the quantum van der Pol oscillator with the quantum Kerr effect, exhibiting quantum limit-cycle oscillations, and the quantum van der Pol model with the quantum squeezing and degenerate parametric oscillator with nonlinear damping, exhibiting quantum noise-induced oscillations, we illustrate that the proposed quantum asymptotic amplitude appropriately yields isostable amplitude values that decay exponentially with a constant rate.


title: A unified SHTC multiphase model of continuum mechanics

abstract: In this paper, we present a unified nonequilibrium model of continuum mechanics for compressible multiphase flows. The model, which is formulated within the framework of Symmetric Hyperbolic Thermodynamically Compatible (SHTC) equations, can describe the arbitrary number of phases that can be heat-conducting inviscid and viscous fluids, as well as elastoplastic solids. The phases are allowed to have different velocities, pressures, temperatures, and shear stresses, while the material interfaces are treated as diffuse interfaces with the volume fraction playing the role of the interface field. To relate our model to other multiphase approaches, we reformulate the SHTC governing equations in terms of the phase state parameters and put them in the form of Baer-Nunziato-type models. It is the Baer-Nunziato form of the SHTC equations which is then solved numerically using a robust second-order path-conservative MUSCL-Hancock finite volume method on Cartesian meshes. Due to the fact that the obtained governing equations are very challenging, we restrict our numerical examples to a simplified version of the model, focusing on the isentropic limit for three-phase mixtures. To address the stiffness properties of the relaxation source terms present in the model, the implemented scheme incorporates a semi-analytical time integration method specifically designed for the non-linear stiff source terms governing the strain relaxation. The validation process involves a wide range of benchmarks and several applications for compressible multiphase problems. Notably, results are presented for multiphase flows in all the relaxation limit cases of the model, including inviscid and viscous Newtonian fluids, as well as non-linear hyperelastic and elastoplastic solids.


title: Post Quantum Cryptography and its Comparison with Classical Cryptography

abstract: Cryptography plays a pivotal role in safeguarding sensitive information and facilitating secure communication. Classical cryptography relies on mathematical computations, whereas quantum cryptography operates on the principles of quantum mechanics, offering a new frontier in secure communication. Quantum cryptographic systems introduce novel dimensions to security, capable of detecting and thwarting eavesdropping attempts. By contrasting quantum cryptography with its classical counterpart, it becomes evident how quantum mechanics revolutionizes the landscape of secure communication.


title: Random Multi-Type Spanning Forests for Synchronization on Sparse Graphs

abstract: Random diffusions are a popular tool in Monte-Carlo estimations, with well established algorithms such as Walk-on-Spheres (WoS) going back several decades. In this work, we introduce diffusion estimators for the problems of angular synchronization and smoothing on graphs, in the presence of a rotation associated to each edge. Unlike classical WoS algorithms, these estimators allow for global estimations by propagating along the branches of multi-type spanning forests, and we show that they can outperform standard numerical-linear-algebra solvers in challenging instances, depending on the topology and density of the graph.


title: Unveiling the Significance of Intrinsic Sensitivity and Multiple Scattering in Speckle Metrology

abstract: Speckle patterns are a powerful tool for high-precision metrology, as they allow remarkable performance in relatively simple setups. Nonetheless, researchers in this field follow rather distinct paths due to underappreciated general principles underlying speckle phenomena. Here, we advise on a universal metric of intrinsic speckle sensitivity, and on the advantages and disadvantages of multiple scattering. This will catalyse progress in speckle metrology but will also translate to other domains of disordered optics which are undergoing rapid developments at present.


title: Generate then Retrieve: Conversational Response Retrieval Using LLMs as Answer and Query Generators

abstract: CIS is a prominent area in IR which focuses on developing interactive knowledge assistants. These systems must adeptly comprehend the user's information requirements within the conversational context and retrieve the relevant information. To this aim, the existing approaches model the user's information needs by generating a single query rewrite or a single representation of the query in the query space embedding. However, to answer complex questions, a single query rewrite or representation is often ineffective. To address this, a system needs to do reasoning over multiple passages. In this work, we propose using a generate-then-retrieve approach to improve the passage retrieval performance for complex user queries. In this approach, we utilize large language models (LLMs) to (i) generate an initial answer to the user's information need by doing reasoning over the context of the conversation, and (ii) ground this answer to the collection. Based on the experiments, our proposed approach significantly improves the retrieval performance on TREC iKAT 23, TREC CAsT 20 and 22 datasets, under various setups. Also, we show that grounding the LLM's answer requires more than one searchable query, where an average of 3 queries outperforms human rewrites.


title: Developing generative AI chatbots conceptual framework for higher education

abstract: This research explores the quickly changing field of generative artificial intelligence (GAI) chatbots in higher education, an industry that is undergoing major technological changes. AI chatbots, such as ChatGPT, HuggingChat, and Google Bard, are becoming more and more common in a variety of sectors, including education. Their acceptance is still in its early phases, with a variety of prospects and obstacles. However, their potential in higher education is particularly noteworthy, providing lecturers and students with affordable, individualized support. Creating a comprehensive framework to aid the usage of generative AI chatbots in higher education institutions (HEIs) is the aim of this project. The Generative AI Chatbots Acceptance Model (GAICAM) is the result of this study's synthesis of elements from well-known frameworks, including the TAM, UTAUT2, TPB, and others along with variables like optimism, innovativeness, discomfort, insecurity, and others. Using a research method that encompasses a comprehensive analysis of extant literature from databases such as IEEE, ACM, ScienceDirect, and Google Scholar, the study aims to comprehend the implications of AI Chatbots on higher education and pinpoint critical elements for their efficacious implementation. Peer-reviewed English-language publications published between 2020 and 2023 with a focus on the use of AI chatbots in higher education were the main focus of the search criteria. The results demonstrate how much AI chatbots can do to improve student engagement, streamline the educational process, and support administrative and research duties. But there are also clear difficulties, such as unfavorable student sentiments, doubts about the veracity of material produced by AI, and unease and nervousness with new technologies.


title: Titanium abundances in late-type stars, II. Grid of departure coefficients and application to a sample of $70\,000$ stars

abstract: Rapidly growing datasets from stellar spectroscopic surveys are providing unprecedented opportunities to analyse the chemical evolution history of our Galaxy. However, spectral analysis requires accurate modelling of synthetic stellar spectra for late-type stars, for which the assumption of local thermodynamic equilibrium (LTE) has been shown to be insufficient in many cases. Errors associated with LTE can be particularly large for Ti I, which is susceptible to over-ionisation, particularly in metal-poor stars. The aims of this work are to study and quantify the 1D non-LTE effects on titanium abundances across the Hertzsprung-Russell diagram for a large sample of stars. A large grid of departure coefficients, $\beta_\nu$, were computed on standard MARCS model atmospheres. The grid extends from 3000K to 8000K in T$_{\mathrm{eff}}$, -0.5 to +5.5 dex in log(g), and -5.0 to +1.0 in [Fe/H], with non-LTE effects in this grid reaching up to 0.4 dex. This was used to compute abundance corrections that were subsequently applied to the LTE abundances of over 70,000 stars selected from the GALAH survey and additional metal-poor dwarfs. The non-LTE effects grow towards lower [Fe/H], lower log(g), and higher T$_{\mathrm{eff}}$, with a minimum and maximum $\Delta$A(Ti I) of 0.02 and 0.19 in the GALAH sample. For metal-poor giants, the non-LTE modelling reduces the average ionisation imbalance from -0.11 dex to -0.01 dex at [Fe/H] = -1.7, and the enhancement in titanium abundances from Ti I lines results in a [Ti/Fe] versus [Fe/H] trend that more closely resembles the behaviour of Ti II at low metallicities. Non-LTE effects on titanium abundances are significant. Neglecting them may alter our understanding of Galactic chemical evolution. We have made our grid of departure coefficients publicly available, with the caveat that the Ti abundances of metal-poor dwarfs need further study in 3D non-LTE.


title: MATEval: A Multi-Agent Discussion Framework for Advancing Open-Ended Text Evaluation

abstract: Recent advancements in generative Large Language Models(LLMs) have been remarkable, however, the quality of the text generated by these models often reveals persistent issues. Evaluating the quality of text generated by these models, especially in open-ended text, has consistently presented a significant challenge. Addressing this, recent work has explored the possibility of using LLMs as evaluators. While using a single LLM as an evaluation agent shows potential, it is filled with significant uncertainty and instability. To address these issues, we propose the MATEval: A "Multi-Agent Text Evaluation framework" where all agents are played by LLMs like GPT-4. The MATEval framework emulates human collaborative discussion methods, integrating multiple agents' interactions to evaluate open-ended text. Our framework incorporates self-reflection and Chain-of-Thought (CoT) strategies, along with feedback mechanisms, enhancing the depth and breadth of the evaluation process and guiding discussions towards consensus, while the framework generates comprehensive evaluation reports, including error localization, error types and scoring. Experimental results show that our framework outperforms existing open-ended text evaluation methods and achieves the highest correlation with human evaluation, which confirms the effectiveness and advancement of our framework in addressing the uncertainties and instabilities in evaluating LLMs-generated text. Furthermore, our framework significantly improves the efficiency of text evaluation and model iteration in industrial scenarios.


title: Sparse Generation: Making Pseudo Labels Sparse for weakly supervision with points

abstract: In recent years, research on point weakly supervised object detection (PWSOD) methods in the field of computer vision has attracted people's attention. However, existing pseudo labels generation methods perform poorly in a small amount of supervised annotation data and dense object detection tasks. We consider the generation of weakly supervised pseudo labels as the result of model's sparse output, and propose a method called Sparse Generation to make pseudo labels sparse. It constructs dense tensors through the relationship between data and detector model, optimizes three of its parameters, and obtains a sparse tensor via coordinated calculation, thereby indirectly obtaining higher quality pseudo labels, and solving the model's density problem in the situation of only a small amount of supervised annotation data can be used. On two broadly used open-source datasets (RSOD, SIMD) and a self-built dataset (Bullet-Hole), the experimental results showed that the proposed method has a significant advantage in terms of overall performance metrics, comparing to that state-of-the-art method.


title: A Deep Redshift Survey of the Perseus Cluster: Spatial Distribution and Kinematics of Galaxies

abstract: We study the global kinematics of the Perseus galaxy cluster (Abell 426) at redshift z = 0.017 using a large sample of galaxies from our new MMT/Hectospec spectroscopic observation for this cluster. The sample includes 1447 galaxies with measured redshifts within 60' from the cluster center (1148 from this MMT/Hectospec program and 299 from the literature). The resulting spectroscopic completeness is 67% at r-band apparent magnitude $r_{\rm{Petro, 0}}\leq 18.0$ within 60' from the cluster center. To identify cluster member galaxies in this sample, we develop a new open-source Python package, CausticSNUpy. This code implements the algorithm of the caustic technique and yields 418 member galaxies within 60' of the cluster. We study the cluster using this sample of member galaxies. The cluster shows no significant signal of global rotation. A statistical test shows that the cluster does not have a noticeable substructure within 30'. We find two central regions where the X-ray emitting intracluster medium and galaxies show significant velocity differences ($>7\sigma$). On a large scale, however, the overall morphology and kinematics between the intracluster medium and galaxies agree well. Our results suggest that the Perseus cluster is a relaxed system and has not experienced a recent merger.


title: Maximum Nim and Josephus Problem

abstract: In this study, we study the relation between Grundy numbers of a Maximum Nim and Josephus problem. Let f(x) = floor(x/k), where floor( ) is the floor function and k is a positive integer. We prove that there is a simple relation with a Maximum Nim with the rule function f and the Josephus problem in which every k-th numbers are to be removed.


title: Improving performance of contour integral-based nonlinear eigensolvers with infinite GMRES

abstract: In this work, the infinite GMRES algorithm, recently proposed by Correnty et al., is employed in contour integral-based nonlinear eigensolvers, avoiding the computation of costly factorizations at each quadrature node to solve the linear systems efficiently. Several techniques are applied to make the infinite GMRES memory-friendly, computationally efficient, and numerically stable in practice. More specifically, we analyze the relationship between polynomial eigenvalue problems and their scaled linearizations, and provide a novel weighting strategy which can significantly accelerate the convergence of infinite GMRES in this particular context. We also adopt the technique of TOAR to infinite GMRES to reduce the memory footprint. Theoretical analysis and numerical experiments are provided to illustrate the efficiency of the proposed algorithm.


title: MRNaB: Mixed Reality-based Robot Navigation Interface using Optical-see-through MR-beacon

abstract: Recent advancements in robotics have led to the development of numerous interfaces to enhance the intuitiveness of robot navigation. However, the reliance on traditional 2D displays imposes limitations on the simultaneous visualization of information. Mixed Reality (MR) technology addresses this issue by enhancing the dimensionality of information visualization, allowing users to perceive multiple pieces of information concurrently. This paper proposes Mixed reality-based robot navigation interface using an optical-see-through MR-beacon (MRNaB), a novel approach that incorporates an MR-beacon, situated atop the real-world environment, to function as a signal transmitter for robot navigation. This MR-beacon is designed to be persistent, eliminating the need for repeated navigation inputs for the same location. Our system is mainly constructed into four primary functions: "Add", "Move", "Delete", and "Select". These allow for the addition of a MR-beacon, location movement, its deletion, and the selection of MR-beacon for navigation purposes, respectively. The effectiveness of the proposed method was then validated through experiments by comparing it with the traditional 2D system. As the result, MRNaB was proven to increase the performance of the user when doing navigation to a certain place subjectively and objectively. For additional material, please check: https://mertcookimg.github.io/mrnab


title: A Photonic Floquet Scattering Matrix for Wavefront-Shaping in Time-Periodic Media

abstract: The physics of waves in time-varying media provides numerous opportunities for wave control that are unattainable with static media. In particular, Floquet systems with a periodic time modulation are currently of considerable interest. Here, we demonstrate how the scattering properties of a finite Floquet medium can be correctly described by a static Floquet scattering matrix, which satisfies a pseudo-unitary relation. This algebraic property is a consequence of the conservation of wave action for which we formulate here a continuity equation. Using this Floquet scattering matrix, we further demonstrate how it can be used to generalize also the seminal Wigner-Smith operator from static to Floquet systems. The eigenstates of the corresponding Floquet Wigner-Smith matrix are shown to be light pulses that are optimally shaped both in their spatial and temporal degrees of freedom for the optical micromanipulation of time-varying media.


title: On the $k$-anti-traceability Conjecture

abstract: An oriented graph is called $k$-anti-traceable if the subdigraph induced by every subset with $k$ vertices has a hamiltonian anti-directed path. In this paper, we consider an anti-traceability conjecture. In particular, we confirm this conjecture holds when $k\leq 4$. We also show that every sufficiently large $k$-anti-traceable oriented graph admits an anti-path that contains $n-o(n)$ vertices.


title: Transport effects of twist-angle disorder in mesoscopic twisted bilayer graphene

abstract: Magic-angle twisted bilayer graphene is a tunable material with remarkably flat energy bands near the Fermi level, leading to fascinating transport properties and correlated states at low temperatures. However, grown pristine samples of this material tend to break up into landscapes of twist-angle domains, strongly influencing the physical properties of each individual sample. This poses a significant problem to the interpretation and comparison between measurements obtained from different samples. In this work, we study numerically the effects of twist-angle disorder on quantum electron transport in mesoscopic samples of magic-angle twisted bilayer graphene. We find a significant property of twist-angle disorder that distinguishes it from onsite-energy disorder: it leads to an asymmetric broadening of the energy-resolved conductance. The magnitude of the twist-angle variation has a strong effect on conductance, while the number of twist-angle domains is of much lesser significance. We further establish a relationship between the asymmetric broadening and the asymmetric density of states of twisted bilayer graphene at angles smaller than the first magic angle. Our results show that the qualitative differences between the types of disorder in the energy-resolved conductance of twisted bilayer graphene samples can be used to characterize them at temperatures above the critical temperatures of the correlated phases, enabling systematic experimental studies of the effects of the different types of disorders also on the other properties such as the competition of the different types of correlated states appearing at lower temperatures.


title: Total-Decom: Decomposed 3D Scene Reconstruction with Minimal Interaction

abstract: Scene reconstruction from multi-view images is a fundamental problem in computer vision and graphics. Recent neural implicit surface reconstruction methods have achieved high-quality results; however, editing and manipulating the 3D geometry of reconstructed scenes remains challenging due to the absence of naturally decomposed object entities and complex object/background compositions. In this paper, we present Total-Decom, a novel method for decomposed 3D reconstruction with minimal human interaction. Our approach seamlessly integrates the Segment Anything Model (SAM) with hybrid implicit-explicit neural surface representations and a mesh-based region-growing technique for accurate 3D object decomposition. Total-Decom requires minimal human annotations while providing users with real-time control over the granularity and quality of decomposition. We extensively evaluate our method on benchmark datasets and demonstrate its potential for downstream applications, such as animation and scene editing. The code is available at https://github.com/CVMI-Lab/Total-Decom.git.


title: Mass fluctuations in non-rotating BTZ black holes

abstract: We investigate the impact of oscillations of a black-hole mass around its average value on the three-dimensional black hole geometry. Drawing on a classical framework that conceptualizes fluctuations near an event horizon as mass variations, we introduce a model where the metric of a black hole, formed from the collapse of a massive null shell, exhibits oscillatory behavior in spherical modes. This dynamic is encapsulated by a non-rotating BTZ-Vaidya solution, characterized by the black hole mass fluctuating at a resonant frequency $\omega$ and a small amplitude parameter $\mu_0$. Using a perturbative approach, solutions to the null geodesic equation are determined up to the second order in $\mu_0$. The temporal fluctuations of the event horizon's location induce alterations in the thermodynamic variables' values. Upon calculating the time-averaged values, it is observed that the mean Hawking temperature experiences a slight decrease due to these fluctuations, while the mean entropy exhibits an increase, deviating from trends observed in four- and higher-dimensional spacetimes. Further, the study delves into the influence of these fluctuations on the trajectories of null rays near the horizon, ultimately reaching the anti-de Sitter boundary at late times. The analytical computation of the general solution for the perturbed rays up to the second order underscores the novel approach of this study in examining the effects of mass oscillations on black hole thermodynamics and geometry, contributing a unique perspective to the field.


title: Hypergraph-based Multi-View Action Recognition using Event Cameras

abstract: Action recognition from video data forms a cornerstone with wide-ranging applications. Single-view action recognition faces limitations due to its reliance on a single viewpoint. In contrast, multi-view approaches capture complementary information from various viewpoints for improved accuracy. Recently, event cameras have emerged as innovative bio-inspired sensors, leading to advancements in event-based action recognition. However, existing works predominantly focus on single-view scenarios, leaving a gap in multi-view event data exploitation, particularly in challenges like information deficit and semantic misalignment. To bridge this gap, we introduce HyperMV, a multi-view event-based action recognition framework. HyperMV converts discrete event data into frame-like representations and extracts view-related features using a shared convolutional network. By treating segments as vertices and constructing hyperedges using rule-based and KNN-based strategies, a multi-view hypergraph neural network that captures relationships across viewpoint and temporal features is established. The vertex attention hypergraph propagation is also introduced for enhanced feature fusion. To prompt research in this area, we present the largest multi-view event-based action dataset $\text{THU}^{\text{MV-EACT}}\text{-50}$, comprising 50 actions from 6 viewpoints, which surpasses existing datasets by over tenfold. Experimental results show that HyperMV significantly outperforms baselines in both cross-subject and cross-view scenarios, and also exceeds the state-of-the-arts in frame-based multi-view action recognition.


title: Beyond Borders: Investigating Cross-Jurisdiction Transfer in Legal Case Summarization

abstract: Legal professionals face the challenge of managing an overwhelming volume of lengthy judgments, making automated legal case summarization crucial. However, prior approaches mainly focused on training and evaluating these models within the same jurisdiction. In this study, we explore the cross-jurisdictional generalizability of legal case summarization models.Specifically, we explore how to effectively summarize legal cases of a target jurisdiction where reference summaries are not available. In particular, we investigate whether supplementing models with unlabeled target jurisdiction corpus and extractive silver summaries obtained from unsupervised algorithms on target data enhances transfer performance. Our comprehensive study on three datasets from different jurisdictions highlights the role of pre-training in improving transfer performance. We shed light on the pivotal influence of jurisdictional similarity in selecting optimal source datasets for effective transfer. Furthermore, our findings underscore that incorporating unlabeled target data yields improvements in general pre-trained models, with additional gains when silver summaries are introduced. This augmentation is especially valuable when dealing with extractive datasets and scenarios featuring limited alignment between source and target jurisdictions. Our study provides key insights for developing adaptable legal case summarization systems, transcending jurisdictional boundaries.


title: TableLLM: Enabling Tabular Data Manipulation by LLMs in Real Office Usage Scenarios

abstract: We introduce TableLLM, a robust large language model (LLM) with 13 billion parameters, purpose-built for proficiently handling tabular data manipulation tasks, whether they are embedded within documents or spreadsheets, catering to real-world office scenarios. We propose a distant supervision method for training, which comprises a reasoning process extension strategy, aiding in training LLMs to understand reasoning patterns more effectively as well as a cross-way validation strategy, ensuring the quality of the automatically generated data. To evaluate the performance of TableLLM, we have crafted a benchmark tailored to address both document and spreadsheet formats as well as constructed a well-organized evaluation pipeline capable of handling both scenarios. Thorough evaluations underscore the advantages of TableLLM when compared to various existing general-purpose and tabular data-focused LLMs. We have publicly released the model checkpoint, source code, benchmarks, and a web application for user interaction.Our codes and data are publicly available at https://github.com/TableLLM/TableLLM.


title: Mesh2NeRF: Direct Mesh Supervision for Neural Radiance Field Representation and Generation

abstract: We present Mesh2NeRF, an approach to derive ground-truth radiance fields from textured meshes for 3D generation tasks. Many 3D generative approaches represent 3D scenes as radiance fields for training. Their ground-truth radiance fields are usually fitted from multi-view renderings from a large-scale synthetic 3D dataset, which often results in artifacts due to occlusions or under-fitting issues. In Mesh2NeRF, we propose an analytic solution to directly obtain ground-truth radiance fields from 3D meshes, characterizing the density field with an occupancy function featuring a defined surface thickness, and determining view-dependent color through a reflection function considering both the mesh and environment lighting. Mesh2NeRF extracts accurate radiance fields which provides direct supervision for training generative NeRFs and single scene representation. We validate the effectiveness of Mesh2NeRF across various tasks, achieving a noteworthy 3.12dB improvement in PSNR for view synthesis in single scene representation on the ABO dataset, a 0.69 PSNR enhancement in the single-view conditional generation of ShapeNet Cars, and notably improved mesh extraction from NeRF in the unconditional generation of Objaverse Mugs.


title: Mean values of arithmetic functions and application to sums of powers

abstract: We provide new upper bounds for sums of certain arithmetic functions in many variables at polynomial arguments and, exploiting recent progress on the mean-value of the Erd\H os-Hooley $\Delta$-function, we derive lower bounds for the cardinality of those integers not exceeding a given limit that are expressible as some sums of powers.


title: Experience deploying an analysis facility for the Rubin Observatory's Legacy Survey of Space and Time (LSST) data

abstract: The Vera C. Rubin Observatory is preparing for the execution of the most ambitious astronomical survey ever attempted, the Legacy Survey of Space and Time (LSST). Currently in its final phase of construction in the Andes mountains in Chile and due to start operations in 2025 for 10 years, its 8.4-meter telescope will nightly scan the southern sky and collect images of the entire visible sky every 4 nights using a 3.2 Gigapixel camera, the largest imaging device ever built for astronomy. Automated detection and classification of celestial objects will be performed by sophisticated algorithms on high-resolution images to progressively produce an astronomical catalog eventually composed of 20 billion galaxies and 17 billion stars and their associated physical properties. In this paper, we briefly present the infrastructure deployed at the French Rubin data facility (operated by IN2P3 computing center, CC-IN2P3) to deploy the Rubin Science Platform, a set of web-based services to provide effective and convenient access to LSST data for scientific analysis. We describe the main services of the platform, the components that provide those services and our deployment model. We also present the Kubernetes-based infrastructure we are experimenting with for hosting the LSST astronomical catalog, a petabyte-scale relational database developed for the specific needs of the project.


title: Plug-and-Play Grounding of Reasoning in Multimodal Large Language Models

abstract: The rise of Multimodal Large Language Models (MLLMs), renowned for their advanced instruction-following and reasoning capabilities, has significantly propelled the field of visual reasoning. However, due to limitations in their image tokenization processes, most MLLMs struggle to capture fine details of text and objects in images, especially in high-resolution samples. To overcome this limitation, we introduce P2G, a novel framework for plug-and-play grounding in MLLMs. P2G utilizes the tool-usage potential of MLLMs to employ expert agents for on-the-fly grounding of reasoning into critical visual and textual elements in images, thereby enabling deliberate reasoning through multimodal prompting. Additionally, we develop P2GB, a benchmark designed to evaluate MLLMs' proficiency in understanding inter-object relationships and textual content in challenging high-resolution images. Extensive experiments on visual reasoning tasks demonstrate the superiority of P2G, achieving performance comparable to GPT-4V on P2GB with a 7B backbone. Our work underscores the potential of grounding reasoning with external agents in MLLMs, presenting a promising alternative to mere model scaling.


title: Rigid and shaky hard link diagrams

abstract: In this study of the Reidemeister moves within the classical knot theory, we focus on hard diagrams of knots and links, categorizing them as either rigid or shaky based on their adaptability to certain moves. We establish that every link possesses a diagram that is a rigid hard diagram and we provide an upper limit for the number of crossings in such diagrams. Furthermore, we investigate rigid hard diagrams for specific knots or links to determine their rigid hard index. In the topic of shaky hard diagrams, we demonstrate the existence of such diagrams for the unknot and unlink, regardless of the number of components, and present examples of shaky hard diagrams.


title: Rapid nonlinear convex guidance using a monomial method

abstract: This paper introduces a framework by which the nonlinear trajectory optimization problem is posed as a path-planning problem in a space liberated of dynamics. In this space, general state constraints for continuous and impulsive control problems are encoded as linear constraints on the native overparameterized variables. This framework is enabled by nonlinear expansion in the vicinity of a reference in terms of fundamental solutions and a minimal nonlinear basis of mixed monomials in problem initial conditions. The former can be computed using state transition tensors, differential algebra, or analytic approaches, and the latter is computed analytically. Nonlinear guidance schemes are proposed taking advantage of this framework, including a successive convex programming scheme for delta-V minimizing trajectory optimization. This work enables a stable, easy to implement, and highly rapid nonlinear guidance implementation without the need for collocation or real-time integration.


title: Bayesian inference of the dense matter equation of state built upon extended Skyrme interactions

abstract: The non-relativistic model of nuclear matter with Brussels extended Skyrme interactions is employed in order to build, within a Bayesian approach, models for the dense matter equation of state (EOS). In addition to a minimal set of constraints on nuclear empirical parameters; the density behavior of energy per particle in pure neutron matter (PNM); a lower limit on the maximum neutron star (NS) mass, we require that the Fermi velocity of neutrons ($v_{\mathrm{F;\,n}}$) in PNM and symmetric nuclear matter (SNM) with densities up to $0.8~\mathrm{fm}^{-3}$ does not exceed the speed of light. The latter condition is imposed in order to cure a deficiency present in many Skyrme interactions [Duan and Urban, Phys. Rev. C 108, 025813 (2023)]. We illustrate the importance of this constraint for the posterior distributions. Some of our models are subjected to constraints on the density dependence of neutron (nucleon) Landau effective mass in PNM (SNM), too. The impact of various sets of constraints on the behaviors of nuclear matter and NSs is discussed in detail. When compared with models built upon standard Skyrme interactions, it turns out that those based on the extended interactions are stiffer if Fermi velocity is disregarded, but softer if it is taken into account.


title: MedBN: Robust Test-Time Adaptation against Malicious Test Samples

abstract: Test-time adaptation (TTA) has emerged as a promising solution to address performance decay due to unforeseen distribution shifts between training and test data. While recent TTA methods excel in adapting to test data variations, such adaptability exposes a model to vulnerability against malicious examples, an aspect that has received limited attention. Previous studies have uncovered security vulnerabilities within TTA even when a small proportion of the test batch is maliciously manipulated. In response to the emerging threat, we propose median batch normalization (MedBN), leveraging the robustness of the median for statistics estimation within the batch normalization layer during test-time inference. Our method is algorithm-agnostic, thus allowing seamless integration with existing TTA frameworks. Our experimental results on benchmark datasets, including CIFAR10-C, CIFAR100-C and ImageNet-C, consistently demonstrate that MedBN outperforms existing approaches in maintaining robust performance across different attack scenarios, encompassing both instant and cumulative attacks. Through extensive experiments, we show that our approach sustains the performance even in the absence of attacks, achieving a practical balance between robustness and performance.


title: Barely alternating real almost chains and extension operators for compact lines

abstract: Assume $\text{MA}(\kappa)$. We show that for every real chain of size $\kappa$ in the quotient Boolean algebra $P(\omega)/fin$ we can find an almost chain of representatives such that every $n\in\omega$ oscillates at most three times along the almost chain. This is used to show that for every countable discrete extension of a separable compact line $K$ of weight $\kappa$ there exists an extension operator $E:C(K)\longrightarrow C(L)$ of norm at most three.


title: Complex generalized Gauss-Radau quadrature rules for Hankel transforms of integer order

abstract: Complex Gaussian quadrature rules for oscillatory integral transforms have the advantage that they can achieve optimal asymptotic order. However, their existence for Hankel transform can only be guaranteed when the order of the transform belongs to $[0,1/2]$. In this paper we consider the construction of generalized Gauss-Radau quadrature rules for Hankel transform. We show that, if adding certain value and derivative information at the left endpoint, then complex generalized Gauss-Radau quadrature rules for Hankel transform of integer order can be constructed with theoretical guarantees. Orthogonal polynomials that are closely related to such quadrature rules are investigated and their existence for even degrees is proved. Numerical experiments are presented to confirm our findings.


title: Simulating Relational Event Histories -- Why and How

abstract: Many important social phenomena result from repeated interactions among individuals over time such as email exchanges in an organization, or face-to-face interactions in a classroom. Insights into the mechanisms underlying the dynamics of these interactions can be achieved through simulations of networks on a fine temporal granularity. In this paper, we present statistical frameworks to simulate relational event networks under dyadic and actor-oriented relational event models. These simulators have a broad applicability in temporal social network research such as model fit assessment, theory building, network intervention planning, making predictions, understanding the impact of network structures, to name a few. We show this in three extensive applications. First, it is shown why simulation-based techniques are crucial for relational event model assessment, for example to investigate how past events affect future interactions in the network. Second, we demonstrate how simulation techniques contribute to a better understanding of the longevity of network interventions. Third, we show how simulation techniques are important when building and extending theories about social phenomena such as understanding social identity dynamics using optimal distinctiveness theory.


title: RootInteractive tool for multidimensional statistical analysis, machine learning and analytical model validation

abstract: The ALICE experiment at CERN LHC is specifically designed for investigating heavy ion collisions. The upgraded ALICE accommodates a tenfold increase in PbPb luminosity and a two-order of magnitude surge in minimum bias events. To address the challenges of high detector occupancy and event pile-ups, advanced multidimensional data analysis techniques, including machine learning (ML), are indispensable. Despite ML popularity, the complexity of its models presents interpretation challenges, and oversimplification in analysis often leads to inaccuracies. Our objective was to develop RootInteractive, a tool for multidimensional statistical analysis. This tool simplifies data analysis across dimensions, visualizes functions with uncertainties, and validates assumptions and approximations. In RootInteractive, it is crucial to easily define the functional composition of analytical parametric and non-parametric functions, exploit symmetries, and define multidimensional invariant functions and corresponding alarms. RootInteractive adopts a declarative programming paradigm, ensuring userfriendliness for experts, students, and educators. It facilitates interactive visualization, n-dimensional histogramming/projection, and information extraction on both Python,C++ server and client. Data compression, datasets with O(10 to 7) entries and O(25) attributes can be interactively analyzed in a browser with O(0.500-1 GB) size. Representative downsampling and reweighting/pre-aggregation enable the effective analysis of one year of ALICE data for various purposes.


title: An extended Nambu--Jona-Lasinio model for quark and nuclear matters

abstract: In this work, we extend the two-flavor Nambu--Jona-Lasinio model to one capable of exploring quark and nuclear matter consistently. With an extra term standing for quark-nucleon interactions, nucleons could automatically emerge as color-singlet three-quark entities by following a process similar to mesons. Besides the quark part in mean field approximation, both mesons and nucleons could contribute to the thermodynamic potential thus possibly give rise to quarkyonic matter beyond mean field. In the study, two kinds of "confining" couplings are adopted for the new interaction term and two different quark masses are considered for comparison. It turns out that only confined nuclear matter or deconfined quark matter is possible for all the cases at zero temperature, thus quarkyonic matter is not favored at all. Even more strictly, only the case with stronger confinement effect and a smaller quark mass admits a physical first-order phase transition from nuclear matter to quark matter around twice saturation density.


title: Learning a Formally Verified Control Barrier Function in Stochastic Environment

abstract: Safety is a fundamental requirement of control systems. Control Barrier Functions (CBFs) are proposed to ensure the safety of the control system by constructing safety filters or synthesizing control inputs. However, the safety guarantee and performance of safe controllers rely on the construction of valid CBFs. Inspired by universal approximatability, CBFs are represented by neural networks, known as neural CBFs (NCBFs). This paper presents an algorithm for synthesizing formally verified continuous-time neural Control Barrier Functions in stochastic environments in a single step. The proposed training process ensures efficacy across the entire state space with only a finite number of data points by constructing a sample-based learning framework for Stochastic Neural CBFs (SNCBFs). Our methodology eliminates the need for post hoc verification by enforcing Lipschitz bounds on the neural network, its Jacobian, and Hessian terms. We demonstrate the effectiveness of our approach through case studies on the inverted pendulum system and obstacle avoidance in autonomous driving, showcasing larger safe regions compared to baseline methods.


title: Three-dimensional shape and connectivity of physical networks

abstract: Data describing the three-dimensional structure of physical networks is increasingly available, leading to a surge of interest in network science to explore the relationship between the shape and connectivity of physical networks. We contribute to this effort by standardizing and analyzing 15 data sets from different domains. Treating junction points as nodes and connections between them as links, we divide the networks into three categories: lattice-like networks, trees, and linked trees. We find that the degree distribution of physical networks is bounded, with most nodes having degree one or three. Characterizing the physical properties of links, we show that links have an elongated shape and tend to follow a nearly straight trajectory, while a small fraction of links follow a winding path. These typical node and link properties must be reflected by physical network models. We also measure how confined a link is in space by comparing its trajectory to a randomized null-model, showing that links that are central in the abstract network tend to be physically confined by their neighbors. The fact that the shape and connectivity of the physical networks are intertwined highlights that their three-dimensional layout must be taken into account to understand the evolution and function of physical networks.


title: Test-Time Domain Generalization for Face Anti-Spoofing

abstract: Face Anti-Spoofing (FAS) is pivotal in safeguarding facial recognition systems against presentation attacks. While domain generalization (DG) methods have been developed to enhance FAS performance, they predominantly focus on learning domain-invariant features during training, which may not guarantee generalizability to unseen data that differs largely from the source distributions. Our insight is that testing data can serve as a valuable resource to enhance the generalizability beyond mere evaluation for DG FAS. In this paper, we introduce a novel Test-Time Domain Generalization (TTDG) framework for FAS, which leverages the testing data to boost the model's generalizability. Our method, consisting of Test-Time Style Projection (TTSP) and Diverse Style Shifts Simulation (DSSS), effectively projects the unseen data to the seen domain space. In particular, we first introduce the innovative TTSP to project the styles of the arbitrarily unseen samples of the testing distribution to the known source space of the training distributions. We then design the efficient DSSS to synthesize diverse style shifts via learnable style bases with two specifically designed losses in a hyperspherical feature space. Our method eliminates the need for model updates at the test time and can be seamlessly integrated into not only the CNN but also ViT backbones. Comprehensive experiments on widely used cross-domain FAS benchmarks demonstrate our method's state-of-the-art performance and effectiveness.


title: KazSAnDRA: Kazakh Sentiment Analysis Dataset of Reviews and Attitudes

abstract: This paper presents KazSAnDRA, a dataset developed for Kazakh sentiment analysis that is the first and largest publicly available dataset of its kind. KazSAnDRA comprises an extensive collection of 180,064 reviews obtained from various sources and includes numerical ratings ranging from 1 to 5, providing a quantitative representation of customer attitudes. The study also pursued the automation of Kazakh sentiment classification through the development and evaluation of four machine learning models trained for both polarity classification and score classification. Experimental analysis included evaluation of the results considering both balanced and imbalanced scenarios. The most successful model attained an F1-score of 0.81 for polarity classification and 0.39 for score classification on the test sets. The dataset and fine-tuned models are open access and available for download under the Creative Commons Attribution 4.0 International License (CC BY 4.0) through our GitHub repository.


title: IVLMap: Instance-Aware Visual Language Grounding for Consumer Robot Navigation

abstract: Vision-and-Language Navigation (VLN) is a challenging task that requires a robot to navigate in photo-realistic environments with human natural language promptings. Recent studies aim to handle this task by constructing the semantic spatial map representation of the environment, and then leveraging the strong ability of reasoning in large language models for generalizing code for guiding the robot navigation. However, these methods face limitations in instance-level and attribute-level navigation tasks as they cannot distinguish different instances of the same object. To address this challenge, we propose a new method, namely, Instance-aware Visual Language Map (IVLMap), to empower the robot with instance-level and attribute-level semantic mapping, where it is autonomously constructed by fusing the RGBD video data collected from the robot agent with special-designed natural language map indexing in the bird's-in-eye view. Such indexing is instance-level and attribute-level. In particular, when integrated with a large language model, IVLMap demonstrates the capability to i) transform natural language into navigation targets with instance and attribute information, enabling precise localization, and ii) accomplish zero-shot end-to-end navigation tasks based on natural language commands. Extensive navigation experiments are conducted. Simulation results illustrate that our method can achieve an average improvement of 14.4\% in navigation accuracy. Code and demo are released at https://ivlmap.github.io/.


title: The Hierarchical Cosmic Web and Assembly Bias

abstract: Accurate modeling of galaxy distributions is paramount for cosmological analysis using galaxy redshift surveys. However, this endeavor is often hindered by the computational complexity of resolving the dark matter halos that host these galaxies. To address this challenge, we propose the development of effective assembly bias models down to small scales, i.e., going beyond the local density dependence capturing non-local cosmic evolution. We introduce a hierarchical cosmic web classification that indirectly captures up to third-order long- and short-range non-local bias terms. This classification system also enables us to maintain positive definite parametric bias expansions. Specifically, we subdivide the traditional cosmic web classification, which is based on the eigenvalues of the tidal field tensor derived, with an additional classification based on the Hessian matrix of the negative density contrast. We obtain the large-scale dark matter field on a mesh with $\sim3.9\,h^{-1}$ Mpc cell side resolution through Augmented Lagrangian Perturbation Theory. To assess the effectiveness of our model, we conduct tests using a reference halo catalogue extracted from the UNIT project simulation, which was run within a cubical volume of 1 $h^{-1}$ Gpc side. The resulting mock halo catalogs, generated trough our approach, exhibit a high level of accuracy in terms of the one-, two- and three-point statistics. They reproduce the reference power spectrum within better than 2 percent accuracy up to wavenumbers $k\sim0.8\,h$ Mpc$^{-1}$ and provide accurate bispectra within the scales that are crucial for cosmological analysis. This effective bias approach provides a forward model appropriate for field-level cosmological inference and holds significant potential for facilitating cosmological analysis of galaxy redshift surveys, particularly in the context of projects such as DESI, EUCLID, and LSST.


title: Introducing scalar leptoquarks into a 3-3-1 model to solve the $(g-2)_\mu $ puzzle

abstract: In this work we introduce scalar leptoquarks into the 3-3-1 model with right-handed neutrinos with the aim of solving the $(g-2)_{\mu}$ puzzle. We show that besides the model supports leptoquarks in the octet, sextet, triplet and singlet representations, we identified that only one specif leptoquark in the singlet representation leads to flip of chirality as required to generate positive and robust contribution to the $(g-2)_\mu$. Then we calculate its contributions to $(g-2)_\mu$ and to the decay process $\mu \rightarrow e \gamma$ and discuss the results.


title: An Interactive Human-Machine Learning Interface for Collecting and Learning from Complex Annotations

abstract: Human-Computer Interaction has been shown to lead to improvements in machine learning systems by boosting model performance, accelerating learning and building user confidence. In this work, we aim to alleviate the expectation that human annotators adapt to the constraints imposed by traditional labels by allowing for extra flexibility in the form that supervision information is collected. For this, we propose a human-machine learning interface for binary classification tasks which enables human annotators to utilise counterfactual examples to complement standard binary labels as annotations for a dataset. Finally we discuss the challenges in future extensions of this work.


title: Dataverse: Open-Source ETL (Extract, Transform, Load) Pipeline for Large Language Models

abstract: To address the challenges associated with data processing at scale, we propose Dataverse, a unified open-source Extract-Transform-Load (ETL) pipeline for large language models (LLMs) with a user-friendly design at its core. Easy addition of custom processors with block-based interface in Dataverse allows users to readily and efficiently use Dataverse to build their own ETL pipeline. We hope that Dataverse will serve as a vital tool for LLM development and open source the entire library to welcome community contribution. Additionally, we provide a concise, two-minute video demonstration of our system, illustrating its capabilities and implementation.


title: The Green's function of polyharmonic operators with diverging coefficients: Construction and sharp asymptotics

abstract: We show existence, uniqueness and positivity for the Green's function of the operator $(\Delta_g + \alpha)^k$ in a closed Riemannian manifold $(M,g)$, of dimension $n>2k$, $k\in \mathbb{N}$, $k\geq 1$, with Laplace-Beltrami operator $\Delta_g = -\operatorname{div}_g(\nabla \cdot)$, and where $\alpha >0$. We are interested in the case where $\alpha$ is large : We prove pointwise estimates with explicit dependence on $\alpha$ for the Green's function and its derivatives. We highlight a region of exponential decay for the Green's function away from the diagonal, for large $\alpha$.


title: An efficient multiscale multigrid preconditioner for Darcy flow in high-contrast media

abstract: In this paper, we develop a multigrid preconditioner to solve Darcy flow in highly heterogeneous porous media. The key component of the preconditioner is to construct a sequence of nested subspaces $W_{\mathcal{L}}\subset W_{\mathcal{L}-1}\subset\cdots\subset W_1=W_h$. An appropriate spectral problem is defined in the space of $W_{i-1}$, then the eigenfunctions of the spectral problems are utilized to form $W_i$. The preconditioner is applied to solve a positive semidefinite linear system which results from discretizing the Darcy flow equation with the lowest order Raviart-Thomas spaces and adopting a trapezoidal quadrature rule. Theoretical analysis and numerical investigations of this preconditioner will be presented. In particular, we will consider several typical highly heterogeneous permeability fields whose resolutions are up to $1024^3$ and examine the computational performance of the preconditioner in several aspects, such as strong scalability, weak scalability, and robustness against the contrast of the media. We also demonstrate an application of this preconditioner for solving a two-phase flow benchmark problem.


title: Running Coupling and Running Quark Mass Effects on the Elastic Form Factors of Nucleons

abstract: We study the elastic electric and magnetic form factors of the proton, neutron and the charged roper resonance ($G_E^p$, $G_M^p$, $G_E^n$, $G_M^n$, $G_E^R$ and $G_M^R$) systematically in a constituent quark model. Three ingredients are crucial in this study: i) the mixing between the pure S-wave and other components which produces a nonzero neutron electric form factor. ii) a running coupling constant that soften the form factors. iii) the running quark mass function, $M_q(p^2)$, which is responsible for the decreasing of the $\mu_p G_E^p(Q^2)/G_M^p(Q^2)$ as $Q^2$ increases. The produced elastic form factors of the proton and neutron match the corresponding observed values fairly well. Our study shows that $\mu_p G_E^p(Q^2)/G_M^p(Q^2) \approx M_q(Q^2/9)/M_q(0)$ upto $Q^2 \approx 4 \text{ GeV}^2$. We give predictions on the elastic form factors of the roper resonance, the electric charge and the magnetic momentum radius ratios of the roper resonance to the proton are $r^R_{E}/r^p_{E} \approx r^R_{M}/r^p_{M} \approx 1.5$.


title: Gain-Only Neural Operator Approximators of PDE Backstepping Controllers

abstract: For the recently introduced deep learning-powered approach to PDE backstepping control, we present an advancement applicable across all the results developed thus far: approximating the control gain function only (a function of one variable), rather than the entire kernel function of the backstepping transformation (a function of two variables). We introduce this idea on a couple benchmark (unstable) PDEs, hyperbolic and parabolic. We alter the approach of quantifying the effect of the approximation error by replacing a backstepping transformation that employs the approximated kernel (suitable for adaptive control) by a transformation that employs the exact kernel (suitable for gain scheduling). A major simplification in the target system arises, with the perturbation due to the approximation shifting from the domain to the boundary condition. This results in a significant difference in the Lyapunov analysis, which nevertheless results in a guarantee of the stability being retained with the simplified approximation approach. The approach of approximating only the control gain function simplifies the operator being approximated and the training of its neural approximation, with an expected reduction in the neural network size. The price for the savings in approximation is paid through a somewhat more intricate Lyapunov analysis, in higher Sobolev spaces for some PDEs, as well as some restrictions on initial conditions that result from higher Sobolev spaces. While the proposed approach appears inapplicable to uses in adaptive control, it is almost certainly applicable in gain scheduling applications of neural operator-approximated PDE backstepping controllers.


title: Intelligent Classification and Personalized Recommendation of E-commerce Products Based on Machine Learning

abstract: With the rapid evolution of the Internet and the exponential proliferation of information, users encounter information overload and the conundrum of choice. Personalized recommendation systems play a pivotal role in alleviating this burden by aiding users in filtering and selecting information tailored to their preferences and requirements. Such systems not only enhance user experience and satisfaction but also furnish opportunities for businesses and platforms to augment user engagement, sales, and advertising efficacy.This paper undertakes a comparative analysis between the operational mechanisms of traditional e-commerce commodity classification systems and personalized recommendation systems. It delineates the significance and application of personalized recommendation systems across e-commerce, content information, and media domains. Furthermore, it delves into the challenges confronting personalized recommendation systems in e-commerce, including data privacy, algorithmic bias, scalability, and the cold start problem. Strategies to address these challenges are elucidated.Subsequently, the paper outlines a personalized recommendation system leveraging the BERT model and nearest neighbor algorithm, specifically tailored to address the exigencies of the eBay e-commerce platform. The efficacy of this recommendation system is substantiated through manual evaluation, and a practical application operational guide and structured output recommendation results are furnished to ensure the system's operability and scalability.


title: Large Language Models Are Unconscious of Unreasonability in Math Problems

abstract: Large language models (LLMs) demonstrate substantial capabilities in solving math problems. However, they tend to produce hallucinations when given questions containing unreasonable errors. In this paper, we study the behavior of LLMs when faced with unreasonable math problems and further explore their potential to address these problems. We construct the Unreasonable Math Problem (UMP) benchmark to examine the error detection ability of LLMs. Experiments show that LLMs are able to detect unreasonable errors, but still fail in generating non-hallucinatory content. In order to improve their ability of error detection and correction, we further design a strategic prompt template called Critical Calculation and Conclusion(CCC). With CCC, LLMs can better self-evaluate and detect unreasonable errors in math questions, making them more reliable and safe in practical application scenarios.


title: Breaking the Length Barrier: LLM-Enhanced CTR Prediction in Long Textual User Behaviors

abstract: With the rise of large language models (LLMs), recent works have leveraged LLMs to improve the performance of click-through rate (CTR) prediction. However, we argue that a critical obstacle remains in deploying LLMs for practical use: the efficiency of LLMs when processing long textual user behaviors. As user sequences grow longer, the current efficiency of LLMs is inadequate for training on billions of users and items. To break through the efficiency barrier of LLMs, we propose Behavior Aggregated Hierarchical Encoding (BAHE) to enhance the efficiency of LLM-based CTR modeling. Specifically, BAHE proposes a novel hierarchical architecture that decouples the encoding of user behaviors from inter-behavior interactions. Firstly, to prevent computational redundancy from repeated encoding of identical user behaviors, BAHE employs the LLM's pre-trained shallow layers to extract embeddings of the most granular, atomic user behaviors from extensive user sequences and stores them in the offline database. Subsequently, the deeper, trainable layers of the LLM facilitate intricate inter-behavior interactions, thereby generating comprehensive user embeddings. This separation allows the learning of high-level user representations to be independent of low-level behavior encoding, significantly reducing computational complexity. Finally, these refined user embeddings, in conjunction with correspondingly processed item embeddings, are incorporated into the CTR model to compute the CTR scores. Extensive experimental results show that BAHE reduces training time and memory by five times for CTR models using LLMs, especially with longer user sequences. BAHE has been deployed in a real-world system, allowing for daily updates of 50 million CTR data on 8 A100 GPUs, making LLMs practical for industrial CTR prediction.