title: DPM-Solver-v3: Improved Diffusion ODE Solver with Empirical Model Statistics

abstract: Diffusion probabilistic models (DPMs) have exhibited excellent performance for high-fidelity image generation while suffering from inefficient sampling. Recent works accelerate the sampling procedure by proposing fast ODE solvers that leverage the specific ODE form of DPMs. However, they highly rely on specific parameterization during inference (such as noise/data prediction), which might not be the optimal choice. In this work, we propose a novel formulation towards the optimal parameterization during sampling that minimizes the first-order discretization error of the ODE solution. Based on such formulation, we propose DPM-Solver-v3, a new fast ODE solver for DPMs by introducing several coefficients efficiently computed on the pretrained model, which we call empirical model statistics. We further incorporate multistep methods and a predictor-corrector framework, and propose some techniques for improving sample quality at small numbers of function evaluations (NFE) or large guidance scales. Experiments show that DPM-Solver-v3 achieves consistently better or comparable performance in both unconditional and conditional sampling with both pixel-space and latent-space DPMs, especially in 5$\sim$10 NFEs. We achieve FIDs of 12.21 (5 NFE), 2.51 (10 NFE) on unconditional CIFAR10, and MSE of 0.55 (5 NFE, 7.5 guidance scale) on Stable Diffusion, bringing a speed-up of 15%$\sim$30% compared to previous state-of-the-art training-free methods. Code is available at https://github.com/thu-ml/DPM-Solver-v3.


title: An Exploratory Study on Simulated Annealing for Feature Selection in Learning-to-Rank

abstract: Learning-to-rank is an applied domain of supervised machine learning. As feature selection has been found to be effective for improving the accuracy of learning models in general, it is intriguing to investigate this process for learning-to-rank domain. In this study, we investigate the use of a popular meta-heuristic approach called simulated annealing for this task. Under the general framework of simulated annealing, we explore various neighborhood selection strategies and temperature cooling schemes. We further introduce a new hyper-parameter called the progress parameter that can effectively be used to traverse the search space. Our algorithms are evaluated on five publicly benchmark datasets of learning-to-rank. For a better validation, we also compare the simulated annealing-based feature selection algorithm with another effective meta-heuristic algorithm, namely local beam search. Extensive experimental results shows the efficacy of our proposed models.


title: Meta-learning of Physics-informed Neural Networks for Efficiently Solving Newly Given PDEs

abstract: We propose a neural network-based meta-learning method to efficiently solve partial differential equation (PDE) problems. The proposed method is designed to meta-learn how to solve a wide variety of PDE problems, and uses the knowledge for solving newly given PDE problems. We encode a PDE problem into a problem representation using neural networks, where governing equations are represented by coefficients of a polynomial function of partial derivatives, and boundary conditions are represented by a set of point-condition pairs. We use the problem representation as an input of a neural network for predicting solutions, which enables us to efficiently predict problem-specific solutions by the forwarding process of the neural network without updating model parameters. To train our model, we minimize the expected error when adapted to a PDE problem based on the physics-informed neural network framework, by which we can evaluate the error even when solutions are unknown. We demonstrate that our proposed method outperforms existing methods in predicting solutions of PDE problems.


title: X-Type Antiferromagnets

abstract: Magnetically ordered materials reveal various types of magnetic moment alignment that affects their functional properties. This makes the exploration of unconventional magnetic orderings promising for the discovery of new physical phenomena and spintronic applications. Here, we introduce cross-chain antiferromagnets, dubbed X-type antiferromagnets, as an uncharted class of magnetically ordered crystals, where the stacking of two magnetic sublattices form an orthogonal pattern of intersecting atomic chains. These largely unexplored X-type antiferromagnets reveal unique spin-dependent transport properties that are not present in conventional magnets. Using $\beta$-Fe2PO5 as a representative example of such X-type antiferromagnets, we predict the emergence of sublattice-selective spin-polarized transport, where one magnetic sublattice is conducting, while the other is not. As a result, spin torque can be exerted solely on a single sublattice, leading to unconventional ultrafast dynamics of the N\`eel vector capable of deterministic switching of the antiferromagnetic domains. Our work uncovers a previously overlooked type of magnetic moment alignment in antiferromagnets and reveals sublattice-selective physical properties promising for high-performance spintronic applications.


title: On generating mapping class groups by pseudo-Anosov elements

abstract: Wajnryb proved that the mapping class group of a closed oriented surface is generated by two elements. We proved that the mapping class group is generated by two pseudo-Anosov elements. In particular, if the genus is greater than or equal to nine, we can take the generators to two conjugate pseudo-Anosov elements with arbitrarily large dilatations. Another result we prove is that the mapping class group is generated by two conjugate reducible but not periodic elements if the genus is greater than or equal to eight. We also give similar results to the first and third results for the hyperelliptic mapping class group when the genus is greater than or equal to one.


title: Dynamic Object Detection in Range data using Spatiotemporal Normals

abstract: On the journey to enable robots to interact with the real world where humans, animals, and unpredictable elements are acting as independent agents; it is crucial for robots to have the capability to detect dynamic objects. In this paper, we argue that the detection of dynamic objects can be solved by computing the spatiotemporal normals of a point cloud. In our experiments, we demonstrate that this simple method can be used robustly for LiDAR and depth cameras with performances similar to the state of the art while offering a significantly simpler method.


title: Investigation of black hole complementarity in AdS$_2$ black holes

abstract: Black hole complementarity plays a pivotal role in resolving the information loss paradox by treating Hawking radiation as carriers of information, apart from the complicated mechanisms involved in decoding information from this radiation. The thought experiment proposed by Susskind and Thorlacius, as well as the criteria set forth by Hayden and Preskill, provide deep insights into the intricate relationship of black hole complementarity between fiducial and infalling observers. We execute the Alice-Bob thought experiment in the context of two-dimensional anti-de Sitter black holes. It turns out that information cloning can be avoided in the case of a large black hole. According to the Hayden-Preskill criteria, the scale parameter associated with the explicit breaking of the one-dimensional group of reparametrizations must significantly exceed the squared mass of the black hole to effectively prevent information cloning.


title: Efficient Active Deep Decoding of Linear Codes using Importance Sampling

abstract: The quality and quantity of data used for training greatly influence the performance and effectiveness of deep learning models. In the context of error correction, it is essential to generate high-quality samples that are neither excessively noisy nor entirely correct but close to the decoding region's decision boundary. To accomplish this objective, this paper utilizes a restricted version of a recent result on Importance Sampling (IS) distribution for fast performance evaluation of linear codes. The IS distribution is used over the segmented observation space and integrated with active learning. This combination allows for the iterative generation of samples from the shells whose acquisition functions, defined as the error probabilities conditioned on each shell, fall within a specific range. By intelligently sampling based on the proposed IS distribution, significant improvements are demonstrated in the performance of BCH(63,36) and BCH(63,45) codes with cycle-reduced parity-check matrices. The proposed IS-based-active Weight Belief Propagation (WBP) decoder shows improvements of up to 0.4dB in the waterfall region and up to 1.9dB in the error-floor region of the BER curve, over the conventional WBP. This approach can be easily adapted to generate efficient samples to train any other deep learning-based decoder.


title: InvGC: Robust Cross-Modal Retrieval by Inverse Graph Convolution

abstract: Over recent decades, significant advancements in cross-modal retrieval are mainly driven by breakthroughs in visual and linguistic modeling. However, a recent study shows that multi-modal data representations tend to cluster within a limited convex cone (as representation degeneration problem), which hinders retrieval performance due to the inseparability of these representations. In our study, we first empirically validate the presence of the representation degeneration problem across multiple cross-modal benchmarks and methods. Next, to address it, we introduce a novel method, called InvGC, a post-processing technique inspired by graph convolution and average pooling. Specifically, InvGC defines the graph topology within the datasets and then applies graph convolution in a subtractive manner. This method effectively separates representations by increasing the distances between data points. To improve the efficiency and effectiveness of InvGC, we propose an advanced graph topology, LocalAdj, which only aims to increase the distances between each data point and its nearest neighbors. To understand why InvGC works, we present a detailed theoretical analysis, proving that the lower bound of recall will be improved after deploying InvGC. Extensive empirical results show that InvGC and InvGC w/LocalAdj significantly mitigate the representation degeneration problem, thereby enhancing retrieval performance. Our code is available at https://github.com/yimuwangcs/Better_Cross_Modal_Retrieval


title: Covering the hypercube, the uncertainty principle, and an interpolation formula

abstract: We show that the minimal number of skewed hyperplanes that cover the hypercube $\{0,1\}^{n}$ is at least $\frac{n}{2}+1$, and there are infinitely many $n$'s when the hypercube can be covered with $n-\log_{2}(n)+1$ skewed hyperplanes. The minimal covering problems are closely related to uncertainty principle on the hypercube, where we also obtain an interpolation formula for multilinear polynomials on $\mathbb{R}^{n}$ of degree less than $\lfloor n/m \rfloor$ by showing that its coefficients corresponding to the largest monomials can be represented as a linear combination of values of the polynomial over the points $\{0,1\}^{n}$ whose hamming weights are divisible by $m$.


title: MaNGA DynPop -- VI. Matter density slopes from dynamical models of 6000 galaxies versus cosmological simulations: the interplay between baryonic and dark matter

abstract: We try to understand the trends in the mass density slopes as a function of galaxy properties. We use the results from the best Jeans Anisotropic Modelling (JAM) of the integral-field stellar kinematics for near 6000 galaxies from the MaNGA DynPop project, with stellar masses of $10^{9-12}\ {\rm M_{\odot}}$, including both early-type and late-type galaxies. We use the mass-weighted density slopes for the stellar $\overline{\gamma}_*$, dark $\overline{\gamma}_{\rm DM}$, and total $\overline{\gamma}_{\rm T}$ mass from the MaNGA DynPop project. The $\overline{\gamma}_{\rm T}$ approaches a constant value of 2.2 for high $\sigma_{\rm e}$ galaxies, and flattens for lg$(\sigma_{\rm e}/{\rm km\ s^{-1}})\lesssim2.3$, reaching 1.5 for lg$(\sigma_{\rm e}/{\rm km\ s^{-1}})\approx1.8$. The total and stellar slopes track each other tightly, with $\overline{\gamma}_{\rm T}\approx\overline{\gamma}_*-0.174$ over the full $\sigma_{\rm e}$ range. This confirms the dominance of stellar matter within $R_{\rm e}$. We also show that there is no perfect conspiracy between baryonic and dark matter, as $\overline{\gamma}_*$ and $\overline{\gamma}_{\rm DM}$ do not vary inversely within the $\sigma_{\rm e}$ range. We find that the central galaxies from TNG50 and TNG100 simulations do not reproduce the observed galaxy mass distribution, which we attribute to the overestimated dark matter fraction, possibly due to a constant IMF and excessive adiabatic contraction effects in the simulations. Finally, we present the stacked dark matter density profiles and show that they are slightly steeper than the pure dark matter simulation prediction of $\overline{\gamma}_{\rm DM}\approx1$, suggesting moderate adiabatic contraction in the central region of galaxies. Our work demonstrate the power of stellar dynamics modelling for probing the interaction between stellar and dark matter and testing galaxy formation theories.


title: Pathologist-Like Explanations Unveiled: an Explainable Deep Learning System for White Blood Cell Classification

abstract: White blood cells (WBCs) play a crucial role in safeguarding the human body against pathogens and foreign substances. Leveraging the abundance of WBC imaging data and the power of deep learning algorithms, automated WBC analysis has the potential for remarkable accuracy. However, the capability of deep learning models to explain their WBC classification remains largely unexplored. In this study, we introduce HemaX, an explainable deep neural network-based model that produces pathologist-like explanations using five attributes: granularity, cytoplasm color, nucleus shape, size relative to red blood cells, and nucleus to cytoplasm ratio (N:C), along with cell classification, localization, and segmentation. HemaX is trained and evaluated on a novel dataset, LeukoX, comprising 467 blood smear images encompassing ten (10) WBC types. The proposed model achieves impressive results, with an average classification accuracy of 81.08% and a Jaccard index of 89.16% for cell localization. Additionally, HemaX performs well in generating the five explanations with a normalized mean square error of 0.0317 for N:C ratio and over 80% accuracy for the other four attributes. Comprehensive experiments comparing against multiple state-of-the-art models demonstrate that HemaX's classification accuracy remains unaffected by its ability to provide explanations. Moreover, empirical analyses and validation by expert hematologists confirm the faithfulness of explanations predicted by our proposed model.


title: Collective Enhancement of Nuclear Level Density and its fade-out in $^{161}$Dy

abstract: The nuclear level density is a fundamental quantity in nuclear physics, governing various nuclear reactions and astrophysical processes. In this study, we report on the collective enhancement of nuclear level density and its fade-out with excitation energy in the deformed $^{161}$Dy, obtained through an exclusive measurement of neutron evaporation spectra. The $^{162}$Dy nucleus was populated via the transfer of a triton in a $^{7}$Li-induced reaction on $^{159}$Tb. Statistical model analysis of the neutron spectra revealed a large collective enhancement factor of 42$\pm$2, consistent with microscopic calculations. This enhancement factor is similar to the one obtained for mass A$\sim$170 in our previous measurement. The energy-dependent collective enhancement over a wide range of excitation energies was inferred by combining the present results with the available Oslo level density below the neutron binding energy.


title: Weil-Petersson volumes, stability conditions and wall-crossing

abstract: In this paper we study Weil-Petersson volumes of the moduli spaces of conical hyperbolic surfaces. The moduli spaces are parametrised by their cone angles which naturally live inside Hassett's space of stability conditions on nodal curves. Such stability conditions produce weighted pointed stable curves which define compactifications of the moduli space of curves generalising the Deligne-Mumford compactification. The space of stability conditions decompose into chambers separated by walls. We assign to each chamber a polynomial corresponding to the Weil-Petersson volume of a moduli space of conical hyperbolic surfaces. The chambers are naturally partially ordered and the maximal chamber is assigned Mirzakhani's polynomial. We calculate wall-crossing polynomials, which relates the polynomial on any chamber to Mirzakhani's polynomial via wall-crossings, and we show how to apply this in particular cases. Since the polynomials are volumes, they have nice properties such as positivity, continuity across walls, and vanishing in certain limits.


title: Characterization of Broadband Purcell Filters with Compact Footprint for Fast Multiplexed Superconducting Qubit Readout

abstract: Engineering the admittance of external environments connected to superconducting qubits is essential, as increasing the measurement speed introduces spontaneous emission loss to superconducting qubits, known as Purcell loss. Here, we report a broad bandwidth Purcell filter design within a small footprint, which effectively suppresses Purcell loss without losing the fast measurement speed. We characterize the filter's frequency response at 4.3 K and also estimate Purcell loss suppression by finite-element-method simulations of superconducting planar circuit layouts with the proposed filter design. The measured bandwidth is over 790 MHz within 0.29 mm$^2$ while the estimated lifetime enhancement can be over 5000 times with multiple Purcell filters. The presented filter design is expected to be easily integrated on existing superconducting quantum circuits for fast and multiplexed readout without occupying large footprint.


title: pFedLoRA: Model-Heterogeneous Personalized Federated Learning with LoRA Tuning

abstract: Federated learning (FL) is an emerging machine learning paradigm in which a central server coordinates multiple participants (clients) collaboratively to train on decentralized data. In practice, FL often faces statistical, system, and model heterogeneities, which inspires the field of Model-Heterogeneous Personalized Federated Learning (MHPFL). With the increased interest in adopting large language models (LLMs) in FL, the existing MHPFL methods cannot achieve acceptable computational and communication costs, while maintaining satisfactory model performance. To bridge this gap, we propose a novel and efficient model-heterogeneous personalized Federated learning framework based on LoRA tuning (pFedLoRA). Inspired by the popular LoRA method for fine-tuning pre-trained LLMs with a low-rank model (a.k.a., an adapter), we design a homogeneous small adapter to facilitate federated client's heterogeneous local model training with our proposed iterative training for global-local knowledge exchange. The homogeneous small local adapters are aggregated on the FL server to generate a global adapter. We theoretically prove the convergence of pFedLoRA. Extensive experiments on two benchmark datasets demonstrate that pFedLoRA outperforms six state-of-the-art baselines, beating the best method by 1.35% in test accuracy, 11.81 times computation overhead reduction and 7.41 times communication cost saving.


title: Learning Recurrent Models with Temporally Local Rules

abstract: Fitting generative models to sequential data typically involves two recursive computations through time, one forward and one backward. The latter could be a computation of the loss gradient (as in backpropagation through time), or an inference algorithm (as in the RTS/Kalman smoother). The backward pass in particular is computationally expensive (since it is inherently serial and cannot exploit GPUs), and difficult to map onto biological processes. Work-arounds have been proposed; here we explore a very different one: requiring the generative model to learn the joint distribution over current and previous states, rather than merely the transition probabilities. We show on toy datasets that different architectures employing this principle can learn aspects of the data typically requiring the backward pass.


title: Positive mass theorem for asymptotically flat spin manifolds with isolated conical singularities

abstract: There has been a lot of interests in Positive Mass Theorems for singular metrics on smooth manifolds. We prove a positive mass theorem for asymptotically flat (AF) spin manifolds with isolated conical singularities or more generally horn singularities. In particular, we allow topological singularities in the space as we do not require the cross sections of the conical singularity to be spherical. Note that the negative mass Schwarzschild metric is AF with a horn singularity.


abstract: Although pretraining has garnered significant attention and popularity in recent years, its application in graph-based recommender systems is relatively limited. It is challenging to exploit prior knowledge by pretraining in widely used ID-dependent datasets. On one hand, user-item interaction history in one dataset can hardly be transferred to other datasets through pretraining, where IDs are different. On the other hand, pretraining and finetuning on the same dataset leads to a high risk of overfitting. In this paper, we propose a novel multitask pretraining framework named Unified Pretraining for Recommendation via Task Hypergraphs. For a unified learning pattern to handle diverse requirements and nuances of various pretext tasks, we design task hypergraphs to generalize pretext tasks to hyperedge prediction. A novel transitional attention layer is devised to discriminatively learn the relevance between each pretext task and recommendation. Experimental results on three benchmark datasets verify the superiority of UPRTH. Additional detailed investigations are conducted to demonstrate the effectiveness of the proposed framework.


title: Space-confined solid-phase growth of two-domain 1T'-ReSe2 for tunable optoelectronics

abstract: Two-dimensional layered ReX2 (X = Se, S) has attracted researcher's great interest due to its unusual in-plane anisotropic optical and electrical properties and great potential in polarization-sensitive optoelectronic devices, while the clean, energy-saving, and ecological synthesis of highly-crystalline ReSe2 with controlled domains remains challenging yet promising. Here, we develop a novel space-confined solid-phase approach for the growth of high-quality two-domain 1T'-ReSe2 with tunable optoelectronic properties by using pure Re powder film as Re precursor. The results show that ReSe2 can be grown at a temperature as low as 550 oC in a small-tube-assisted space-confined reactor, with its size and shape well-tailored via temperature control. A solid-phase two-domain ReSe2 growth mechanism is proposed, as evidenced by combining in-situ optical monitoring, ex-situ electron microscope and elemental mapping, and polarized optical imaging. Moreover, we have fabricated two-domain ReSe2 transistors, which exhibit switchable transport behavior between n-type and ambipolar character via grain boundary orientation control. This modulation phenomenon is attributed to the different doping levels between the grain boundary and the single domain. Furthermore, the as-fabricated two-domain ReSe2 photodetectors exhibit a highly gate-tunable current on-off ratio (with a maximum value of ~8.2x10^3), a polarization-sensitive photo-response, and a high-speed response time (~300 us), exceeding most of the previously reported ReX2 photodetectors. Our work thus provides a new, low-consumption, energy-saving growth strategy toward high-quality, domain-controlled ReX2 for highly tunable and high-performance optoelectronics.


title: Simulation of high-speed impact of surfactant-laden drops

abstract: We develop a computational model to simulate the immediate post-impact spreading behaviour of surfactant-laden drops that impact a flat and solid surface. The model is built on the InterFoam solver (OpenFOAM software), which uses the volume-of-fluid method to solve the Navier-Stokes equations. In order to incorporate surfactant in the bulk and on the interface, we make numerous modifications and extensions, such as coupling the volume-of-fluid method with a level-set method. Simulations demonstrate the accumulation of surfactant in the vicinity of the moving contact line, especially during the formation of the rim. Gradients of surfactant at the liquid-air interface lead to Marangoni forces that oppose the drop spreading, while high-velocity impacts reduce the overall surface tension and increase the magnitude of Marangoni forces. Both of these phenomena, which tend to reduce the maximum spreading, are highly dependent on the surfactant properties. Our computational methodology expands the potential for utilising Computational Fluid Dynamics to model complex interfacial flows that involve surfactants, leading to various opportunities in the future.


title: SALMONN: Towards Generic Hearing Abilities for Large Language Models

abstract: Hearing is arguably an essential ability of artificial intelligence (AI) agents in the physical world, which refers to the perception and understanding of general auditory information consisting of at least three types of sounds: speech, audio events, and music. In this paper, we propose SALMONN, a speech audio language music open neural network, built by integrating a pre-trained text-based large language model (LLM) with speech and audio encoders into a single multimodal model. SALMONN enables the LLM to directly process and understand general audio inputs and achieve competitive performances on a number of speech and audio tasks used in training, such as automatic speech recognition and translation, auditory-information-based question answering, emotion recognition, speaker verification, and music and audio captioning etc. SALMONN also has a diverse set of emergent abilities unseen in the training, which includes but is not limited to speech translation to untrained languages, speech-based slot filling, spoken-query-based question answering, audio-based storytelling, and speech audio co-reasoning etc. The presence of cross-modal emergent abilities is studied, and a novel few-shot activation tuning approach is proposed to activate such abilities. To our knowledge, SALMONN is the first model of its type and can be regarded as a step towards AI with generic hearing abilities. The source code, model checkpoints and data are available at https://github.com/bytedance/SALMONN.


title: Interpreting Indirect Answers to Yes-No Questions in Multiple Languages

abstract: Yes-no questions expect a yes or no for an answer, but people often skip polar keywords. Instead, they answer with long explanations that must be interpreted. In this paper, we focus on this challenging problem and release new benchmarks in eight languages. We present a distant supervision approach to collect training data. We also demonstrate that direct answers (i.e., with polar keywords) are useful to train models to interpret indirect answers (i.e., without polar keywords). Experimental results demonstrate that monolingual fine-tuning is beneficial if training data can be obtained via distant supervision for the language of interest (5 languages). Additionally, we show that cross-lingual fine-tuning is always beneficial (8 languages).


title: Assessing Privacy Risks in Language Models: A Case Study on Summarization Tasks

abstract: Large language models have revolutionized the field of NLP by achieving state-of-the-art performance on various tasks. However, there is a concern that these models may disclose information in the training data. In this study, we focus on the summarization task and investigate the membership inference (MI) attack: given a sample and black-box access to a model's API, it is possible to determine if the sample was part of the training data. We exploit text similarity and the model's resistance to document modifications as potential MI signals and evaluate their effectiveness on widely used datasets. Our results demonstrate that summarization models are at risk of exposing data membership, even in cases where the reference summary is not available. Furthermore, we discuss several safeguards for training summarization models to protect against MI attacks and discuss the inherent trade-off between privacy and utility.


title: CXR-CLIP: Toward Large Scale Chest X-ray Language-Image Pre-training

abstract: A large-scale image-text pair dataset has greatly contributed to the development of vision-language pre-training (VLP) models, which enable zero-shot or few-shot classification without costly annotation. However, in the medical domain, the scarcity of data remains a significant challenge for developing a powerful VLP model. In this paper, we tackle the lack of image-text data in chest X-ray by expanding image-label pair as image-text pair via general prompt and utilizing multiple images and multiple sections in a radiologic report. We also design two contrastive losses, named ICL and TCL, for learning study-level characteristics of medical images and reports, respectively. Our model outperforms the state-of-the-art models trained under the same conditions. Also, enlarged dataset improve the discriminative power of our pre-trained model for classification, while sacrificing marginal retrieval performance. Code is available at https://github.com/kakaobrain/cxr-clip.


title: Systematic study of rotational decoherence with a trapped-ion planar rotor

abstract: Quantum rotors promise unique advantages for quantum sensing, quantum simulation, and quantum information processing. At present, a variety of systems ranging from nanoparticles to single molecules and trapped ions have demonstrated detection and control of rotational motion in and near the quantum regime. For future applications of quantum rotors, understanding their dynamics in the presence of ambient environments and decoherence will be critical. While other model quantum systems such as the harmonic oscillator have seen extensive experimental study of their decoherence dynamics, such experiments remain an open task for the rigid rotor. We present measurements of fundamental scaling relationships for decoherence of a quantum planar rotor realized with two trapped ions, and find excellent agreement with recent theoretical work.


title: VR PreM+ : An Immersive Pre-learning Branching Visualization System for Museum Tours

abstract: We present VR PreM+, an innovative VR system designed to enhance web exploration beyond traditional computer screens. Unlike static 2D displays, VR PreM+ leverages 3D environments to create an immersive pre-learning experience. Using keyword-based information retrieval allows users to manage and connect various content sources in a dynamic 3D space, improving communication and data comparison. We conducted preliminary and user studies that demonstrated efficient information retrieval, increased user engagement, and a greater sense of presence. These findings yielded three design guidelines for future VR information systems: display, interaction, and user-centric design. VR PreM+ bridges the gap between traditional web browsing and immersive VR, offering an interactive and comprehensive approach to information acquisition. It holds promise for research, education, and beyond.


title: PathRL: An End-to-End Path Generation Method for Collision Avoidance via Deep Reinforcement Learning

abstract: Robot navigation using deep reinforcement learning (DRL) has shown great potential in improving the performance of mobile robots. Nevertheless, most existing DRL-based navigation methods primarily focus on training a policy that directly commands the robot with low-level controls, like linear and angular velocities, which leads to unstable speeds and unsmooth trajectories of the robot during the long-term execution. An alternative method is to train a DRL policy that outputs the navigation path directly. However, two roadblocks arise for training a DRL policy that outputs paths: (1) The action space for potential paths often involves higher dimensions comparing to low-level commands, which increases the difficulties of training; (2) It takes multiple time steps to track a path instead of a single time step, which requires the path to predicate the interactions of the robot w.r.t. the dynamic environment in multiple time steps. This, in turn, amplifies the challenges associated with training. In response to these challenges, we propose PathRL, a novel DRL method that trains the policy to generate the navigation path for the robot. Specifically, we employ specific action space discretization techniques and tailored state space representation methods to address the associated challenges. In our experiments, PathRL achieves better success rates and reduces angular rotation variability compared to other DRL navigation methods, facilitating stable and smooth robot movement. We demonstrate the competitive edge of PathRL in both real-world scenarios and multiple challenging simulation environments.


title: Trotterization in Quantum Theory

abstract: Trotterization in quantum mechanics is an important theoretical concept in handling the exponential of noncommutative operators. In this communication, we give a mathematical formulation of the Trotter Product Formula, and apply it to basic examples in which the utility of Trotterization is evident. Originally, this article was completed in December 2020 as a report under the mentorship of Esteban C\'ardenas for the University of Texas at Austin Mathematics Directed Reading Program (DRP). However, the relevance of Trotterization in reducing quantum circuit complexity has warranted the release of a revised and more formal version of the original. Thus, we present a mathematical perspective on Trotterization, including a detailed sketch of a formal proof of the Trotter Product Formula.


title: Decoding the Silent Majority: Inducing Belief Augmented Social Graph with Large Language Model for Response Forecasting

abstract: Automatic response forecasting for news media plays a crucial role in enabling content producers to efficiently predict the impact of news releases and prevent unexpected negative outcomes such as social conflict and moral injury. To effectively forecast responses, it is essential to develop measures that leverage the social dynamics and contextual information surrounding individuals, especially in cases where explicit profiles or historical actions of the users are limited (referred to as lurkers). As shown in a previous study, 97% of all tweets are produced by only the most active 25% of users. However, existing approaches have limited exploration of how to best process and utilize these important features. To address this gap, we propose a novel framework, named SocialSense, that leverages a large language model to induce a belief-centered graph on top of an existent social network, along with graph-based propagation to capture social dynamics. We hypothesize that the induced graph that bridges the gap between distant users who share similar beliefs allows the model to effectively capture the response patterns. Our method surpasses existing state-of-the-art in experimental evaluations for both zero-shot and supervised settings, demonstrating its effectiveness in response forecasting. Moreover, the analysis reveals the framework's capability to effectively handle unseen user and lurker scenarios, further highlighting its robustness and practical applicability.


title: Cache-Aided Communications in MISO Networks with Dynamic User Behavior

abstract: Coded caching (CC) can substantially enhance network performance by leveraging memory as an additional communication resource. However, the use of CC is challenging in various practical applications due to dynamic user behavior. The existing solutions, based on shared caching, cannot directly handle all scenarios where users freely enter and depart the network at any time as they are constrained by specific conditions on network parameters. This paper proposes a universally applicable shared-caching scheme for dynamic setups without any restriction on network parameters. The closed-form expressions for the achievable degrees of freedom (DoF) are computed for the resulting generalized scheme, and are shown to achieve the existing optimal bounds of the shared-cache model. Furthermore, a successive-interference-cancellation-free extension based on a fast iterative optimized beamformer design is devised to optimize the use of excess spatial dimensions freed by cache-aided interference cancellation. Extensive numerical experiments are carried out to assess the performance of the proposed scheme. In particular, the results demonstrate that while a dynamic setup may achieve a DoF substantially lower than the optimal DoF of shared caching, our proposed scheme significantly improves the performance at the finite signal-to-noise ratio compared to unicasting, which only benefits from the local caching gain.


title: Spacetime-Localized Response in Quantum Critical Spin Systems: Insights from Holography

abstract: According to the AdS/CFT correspondence, certain quantum many-body systems in $d$-dimensions are equivalent to gravitational theories in $(d+1)$-dimensional asymptotically AdS spacetimes. When a massless particle is sent from the AdS boundary to the bulk curved spacetime, it reaches another point of the boundary after a time lag. In the dual quantum system, it should appear as if quasiparticles have been transferred between two separated points. We theoretically demonstrate that this phenomenon, which we call "spacetime-localized response," is actually observed in the dynamics of the one-dimensional transverse-field Ising model near the quantum critical point. This result suggests that, if we can realize a holographic spin system in a laboratory, the experimental probing of the emergent extra-dimension is possible by applying a designed stimulus to a quantum many-body system, which is holographically equivalent to sending a massless particle through the higher-dimensional curved bulk geometry. We also discuss possible experimental realizations using Rydberg atoms in an optical tweezers array.

categories: hep-th cond-mat.quant-gas cond-mat.str-el gr-qc


title: Impact of Loss-Framing and Risk Attitudes on Insurance Purchase: Insights from a Game-like Interface Study

abstract: This study investigates the impact of loss-framing and individual risk attitude on willingness- to purchase insurance products utilizing a game-like interface as choice architecture. The application presents events as experienced in real life. Both financial and emotional loss-framing events are followed by choices to purchase insurance. The participant cohorts considered were undergraduate students and older participants; the latter group was further subdivided by income and education. The within-subject analysis reveals that the loss framing effect on insurance consumption is higher in the younger population, though contingent on the insurance product type. Health and accident insurance shows a negative correlation with risk attitudes for younger participants and a positive correlation with accident insurance for older participants. Risk attitude and life insurance products showed no dependency. The findings elucidate the role of age, income, family responsibilities, and risk attitude in purchasing insurance products. Importantly, it confirms the heuristics of framing/nudging.


title: Multiferroic kinks and spin-flop transition in Ni$_{2}$InSbO$_6$ from first principles

abstract: Magnetoelectric multiferroics are key materials for next-generation spintronic devices due to their entangled magnetic and ferroelectric properties. Spiral multiferroics possess ferroelectric polarization and are particularly promising for electric control of magnetism and magnetic control of ferroelectricity. In this work, we uncover long-period incommensurate states characterized by unique multiferroic kinks in corundum nickelate Ni$_{2}$InSbO$_6$, a member of a promising family of polar magnets. Utilizing a 2-orbital $S=1$ model, we derive formulas for Heisenberg and anisotropic magnetic exchanges and magnetically-induced polarization, enabling their calculations from first principles. We use these parameters in Monte Carlo and Landau theory-based calculations to reproduce experimentally observed magnetic structures and polarization dependence on the magnetic field. We predict magnetic phase transitions between flat spiral, conical spiral, canted antiferromagnetic and ferromagnetic states under increasing magnetic fields. Kinks in the spiral phases repel each other through a Yukawa-like potential arising from exchange of massive magnons. We also find that suitably directed electric fields can be used to stabilize the ferromagnetic and spiral states. The findings open a new pathway to predictive first-principles modelling of multiferroics and will inspire experiments and technological applications based on multiferroic kinks.


title: Towards the MICADO@ELT PSF-R with simulated and real data

abstract: Observations close to the diffraction limit, with high Strehl ratios from Adaptive Optics (AO)-assisted instruments mounted on ground-based telescopes are a reality and will become even more widespread with the next generation instruments that equip 30 meter-class telescopes. This results in a growing interest in tools and methods to accurately reconstruct the observed Point Spread Function (PSF) of AO systems. We will discuss the performance of the PSF reconstruction (PSF-R) software developed in the context of the MICADO instrument of the Extremely Large Telescope. In particular, we have recently implemented a novel algorithm for reconstructing off-axis PSFs. In every case, the PSF is reconstructed from AO telemetry, without making use of science exposures. We will present the results coming from end-to-end simulations and real AO observations, covering a wide range of observing conditions. Specifically, the spatial variation of the PSF has been studied with different AO-reference star magnitudes. The reconstructed PSFs are observed to match the reference ones with a relative error in Strehl ratio and full-width at half maximum below 10% over a field of view of the order of one arcmin, making the proposed PSF-R method an appealing tool to assist observation analysis, and interpretation.


title: Motif-Based Prompt Learning for Universal Cross-Domain Recommendation

abstract: Cross-Domain Recommendation (CDR) stands as a pivotal technology addressing issues of data sparsity and cold start by transferring general knowledge from the source to the target domain. However, existing CDR models suffer limitations in adaptability across various scenarios due to their inherent complexity. To tackle this challenge, recent advancements introduce universal CDR models that leverage shared embeddings to capture general knowledge across domains and transfer it through "Multi-task Learning" or "Pre-train, Fine-tune" paradigms. However, these models often overlook the broader structural topology that spans domains and fail to align training objectives, potentially leading to negative transfer. To address these issues, we propose a motif-based prompt learning framework, MOP, which introduces motif-based shared embeddings to encapsulate generalized domain knowledge, catering to both intra-domain and inter-domain CDR tasks. Specifically, we devise three typical motifs: butterfly, triangle, and random walk, and encode them through a Motif-based Encoder to obtain motif-based shared embeddings. Moreover, we train MOP under the "Pre-training \& Prompt Tuning" paradigm. By unifying pre-training and recommendation tasks as a common motif-based similarity learning task and integrating adaptable prompt parameters to guide the model in downstream recommendation tasks, MOP excels in transferring domain knowledge effectively. Experimental results on four distinct CDR tasks demonstrate the effectiveness of MOP than the state-of-the-art models.


title: "Living Within Four Walls": Exploring Emotional and Social Dynamics in Mobile Usage During Home Confinement

abstract: Home confinement, a situation experienced by individuals for reasons ranging from medical quarantines, rehabilitation needs, disability accommodations, and remote working, is a common yet impactful aspect of modern life. While essential in various scenarios, confinement within the home environment can profoundly influence psychological well-being and digital device usage. In this study, we delve into these effects, utilising the COVID-19 lockdown as a special case study to draw insights extending to various homebound situations. We conducted an in-situ study with 32 participants living in states affected by COVID-19 lockdowns for three weeks and analysed their emotions, well-being, social roles, and mobile usage behaviours. We extracted user activity from app usage records in an unsupervised manner, and experimental results revealed that app usage behaviours are effective indicators of emotional well-being in confined environments. Our research has great potential for developing supportive strategies and remote programs, not only for people facing similar medical isolation situations, but also for individuals in long-term home confinement, such as those with chronic illnesses, recovering from surgery, or adapting to permanent remote work arrangements.


title: Influence of ferroelastic domain walls on thermal conductivity

abstract: Enabling on-demand control of heat flow is key for the development of next-generation electronic devices, solid-state heat pumps, and thermal logic. However, precise and agile tuning of the relevant microscopic material parameters for adjusting thermal conductivities remains elusive. Here, we study several single crystals of lanthanum aluminate (LaAlO$_{3}$) with different domain structures and show that ferroelastic domain walls behave as boundaries that act like efficient controllers to govern thermal conductivity. At low temperature (3 K), we demonstrate a fivefold reduction in thermal conductivity induced by domain walls orthogonal to the heat flow and a twofold reduction when they are parallel to the heat flow. Atomistic calculations fully support this experimental observation. By breaking down phonon scattering mechanisms, we also analyze the temperature dependence of the thermal conductivity to derive a quantitative relation between thermal conductivity variations and domain wall organization and density.


title: Electronic Structure Modulation from Configuring Anatase TiO2 into a Bicontinuous Mesostructure

abstract: Configuring TiO2 into bicontinuous mesostructures greatly improves its photocatalytic efficiency. This is often ascribed to the expanded surface area. Yet, whether mesostructuring modulates TiO2's electronic structure and how that contributes to the improvement are rarely discussed. Here, we employed spectroscopic and density functional theory approaches to address the question. It is found that the improved efficacy could arise from an expansion in surface area and elevation in density of states, both of which might collectively lead to the observed reduction in charge-carrier recombination.


title: Test-Time Self-Adaptive Small Language Models for Question Answering

abstract: Recent instruction-finetuned large language models (LMs) have achieved notable performances in various tasks, such as question-answering (QA). However, despite their ability to memorize a vast amount of general knowledge across diverse tasks, they might be suboptimal on specific tasks due to their limited capacity to transfer and adapt knowledge to target tasks. Moreover, further finetuning LMs with labeled datasets is often infeasible due to their absence, but it is also questionable if we can transfer smaller LMs having limited knowledge only with unlabeled test data. In this work, we show and investigate the capabilities of smaller self-adaptive LMs, only with unlabeled test data. In particular, we first stochastically generate multiple answers, and then ensemble them while filtering out low-quality samples to mitigate noise from inaccurate labels. Our proposed self-adaption strategy demonstrates significant performance improvements on benchmark QA datasets with higher robustness across diverse prompts, enabling LMs to stay stable. Code is available at: https://github.com/starsuzi/T-SAS.


title: A model for time-evolution of coupling constants

abstract: A general model is proposed for time-varying coupling constants in field theory, assuming the ultraviolet cutoff is a varying entity in the expanding universe. It is assumed that the cutoff depends on the scale factor of the universe and all bare couplings remain constant. This leads to varying renormalized coupling constants that evolve in proportion to the Hubble parameter. The evolution of the standard model constants is discussed.


title: Enumerating regular languages in radix order : Revisiting the Ackerman-Shallit algorithm

abstract: We consider the problem of enumerating a regular language $L$ in radix order, or more precisely, the equivalent problem of enumerating all words in $L$ of a given length in lexicographic order. Ackerman and Shallit gave in 2009 the principles of an efficient solution to this problem, but they did not use the enumeration complexity framework for their analysis. We adapt their work into an explicit algorithm that fits this framework.


title: Polarizability Models for Simulations of Finite Temperature Raman Spectra from Machine Learning Molecular Dynamics

abstract: Raman spectroscopy is a powerful and nondestructive method that is widely used to study the vibrational properties of solids or molecules. Simulations of finite-temperature Raman spectra rely on obtaining polarizabilities along molecular dynamics trajectories, which is computationally highly demanding if calculated from first principles. Machine learning force fields (MLFF) are becoming widely used for accelerating molecular dynamics simulations, but machine-learning models for polarizability are still rare. In this work, we present and compare three polarizability models for obtaining Raman spectra in conjunction with MLFF molecular dynamics trajectories: (i) model based on projection to primitive cell eigenmodes, (ii) bond polarizability model, and (iii) symmetry-adapted Gaussian process regression (SA-GPR) using smooth overlap of atomic positions. In particular, we investigate the accuracy of these models for different systems and how much training data is required. Models are first applied to boron arsenide, where the first- and second-order Raman spectra are studied as well as the effect of boron isotopes. With MoS$_2$ we study the applicability of the models for highly anisotropic systems and for simulating resonant Raman spectra. Finally, inorganic halide perovskites CsPbBr$_3$ and CsSnBr$_3$ are studied with a particular interest in simulating the spectra across phase transitions and the evolution of the central peak. All models can be used to efficiently predict polarizabilities and are applicable to large systems and long simulation times, and while all three models were found to perform similarly for BAs and MoS$_2$, only SA-GPR offers sufficient flexibility to accurately describe complex anharmonic materials like the perovskites.


title: Non-Negative Spherical Relaxations for Universe-Free Multi-Matching and Clustering

abstract: We propose a novel non-negative spherical relaxation for optimization problems over binary matrices with injectivity constraints, which in particular has applications in multi-matching and clustering. We relax respective binary matrix constraints to the (high-dimensional) non-negative sphere. To optimize our relaxed problem, we use a conditional power iteration method to iteratively improve the objective function, while at same time sweeping over a continuous scalar parameter that is (indirectly) related to the universe size (or number of clusters). Opposed to existing procedures that require to fix the integer universe size before optimization, our method automatically adjusts the analogous continuous parameter. Furthermore, while our approach shares similarities with spectral multi-matching and spectral clustering, our formulation has the strong advantage that we do not rely on additional post-processing procedures to obtain binary results. Our method shows compelling results in various multi-matching and clustering settings, even when compared to methods that use the ground truth universe size (or number of clusters).


title: Exploring the Impact of Corpus Diversity on Financial Pretrained Language Models

abstract: Over the past few years, various domain-specific pretrained language models (PLMs) have been proposed and have outperformed general-domain PLMs in specialized areas such as biomedical, scientific, and clinical domains. In addition, financial PLMs have been studied because of the high economic impact of financial data analysis. However, we found that financial PLMs were not pretrained on sufficiently diverse financial data. This lack of diverse training data leads to a subpar generalization performance, resulting in general-purpose PLMs, including BERT, often outperforming financial PLMs on many downstream tasks. To address this issue, we collected a broad range of financial corpus and trained the Financial Language Model (FiLM) on these diverse datasets. Our experimental results confirm that FiLM outperforms not only existing financial PLMs but also general domain PLMs. Furthermore, we provide empirical evidence that this improvement can be achieved even for unseen corpus groups.


title: Uniform convergence of optimal order of a local discontinuous Galerkin method on a Shishkin mesh under a balanced norm

abstract: This article investigates a local discontinuous Galerkin (LDG) method for one-dimensional and two-dimensional singularly perturbed reaction-diffusion problems on a Shishkin mesh. During this process, due to the inability of the energy norm to fully capture the behavior of the boundary layers appearing in the solutions, a balanced norm is introduced. By designing novel numerical fluxes and constructing special interpolations, optimal convergences under the balanced norm are achieved in both 1D and 2D cases. Numerical experiments support the main theoretical conclusions.


title: Combining Policy Gradient and Safety-Based Control for Autonomous Driving

abstract: With the advancement of data-driven techniques, addressing continuous con-trol challenges has become more efficient. However, the reliance of these methods on historical data introduces the potential for unexpected decisions in novel scenarios. To enhance performance in autonomous driving and collision avoidance, we propose a symbiotic fusion of policy gradient with safety-based control. In this study, we em-ploy the Deep Deterministic Policy Gradient (DDPG) algorithm to enable autono-mous driving in the absence of surrounding vehicles. By training the vehicle's driving policy within a stable and familiar environment, a robust and efficient learning pro-cess is achieved. Subsequently, an artificial potential field approach is utilized to formulate a collision avoidance algorithm, accounting for the presence of surround-ing vehicles. Furthermore, meticulous consideration is given to path tracking meth-ods. The amalgamation of these approaches demonstrates substantial performance across diverse scenarios, underscoring its potential for advancing autonomous driving while upholding safety standards.


title: Zero-Shot Sharpness-Aware Quantization for Pre-trained Language Models

abstract: Quantization is a promising approach for reducing memory overhead and accelerating inference, especially in large pre-trained language model (PLM) scenarios. While having no access to original training data due to security and privacy concerns has emerged the demand for zero-shot quantization. Most of the cutting-edge zero-shot quantization methods primarily 1) apply to computer vision tasks, and 2) neglect of overfitting problem in the generative adversarial learning process, leading to sub-optimal performance. Motivated by this, we propose a novel zero-shot sharpness-aware quantization (ZSAQ) framework for the zero-shot quantization of various PLMs. The key algorithm in solving ZSAQ is the SAM-SGA optimization, which aims to improve the quantization accuracy and model generalization via optimizing a minimax problem. We theoretically prove the convergence rate for the minimax optimization problem and this result can be applied to other nonconvex-PL minimax optimization frameworks. Extensive experiments on 11 tasks demonstrate that our method brings consistent and significant performance gains on both discriminative and generative PLMs, i.e., up to +6.98 average score. Furthermore, we empirically validate that our method can effectively improve the model generalization.


title: Coarse-to-Fine Dual Encoders are Better Frame Identification Learners

abstract: Frame identification aims to find semantic frames associated with target words in a sentence. Recent researches measure the similarity or matching score between targets and candidate frames by modeling frame definitions. However, they either lack sufficient representation learning of the definitions or face challenges in efficiently selecting the most suitable frame from over 1000 candidate frames. Moreover, commonly used lexicon filtering ($lf$) to obtain candidate frames for the target may ignore out-of-vocabulary targets and cause inadequate frame modeling. In this paper, we propose CoFFTEA, a $\underline{Co}$arse-to-$\underline{F}$ine $\underline{F}$rame and $\underline{T}$arget $\underline{E}$ncoders $\underline{A}$rchitecture. With contrastive learning and dual encoders, CoFFTEA efficiently and effectively models the alignment between frames and targets. By employing a coarse-to-fine curriculum learning procedure, CoFFTEA gradually learns to differentiate frames with varying degrees of similarity. Experimental results demonstrate that CoFFTEA outperforms previous models by 0.93 overall scores and 1.53 R@1 without $lf$. Further analysis suggests that CoFFTEA can better model the relationships between frame and frame, as well as target and target. The code for our approach is available at https://github.com/pkunlp-icler/COFFTEA.


title: Finite sequences of integers expressible as sums of two squares

abstract: This paper is concerned with finite sequences of integers that may be written as sums of squares of two nonzero integers. We first find infinitely many integers $n$ such that $n, n+h$ and $n+k$ are all sums of two squares where $h$ and $k$ are two arbitrary integers, and as an immediate corollary obtain, in parametric terms, three consecutive integers that are sums of two squares. Similarly we obtain $n$ in parametric terms such that all the four integers $n, n+1, n+2, n+4$ are sums of two squares. We also find infinitely many integers $n$ such that all the five integers $n, n+1, n+2, n+4, n+5$ are sums of two squares, and finally, we find infinitely many arithmetic progressions, with common difference $4$, of five integers all of which are sums of two squares.


title: The neural signature of inner peace: morphometric differences between high and low accepters

abstract: Acceptance is an adaptive emotion regulation strategy characterized by an open and non-judgmental attitude toward mental and sensory experiences. While a few studies have investigated the neural correlates of acceptance in task-based fMRI studies, a gap remains in the scientific literature in dispositional use of acceptance, and how this is sedimented at a structural level. Therefore, the aim of the present study is to investigate the neural and psychological differences between infrequent acceptance users (i.e., low accepters) and frequent users (i.e., high accepters). Another question is whether high and low accepters differ in personality traits and emotional intelligence. To this aim, we applied, for the first time, a data fusion unsupervised machine learning approach (mCCA-jICA) to the gray matter (GM) and white matter (WM) of high accepters (N = 50), and low accepters (N = 78) to possibly find joint GM-WM differences in both modalities. Our results show that two covarying GM-WM networks separate high from low accepters. The first network showed decreased GM-WM concentration in a fronto-temporal-parietal circuit largely overlapping with the Default Mode Network, while the second network showed increased GM-WM concentration in portions of the orbito-frontal, temporal, and parietal areas, related to a Central Executive Network. At the psychological level, the high accepters display higher openness to experience compared to low accepters. Overall, our findings suggest that high accepters compared to low accepters differ in neural and psychological mechanisms. These findings confirm and extend previous studies on the relevance of acceptance as a strategy associated with well-being.


title: Exceptional collections and phantoms of special Dolgachev surfaces

abstract: We provide an explicit description of exceptional collection of maximal length in the derived category $D^b(Y)$ for a particular class of elliptic surfaces $Y$. The existence of non\,-\,trivial semiorthogonal complement (a "\,phantom\,") of this collection is also established.


title: CylinderTag: An Accurate and Flexible Marker for Cylinder-Shape Objects Pose Estimation Based on Projective Invariants

abstract: High-precision pose estimation based on visual markers has been a thriving research topic in the field of computer vision. However, the suitability of traditional flat markers on curved objects is limited due to the diverse shapes of curved surfaces, which hinders the development of high-precision pose estimation for curved objects. Therefore, this paper proposes a novel visual marker called CylinderTag, which is designed for developable curved surfaces such as cylindrical surfaces. CylinderTag is a cyclic marker that can be firmly attached to objects with a cylindrical shape. Leveraging the manifold assumption, the cross-ratio in projective invariance is utilized for encoding in the direction of zero curvature on the surface. Additionally, to facilitate the usage of CylinderTag, we propose a heuristic search-based marker generator and a high-performance recognizer as well. Moreover, an all-encompassing evaluation of CylinderTag properties is conducted by means of extensive experimentation, covering detection rate, detection speed, dictionary size, localization jitter, and pose estimation accuracy. CylinderTag showcases superior detection performance from varying view angles in comparison to traditional visual markers, accompanied by higher localization accuracy. Furthermore, CylinderTag boasts real-time detection capability and an extensive marker dictionary, offering enhanced versatility and practicality in a wide range of applications. Experimental results demonstrate that the CylinderTag is a highly promising visual marker for use on cylindrical-like surfaces, thus offering important guidance for future research on high-precision visual localization of cylinder-shaped objects. The code is available at: https://github.com/wsakobe/CylinderTag.


title: Beyond Hard Samples: Robust and Effective Grammatical Error Correction with Cycle Self-Augmenting

abstract: Recent studies have revealed that grammatical error correction methods in the sequence-to-sequence paradigm are vulnerable to adversarial attack, and simply utilizing adversarial examples in the pre-training or post-training process can significantly enhance the robustness of GEC models to certain types of attack without suffering too much performance loss on clean data. In this paper, we further conduct a thorough robustness evaluation of cutting-edge GEC methods for four different types of adversarial attacks and propose a simple yet very effective Cycle Self-Augmenting (CSA) method accordingly. By leveraging the augmenting data from the GEC models themselves in the post-training process and introducing regularization data for cycle training, our proposed method can effectively improve the model robustness of well-trained GEC models with only a few more training epochs as an extra cost. More concretely, further training on the regularization data can prevent the GEC models from over-fitting on easy-to-learn samples and thus can improve the generalization capability and robustness towards unseen data (adversarial noise/samples). Meanwhile, the self-augmented data can provide more high-quality pseudo pairs to improve model performance on the original testing data. Experiments on four benchmark datasets and seven strong models indicate that our proposed training method can significantly enhance the robustness of four types of attacks without using purposely built adversarial examples in training. Evaluation results on clean data further confirm that our proposed CSA method significantly improves the performance of four baselines and yields nearly comparable results with other state-of-the-art models. Our code is available at https://github.com/ZetangForward/CSA-GEC.


title: Ferroelectricity in crystals with non-polar point groups

abstract: Ferroelectric crystals must adopt one of the 10 polar point groups according to the Neumann's principle. In this paper we propose that this conclusion is based on perfect bulk crystals without taking the boundaries into account, and we show first-principles evidence that ferroelectric polarizations may also be formed in some non-polar point groups as the edges generally break the crystal symmetry, which may even maintain at macroscale. They can be switchable in some systems with weak van der Waals bondings or covalent-like ionic bondings where long ion displacements with moderate barriers are possible. Such unconventional ferroelectricity violates the Neumann's principle and Abrahams' conditions respectively due to the boundaries and long ion displacements, which may explain some unclarified phenomena reported previously as well as significantly expand the scope of ferroelectrics.


title: Molecular beam epitaxy of GaN/AlGaN quantum wells on bulk GaN substrate in the step-flow or step meandering regime: influence on indirect exciton diffusion

abstract: GaN/AlxGa1-xN quantum wells were grown by molecular beam epitaxy on high quality bulk (0001) GaN substrates. The quantum well thickness was set in the 6-8 nm range to favor the photoluminescence emission of indirect excitons. Indeed, such excitons are known to be spatially indirect, due to the presence of the internal electric field which spatially separates the electron and hole wave functions. The growth conditions were optimized in view of minimizing the photoluminescence peak broadening. In particular, the impact of growth temperature (up to 900{\deg}C) on the surface morphology, structural and photoluminescence properties was studied. The diffusion of indirect excitons on the scale of tens of microns was measured with a micro-photoluminescence setup equipped with a spatially resolved detection. A dedicated model and its analysis allow us to extract from these measurements the exciton diffusion constant and to conclude on the optimum growth conditions for the GaN/AlxGa1-xN quantum well structures suited for studies of quantum collective effects in indirect exciton liquids.


title: ColAG: A Collaborative Air-Ground Framework for Perception-Limited UGVs' Navigation

abstract: Perception is necessary for autonomous navigation in an unknown area crowded with obstacles. It's challenging for a robot to navigate safely without any sensors that can sense the environment, resulting in a $\textit{blind}$ robot, and becomes more difficult when comes to a group of robots. However, it could be costly to equip all robots with expensive perception or SLAM systems. In this paper, we propose a novel system named $\textbf{ColAG}$, to solve the problem of autonomous navigation for a group of $\textit{blind}$ UGVs by introducing cooperation with one UAV, which is the only robot that has full perception capabilities in the group. The UAV uses SLAM for its odometry and mapping while sharing this information with UGVs via limited relative pose estimation. The UGVs plan their trajectories in the received map and predict possible failures caused by the uncertainty of its wheel odometry and unknown risky areas. The UAV dynamically schedules waypoints to prevent UGVs from collisions, formulated as a Vehicle Routing Problem with Time Windows to optimize the UAV's trajectories and minimize time when UGVs have to wait to guarantee safety. We validate our system through extensive simulation with up to 7 UGVs and real-world experiments with 3 UGVs.


title: VIP -- Variational Inversion Package with example implementations of Bayesian tomographic imaging

abstract: Bayesian inference has become an important tool to solve inverse problems and to quantify uncertainties in their solutions. Variational inference is a method that provides probabilistic, Bayesian solutions efficiently by using optimization. In this study we present a Python Variational Inversion Package (VIP), to solve inverse problems using variational inference methods. The package includes automatic differential variational inference (ADVI), Stein variational gradient descent (SVGD) and stochastic SVGD (sSVGD), and provides implementations of 2D travel time tomography and 2D full waveform inversion including test examples and solutions. Users can solve their own problems by supplying an appropriate forward function and a gradient calculation code. In addition, the package provides a scalable implementation which can be deployed easily on a desktop machine or using modern high performance computational facilities. The examples demonstrate that VIP is an efficient, scalable, extensible and user-friendly package, and can be used to solve a wide range of low or high dimensional inverse problems in practice.


title: A Critical Insight into Pretransitional Behavior and Dielectric Tunability of Relaxor Ceramics

abstract: The model discussion focused on links between the unique properties of relaxor ceramics and the basics of critical phenomena physics and glass transition physics. It indicates the significance of uniaxiality for appearing mean-field features near paraelectric_ferroelectric transition. Pretransitional fluctuations, increasing up to grain size and leading to inter-grain, random, local electric fields, are indicated to be responsible for relaxor ceramics characteristics. Their impacts yield the pseudo spinodal behavior associated with weakly discontinuous local phase transitions. The emerging model redefines the meaning of the Burns temperature and polar nanoregions PNRs. It explains coherently dielectric constant changes with the diffused maximum near paraelectric_ferroelectric transition, the sensitivity even to moderate electric fields, tunability, and the glassy dynamics. These considerations are confronted with experimental results for the complex dielectric permittivity studies in relaxor ceramic, covering the 200K range, from the paraelectric to the deep ferroelectric phase. The distortions-sensitive and derivative-based analysis revealed the preference for the exponential scaling pattern in the paraelectric phase and the surroundings of the paraelectric-ferroelectric transition. It may suggest the Griffith phase behavior associated with the mean-field criticality disturbed by random local impacts. The discussion of experimental results is supplemented by relaxation times changes and the coupled energy losses analysis. The studies also led to the description of tunability temperature changes with scaling relations.


title: The interplay between electron tunneling and Auger emission in a single quantum emitter weakly coupled to an electron reservoir

abstract: In quantum dots (QDs) the Auger recombination is a non-radiative scattering process in which the optical transition energy of a charged exciton (trion) is transferred to an additional electron leaving the dot. Electron tunneling from a reservoir is the competing process that replenishes the QD with an electron again. Here, we study the dependence of the tunneling and Auger recombintaion rate on the applied electric field using high-resolution time-resolved resonance fluorescence (RF) measurements. With the given p-i-n diode structure and a tunnel barrier between the electron reservoir and the QD of $45\,$nm, we measured a tunneling rate into the QD in the order of ms$^{-1}$. This rate shows a strong decrease by almost an order of magnitude for decreasing electric field, while the Auger emission rate decreases by a factor of five in the same voltage range. Furthermore, we study in detail the influence of the Auger recombination and the tunneling rate from the charge reservoir into the QD on the intensity and linewidth of the trion transition. Besides the well-known quenching of the trion transition, we observe in our time-resolved RF measurements a strong influence of the tunneling rate on the observed linewidth. The steady-state RF measurement yields a broadened trion transition of about $1.5\,$GHz for an Auger emission rate of the same order as the electron tunneling rate. In a non-equilibrium measurement, the Auger recombination can be suppressed, and a more than four times smaller linewidth of $340\,$MHz ($1.4\,$${\mu}$eV) is measured.


title: One-Phase Batch Update on Sparse Merkle Trees for Rollups

abstract: A sparse Merkle tree is a Merkle tree with fixed height and indexed leaves given by a map from indices to leaf values. It allows for both efficient membership and non-membership proofs. It has been widely used as an authenticated data structure in various applications, such as layer-2 rollups for blockchains. zkSync Lite, a popular Ethereum layer-2 rollup solution, uses a sparse Merkle tree to represent the state of the layer-2 blockchain. The account information is recorded in the leaves of the tree. In this paper, we study the sparse Merkle tree algorithms presented in zkSync Lite, and propose an efficient batch update algorithm to calculate a new root hash given a list of account (leaf) operations. Using the construction in zkSync Lite as a benchmark, our algorithm 1) improves the account update time from $\mathcal{O}(\log n)$ to $\mathcal{O}(1)$ and 2) reduces the batch update cost by half using a one-pass traversal. Empirical analysis of real-world block data shows that our algorithm outperforms the benchmark by at most 14%.


title: Spectral constant rigidity of warped product metrics

abstract: A theorem of Llarull says that if a smooth metric $g$ on the $n$-sphere $\mathbb{S}^n$ is bounded below by the standard round metric and the scalar curvature $R_g$ of $g$ is bounded below by $n (n - 1)$, then the metric $g$ must be the standard round metric. We prove a spectral Llarull theorem by replacing the bound $R_g \geq n (n - 1)$ by a lower bound on the first eigenvalue of an elliptic operator involving the Laplacian and the scalar curvature $R_g$. We utilize two methods: spinor and spacetime harmonic function.


title: Flat to nonflat: Calculating nonlinear power spectra of biased tracers for nonflat $\Lambda$CDM model

abstract: The growth of large-scale structure, together with the geometrical information of cosmic expansion history and cosmological distances, can be used to obtain constraints on the spatial curvature of the universe that probes the early universe physics, whereas modeling the nonlinear growth in a nonflat universe is still challenging due to computational expense of simulations in a high-dimensional cosmological parameter space. In this paper, we develop an approximate method to compute the halo-matter and halo-auto power spectra for nonflat $\Lambda$CDM model, from quantities representing the nonlinear evolution of the corresponding flat $\Lambda$CDM model, based on the separate universe (SU) method. By utilizing the fact that the growth response to long-wavelength fluctuations (equivalently the curvature), $T_{\delta_{\rm b}}(k)$, is approximated by the response to the Hubble parameter, $T_h(k)$, our method allows one to estimate the nonlinear power spectra in a nonflat universe efficiently from the power spectra of the flat universe. We use $N$-body simulations to show that the estimator can provide the halo-matter (halo-auto) power spectrum at $\sim 1\%$ ($\sim 2\%$ ) accuracy up to $k \simeq 3 (1) \, h {\rm Mpc}^{-1}$ even for a model with large curvature $\Omega_K = \pm 0.1$. Using the estimator we can extend the prediction of the existing emulators such as Dark Emulator to nonflat models without degrading their accuracy. Since the response to long-wavelength fluctuations is also a key quantity for estimating the super sample covariance (SSC), we discuss that the approximate identity $T_{\delta_{\rm b}}(k) \approx T_h(k)$ can be used to calculate the SSC terms analytically.


title: Globality of the DPW construction for Smyth potentials in the case of SU(1,1)

abstract: We construct harmonic maps into SU(1,1)/U(1) satrting from Smyth potentials \xi, by the DPW method, In this method, harmonic maps are obtained from the Iwasawa factorization of a solution L of L^{-1} dL = \xi. However, the Iwasawa factorization in the case of a noncompact group is not always global. We show that L can be expressed in terms of Bessel functions and from the asymptotic expansion of Bessel functions we solve a Riemann-Hilbert problem to give a global Iwasawa factorization. In this way we give a more direct proof than in the work of Dorfmeister-Guest-Rossman (2010), while avoiding the general isomonodromy theory used by Guest-Its-Lin (2015).


title: Democratizing Reasoning Ability: Tailored Learning from Large Language Model

abstract: Large language models (LLMs) exhibit impressive emergent abilities in natural language processing, but their democratization is hindered due to huge computation requirements and closed-source nature. Recent research on advancing open-source smaller LMs by distilling knowledge from black-box LLMs has obtained promising results in the instruction-following ability. However, the reasoning ability which is more challenging to foster, is relatively rarely explored. In this paper, we propose a tailored learning approach to distill such reasoning ability to smaller LMs to facilitate the democratization of the exclusive reasoning ability. In contrast to merely employing LLM as a data annotator, we exploit the potential of LLM as a reasoning teacher by building an interactive multi-round learning paradigm. This paradigm enables the student to expose its deficiencies to the black-box teacher who then can provide customized training data in return. Further, to exploit the reasoning potential of the smaller LM, we propose self-reflection learning to motivate the student to learn from self-made mistakes. The learning from self-reflection and LLM are all tailored to the student's learning status, thanks to the seamless integration with the multi-round learning paradigm. Comprehensive experiments and analysis on mathematical and commonsense reasoning tasks demonstrate the effectiveness of our method. The code will be available at https://github.com/Raibows/Learn-to-Reason.


title: Primordial Origin of Supermassive Black Holes from Axion Bubbles

abstract: We study a modification of the primordial black hole (PBH) formation model from axion bubbles. We assume that the Peccei-Quinn scalar rolls down in the radial direction from a large field value to the potential minimum during inflation, which suppresses the axion fluctuations and weakens the clustering of PBHs on large scales. We find that the modified model can produce a sufficient number of PBHs that seed the supermassive black holes while avoiding the observational constraints from isocurvature perturbations and angular correlation of the high-redshift quasars.


title: Convergence analysis on the alternating direction method of multipliers for the cosparse optimization problem

abstract: From a dual perspective of the sparse representation model, Nam et al. proposed the cosparse analysis model. In this paper, we aim to investigate the convergence of the alternating direction method of multipliers (ADMM) for the cosparse optimization problem. First, we examine the variational inequality representation of the cosparse optimization problem by introducing auxiliary variables. Second, ADMM is used to solve cosparse optimization problem. Finally, by utilizing a tight frame with a uniform row norm and building upon lemmas and the strict contraction theorem, we establish a worst-case $\mathcal{O}(1/t)$ convergence rate in the ergodic sense.


title: Reconfigurable Intelligent Sensing Surface aided Wireless Powered Communication Networks: A Sensing-Then-Reflecting Approach

abstract: This paper presents a reconfigurable intelligent sensing surface (RISS) that combines passive and active elements to achieve simultaneous reflection and direction of arrival (DOA) estimation tasks. By utilizing DOA information from the RISS instead of conventional channel estimation, the pilot overhead is reduced and the RISS becomes independent of the hybrid access point (HAP), enabling efficient operation. Specifically, the RISS autonomously estimates the DOA of uplink signals from single-antenna users and reflects them using the HAP's slowly varying DOA information. During downlink transmission, it updates the HAP's DOA information and designs the reflection phase of energy signals based on the latest user DOA information. The paper includes a comprehensive performance analysis, covering system design, protocol details, receiving performance, and RISS deployment suggestions. We derive a closed-form expression to analyze system performance under DOA errors, and calculate the statistical distribution of user received energy using the moment-matching technique. We provide a recommended transmit power to meet a specified outage probability and energy threshold. Numerical results demonstrate that the proposed system outperforms the conventional counterpart by 2.3 dB and 4.7 dB for Rician factors $\kappa_h=\kappa_G=1$ and $\kappa_h=\kappa_G=10$, respectively.


title: FLAIR: a Country-Scale Land Cover Semantic Segmentation Dataset From Multi-Source Optical Imagery

abstract: We introduce the French Land cover from Aerospace ImageRy (FLAIR), an extensive dataset from the French National Institute of Geographical and Forest Information (IGN) that provides a unique and rich resource for large-scale geospatial analysis. FLAIR contains high-resolution aerial imagery with a ground sample distance of 20 cm and over 20 billion individually labeled pixels for precise land-cover classification. The dataset also integrates temporal and spectral data from optical satellite time series. FLAIR thus combines data with varying spatial, spectral, and temporal resolutions across over 817 km2 of acquisitions representing the full landscape diversity of France. This diversity makes FLAIR a valuable resource for the development and evaluation of novel methods for large-scale land-cover semantic segmentation and raises significant challenges in terms of computer vision, data fusion, and geospatial analysis. We also provide powerful uni- and multi-sensor baseline models that can be employed to assess algorithm's performance and for downstream applications. Through its extent and the quality of its annotation, FLAIR aims to spur improvements in monitoring and understanding key anthropogenic development indicators such as urban growth, deforestation, and soil artificialization. Dataset and codes can be accessed at https://ignf.github.io/FLAIR/


title: Dynamical quantum phase transitions following a noisy quench

abstract: We study how time-dependent energy fluctuations impact the dynamical quantum phase transitions (DQPTs) following a noisy ramped quench of the transverse magnetic field in a quantum Ising chain. By numerically solving the stochastic Schr\"odinger equation of the mode-decoupled fermionic Hamiltonian of the problem, we identify two generic scenarios: Depending on the amplitude of the noise and the rate of the ramp, the expected periodic sequence of noiseless DQPTs may either be uniformly shifted in time or else replaced by a disarray of closely spaced DQPTs. Guided by an exact noise master equation, we trace the phenomenon to the interplay between noise-induced excitations which accumulate during the quench and the near-adiabatic dynamics of the massive modes of the system. Our analysis generalizes to any 1D fermionic two-band model subject to a noisy quench.


title: Heat equation from a deterministic dynamics

abstract: We derive the heat equation for the thermal energy under diffusive space-time scaling for a purely deterministic microscopic dynamics satisfying Newton equations perturbed by an external chaotic force acting like a magnetic field.


title: Bootstrap-based tests for the total time on test order, the NBUE property, and the excess wealth order

abstract: Given a pair of non-negative random variables $X$ and $Y$, we introduce a class of nonparametric tests for the null hypothesis that $X$ dominates $Y$ in the total time on test order. Critical values are determined using bootstrap-based inference, and the tests are shown to be consistent. The same approach is used to construct tests for the excess wealth order. As a byproduct, we also obtain a class of goodness-of-fit tests for the NBUE family of distributions.


title: Large-Scale and Multi-Perspective Opinion Summarization with Diverse Review Subsets

abstract: Opinion summarization is expected to digest larger review sets and provide summaries from different perspectives. However, most existing solutions are deficient in epitomizing extensive reviews and offering opinion summaries from various angles due to the lack of designs for information selection. To this end, we propose SUBSUMM, a supervised summarization framework for large-scale multi-perspective opinion summarization. SUBSUMM consists of a review sampling strategy set and a two-stage training scheme. The sampling strategies take sentiment orientation and contrastive information value into consideration, with which the review subsets from different perspectives and quality levels can be selected. Subsequently, the summarizer is encouraged to learn from the sub-optimal and optimal subsets successively in order to capitalize on the massive input. Experimental results on AmaSum and Rotten Tomatoes datasets demonstrate that SUBSUMM is adept at generating pros, cons, and verdict summaries from hundreds of input reviews. Furthermore, our in-depth analysis verifies that the advanced selection of review subsets and the two-stage training scheme are vital to boosting the summarization performance.


title: Packing forests

abstract: The seminal papers of Edmonds \cite{Egy}, Nash-Williams \cite{NW} and Tutte \cite{Tu} have laid the foundations of the theories of packing arborescences and packing trees. The directed version has been extensively investigated, resulting in a great number of generalizations. In contrast, the undirected version has been marginally considered. The aim of this paper is to further develop the theories of packing trees and forests. Our main result on graphs characterizes the existence of a packing of $k$ forests, $F_1, \ldots, F_k$, in a graph $G$ such that each vertex of $G$ belongs to exactly $h$ of the forests, and in addition, each $F_i$ has between $\ell(i)$ and $\ell'(i)$ connected components and the total number of connected components in the packing is between $\alpha$ and $\beta$. Finally, we extend this result to hypergraphs and dypergraphs, the latter giving a generalization of a theorem of B\'erczi and Frank \cite{BF3}.


title: Unsupervised learning of phase transitions via modified anomaly detection with autoencoders

abstract: In this paper, a modified method of anomaly detection using convolutional autoencoders is employed to predict phase transitions in several statistical mechanical models on a square lattice. We show that, when the autoencoder is trained with input data of various phases, the mean-square-error loss function can serve as a measure of disorder, and its standard deviation becomes an excellent indicator of critical points. We find that various types of phase transition points, including first-order, second-order, and topological ones, can be faithfully detected by the peaks in the standard deviation of the loss function. Besides, the values of transition points can be accurately determined under the analysis of finite-size scaling. Our results demonstrate that the present approach has general application in identification/classification of phase transitions even without a priori knowledge of the systems in question.


title: Challenges and Contributing Factors in the Utilization of Large Language Models (LLMs)

abstract: With the development of large language models (LLMs) like the GPT series, their widespread use across various application scenarios presents a myriad of challenges. This review initially explores the issue of domain specificity, where LLMs may struggle to provide precise answers to specialized questions within niche fields. The problem of knowledge forgetting arises as these LLMs might find it hard to balance old and new information. The knowledge repetition phenomenon reveals that sometimes LLMs might deliver overly mechanized responses, lacking depth and originality. Furthermore, knowledge illusion describes situations where LLMs might provide answers that seem insightful but are actually superficial, while knowledge toxicity focuses on harmful or biased information outputs. These challenges underscore problems in the training data and algorithmic design of LLMs. To address these issues, it's suggested to diversify training data, fine-tune models, enhance transparency and interpretability, and incorporate ethics and fairness training. Future technological trends might lean towards iterative methodologies, multimodal learning, model personalization and customization, and real-time learning and feedback mechanisms. In conclusion, future LLMs should prioritize fairness, transparency, and ethics, ensuring they uphold high moral and ethical standards when serving humanity.


title: DeepFracture: A Generative Approach for Predicting Brittle Fractures

abstract: In the realm of brittle fracture animation, generating realistic destruction animations with physics simulation techniques can be computationally expensive. Although methods using Voronoi diagrams or pre-fractured patterns work for real-time applications, they often lack realism in portraying brittle fractures. This paper introduces a novel learning-based approach for seamlessly merging realistic brittle fracture animations with rigid-body simulations. Our method utilizes BEM brittle fracture simulations to create fractured patterns and collision conditions for a given shape, which serve as training data for the learning process. To effectively integrate collision conditions and fractured shapes into a deep learning framework, we introduce the concept of latent impulse representation and geometrically-segmented signed distance function (GS-SDF). The latent impulse representation serves as input, capturing information about impact forces on the shape's surface. Simultaneously, a GS-SDF is used as the output representation of the fractured shape. To address the challenge of optimizing multiple fractured pattern targets with a single latent code, we propose an eight-dimensional latent space based on a normal distribution code within our latent impulse representation design. This adaptation effectively transforms our neural network into a generative one. Our experimental results demonstrate that our approach can generate significantly more detailed brittle fractures compared to existing techniques, all while maintaining commendable computational efficiency during run-time.


title: An LLM can Fool Itself: A Prompt-Based Adversarial Attack

abstract: The wide-ranging applications of large language models (LLMs), especially in safety-critical domains, necessitate the proper evaluation of the LLM's adversarial robustness. This paper proposes an efficient tool to audit the LLM's adversarial robustness via a prompt-based adversarial attack (PromptAttack). PromptAttack converts adversarial textual attacks into an attack prompt that can cause the victim LLM to output the adversarial sample to fool itself. The attack prompt is composed of three important components: (1) original input (OI) including the original sample and its ground-truth label, (2) attack objective (AO) illustrating a task description of generating a new sample that can fool itself without changing the semantic meaning, and (3) attack guidance (AG) containing the perturbation instructions to guide the LLM on how to complete the task by perturbing the original sample at character, word, and sentence levels, respectively. Besides, we use a fidelity filter to ensure that PromptAttack maintains the original semantic meanings of the adversarial examples. Further, we enhance the attack power of PromptAttack by ensembling adversarial examples at different perturbation levels. Comprehensive empirical results using Llama2 and GPT-3.5 validate that PromptAttack consistently yields a much higher attack success rate compared to AdvGLUE and AdvGLUE++. Interesting findings include that a simple emoji can easily mislead GPT-3.5 to make wrong predictions.


title: Decentralized approaches for autonomous vehicles coordination

abstract: The coordination of autonomous vehicles is an open field that is addressed by different researches comprising many different techniques. In this paper we focus on decentralized approaches able to provide adaptability to different infrastructural and traffic conditions. We formalize an Emergent Behavior Approach that, as per our knowledge, has never been performed for this purpose, and a Decentralized Auction approach. We compare them against existing centralized negotiation approaches based on auctions and we determine under which conditions each approach is preferable to the others.


title: NurViD: A Large Expert-Level Video Database for Nursing Procedure Activity Understanding

abstract: The application of deep learning to nursing procedure activity understanding has the potential to greatly enhance the quality and safety of nurse-patient interactions. By utilizing the technique, we can facilitate training and education, improve quality control, and enable operational compliance monitoring. However, the development of automatic recognition systems in this field is currently hindered by the scarcity of appropriately labeled datasets. The existing video datasets pose several limitations: 1) these datasets are small-scale in size to support comprehensive investigations of nursing activity; 2) they primarily focus on single procedures, lacking expert-level annotations for various nursing procedures and action steps; and 3) they lack temporally localized annotations, which prevents the effective localization of targeted actions within longer video sequences. To mitigate these limitations, we propose NurViD, a large video dataset with expert-level annotation for nursing procedure activity understanding. NurViD consists of over 1.5k videos totaling 144 hours, making it approximately four times longer than the existing largest nursing activity datasets. Notably, it encompasses 51 distinct nursing procedures and 177 action steps, providing a much more comprehensive coverage compared to existing datasets that primarily focus on limited procedures. To evaluate the efficacy of current deep learning methods on nursing activity understanding, we establish three benchmarks on NurViD: procedure recognition on untrimmed videos, procedure and action recognition on trimmed videos, and action detection. Our benchmark and code will be available at \url{https://github.com/minghu0830/NurViD-benchmark}.


title: Analyzing Cognitive Plausibility of Subword Tokenization

abstract: Subword tokenization has become the de-facto standard for tokenization, although comparative evaluations of subword vocabulary quality across languages are scarce. Existing evaluation studies focus on the effect of a tokenization algorithm on the performance in downstream tasks, or on engineering criteria such as the compression rate. We present a new evaluation paradigm that focuses on the cognitive plausibility of subword tokenization. We analyze the correlation of the tokenizer output with the response time and accuracy of human performance on a lexical decision task. We compare three tokenization algorithms across several languages and vocabulary sizes. Our results indicate that the UnigramLM algorithm yields less cognitively plausible tokenization behavior and a worse coverage of derivational morphemes, in contrast with prior work.


title: DeepFDR: A Deep Learning-based False Discovery Rate Control Method for Neuroimaging Data

abstract: Voxel-based multiple testing is widely used in neuroimaging data analysis. Traditional false discovery rate (FDR) control methods often ignore the spatial dependence among the voxel-based tests and thus suffer from substantial loss of testing power. While recent spatial FDR control methods have emerged, their validity and optimality remain questionable when handling the complex spatial dependencies of the brain. Concurrently, deep learning methods have revolutionized image segmentation, a task closely related to voxel-based multiple testing. In this paper, we propose DeepFDR, a novel spatial FDR control method that leverages unsupervised deep learning-based image segmentation to address the voxel-based multiple testing problem. Numerical studies, including comprehensive simulations and Alzheimer's disease FDG-PET image analysis, demonstrate DeepFDR's superiority over existing methods. DeepFDR not only excels in FDR control and effectively diminishes the false nondiscovery rate, but also boasts exceptional computational efficiency highly suited for tackling large-scale neuroimaging data.