title: Session-level Normalization and Click-through Data Enhancement for Session-based Evaluation

abstract: Since a user usually has to issue a sequence of queries and examine multiple documents to resolve a complex information need in a search session, researchers have paid much attention to evaluating search systems at the session level rather than the single-query level. Most existing session-level metrics evaluate each query separately and then aggregate the query-level scores using a session-level weighting function. The assumptions behind these metrics are that all queries in the session should be involved, and their orders are fixed. However, if a search system could make the user satisfied with her first few queries, she may not need any subsequent queries. Besides, in most real-world search scenarios, due to a lack of explicit feedback from real users, we can only leverage some implicit feedback, such as users' clicks, as relevance labels for offline evaluation. Such implicit feedback might be different from the real relevance in a search session as some documents may be omitted in the previous query but identified in the later reformulations. To address the above issues, we make two assumptions about session-based evaluation, which explicitly describe an ideal session-search system and how to enhance click-through data in computing session-level evaluation metrics. Based on our assumptions, we design a session-level metric called Normalized U-Measure (NUM). NUM evaluates a session as a whole and utilizes an ideal session to normalize the result of the actual session. Besides, it infers session-level relevance labels based on implicit feedback. Experiments on two public datasets demonstrate the effectiveness of NUM by comparing it with existing session-based metrics in terms of correlation with user satisfaction and intuitiveness. We also conduct ablation studies to explore whether these assumptions hold.


title: Some inequalities regarding the regularity of powers of monomial ideals

abstract: We prove some inequalities regarding the Castelnuovo--Mumford regularity of symbolic powers and integral closure of powers of monomial ideals.


title: NIV-SSD: Neighbor IoU-Voting Single-Stage Object Detector From Point Cloud

abstract: Previous single-stage detectors typically suffer the misalignment between localization accuracy and classification confidence. To solve the misalignment problem, we introduce a novel rectification method named neighbor IoU-voting (NIV) strategy. Typically, classification and regression are treated as separate branches, making it challenging to establish a connection between them. Consequently, the classification confidence cannot accurately reflect the regression quality. NIV strategy can serve as a bridge between classification and regression branches by calculating two types of statistical data from the regression output to correct the classification confidence. Furthermore, to alleviate the imbalance of detection accuracy for complete objects with dense points (easy objects) and incomplete objects with sparse points (difficult objects), we propose a new data augmentation scheme named object resampling. It undersamples easy objects and oversamples difficult objects by randomly transforming part of easy objects into difficult objects. Finally, combining the NIV strategy and object resampling augmentation, we design an efficient single-stage detector termed NIV-SSD. Extensive experiments on several datasets indicate the effectiveness of the NIV strategy and the competitive performance of the NIV-SSD detector. The code will be available at https://github.com/Say2L/NIV-SSD.


title: Field-induced phase transitions and quantum criticality in a honeycomb antiferromagnet Na3Co2SbO6

abstract: We performed 23Na NMR measurements on a single-domain crystal of the Kitaev material Na3Co2SbO6, with magnetic field applied along the crystalline a axis. A positive Curie-Weiss constant is obtained from the NMR Knight shift, which suggests the existence of ferromagnetic exchange couplings. The antiferromagnetic ordering is found to be suppressed at a field of 1.9 T. Inside the ordered phase, our data reveal two additional phase transitions. At 1.9 T, the spin-lattice relaxation rate 1/23T1 establishes a quantum critical behavior at high temperatures. However, at low temperatures, a gapped behavior is observed at the critical field, which suggests a weakly first-order transition instead and a possible field-induced quantum spin liquid. Our results reveal complex microscopic interactions in the system, which may help to search for possible quantum spin liquids.


title: Multiple Jets in the bursting protostar HOPS 373SW

abstract: We present the outflows detected in HOPS 373SW, a protostar undergoing a modest $30\%$ brightness increase at 850 $\mu$m. Atacama Large Millimeter/submillimeter Array (ALMA) observations of shock tracers, including SiO 8--7, CH$_3$OH 7$_{\rm k}$--6$_{\rm k}$, and $^{12}$CO 3--2 emission, reveal several outflow features around HOPS 373SW. The knots in the extremely high-velocity SiO emission reveal the wiggle of the jet, for which a simple model derives a 37$^\circ$ inclination angle of the jet to the plane of the sky, a jet velocity of 90 km s$^{-1}$, and a period of 50 years. The slow SiO and CH$_3$OH emission traces U-shaped bow shocks surrounding the two CO outflows. One outflow is associated with the high-velocity jets, while the other is observed to be close to the plane of the sky. The misaligned outflows imply that previous episodic accretion events have either reoriented HOPS 373SW or that it is an unresolved protostellar binary system with misaligned outflows.


title: The Chermak-Delgado Measure as a Map on Posets

abstract: The Chermak-Delgado measure of a finite group is a function which assigns to each subgroup a positive integer. In this paper, we give necessary and sufficient conditions for when the Chermak-Delgado measure of a group is actually a map of posets, i.e., a monotone function from the subgroup lattice to the positive integers. We also investigate when the Chermak-Delgado measure, restricted to the centralizers, is increasing.


title: Methods and strategies for improving the novel view synthesis quality of neural radiation field

abstract: Neural Radiation Field (NeRF) technology can learn a 3D implicit model of a scene from 2D images and synthesize realistic novel view images. This technology has received widespread attention from the industry and has good application prospects. In response to the problem that the rendering quality of NeRF images needs to be improved, many researchers have proposed various methods to improve the rendering quality in the past three years. The latest relevant papers are classified and reviewed, the technical principles behind quality improvement are analyzed, and the future evolution direction of quality improvement methods is discussed. This study can help researchers quickly understand the current state and evolutionary context of technology in this field, which is helpful in inspiring the development of more efficient algorithms and promoting the application of NeRF technology in related fields.


title: Self-supervised Learning of LiDAR 3D Point Clouds via 2D-3D Neural Calibration

abstract: This paper introduces a novel self-supervised learning framework for enhancing 3D perception in autonomous driving scenes. Specifically, our approach, named NCLR, focuses on 2D-3D neural calibration, a novel pretext task that estimates the rigid transformation aligning camera and LiDAR coordinate systems. First, we propose the learnable transformation alignment to bridge the domain gap between image and point cloud data, converting features into a unified representation space for effective comparison and matching. Second, we identify the overlapping area between the image and point cloud with the fused features. Third, we establish dense 2D-3D correspondences to estimate the rigid transformation. The framework not only learns fine-grained matching from points to pixels but also achieves alignment of the image and point cloud at a holistic level, understanding their relative pose. We demonstrate NCLR's efficacy by applying the pre-trained backbone to downstream tasks, such as LiDAR-based 3D semantic segmentation, object detection, and panoptic segmentation. Comprehensive experiments on various datasets illustrate the superiority of NCLR over existing self-supervised methods. The results confirm that joint learning from different modalities significantly enhances the network's understanding abilities and effectiveness of learned representation. Code will be available at \url{https://github.com/Eaphan/NCLR}.


title: "The teachers are confused as well": A Multiple-Stakeholder Ethics Discussion on Large Language Models in Computing Education

abstract: Large Language Models (LLMs) are advancing quickly and impacting people's lives for better or worse. In higher education, concerns have emerged such as students' misuse of LLMs and degraded education outcomes. To unpack the ethical concerns of LLMs for higher education, we conducted a case study consisting of stakeholder interviews (n=20) in higher education computer science. We found that students use several distinct mental models to interact with LLMs - LLMs serve as a tool for (a) writing, (b) coding, and (c) information retrieval, which differ somewhat in ethical considerations. Students and teachers brought up ethical issues that directly impact them, such as inaccurate LLM responses, hallucinations, biases, privacy leakage, and academic integrity issues. Participants emphasized the necessity of guidance and rules for the use of LLMs in higher education, including teaching digital literacy, rethinking education, and having cautious and contextual policies. We reflect on the ethical challenges and propose solutions.


title: Charged massless scalar fields in a charged $C$-metric black hole: Exact solutions, Hawking radiation and scattering of scalar waves

abstract: We study Hawking radiation and wave scattering of charged scalar fields in a charged $C$-metric black hole background. The conformally invariant wave equation for charged scalar fields can be separated into radial and angular parts, each with five singularities. We show that the radial and angular equations can be respectively transformed into the general Heun equation. We explore exact solutions of the radial Heun equation in terms of the local Heun functions and connection coefficients. Exact behaviours of the asymptotic wave functions are determined without approximations. We apply the exact results to derive Hawking radiation, quasi-normal modes and superradiance. Since quasinormal modes are significant for black holes through gravitional waves, we present the numeric results for quasinormal modes, and show the dependence upon the $C$-metric parameters and the charge of scalar fields. The analytic expressions of the solutions allow us to make fast numerical calculations of high precision without restrictions on the model parameters.


title: Multi-agent deep reinforcement learning with centralized training and decentralized execution for transportation infrastructure management

abstract: We present a multi-agent Deep Reinforcement Learning (DRL) framework for managing large transportation infrastructure systems over their life-cycle. Life-cycle management of such engineering systems is a computationally intensive task, requiring appropriate sequential inspection and maintenance decisions able to reduce long-term risks and costs, while dealing with different uncertainties and constraints that lie in high-dimensional spaces. To date, static age- or condition-based maintenance methods and risk-based or periodic inspection plans have mostly addressed this class of optimization problems. However, optimality, scalability, and uncertainty limitations are often manifested under such approaches. The optimization problem in this work is cast in the framework of constrained Partially Observable Markov Decision Processes (POMDPs), which provides a comprehensive mathematical basis for stochastic sequential decision settings with observation uncertainties, risk considerations, and limited resources. To address significantly large state and action spaces, a Deep Decentralized Multi-agent Actor-Critic (DDMAC) DRL method with Centralized Training and Decentralized Execution (CTDE), termed as DDMAC-CTDE is developed. The performance strengths of the DDMAC-CTDE method are demonstrated in a generally representative and realistic example application of an existing transportation network in Virginia, USA. The network includes several bridge and pavement components with nonstationary degradation, agency-imposed constraints, and traffic delay and risk considerations. Compared to traditional management policies for transportation networks, the proposed DDMAC-CTDE method vastly outperforms its counterparts. Overall, the proposed algorithmic framework provides near optimal solutions for transportation infrastructure management under real-world constraints and complexities.


title: Exploration and Improvement of Nerf-based 3D Scene Editing Techniques

abstract: NeRF's high-quality scene synthesis capability was quickly accepted by scholars in the years after it was proposed, and significant progress has been made in 3D scene representation and synthesis. However, the high computational cost limits intuitive and efficient editing of scenes, making NeRF's development in the scene editing field facing many challenges. This paper reviews the preliminary explorations of scholars on NeRF in the scene or object editing field in recent years, mainly changing the shape and texture of scenes or objects in new synthesized scenes; through the combination of residual models such as GaN and Transformer with NeRF, the generalization ability of NeRF scene editing has been further expanded, including realizing real-time new perspective editing feedback, multimodal editing of text synthesized 3D scenes, 4D synthesis performance, and in-depth exploration in light and shadow editing, initially achieving optimization of indirect touch editing and detail representation in complex scenes. Currently, most NeRF editing methods focus on the touch points and materials of indirect points, but when dealing with more complex or larger 3D scenes, it is difficult to balance accuracy, breadth, efficiency, and quality. Overcoming these challenges may become the direction of future NeRF 3D scene editing technology.


title: Quantum gyroscopes based on double-mode surface-acoustic-wave cavities

abstract: Recent progress shows that a surface-acoustic-wave (SAW) cavity can not only induce quantum acoustic dynamics but also can form optomechanical-like systems. Its operating frequencies in the microwave band make it resistant to the thermal noise of surrounding environments, while its radiation-pressure couplings make it susceptible to weak forces. Based on these advantages, we propose a gyroscope comprising coupled microwave-SAW cavities. In this paper, we systematically consider the three indices including range, signal-to-noise ratio, and sensitivity, which are the most important to gyroscopes but only partially considered in existing works. Additionally, we establish the fundamental limits of sensitivity when the quantum input is in the vacuum state and the squeezed vacuum state. We find that squeezing improves sensitivity and can surpass the standard quantum limit. However, this improvement can only reach up to $\sqrt{2}/2$ even as the squeezed parameter approaches infinity, which is rarely noted in recent works. Finally, we also offer analytical constraints for cooperativity and squeezed parameters. These constraints can be utilized to design gyroscopes based on coupled cavities in experiments.


title: On the solvability of some systems of integro-differential equations with and without a drift

abstract: We prove the existence of solutions for some integro-differential systems containing equations with and without the drift terms in the H^2 spaces by virtue of the fixed point technique when the elliptic equations contain second order differential operators with and without the Fredholm property, on the whole real line or on a finite interval with periodic boundary conditions. Let us emphasize that the study of the systems case is more complicated than of the scalar situation and requires to overcome more cumbersome technicalities.


title: Towards Socially and Morally Aware RL agent: Reward Design With LLM

abstract: When we design and deploy an Reinforcement Learning (RL) agent, reward functions motivates agents to achieve an objective. An incorrect or incomplete specification of the objective can result in behavior that does not align with human values - failing to adhere with social and moral norms that are ambiguous and context dependent, and cause undesired outcomes such as negative side effects and exploration that is unsafe. Previous work have manually defined reward functions to avoid negative side effects, use human oversight for safe exploration, or use foundation models as planning tools. This work studies the ability of leveraging Large Language Models (LLM)' understanding of morality and social norms on safe exploration augmented RL methods. This work evaluates language model's result against human feedbacks and demonstrates language model's capability as direct reward signals.


title: Tensor network influence functionals in the continuous-time limit: connections to quantum embedding, bath discretization, and higher-order time propagation

abstract: We describe two developments of tensor network influence functionals (in particular, influence functional matrix product states (IF-MPS)) for quantum impurity dynamics within the fermionic setting of the Anderson impurity model. The first provides the correct extension of the IF-MPS to continuous time by introducing a related mathematical object, the boundary influence functional MPS. The second connects the dynamics described by a compressed IF-MPS to that of a quantum embedding method with a time-dependent effective bath undergoing non-unitary dynamics. Using these concepts, we implement higher-order time propagators for the quench dynamics of the Anderson impurity model within the boundary IF-MPS formalism. The calculations illustrate the ability of the current formulation to efficiently remove the time-step error in standard discrete-time IF-MPS implementations as well as to interface with state-vector propagation techniques. They also show the advantages of IF-MPS dynamics, with its associated highly compact effective bath dynamics, over state-vector propagation with a static bath discretization.


title: Fast Adversarial Training against Textual Adversarial Attacks

abstract: Many adversarial defense methods have been proposed to enhance the adversarial robustness of natural language processing models. However, most of them introduce additional pre-set linguistic knowledge and assume that the synonym candidates used by attackers are accessible, which is an ideal assumption. We delve into adversarial training in the embedding space and propose a Fast Adversarial Training (FAT) method to improve the model robustness in the synonym-unaware scenario from the perspective of single-step perturbation generation and perturbation initialization. Based on the observation that the adversarial perturbations crafted by single-step and multi-step gradient ascent are similar, FAT uses single-step gradient ascent to craft adversarial examples in the embedding space to expedite the training process. Based on the observation that the perturbations generated on the identical training sample in successive epochs are similar, FAT fully utilizes historical information when initializing the perturbation. Extensive experiments demonstrate that FAT significantly boosts the robustness of BERT models in the synonym-unaware scenario, and outperforms the defense baselines under various attacks with character-level and word-level modifications.


title: A dynamic model to study the potential TB infections and assessment of control strategies in China

abstract: China is one of the countries with a high burden of tuberculosis, and although the number of new cases of tuberculosis has been decreasing year by year, the number of new infections per year has remained high and the diagnosis rate of tuberculosis-infected patients has remained low. Based on the analysis of TB infection data, we develop a model of TB transmission dynamics that include potentially infected individuals and BCG vaccination, fit the model parameters to the data on new TB cases, calculate the basic reproduction number \mathcal{R}_v= 0.4442. A parametric sensitivity analysis of \mathcal{R}_v is performed, and we obtained the correlation coefficients of BCG vaccination rate and effectiveness rate with \mathcal{R}_v as -0.810, -0.825. According to the model, we estimate that there are 614,186 (95% CI [562,631,665,741]) potentially infected TB cases in China, accounting for about 39.5% of the total number of TB cases. We assess the feasibility of achieving the goals of the WHO strategy to end tuberculosis in China and find that reducing the number of new cases by 90 per cent by 2035 is very difficult with the current tuberculosis control measures. However, with an effective combination of control measures such as increased detection of potentially infected persons, improved drug treatment, and reduction of overall exposure to tuberculosis patients, it is feasible to reach the WHO strategic goal of ending tuberculosis by 2035.


title: A Quantum Inspired Bi-level Optimization Algorithm for the First Responder Network Design Problem

abstract: In the aftermath of a sudden catastrophe, First Responders (FR) strive to promptly reach and rescue immobile victims. Simultaneously, other mobile individuals take roads to evacuate the affected region, or access shelters. The escalated traffic congestion significantly hinders critical FR operations if they share some of the same roads. A proposal from the Turkish Ministry of Transportation and Infrastructure being discussed for implementation is to allocate a subset of road segments for use by FRs only, mark them clearly, and pre-communicate them to the citizens. For the FR paths under consideration: (i) there should exist an FR path from designated entry points to each demand point in the network, and (ii) evacuees try to leave the network (through some exit points following the selfish routing principle) in the shortest time possible when they know that certain segments are not available to them. We develop a mixed integer non-linear programming formulation for this First Responder Network Design Problem (FRNDP). We solve FRNDP using a novel hybrid quantum-classical heuristic building on the Graver Augmented Multi-Seed Algorithm (GAMA). Using the flow-balance constraints for the FR and evacuee paths, we use a Quadratic Unconstrained Binary Optimization (QUBO) model to obtain a partial Graver Bases to move between the feasible solutions of FRNDP. To efficiently explore the solution space for high-quality solutions, we develop a novel bi-level nested GAMA within GAMA: GAGA. We test GAGA on random graph instances of various sizes and instances related to an expected Istanbul earthquake. Comparing GAGA against a state-of-the-art exact algorithm for traditional formulations, we find that GAGA offers a promising alternative approach. We hope our work encourages further study of quantum (inspired) algorithms to tackle complex optimization models from other application domains.


title: Estimation of posture and joint angle of human body using foot pressure distribution: Morphological computation with human foot

abstract: This paper proposes a novel contact and wearable sensing system for estimating the upper body posture and joint angles (ankle, knee, and hip) of the human body using foot pressure distribution information obtained from a sensor attached to the plantar region. In the proposed estimation method, sensors are installed only on the plantar region, which is the end of the human body and the point of contact with the environment. The posture and joint angles of other parts of the body are estimated using only this information. As a contact and wearable sensor, the proposed system differs from previous measurement systems in the sense that the sensor does not need to be placed near the target joint or body. The estimation was carried out using a multivariate linear regression model with the foot pressure distribution as the input and the joint angle or posture as the output. The results reveal that it is possible to estimate the posture and joint angles of the human body from foot pressure distribution information (R2$\fallingdotseq$0.9). The proposed estimation method was validated by morphological computation to confirm that it is enabled by foot morphology. The validation approach compared the estimation accuracy achieved when an object was interposed between the foot pressure distribution sensor and the plantar region and the morphological relationship of the plantar region to the environment varied. The results reveal that there is a significant difference in the estimation accuracy between cases with and without an intervening object, suggesting that the morphology of the plantar region contributes to the estimation. Furthermore, the proposed estimation method is considered as physical reservoir computing, wherein the human foot is used as a computational resource.


title: Entropy properties of mostly expanding partially hyperbolic diffeomorphisms

abstract: The statistical properties of mostly expanding partially hyperbolic diffeomorphisms have been substantially studied. In this paper, we would like to address the entropy properties of mostly expanding partially hyperbolic diffeomorphisms. We prove that for mostly expanding partially hyperbolic diffeomorphisms with minimal strong stable foliation and one-dimensional center bundle, there exists a $C^1$-open neighborhood of them, in which the topological entropy varies continuously and the intermediate entropy property holds. To prove that, we show that each non-hyperbolic ergodic measure is approached by horseshoes in entropy and in weak$*$-topology.


title: Accurate atomic positions via local-orbital tomography with depth-dependent interactions

abstract: Three-dimensional reconstruction of atomic structure, known as atomic electron tomography (AET), has found increasing applications in materials science. The AET has been limited to very small nanoparticles due to the challenges of obtaining accurate atomic positions for large objects, for which the projection approximation generally assumed in AET is no longer valid due to the evolution of the electron probe along the beam direction. To address these challenges, we have developed a method that represents atoms as local orbitals and implements a depth-dependent probe-object interaction. Compared to conventional tomographic methods, the accuracy of atomic positions is improved by a factor of three and provides a solution for the tomographic reconstruction of large objects.


title: An open dataset for the evolution of oracle bone characters: EVOBC

abstract: The earliest extant Chinese characters originate from oracle bone inscriptions, which are closely related to other East Asian languages. These inscriptions hold immense value for anthropology and archaeology. However, deciphering oracle bone script remains a formidable challenge, with only approximately 1,600 of the over 4,500 extant characters elucidated to date. Further scholarly investigation is required to comprehensively understand this ancient writing system. Artificial Intelligence technology is a promising avenue for deciphering oracle bone characters, particularly concerning their evolution. However, one of the challenges is the lack of datasets mapping the evolution of these characters over time. In this study, we systematically collected ancient characters from authoritative texts and websites spanning six historical stages: Oracle Bone Characters - OBC (15th century B.C.), Bronze Inscriptions - BI (13th to 221 B.C.), Seal Script - SS (11th to 8th centuries B.C.), Spring and Autumn period Characters - SAC (770 to 476 B.C.), Warring States period Characters - WSC (475 B.C. to 221 B.C.), and Clerical Script - CS (221 B.C. to 220 A.D.). Subsequently, we constructed an extensive dataset, namely EVolution Oracle Bone Characters (EVOBC), consisting of 229,170 images representing 13,714 distinct character categories. We conducted validation and simulated deciphering on the constructed dataset, and the results demonstrate its high efficacy in aiding the study of oracle bone script. This openly accessible dataset aims to digitalize ancient Chinese scripts across multiple eras, facilitating the decipherment of oracle bone script by examining the evolution of glyph forms.


title: Minimum observability of probabilistic Boolean networks

abstract: This paper studies the minimum observability of probabilistic Boolean networks (PBNs), the main objective of which is to add the fewest measurements to make an unobservable PBN become observable. First of all, the algebraic form of a PBN is established with the help of semi-tensor product (STP) of matrices. By combining the algebraic forms of two identical PBNs into a parallel system, a method to search the states that need to be H-distinguishable is proposed based on the robust set reachability technique. Secondly, a necessary and sufficient condition is given to find the minimum measurements such that a given set can be H-distinguishable. Moreover, by comparing the numbers of measurements for all the feasible H-distinguishable state sets, the least measurements that make the system observable are gained. Finally, an example is given to verify the validity of the obtained results.


title: Towards Adaptive Subspace Detection in Heterogeneous Environment

abstract: In this paper, we aim to take one step forward to the scenario where an adaptive subspace detection framework is required to detect subspace signals in non-stationary environments. Despite the fact that this scenario is more realistic, the existing studies in detection theory mostly rely on homogeneous, or partially homogeneous assumptions in the environments for their design process meaning that the covariance matrices of primary and secondary datasets are exactly the same or different up to a scale factor. In this study, we allow some partial information of the train covariance matrix to be shared with the primary dataset, but the covariance matrix in the primary set can be entirely different in the structure. This is particularly true in radar systems where the secondary set is collected in distinct spatial and time zones. We design a Generalized Likelihood Ratio Test (GLRT) based detector where the noise is multivariate Gaussian and the subspace interference is assumed to be known. The simulation results reveal the superiority of the proposed approach in comparison with conventional detectors for such a realistic and general scenario.


title: Reinforcement Learning for Graph Coloring: Understanding the Power and Limits of Non-Label Invariant Representations

abstract: Register allocation is one of the most important problems for modern compilers. With a practically unlimited number of user variables and a small number of CPU registers, assigning variables to registers without conflicts is a complex task. This work demonstrates the use of casting the register allocation problem as a graph coloring problem. Using technologies such as PyTorch and OpenAI Gymnasium Environments we will show that a Proximal Policy Optimization model can learn to solve the graph coloring problem. We will also show that the labeling of a graph is critical to the performance of the model by taking the matrix representation of a graph and permuting it. We then test the model's effectiveness on each of these permutations and show that it is not effective when given a relabeling of the same graph. Our main contribution lies in showing the need for label reordering invariant representations of graphs for machine learning models to achieve consistent performance.


title: Zero Shot Open-ended Video Inference

abstract: Zero-shot open-ended inference on untrimmed videos poses a significant challenge, especially when no annotated data is utilized to navigate the inference direction. In this work, we aim to address this underexplored domain by introducing an adaptable framework that efficiently combines both the frozen vision-language (VL) model and off-the-shelf large language model (LLM) for conducting zero-shot open-ended inference tasks without requiring any additional training or fine-tuning. Our comprehensive experiments span various video action datasets for goal inference and action recognition tasks. The results demonstrate the framework's superior performance in goal inference compared to conventional vision-language models in open-ended and close-ended scenarios. Notably, the proposed framework exhibits the capability to generalize effectively to action recognition tasks, underscoring its versatility and potential contributions to advancing the video-based zero-shot understanding.


title: Contrastive Learning in Distilled Models

abstract: Natural Language Processing models like BERT can provide state-of-the-art word embeddings for downstream NLP tasks. However, these models yet to perform well on Semantic Textual Similarity, and may be too large to be deployed as lightweight edge applications. We seek to apply a suitable contrastive learning method based on the SimCSE paper, to a model architecture adapted from a knowledge distillation based model, DistilBERT, to address these two issues. Our final lightweight model DistilFace achieves an average of 72.1 in Spearman's correlation on STS tasks, a 34.2 percent improvement over BERT base.


title: Boosting Unknown-number Speaker Separation with Transformer Decoder-based Attractor

abstract: We propose a novel speech separation model designed to separate mixtures with an unknown number of speakers. The proposed model stacks 1) a dual-path processing block that can model spectro-temporal patterns, 2) a transformer decoder-based attractor (TDA) calculation module that can deal with an unknown number of speakers, and 3) triple-path processing blocks that can model inter-speaker relations. Given a fixed, small set of learned speaker queries and the mixture embedding produced by the dual-path blocks, TDA infers the relations of these queries and generates an attractor vector for each speaker. The estimated attractors are then combined with the mixture embedding by feature-wise linear modulation conditioning, creating a speaker dimension. The mixture embedding, conditioned with speaker information produced by TDA, is fed to the final triple-path blocks, which augment the dual-path blocks with an additional pathway dedicated to inter-speaker processing. The proposed approach outperforms the previous best reported in the literature, achieving 24.0 and 23.7 dB SI-SDR improvement (SI-SDRi) on WSJ0-2 and 3mix respectively, with a single model trained to separate 2- and 3-speaker mixtures. The proposed model also exhibits strong performance and generalizability at counting sources and separating mixtures with up to 5 speakers.


title: Large Language Models are Superpositions of All Characters: Attaining Arbitrary Role-play via Self-Alignment

abstract: Considerable efforts have been invested in augmenting the role-playing proficiency of open-source large language models (LLMs) by emulating proprietary counterparts. Nevertheless, we posit that LLMs inherently harbor role-play capabilities, owing to the extensive knowledge of characters and potential dialogues ingrained in their vast training corpora. Thus, in this study, we introduce Ditto, a self-alignment method for role-play. Ditto capitalizes on character knowledge, encouraging an instruction-following LLM to simulate role-play dialogues as a variant of reading comprehension. This method creates a role-play training set comprising 4,000 characters, surpassing the scale of currently available datasets by tenfold regarding the number of roles. Subsequently, we fine-tune the LLM using this self-generated dataset to augment its role-playing capabilities. Upon evaluating our meticulously constructed and reproducible role-play benchmark and the roleplay subset of MT-Bench, Ditto, in various parameter scales, consistently maintains a consistent role identity and provides accurate role-specific knowledge in multi-turn role-play conversations. Notably, it outperforms all open-source role-play baselines, showcasing performance levels comparable to advanced proprietary chatbots. Furthermore, we present the first comprehensive cross-supervision alignment experiment in the role-play domain, revealing that the intrinsic capabilities of LLMs confine the knowledge within role-play. Meanwhile, the role-play styles can be easily acquired with the guidance of smaller models. We open-source related resources at https://github.com/OFA-Sys/Ditto.


title: Moen Meets Rotemberg: An Earthly Model of the Divine Coincidence

abstract: This paper proposes a model of the divine coincidence, explaining its recent appearance in US data. The divine coincidence matters because it helps explain the behavior of inflation after the pandemic, and it guarantees that the full-employment and price-stability mandates of the Federal Reserve coincide. In the model, a Phillips curve relating unemployment to inflation arises from Moen's (1997) directed search. The Phillips curve is nonvertical thanks to Rotemberg's (1982) price-adjustment costs. The model's Phillips curve guarantees that the rate of inflation is on target whenever the rate of unemployment is efficient, generating the divine coincidence. If we assume that wage decreases -- which reduce workers' morale -- are more costly to producers than price increases -- which upset customers -- the Phillips curve also displays a kink at the point of divine coincidence.


title: Bayesian identification of nonseparable Hamiltonians with multiplicative noise using deep learning and reduced-order modeling

abstract: This paper presents a structure-preserving Bayesian approach for learning nonseparable Hamiltonian systems using stochastic dynamic models allowing for statistically-dependent, vector-valued additive and multiplicative measurement noise. The approach is comprised of three main facets. First, we derive a Gaussian filter for a statistically-dependent, vector-valued, additive and multiplicative noise model that is needed to evaluate the likelihood within the Bayesian posterior. Second, we develop a novel algorithm for cost-effective application of Bayesian system identification to high-dimensional systems. Third, we demonstrate how structure-preserving methods can be incorporated into the proposed framework, using nonseparable Hamiltonians as an illustrative system class. We assess the method's performance based on the forecasting accuracy of a model estimated from-single trajectory data. We compare the Bayesian method to a state-of-the-art machine learning method on a canonical nonseparable Hamiltonian model and a chaotic double pendulum model with small, noisy training datasets. The results show that using the Bayesian posterior as a training objective can yield upwards of 724 times improvement in Hamiltonian mean squared error using training data with up to 10% multiplicative noise compared to a standard training objective. Lastly, we demonstrate the utility of the novel algorithm for parameter estimation of a 64-dimensional model of the spatially-discretized nonlinear Schr\"odinger equation with data corrupted by up to 20% multiplicative noise.

categories: stat.ML cs.LG math.DS physics.data-an stat.CO


title: Modular Control of Biological Networks

abstract: The concept of control is central to understanding and applications of biological network models. Some of their key structural features relate to control functions, through gene regulation, signaling, or metabolic mechanisms, and computational models need to encode these. Applications of models often focus on model-based control, such as in biomedicine or metabolic engineering. This paper presents an approach to model-based control that exploits two common features of biological networks, namely their modular structure and canalizing features of their regulatory mechanisms. The paper focuses on intracellular regulatory networks, represented by Boolean network models. A main result of this paper is that control strategies can be identified by focusing on one module at a time. This paper also presents a criterion based on canalizing features of the regulatory rules to identify modules that do not contribute to network control and can be excluded. For even moderately sized networks, finding global control inputs is computationally very challenging. The modular approach presented here leads to a highly efficient approach to solving this problem. This approach is applied to a published Boolean network model of blood cancer large granular lymphocyte (T-LGL) leukemia to identify a minimal control set that achieves a desired control objective.


title: Mini-batch Submodular Maximization

abstract: We present the first mini-batch algorithm for maximizing a non-negative monotone decomposable submodular function, $F=\sum_{i=1}^N f^i$, under a set of constraints. We improve over the sparsifier based approach both in theory and in practice. We experimentally observe that our algorithm generates solutions that are far superior to those generated by the sparsifier based approach.


title: TD^2-Net: Toward Denoising and Debiasing for Dynamic Scene Graph Generation

abstract: Dynamic scene graph generation (SGG) focuses on detecting objects in a video and determining their pairwise relationships. Existing dynamic SGG methods usually suffer from several issues, including 1) Contextual noise, as some frames might contain occluded and blurred objects. 2) Label bias, primarily due to the high imbalance between a few positive relationship samples and numerous negative ones. Additionally, the distribution of relationships exhibits a long-tailed pattern. To address the above problems, in this paper, we introduce a network named TD$^2$-Net that aims at denoising and debiasing for dynamic SGG. Specifically, we first propose a denoising spatio-temporal transformer module that enhances object representation with robust contextual information. This is achieved by designing a differentiable Top-K object selector that utilizes the gumbel-softmax sampling strategy to select the relevant neighborhood for each object. Second, we introduce an asymmetrical reweighting loss to relieve the issue of label bias. This loss function integrates asymmetry focusing factors and the volume of samples to adjust the weights assigned to individual samples. Systematic experimental results demonstrate the superiority of our proposed TD$^2$-Net over existing state-of-the-art approaches on Action Genome databases. In more detail, TD$^2$-Net outperforms the second-best competitors by 12.7 \% on mean-Recall@10 for predicate classification.


title: Explore Synergistic Interaction Across Frames for Interactive Video Object Segmentation

abstract: Interactive Video Object Segmentation (iVOS) is a challenging task that requires real-time human-computer interaction. To improve the user experience, it is important to consider the user's input habits, segmentation quality, running time and memory consumption.However, existing methods compromise user experience with single input mode and slow running speed. Specifically, these methods only allow the user to interact with one single frame, which limits the expression of the user's intent.To overcome these limitations and better align with people's usage habits, we propose a framework that can accept multiple frames simultaneously and explore synergistic interaction across frames (SIAF). Concretely, we designed the Across-Frame Interaction Module that enables users to annotate different objects freely on multiple frames. The AFI module will migrate scribble information among multiple interactive frames and generate multi-frame masks. Additionally, we employ the id-queried mechanism to process multiple objects in batches. Furthermore, for a more efficient propagation and lightweight model, we design a truncated re-propagation strategy to replace the previous multi-round fusion module, which employs an across-round memory that stores important interaction information. Our SwinB-SIAF achieves new state-of-the-art performance on DAVIS 2017 (89.6%, J&F@60). Moreover, our R50-SIAF is more than 3 faster than the state-of-the-art competitor under challenging multi-object scenarios.


title: AIRS-assisted Vehicular Networks with Rate-Splitting SWIPT Receivers: Joint Trajectory and Communication Design

abstract: In this correspondence, we propose to use an intelligent reflective surface (IRS) installed on unmanned aerial vehicle (UAV), referred to as aerial IRS (AIRS), for vehicular networks, where simultaneous wireless information and power transfer (SWIPT) receivers to concurrently allow information decoding (ID) and energy harvesting (EH) are equipped at the battery-limited vehicles. For efficiently supporting the multiple moving vehicles, we adopt rate-splitting multiple access (RSMA) technique. With the aim of maximizing the sum rate of vehicles, we jointly optimize trajectory and phase shift design of AIRS, transmit power and rate allocation for RSMA along with power splitting ratio for SWIPT implementation. Via simulations, the superior performances of the proposed algorithm are validated compared to the conventional partial optimizations.


title: Nonparametric logistic regression with deep learning

abstract: Consider the nonparametric logistic regression problem. In the logistic regression, we usually consider the maximum likelihood estimator, and the excess risk is the expectation of the Kullback-Leibler (KL) divergence between the true and estimated conditional class probabilities. However, in the nonparametric logistic regression, the KL divergence could diverge easily, and thus, the convergence of the excess risk is difficult to prove or does not hold. Several existing studies show the convergence of the KL divergence under strong assumptions. In most cases, our goal is to estimate the true conditional class probabilities. Thus, instead of analyzing the excess risk itself, it suffices to show the consistency of the maximum likelihood estimator in some suitable metric. In this paper, using a simple unified approach for analyzing the nonparametric maximum likelihood estimator (NPMLE), we directly derive the convergence rates of the NPMLE in the Hellinger distance under mild assumptions. Although our results are similar to the results in some existing studies, we provide simple and more direct proofs for these results. As an important application, we derive the convergence rates of the NPMLE with deep neural networks and show that the derived rate nearly achieves the minimax optimal rate.


title: Persona-centric Metamorphic Relation guided Robustness Evaluation for Multi-turn Dialogue Modelling

abstract: Recently there has been significant progress in the field of dialogue system thanks to the introduction of training paradigms such as fine-tune and prompt learning. Persona can function as the prior knowledge for maintaining the personality consistency of dialogue systems, which makes it perform well on accuracy. Nonetheless, the conventional reference-based evaluation method falls short in capturing the genuine text comprehension prowess of the model, significantly relying on the quality of data annotation. In contrast, the application of metamorphic testing offers a more profound insight into the model's distinct capabilities without necessitating supplementary annotation labels. This approach furnishes a more comprehensive portrayal of the model's intricacies and exposes intricacies concealed within reference-based validation techniques. Consequently, we introduce a persona-centric metamorphic relation construction for metamorphic testing, aimed at evaluating both the persona consistency and robustness of personalized dialogue models. For that reason, this work evaluates several widely used training paradigms including learning from scratch, pretrain + fine-tune and prompt learning in personalized dialogue retrieval to know if they are more robust or if they have the same flaws as their predecessor. Under three kinds of designed metamorphic relations with consistent outputs, our experimental results reveal that prompt learning shows stronger robustness compared to training from scratch and fine-tune. Although tested retrieval models gain competitively high retrieval accuracy according to the traditional reference-based validation, they are still fragile and demonstrate various unexpected behaviors, thus there is still room for future improvement in personalized dialogue retrieval.


title: Impulsive Gas Fueling to Galactic Center in a Barred Galaxy Due to Falls of Gas Clouds

abstract: We have studied the evolution of the central hundred pc region of barred galaxies by performing numerical simulations realizing multi-phase nature of gas. Our simulations have shown that a stellar bar produces an oval gas ring namely the $x$-2 ring within $1~{\rm kpc}$ as the bar grows. The ring is self-gravitationally unstable enough to trigger formations of gas clouds. Although the gas clouds initially rotate in the $x$-2 ring, cloud-cloud collisions and/or energy injections into the gas ring by Type II supernovae deviate some of the clouds from the ring orbit. After the deviation, the deviated clouds repeat collisions with the other clouds, which rotate in the $x$-2 ring, during several rotations. These processes effectively reduce the angular momentum of the deviated gas cloud. As a result, the gas cloud finally falls into the galactic center, and episodic gas supply to the galactic center takes place.


title: Adiabatic Quantum Support Vector Machines

abstract: Adiabatic quantum computers can solve difficult optimization problems (e.g., the quadratic unconstrained binary optimization problem), and they seem well suited to train machine learning models. In this paper, we describe an adiabatic quantum approach for training support vector machines. We show that the time complexity of our quantum approach is an order of magnitude better than the classical approach. Next, we compare the test accuracy of our quantum approach against a classical approach that uses the Scikit-learn library in Python across five benchmark datasets (Iris, Wisconsin Breast Cancer (WBC), Wine, Digits, and Lambeq). We show that our quantum approach obtains accuracies on par with the classical approach. Finally, we perform a scalability study in which we compute the total training times of the quantum approach and the classical approach with increasing number of features and number of data points in the training dataset. Our scalability results show that the quantum approach obtains a 3.5--4.5 times speedup over the classical approach on datasets with many (millions of) features.


title: Quaternary codes and their binary images

abstract: Recently, simplicial complexes are used in constructions of several infinite families of minimal and optimal linear codes by Hyun {\em et al.} Building upon their research, in this paper more linear codes over the ring $\mathbb{Z}_4$ are constructed by simplicial complexes. Specifically, the Lee weight distributions of the resulting quaternary codes are determined and two infinite families of four-Lee-weight quaternary codes are obtained. Compared to the databases of $\mathbb Z_4$ codes by Aydin {\em et al.}, at least nine new quaternary codes are found. Thanks to the special structure of the defining sets, we have the ability to determine whether the Gray images of certain obtained quaternary codes are linear or not. This allows us to obtain two infinite families of binary nonlinear codes and one infinite family of binary minimal linear codes. Furthermore, utilizing these minimal binary codes, some secret sharing schemes as a byproduct also are established.


title: Radio emission from SN 1181 hosting a white dwarf merger product

abstract: The remnant of the historical supernova 1181 is claimed to be associated with a white dwarf merger remnant J005311. The supernova remnant (SNR) shock, and a termination shock expected to be formed by the intense wind of J005311, are potential sites for radio emission via synchrotron emission from shock-accelerated electrons. In this paper, we estimate the radio emission from these two shocks, and find the peak radio flux to be 0.1--10 mJy (at 0.01--1 GHz) in the outer SNR shock and 0.01--0.1 mJy (at 1--10 GHz) in the inner termination shock. We also search for radio emission from this source in the archival data of the Karl G. Jansky Very Large Array (VLA) Sky Survey at 3 GHz, NRAO VLA Sky Survey at 1.4 GHz and the Canadian Galactic Plane Survey at 408 MHz, resulting in no significant detection. While targeted observations with higher sensitivity are desired, we particularly encourage those at higher frequency and angular resolution to probe the inner termination shock and its evolution.


title: An Automated Real-Time Approach for Image Processing and Segmentation of Fluoroscopic Images and Videos Using a Single Deep Learning Network

abstract: Image segmentation in total knee arthroplasty is crucial for precise preoperative planning and accurate implant positioning, leading to improved surgical outcomes and patient satisfaction. The biggest challenges of image segmentation in total knee arthroplasty include accurately delineating complex anatomical structures, dealing with image artifacts and noise, and developing robust algorithms that can handle anatomical variations and pathologies commonly encountered in patients. The potential of using machine learning for image segmentation in total knee arthroplasty lies in its ability to improve segmentation accuracy, automate the process, and provide real-time assistance to surgeons, leading to enhanced surgical planning, implant placement, and patient outcomes. This paper proposes a methodology to use deep learning for robust and real-time total knee arthroplasty image segmentation. The deep learning model, trained on a large dataset, demonstrates outstanding performance in accurately segmenting both the implanted femur and tibia, achieving an impressive mean-Average-Precision (mAP) of 88.83 when compared to the ground truth while also achieving a real-time segmented speed of 20 frames per second (fps). We have introduced a novel methodology for segmenting implanted knee fluoroscopic or x-ray images that showcases remarkable levels of accuracy and speed, paving the way for various potential extended applications.


title: Unsupervised Learning Method for the Wave Equation Based on Finite Difference Residual Constraints Loss

abstract: The wave equation is an important physical partial differential equation, and in recent years, deep learning has shown promise in accelerating or replacing traditional numerical methods for solving it. However, existing deep learning methods suffer from high data acquisition costs, low training efficiency, and insufficient generalization capability for boundary conditions. To address these issues, this paper proposes an unsupervised learning method for the wave equation based on finite difference residual constraints. We construct a novel finite difference residual constraint based on structured grids and finite difference methods, as well as an unsupervised training strategy, enabling convolutional neural networks to train without data and predict the forward propagation process of waves. Experimental results show that finite difference residual constraints have advantages over physics-informed neural networks (PINNs) type physical information constraints, such as easier fitting, lower computational costs, and stronger source term generalization capability, making our method more efficient in training and potent in application.


title: A low-rank augmented Lagrangian method for large-scale semidefinite programming based on a hybrid convex-nonconvex approach

abstract: This paper introduces HALLaR, a new first-order method for solving large-scale semidefinite programs (SDPs) with bounded domain. HALLaR is an inexact augmented Lagrangian (AL) method where the AL subproblems are solved by a novel hybrid low-rank (HLR) method. The recipe behind HLR is based on two key ingredients: 1) an adaptive inexact proximal point method with inner acceleration; 2) Frank-Wolfe steps to escape from spurious local stationary points. In contrast to the low-rank method of Burer and Monteiro, HALLaR finds a near-optimal solution (with provable complexity bounds) of SDP instances satisfying strong duality. Computational results comparing HALLaR to state-of-the-art solvers on several large SDP instances arising from maximum stable set, phase retrieval, and matrix completion show that the former finds higher accurate solutions in substantially less CPU time than the latter ones. For example, in less than 20 minutes, HALLaR can solve a maximum stable set SDP instance with dimension pair $(n,m)\approx (10^6,10^7)$ within $10^{-5}$ relative precision.


title: Assessing and Understanding Creativity in Large Language Models

abstract: In the field of natural language processing, the rapid development of large language model (LLM) has attracted more and more attention. LLMs have shown a high level of creativity in various tasks, but the methods for assessing such creativity are inadequate. The assessment of LLM creativity needs to consider differences from humans, requiring multi-dimensional measurement while balancing accuracy and efficiency. This paper aims to establish an efficient framework for assessing the level of creativity in LLMs. By adapting the modified Torrance Tests of Creative Thinking, the research evaluates the creative performance of various LLMs across 7 tasks, emphasizing 4 criteria including Fluency, Flexibility, Originality, and Elaboration. In this context, we develop a comprehensive dataset of 700 questions for testing and an LLM-based evaluation method. In addition, this study presents a novel analysis of LLMs' responses to diverse prompts and role-play situations. We found that the creativity of LLMs primarily falls short in originality, while excelling in elaboration. Besides, the use of prompts and the role-play settings of the model significantly influence creativity. Additionally, the experimental results also indicate that collaboration among multiple LLMs can enhance originality. Notably, our findings reveal a consensus between human evaluations and LLMs regarding the personality traits that influence creativity. The findings underscore the significant impact of LLM design on creativity and bridges artificial intelligence and human creativity, offering insights into LLMs' creativity and potential applications.


title: Comparing Pre-trained Human Language Models: Is it Better with Human Context as Groups, Individual Traits, or Both?

abstract: Incorporating human context into language models is the next frontier for human-centered natural language processing. Currently, two pre-training methods exist: group-wise attributes (e.g., over-45-year-olds) or individual traits. Group attributes are coarse -- not all 45-year-olds write the same way -- while modeling individual traits allows for a more personalized representation, but requires more complex modeling and data. So far, it is unclear which pre-training approach benefits what tasks. We compare pre-training models with human context via 1) group attributes, 2) individual users, and 3) a combined approach on 5 user- and document-level tasks. We find that pre-training with both group and individual features significantly improves the two user-level regression tasks like age estimation and personality assessment. Pre-training on individual users significantly improves the three document-level classification tasks like stance and topic detection. It even does well for downstream tasks without historical user data. Our results suggest both approaches have specific use cases, opening new avenues for human-centered language modeling.


title: Semiclassical equivalence of two white dwarf models as ground states of the relativistic Hartree-Fock and Vlasov-Poisson energies

abstract: We are concerned with the semi-classical limit for ground states of the relativistic Hartree-Fock energies (HF) under a mass constraint, which are considered as the quantum mean-field model of white dwarfs \cite{LeLe}. In Jang and Seok \cite{JS}, fermionic ground states of the relativistic Vlasov-Poisson energy (VP) are constructed as a classical mean-field model of white dwarfs, and are shown to be equivalent to the classical Chandrasekhar model. In this paper, we prove that as the reduced Planck constant $\hbar$ goes to the zero, the $\hbar$-parameter family of the ground energies and states of (HF) converges to the fermionic ground energy and state of (VP) with the same mass constraint.


title: Apparently ultra-long period radio sources from self-lensed pulsar-black hole binaries

abstract: Pulsar-black hole (BH) close binary systems, which have not been found yet, are unique laboratories for testing theories of gravity and understanding the formation channels of gravitational-wave sources. We study the self-gravitational lensing effect in a pulsar-BH system on the pulsar's emission. Because this effect occurs once per orbital period for almost edge-on binaries, we find that it could generate apparently ultra-long period (minutes to hours) radio signals when the intrinsic pulsar signal is too weak to detect. Each of such lensed signals, or 'pulse', is composed of a number of amplified intrinsic pulsar pulses. We estimate that a radio telescope with a sensitivity of $10\,\rm mJy$ could detect $\sim$ a few systems that emit such signals in our galaxy. The model is applied to three recently found puzzling long-period radio sources: GLEAM-X J1627, PSR J0901-4046, and GPM J1839-10. To explain their observed signal durations and periods, the masses of their lensing components would be $\sim10^4\,\rm M_{\odot}$, $\sim4\,\rm M_{\odot}$ and $10^{3-6}\,\rm M_{\odot}$, respectively, with their binary coalescence times ranging from a few tens to thousands of years. However, the implied merger rates (as high as $\sim 10^{3-4}\,\rm Myr^{-1}$ per galaxy) and the large period decay rates ($>10^{-8}\,\rm s\,s^{-1}$) tend to disfavour this self-lensing scenario for these three sources. Finally, for a binary containing a millisecond pulsar and a stellar-mass BH, the Shapiro delay effect would cause a $\geq10\%$ variation of the profile width for the sub-pulses in such lensed signals.


title: Improving Zero-noise Extrapolation for Quantum-gate Error Mitigation using a Noise-aware Folding Method

abstract: Recent thousand-qubit processors represent a significant hardware advancement, but current limitations prevent effective quantum error correction (QEC), necessitating reliance on quantum error mitigation (QEM) to enhance result fidelity from quantum computers. Our paper introduces a noise-aware folding technique that enhances Zero-Noise Extrapolation (ZNE) by leveraging the noise characteristics of target quantum hardware to fold circuits more efficiently. Unlike traditional ZNE approaches assuming uniform error distribution, our method redistributes noise using calibration data based on hardware noise models. By employing a noise-adaptive compilation method combined with our proposed folding mechanism, we enhance the ZNE accuracy of quantum gate-based computing using superconducting quantum computers. This paper highlights the uniqueness of our method, summarizes noise accumulation, presents the scaling algorithm, and compares the reliability of our method with those of existing models using linear extrapolation model. Experimental results show that compared to existing folding methods, our approach achieved a 35% improvement on quantum computer simulators and a 31% improvement on real quantum computers, demonstrating the effectiveness of our proposed approach.


title: DexTouch: Learning to Seek and Manipulate Objects with Tactile Dexterity

abstract: The sense of touch is an essential ability for skillfully performing a variety of tasks, providing the capacity to search and manipulate objects without relying on visual information. Extensive research has been conducted over time to apply these human tactile abilities to robots. In this paper, we introduce a multi-finger robot system designed to search for and manipulate objects using the sense of touch without relying on visual information. Randomly located target objects are searched using tactile sensors, and the objects are manipulated for tasks that mimic daily-life. The objective of the study is to endow robots with human-like tactile capabilities. To achieve this, binary tactile sensors are implemented on one side of the robot hand to minimize the Sim2Real gap. Training the policy through reinforcement learning in simulation and transferring the trained policy to the real environment, we demonstrate that object search and manipulation using tactile sensors is possible even in an environment without vision information. In addition, an ablation study was conducted to analyze the effect of tactile information on manipulative tasks. Our project page is available at https://lee-kangwon.github.io/dextouch/


title: Building Minimal and Reusable Causal State Abstractions for Reinforcement Learning

abstract: Two desiderata of reinforcement learning (RL) algorithms are the ability to learn from relatively little experience and the ability to learn policies that generalize to a range of problem specifications. In factored state spaces, one approach towards achieving both goals is to learn state abstractions, which only keep the necessary variables for learning the tasks at hand. This paper introduces Causal Bisimulation Modeling (CBM), a method that learns the causal relationships in the dynamics and reward functions for each task to derive a minimal, task-specific abstraction. CBM leverages and improves implicit modeling to train a high-fidelity causal dynamics model that can be reused for all tasks in the same environment. Empirical validation on manipulation environments and Deepmind Control Suite reveals that CBM's learned implicit dynamics models identify the underlying causal relationships and state abstractions more accurately than explicit ones. Furthermore, the derived state abstractions allow a task learner to achieve near-oracle levels of sample efficiency and outperform baselines on all tasks.


title: Understanding Cellular Noise with Optical Perturbation and Deep Learning

abstract: Noise plays a crucial role in the regulation of cellular and organismal function and behavior. Exploring noise's impact is key to understanding fundamental biological processes, such as gene expression, signal transduction, and the mechanisms of development and evolution. Currently, a comprehensive method to quantify dynamical behavior of cellular noise within these biochemical systems is lacking. In this study, we introduce an optically-controlled perturbation system utilizing the light-sensitive Phytochrome B (PhyB) from \textit{Arabidopsis thaliana}, which enables precise noise modulation with high spatial-temporal resolution. Our system exhibits exceptional sensitivity to light, reacting consistently to pulsed light signals, distinguishing it from other photoreceptor-based promoter systems that respond to a single light wavelength. To characterize our system, we developed a stochastic model for phytochromes that accounts for photoactivation/deactivation, thermal reversion, and the dynamics of the light-activated gene promoter system. To precisely control our system, we determined the rate constants for this model using an omniscient deep neural network that can directly map rate constant combinations to time-dependent state joint distributions. By adjusting the activation rates through light intensity and degradation rates via N-terminal mutagenesis, we illustrate that out optical-controlled perturbation can effectively modulate molecular expression level as well as noise. Our results highlight the potential of employing an optically-controlled gene perturbation system as a noise-controlled stimulus source. This approach, when combined with the analytical capabilities of a sophisticated deep neural network, enables the accurate estimation of rate constants from observational data in a broad range of biochemical reaction networks.


title: On the Fundamental Tradeoff of Joint Communication and Quickest Change Detection

abstract: In this work, we take the initiative in studying the fundamental tradeoff between communication and quickest change detection (QCD) under an integrated sensing and communication setting. We formally establish a joint communication and sensing problem for quickest change detection. Then, by utilizing constant subblock-composition codes and a modified QuSum detection rule, which we call subblock QuSum (SQS), we provide an inner bound on the fundamental tradeoff between communication rate and change point detection delay in the asymptotic regime of vanishing false alarm rate. We further provide a partial converse that matches our inner bound for a certain class of codes. This implies that the SQS detection strategy is asymptotically optimal for our codes as the false alarm rate constraint vanishes. We also present some canonical examples of the tradeoff region for a binary channel, a scalar Gaussian channel, and a MIMO Gaussian channel.


title: Exploring quantum coherence, spin squeezing and entanglement in an extended spin-1/2 XX Chain

abstract: In this study, we explore the ground state phase diagram of the spin-1/2 XX chain model, which features $XZY-YZX$ type three-spin interactions (TSI). This model, while seemingly simple, reveals a rich tapestry of quantum behaviors. Our analysis relies on several key metrics. The '$l_1$-norm of coherence' helps us identify coherent states within the phase diagram, which represent states capable of superposition and interference. We employ the 'spin squeezing parameter' to pinpoint unique coherent states characterized by isotropic noise in all directions, making them invaluable for quantum metrology. Additionally, we utilize the 'entanglement entropy' to determine which of these coherent states exhibit entanglement, indicating states that cannot be fully described by local variables. Our research unveils diverse regions within the phase diagram, each characterized by coherent, squeezed, or entangled states, offering insights into the quantum phenomena underling these systems. We also study the critical scaling versus the system size for the mentioned quantities.


title: A parametrix method for elliptic surface PDEs

abstract: Elliptic problems along smooth surfaces embedded in three dimensions occur in thin-membrane mechanics, electromagnetics (harmonic vector fields), and computational geometry. In this work, we present a parametrix-based integral equation method applicable to several forms of variable coefficient surface elliptic problems. Via the use of an approximate Green's function, the surface PDEs are transformed into well-conditioned integral equations. We demonstrate high-order numerical examples of this method applied to problems on general surfaces using a variant of the fast multipole method based on smooth interpolation properties of the kernel. Lastly, we discuss extensions of the method to surfaces with boundaries.


title: Quantumness of electron transport in quantum dot devices through Leggett-Garg inequalities: A non-equilibrium Green's function approach

abstract: Although coherent manipulation of electronic states can be achieved in quantum dot (QD) devices by harnessing nanofabrication tools, it is often hard to fathom the extent to which these nanoelectronic devices can behave quantum mechanically. Witnessing their nonclassical nature would thus remain of paramount importance in the emerging world of quantum technologies, since the coherent dynamics of electronic states plays there a crucial role. Against this backdrop, we resort to the general framework of Leggett-Garg inequalities (LGI) as it allows for distinguishing the classical and quantum transport through nanostructures by way of various two-time correlation functions. Using the local charge detection at two different time, we investigate here theoretically whether any quantum violation of the original LGI exists with varying device configurations and parameters under both Markovian and non-Markovian dynamics. Two-time correlators within LGI are derived in terms of the non-equilibrium Green's functions (NEGFs) by exactly solving the quantum Langevin equations. The present study of non-Markovian dynamics of quantum systems interacting with reservoirs is significant for understanding the relaxation phenomenon in the ultrafast transient regime to especially mimic what happens to high-speed quantum devices. We can potentially capture the effect of finite reservoir correlation time by accounting for level broadening at the electrodes along with non-Markovian memory effects. Furthermore, the large bias restriction is no longer imposed in our calculations so that we can safely consider a finite bias between the electronic reservoirs. Our approach is likely to open up new possibilities of witnessing the quantumness for other quantum many-body systems as well that are driven out of the equilibrium.


title: Small Language Model Meets with Reinforced Vision Vocabulary

abstract: Playing Large Vision Language Models (LVLMs) in 2023 is trendy among the AI community. However, the relatively large number of parameters (more than 7B) of popular LVLMs makes it difficult to train and deploy on consumer GPUs, discouraging many researchers with limited resources. Imagine how cool it would be to experience all the features of current LVLMs on an old GTX1080ti (our only game card). Accordingly, we present Vary-toy in this report, a small-size Vary along with Qwen-1.8B as the base ``large'' language model. In Vary-toy, we introduce an improved vision vocabulary, allowing the model to not only possess all features of Vary but also gather more generality. Specifically, we replace negative samples of natural images with positive sample data driven by object detection in the procedure of generating vision vocabulary, more sufficiently utilizing the capacity of the vocabulary network and enabling it to efficiently encode visual information corresponding to natural objects. For experiments, Vary-toy can achieve 65.6% ANLS on DocVQA, 59.1% accuracy on ChartQA, 88.1% accuracy on RefCOCO, and 29% on MMVet. The code will be publicly available on the homepage.


title: Assessing Left Main Bifurcation Anatomy and Haemodynamics: A Potential Surrogate for Disease Risk in Suspected Coronary Artery Disease Without Stenosis?

abstract: Coronary anatomy governs local haemodynamics associated with atherosclerotic development, progression and ultimately adverse clinical outcomes. However, lack of large sample size studies and methods to link adverse haemodynamics to anatomical information has hindered meaningful insights to date. The Left Main coronary bifurcations of 127 patients with suspected coronary artery disease in the absence of significant stenosis were segmented from CTCA images before computing the local haemodynamics. We correlated 11 coronary anatomical characteristics with the normalised lumen area exposed to adverse haemodynamics linked with atherosclerotic processes. These include mean curvatures and diameters of branches, bifurcation and inflow angles, and Finet's ratio as the anatomical parameters, and low Time-Averaged Endothelial Shear Stress (lowTAESS<0.5Pa), high Oscillatory Shear Index (highOSI>0.1), and high Relative Residence Time (highRRT>4.17 1/Pa) for the haemodynamic consideration. We separately tested if the geometric measures and haemodynamics indicators differed between subgroups (sex, smokers, and those with hypertension). We then use a step-down multiple linear regression model to find the best model for predicting lowTAESS, highOSI and highRRT. Finet's Ratio (FR) significantly correlated to lowTAESS (p<0.001). Vessel diameters and curvature correlated to highOSI (both p<0.001). Finet's ratio, vessel diameters and daughter branch curvature independently correlated to RRT (all p<0.01). Our results indicate that specific anatomical vessel characteristics may be used as a surrogate of adverse haemodynamic environment associated with clinically adverse mechanisms of disease. This is especially powerful with the latest computing resources and may unlock clinical integration via standard imaging modalities as biomarkers without further computationally expensive simulations.


title: Topological magnons in a non-coplanar magnetic order on the triangular lattice

abstract: The bond-dependent Kitaev interaction $K$ is familiar in the effective spin model of transition metal compounds with octahedral ligands. In this work, we find a peculiar non-coplanar magnetic order can be formed with the help of $K$ and next-nearest neighbor Heisenberg coupling $J_2$ on the triangular lattice. It can be seen as a miniature version of skyrmion crystal, since it has nine spins and an integer topological number in a magnetic unit cell. The magnon excitations in such an order are studied by the linear spin-wave theory. Of note is that the change in the relative size of $J_2$ and $K$ produces topological magnon phase transitions although the topological number remains unchanged. We also calculated the experimentally observable thermal Hall conductivity, and found that the signs of thermal Hall conductivity will change with topological phase transitions or temperature changes in certain regions.


title: Virtualized Delta moves for virtual knots and links

abstract: We introduce a local deformation called the virtualized $\Delta$-move for virtual knots and links. We prove that the virtualized $\Delta$-move is an unknotting operation for virtual knots. Furthermore we give a necessary and sufficient condition for two virtual links to be related by a finite sequence of virtualized $\Delta$-moves.


title: Open-Set Facial Expression Recognition

abstract: Facial expression recognition (FER) models are typically trained on datasets with a fixed number of seven basic classes. However, recent research works point out that there are far more expressions than the basic ones. Thus, when these models are deployed in the real world, they may encounter unknown classes, such as compound expressions that cannot be classified into existing basic classes. To address this issue, we propose the open-set FER task for the first time. Though there are many existing open-set recognition methods, we argue that they do not work well for open-set FER because FER data are all human faces with very small inter-class distances, which makes the open-set samples very similar to close-set samples. In this paper, we are the first to transform the disadvantage of small inter-class distance into an advantage by proposing a new way for open-set FER. Specifically, we find that small inter-class distance allows for sparsely distributed pseudo labels of open-set samples, which can be viewed as symmetric noisy labels. Based on this novel observation, we convert the open-set FER to a noisy label detection problem. We further propose a novel method that incorporates attention map consistency and cycle training to detect the open-set samples. Extensive experiments on various FER datasets demonstrate that our method clearly outperforms state-of-the-art open-set recognition methods by large margins. Code is available at https://github.com/zyh-uaiaaaa.


title: On the Stochastic (Variance-Reduced) Proximal Gradient Method for Regularized Expected Reward Optimization

abstract: We consider a regularized expected reward optimization problem in the non-oblivious setting that covers many existing problems in reinforcement learning (RL). In order to solve such an optimization problem, we apply and analyze the classical stochastic proximal gradient method. In particular, the method has shown to admit an $O(\epsilon^{-4})$ sample complexity to an $\epsilon$-stationary point, under standard conditions. Since the variance of the classical stochastic gradient estimator is typically large which slows down the convergence, we also apply an efficient stochastic variance-reduce proximal gradient method with an importance sampling based ProbAbilistic Gradient Estimator (PAGE). To the best of our knowledge, the application of this method represents a novel approach in addressing the general regularized reward optimization problem. Our analysis shows that the sample complexity can be improved from $O(\epsilon^{-4})$ to $O(\epsilon^{-3})$ under additional conditions. Our results on the stochastic (variance-reduced) proximal gradient method match the sample complexity of their most competitive counterparts under similar settings in the RL literature.


title: Digital cloning of online social networks for language-sensitive agent-based modeling of misinformation spread

abstract: We develop a simulation framework for studying misinformation spread within online social networks that blends agent-based modeling and natural language processing techniques. While many other agent-based simulations exist in this space, questions over their fidelity and generalization to existing networks in part hinders their ability to provide actionable insights. To partially address these concerns, we create a 'digital clone' of a known misinformation sharing network by downloading social media histories for over ten thousand of its users. We parse these histories to both extract the structure of the network and model the nuanced ways in which information is shared and spread among its members. Unlike many other agent-based methods in this space, information sharing between users in our framework is sensitive to topic of discussion, user preferences, and online community dynamics. To evaluate the fidelity of our method, we seed our cloned network with a set of posts recorded in the base network and compare propagation dynamics between the two, observing reasonable agreement across the twin networks over a variety of metrics. Lastly, we explore how the cloned network may serve as a flexible, low-cost testbed for misinformation countermeasure evaluation and red teaming analysis. We hope the tools explored here augment existing efforts in the space and unlock new opportunities for misinformation countermeasure evaluation, a field that may become increasingly important to consider with the anticipated rise of misinformation campaigns fueled by generative artificial intelligence.


title: On Centrally Essential Rings

abstract: A ring $R$ with center $C$ is said to be centrally essential if the module $R_C$ is an essential extension of the module $C_C$. In this paper, we study properties of ideals of centrally essential rings, centrally essential quaternion algebras, and group rings of Hamiltonian groups.


title: Convolutional Initialization for Data-Efficient Vision Transformers

abstract: Training vision transformer networks on small datasets poses challenges. In contrast, convolutional neural networks (CNNs) can achieve state-of-the-art performance by leveraging their architectural inductive bias. In this paper, we investigate whether this inductive bias can be reinterpreted as an initialization bias within a vision transformer network. Our approach is motivated by the finding that random impulse filters can achieve almost comparable performance to learned filters in CNNs. We introduce a novel initialization strategy for transformer networks that can achieve comparable performance to CNNs on small datasets while preserving its architectural flexibility.


title: Mean field limits of a class of conservative systems with position-dependent transition rates

abstract: In this paper, we are concerned with a class of conservative systems including asymmetric exclusion processes and zero-range processes as examples, where some particles are initially placed on $N$ positions. A particle jumps from a position to another at a rate depending on coordinates of these two positions and numbers of particles on these two positions. We show that the hydrodynamic limit of our model is driven by a nonlinear function-valued ordinary differential equation which is consistent with a mean field analysis. Furthermore, in the case where numbers of particles on all positions are bounded by $\mathcal{K}<+\infty$, we show that the fluctuation of our model is driven by a generalized Ornstein-Uhlenbeck process. A crucial step in proofs of our main results is to show that numbers of particles on different positions are approximately independent by utilizing a graphical method.


title: Detecting and recognizing characters in Greek papyri with YOLOv8, DeiT and SimCLR

abstract: Purpose: The capacity to isolate and recognize individual characters from facsimile images of papyrus manuscripts yields rich opportunities for digital analysis. For this reason the `ICDAR 2023 Competition on Detection and Recognition of Greek Letters on Papyri' was held as part of the 17th International Conference on Document Analysis and Recognition. This paper discusses our submission to the competition. Methods: We used an ensemble of YOLOv8 models to detect and classify individual characters and employed two different approaches for refining the character predictions, including a transformer based DeiT approach and a ResNet-50 model trained on a large corpus of unlabelled data using SimCLR, a self-supervised learning method. Results: Our submission won the recognition challenge with a mAP of 42.2%, and was runner-up in the detection challenge with a mean average precision (mAP) of 51.4%. At the more relaxed intersection over union threshold of 0.5, we achieved the highest mean average precision and mean average recall results for both detection and classification. Conclusion: The results demonstrate the potential for these techniques for automated character recognition on historical manuscripts. We ran the prediction pipeline on more than 4,500 images from the Oxyrhynchus Papyri to illustrate the utility of our approach, and we release the results publicly in multiple formats.


title: Revisiting magnetic exchange interactions in transition metal doped Bi$_2$Se$_3$ using DFT+MFT

abstract: Topological insulators doped with magnetic impurities has become a promising candidate for Quantum Anomalous Hall Effect (QAHE) in the dilute doping limit. The crucial factor in realizing the QAHE in these systems is the spontaneous Ferromagnetic (FM) ordering between the doped magnetic atoms. Hence, understanding the magnetic exchange interaction between the magnetic atoms becomes essential. In this work, we use the Density functional theory (DFT) and Magnetic force theorem (MFT) to calculate the magnetic exchange interaction between magnetic impurities (V, Cr, Mn, Fe) in the host Bi2Se3. Through an orbital decomposition of the calculated exchange, we can identify the nature and origin of the exchange mechanism that depends on the type of magnetic atoms, doping concentration, host material etc. Our results show that Cr doping results in an insulating state, a prerequisite for the QAHE, that remains robust against doping concentration and local correlation. In this case, the short-ranged superexchange and long-ranged exchange via the p-orbitals of the host results in an FM order. For other doped systems (V, Mn and Fe doped), their electronic configuration and local octahedral environment open the possibility of finite carrier density at the Fermi energy. Depending on the type of this carrier (electron/hole) and their localized/delocalized nature, a short-ranged double exchange / long-ranged RKKY mechanism could occur between the magnetic atoms.


title: Isotropy indices of Pfister multiples in characteristic two

abstract: Let $F$ be a field of characteristic $2$, $\pi$ be an $n$-fold bilinear Pfister form over $F$ and $\varphi$ an arbitrary quadratic form over $F$. In this note, we investigate Witt index, defect, total isotropy index and higher isotropy indices of $\varphi$ and $\pi\otimes\varphi$ and prove relations among the indices of these two forms over certain field extensions.


title: Conservation Principles in AQUAL

abstract: We consider conservation of momentum in AQUAL, a field-theoretic extension to Modified Newtonian Dynamics (MOND). We show that while there is a sense in which momentum is conserved, it is only if momentum is attributed to the gravitational field, and thus Newton's third law fails as usually understood. We contrast this situation with that of Newtonian gravitation on a field theoretic formulation. We then briefly discuss the situation in TeVeS, a relativistic theory that has AQUAL as a classical limit.

categories: physics.hist-ph astro-ph.GA gr-qc physics.class-ph


title: DDMI: Domain-Agnostic Latent Diffusion Models for Synthesizing High-Quality Implicit Neural Representations

abstract: Recent studies have introduced a new class of generative models for synthesizing implicit neural representations (INRs) that capture arbitrary continuous signals in various domains. These models opened the door for domain-agnostic generative models, but they often fail to achieve high-quality generation. We observed that the existing methods generate the weights of neural networks to parameterize INRs and evaluate the network with fixed positional embeddings (PEs). Arguably, this architecture limits the expressive power of generative models and results in low-quality INR generation. To address this limitation, we propose Domain-agnostic Latent Diffusion Model for INRs (DDMI) that generates adaptive positional embeddings instead of neural networks' weights. Specifically, we develop a Discrete-to-continuous space Variational AutoEncoder (D2C-VAE), which seamlessly connects discrete data and the continuous signal functions in the shared latent space. Additionally, we introduce a novel conditioning mechanism for evaluating INRs with the hierarchically decomposed PEs to further enhance expressive power. Extensive experiments across four modalities, e.g., 2D images, 3D shapes, Neural Radiance Fields, and videos, with seven benchmark datasets, demonstrate the versatility of DDMI and its superior performance compared to the existing INR generative models.


title: Existence of three distinct scaling regimes in self-propelled rigid pitching airfoil

abstract: Oscillating foils in self-propelled mode are the simplest model for investigating oscillatory locomotion in cruising fishes. In this investigation, we explore the self-propulsion characterisitics of a NACA0015 section airfoil, with chord length $C$, subjected to sinusoidal pitching using a rotary apparatus. A power-spring-based crank-rocker mechanism actuates the airfoil. We examine the effect of pitching frequency ($f$), amplitude ($A$), and the pitching point location ($p$) on the self-propulsion speed, $U_s$. We present the results in terms of self-propulsion Reynolds number ($Re_s = U_sC/\nu$), reduced frequency ($k_s$), Strouhal number ($St$), and two non-dimensional speeds, $U^*_{BL}$ (body length per oscillation) and $U^*_{AL}$ (forward speed in terms of trailing edge excursion per oscillation). $U_s$ increases with frequency and amplitude, but a diminishing effect of amplitude was noted at larger amplitudes. Highest speeds were achieved when pitched closest to the leading edge, with $St$ in the range of $0.2 - 0.4$. Three distinct scaling regimes are identified, each characterized by a specific relationship between $Re_s$ and trailing-edge Reynolds number, $Re_{TE} = fAC/\nu$. When pitching at low-amplitude, close to leading-edge, $Re_s \sim (1-2p) Re_{TE}^{3/2}$ (power scaling). For higher amplitude pitching, $Re_s \sim Re_{TE} (1-2p)^{1/2} (A/C)^{-1/2}$ (separable scaling). When pitched close to the midpoint, the airfoil propels beyond a threshold $Re_{TE,0}$, and $Re_s$ increases linearly with $Re_{TE}$ (linear scaling). Notably, in separable and linear regimes, self-propulsion is independent of viscosity. These relations collectively offer a comprehensive framework for understanding the self-propulsion of rigid pitching airfoils across a wide range of parameters.


title: Universal relations for anisotropic interacting quark stars

abstract: Interacting quark stars, which are entirely composed of interacting quark matter including perturbative QCD corrections and color superconductivity, can meet constraints from various pulsar observations. In realistic scenarios, pressure anisotropies are expected in the star's interior. Recently, the stellar structural properties of anisotropic interacting quark stars have been investigated. In this study, we further explore the universal relations (URs) related to the moment of inertia $I$, tidal deformability $\Lambda$, compactness $C$, and the $f$-mode nonradial pulsation frequency for such stars. Our results reveal that these approximate URs generally hold, being insensitive to both the EOS variations as well as to the presence of anisotropy. Specifically, we find that more positive anisotropy tends to enhance the $I-\Lambda$ and $I-C$ URs, but weakens the $C-\Lambda$ UR. For all the URs involving $f$-mode frequency, we find that they are enhanced by the inclusion of anisotropy (whether positive or negative).


title: Key Information Retrieval to Classify the Unstructured Data Content of Preferential Trade Agreements

abstract: With the rapid proliferation of textual data, predicting long texts has emerged as a significant challenge in the domain of natural language processing. Traditional text prediction methods encounter substantial difficulties when grappling with long texts, primarily due to the presence of redundant and irrelevant information, which impedes the model's capacity to capture pivotal insights from the text. To address this issue, we introduce a novel approach to long-text classification and prediction. Initially, we employ embedding techniques to condense the long texts, aiming to diminish the redundancy therein. Subsequently,the Bidirectional Encoder Representations from Transformers (BERT) embedding method is utilized for text classification training. Experimental outcomes indicate that our method realizes considerable performance enhancements in classifying long texts of Preferential Trade Agreements. Furthermore, the condensation of text through embedding methods not only augments prediction accuracy but also substantially reduces computational complexity. Overall, this paper presents a strategy for long-text prediction, offering a valuable reference for researchers and engineers in the natural language processing sphere.


title: Exploring Virtual Reality through Ihde's Instrumental Realism

abstract: Based on Ihde's theory, this paper explores the relationship between virtual reality (VR) as an instrument and phenomenology. It reviews the "technological revolution" spurred by the development of VR technology and discusses how VR has been used to study subjective experience, explore perception and embodiment, enhance empathy and perspective, and investigate altered states of consciousness. The paper emphasizes the role of VR as an instrumental technology, particularly its ability to expand human perception and cognition. Reflecting on this in conjunction with the work of Husserl and Ihde, among others, it revisits the potential of VR to provide new avenues for scientific inquiry and experience and to transform our understanding of the world through VR.


title: BiTA: Bi-Directional Tuning for Lossless Acceleration in Large Language Models

abstract: Large language models (LLMs) commonly employ autoregressive generation during inference, leading to high memory bandwidth demand and consequently extended latency. To mitigate this inefficiency, we present Bi-directional Tuning for lossless Acceleration (BiTA), an innovative method expediting LLMs via streamlined semi-autoregressive generation and draft verification. Inspired by the concept of prompt tuning, we enhance LLMs with a parameter-efficient design called bi-directional tuning for the capability in semi-autoregressive generation. Employing efficient tree-based decoding, the models perform draft candidate generation and verification in parallel, ensuring outputs identical to their autoregressive counterparts under greedy sampling. BiTA serves as a lightweight plug-in module, seamlessly boosting the inference efficiency of existing LLMs without requiring additional assistance models or incurring significant extra memory costs. Applying the proposed BiTA, LLaMA-2-70B-Chat achieves a 2.7$\times$ speedup on the MT-Bench benchmark. Extensive experiments confirm our method surpasses state-of-the-art acceleration techniques.


title: On polynomial automorphisms of Nagata type

abstract: We define a family of polynomial ring homomorphisms generalising the Nagata automorphism, and relate the condition of non-vanishing of their Jacobian determinant with a certain linear partial differential equation. We also give a condition on that family to get wild automorphisms.