title: Stochastic ISTA/FISTA Adaptive Step Search Algorithms for Convex Composite Optimization

abstract: We develop and analyze stochastic variants of ISTA and a full backtracking FISTA algorithms [Beck and Teboulle, 2009, Scheinberg et al., 2014] for composite optimization without the assumption that stochastic gradient is an unbiased estimator. This work extends analysis of inexact fixed step ISTA/FISTA in [Schmidt et al., 2011] to the case of stochastic gradient estimates and adaptive step-size parameter chosen by backtracking. It also extends the framework for analyzing stochastic line-search method in [Cartis and Scheinberg, 2018] to the proximal gradient framework as well as to the accelerated first order methods.


title: Helioseismic Properties of Dynamo Waves in the Variation of Solar Differential Rotation

abstract: Solar differential rotation exhibits a prominent feature: its cyclic variations over the solar cycle, referred to as zonal flows or torsional oscillations, are observed throughout the convection zone. Given the challenge of measuring magnetic fields in subsurface layers, understanding deep torsional oscillations becomes pivotal in deciphering the underlying solar dynamo mechanism. In this study, we address the critical question of identifying specific signatures within helioseismic frequency-splitting data associated with the torsional oscillations. To achieve this, a comprehensive forward modeling approach is employed to simulate the helioseismic data for a dynamo model that, to some extent, reproduces solar-cycle variations of magnetic fields and flows. We provide a comprehensive derivation of the forward modeling process utilizing generalized spherical harmonics, as it involves intricate algebraic computations. All estimated frequency-splitting coefficients from the model display an 11-year periodicity. Using the simulated splitting coefficients and realistic noise, we show that it is possible to identify the dynamo wave signal present in the solar zonal flow from the tachocline to the solar surface. By analyzing observed data, we find similar dynamo wave patterns in the observational data from MDI, HMI, and GONG. This validates the earlier detection of dynamo waves and holds potential implications for the solar dynamo theory models.


title: MambaIR: A Simple Baseline for Image Restoration with State-Space Model

abstract: Recent years have seen significant advancements in image restoration, largely attributed to the development of modern deep neural networks, such as CNNs and Transformers. However, existing restoration backbones often face the dilemma between global receptive fields and efficient computation, hindering their application in practice. Recently, the Selective Structured State Space Model, especially the improved version Mamba, has shown great potential for long-range dependency modeling with linear complexity, which offers a way to resolve the above dilemma. However, the standard Mamba still faces certain challenges in low-level vision such as local pixel forgetting and channel redundancy. In this work, we introduce a simple but effective baseline, named MambaIR, which introduces both local enhancement and channel attention to improve the vanilla Mamba. In this way, our MambaIR takes advantage of the local pixel similarity and reduces the channel redundancy. Extensive experiments demonstrate the superiority of our method, for example, MambaIR outperforms SwinIR by up to 0.45dB on image SR, using similar computational cost but with a global receptive field. Code is available at \url{https://github.com/csguoh/MambaIR}.


title: Some Lower Bounds on the Reach of an Algebraic Variety

abstract: Separation bounds are a fundamental measure of the complexity of solving a zero-dimensional system as it measures how difficult it is to separate its zeroes. In the positive dimensional case, the notion of reach takes its place. In this paper, we provide bounds on the reach of a smooth algebraic variety in terms of several invariants of interest: the condition number, Smale's $\gamma$ and the bit-size. We also provide probabilistic bounds for random algebraic varieties under some general assumptions.


title: Multi-Constraint Safe RL with Objective Suppression for Safety-Critical Applications

abstract: Safe reinforcement learning tasks with multiple constraints are a challenging domain despite being very common in the real world. In safety-critical domains, properly handling the constraints becomes even more important. To address this challenge, we first describe the multi-constraint problem with a stronger Uniformly Constrained MDP (UCMDP) model; we then propose Objective Suppression, a novel method that adaptively suppresses the task reward maximizing objectives according to a safety critic, as a solution to the Lagrangian dual of a UCMDP. We benchmark Objective Suppression in two multi-constraint safety domains, including an autonomous driving domain where any incorrect behavior can lead to disastrous consequences. Empirically, we demonstrate that our proposed method, when combined with existing safe RL algorithms, can match the task reward achieved by our baselines with significantly fewer constraint violations.


title: Hybrid Physics-Based and Data-Driven Modeling of Vascular Bifurcation Pressure Differences

abstract: Reduced-order models (ROMs) allow for the simulation of blood flow in patient-specific vasculatures without the high computational cost and wait time associated with traditional computational fluid dynamics (CFD) models. Unfortunately, due to the simplifications made in their formulations, ROMs can suffer from significantly reduced accuracy. One common simplifying assumption is the continuity of static or total pressure over vascular junctions. In many cases, this assumption has been shown to introduce significant error. We propose a model to account for this pressure difference, with the ultimate goal of increasing the accuracy of cardiovascular ROMs. Our model successfully uses a structure common in existing ROMs in conjunction with machine-learning techniques to predict the pressure difference over a vascular bifurcation. We analyze the performance of our model on steady and transient flows, testing it on three bifurcation cohorts representing three different bifurcation geometric types. We also compare the efficacy of different machine-learning techniques and two different model modalities.


title: Diagonals of solutions of the Yang-Baxter equation

abstract: We study diagonal mappings in non-involutive set-theoretic solutions of the Yang-Baxter equation. We show that they are commuting bijections. We also give equational characterization of multipermutation solutions and extend results of Rump and Gateva-Ivanova about decomposability to non-involutive solutions. We show that each, not necessarily involutive, square-free multipermutation solution of arbitrary cardinality, is always decomposable.


title: Low-Frequency Black-Box Backdoor Attack via Evolutionary Algorithm

abstract: While convolutional neural networks (CNNs) have achieved success in computer vision tasks, it is vulnerable to backdoor attacks. Such attacks could mislead the victim model to make attacker-chosen prediction with a specific trigger pattern. Until now, the trigger injection of existing attacks is mainly limited to spatial domain. Recent works take advantage of perceptual properties of planting specific patterns in the frequency domain, which only reflect indistinguishable pixel-wise perturbations in pixel domain. However, in the black-box setup, the inaccessibility of training process often renders more complex trigger designs. Existing frequency attacks simply handcraft the magnitude of spectrum, introducing anomaly frequency disparities between clean and poisoned data and taking risks of being removed by image processing operations (such as lossy compression and filtering). In this paper, we propose a robust low-frequency black-box backdoor attack (LFBA), which minimally perturbs low-frequency components of frequency spectrum and maintains the perceptual similarity in spatial space simultaneously. The key insight of our attack restrict the search for the optimal trigger to low-frequency region that can achieve high attack effectiveness, robustness against image transformation defenses and stealthiness in dual space. We utilize simulated annealing (SA), a form of evolutionary algorithm, to optimize the properties of frequency trigger including the number of manipulated frequency bands and the perturbation of each frequency component, without relying on the knowledge from the victim classifier. Extensive experiments on real-world datasets verify the effectiveness and robustness of LFBA against image processing operations and the state-of-the-art backdoor defenses, as well as its inherent stealthiness in both spatial and frequency space, making it resilient against frequency inspection.


title: Exploring Failure Cases in Multimodal Reasoning About Physical Dynamics

abstract: In this paper, we present an exploration of LLMs' abilities to problem solve with physical reasoning in situated environments. We construct a simple simulated environment and demonstrate examples of where, in a zero-shot setting, both text and multimodal LLMs display atomic world knowledge about various objects but fail to compose this knowledge in correct solutions for an object manipulation and placement task. We also use BLIP, a vision-language model trained with more sophisticated cross-modal attention, to identify cases relevant to object physical properties that that model fails to ground. Finally, we present a procedure for discovering the relevant properties of objects in the environment and propose a method to distill this knowledge back into the LLM.


title: Contact Complexity in Customer Service

abstract: Customers who reach out for customer service support may face a range of issues that vary in complexity. Routing high-complexity contacts to junior agents can lead to multiple transfers or repeated contacts, while directing low-complexity contacts to senior agents can strain their capacity to assist customers who need professional help. To tackle this, a machine learning model that accurately predicts the complexity of customer issues is highly desirable. However, defining the complexity of a contact is a difficult task as it is a highly abstract concept. While consensus-based data annotation by experienced agents is a possible solution, it is time-consuming and costly. To overcome these challenges, we have developed a novel machine learning approach to define contact complexity. Instead of relying on human annotation, we trained an AI expert model to mimic the behavior of agents and evaluate each contact's complexity based on how the AI expert responds. If the AI expert is uncertain or lacks the skills to comprehend the contact transcript, it is considered a high-complexity contact. Our method has proven to be reliable, scalable, and cost-effective based on the collected data.


title: Learning Semilinear Neural Operators : A Unified Recursive Framework For Prediction And Data Assimilation

abstract: Recent advances in the theory of Neural Operators (NOs) have enabled fast and accurate computation of the solutions to complex systems described by partial differential equations (PDEs). Despite their great success, current NO-based solutions face important challenges when dealing with spatio-temporal PDEs over long time scales. Specifically, the current theory of NOs does not present a systematic framework to perform data assimilation and efficiently correct the evolution of PDE solutions over time based on sparsely sampled noisy measurements. In this paper, we propose a learning-based state-space approach to compute the solution operators to infinite-dimensional semilinear PDEs. Exploiting the structure of semilinear PDEs and the theory of nonlinear observers in function spaces, we develop a flexible recursive method that allows for both prediction and data assimilation by combining prediction and correction operations. The proposed framework is capable of producing fast and accurate predictions over long time horizons, dealing with irregularly sampled noisy measurements to correct the solution, and benefits from the decoupling between the spatial and temporal dynamics of this class of PDEs. We show through experiments on the Kuramoto-Sivashinsky, Navier-Stokes and Korteweg-de Vries equations that the proposed model is robust to noise and can leverage arbitrary amounts of measurements to correct its prediction over a long time horizon with little computational overhead.


title: A simple model of globally magnetized accretion discs

abstract: We present an analytic, quasi-local dynamo model for accretion discs threaded by net, vertical magnetic flux. In a simple slab geometry and ignoring stochastic mean-field dynamo effects, we calculate the large-scale field resulting from the balance between kinematic field amplification and turbulent resistive diffusion. The ability of the disc to accumulate magnetic flux is sensitive to a single parameter dependent on the ratio of the vertical resistive diffusion time to the Alfv\'en crossing time, and we show how the saturation levels of magnetorotational and other instabilities can govern disc structure and evolution. Under wide-ranging conditions, inflow is governed by large-scale magnetic stresses rather than internal viscous stress. We present models of such "magnetically boosted" discs and show that they lack a radiation pressure-dominated zone. Our model can account for "magnetically elevated" discs as well as instances of midplane outflow and field reversals with height that have been seen in some global simulations. Using the time-dependent features of our model, we find that the incorporation of dynamo effects into disc structure can lead to steady or episodic "magnetically arrested discs" (MADs) that maximize the concentration of magnetic flux in their central regions.


title: The influence of Structural Dynamics in Two-Dimensional Hybrid Organic-Inorganic Perovskites on their Photoluminescence Efficiency -- Neutron scattering analysis

abstract: Two-dimensional hybrid organic-inorganic perovskites (HOIPs) have emerged as promising materials for light-emitting diode applications. In this study, by using time-of-flight neutron spectroscopy we identified and quantitatively separated the lattice vibrational and molecular rotational dynamics of two perovskites, butylammonium lead iodide $(\text{BA})_{2}\text{PbI}_{4}$ and phenethyl-ammonium lead iodide $\text{(PEA)}_{2}\text{PbI}_{4}$. By examining the corresponding temperature dependence, we found that the lattice vibrations, as evidenced by neutron spectra, are consistent with the lattice dynamics obtained from Raman scattering. We revealed that the rotational dynamics of organic molecules in these materials tend to suppress their photoluminescence quantum yield while the vibrational dynamics did not show predominant correlations with their optoelectronic properties. This study proposes that the rotational motions of the polarized molecules could significantly interrupt the exciton binding energy potential, cause the exciton dissociations, enhance the non-radiative recombination rates, and hence reduce the photoluminescence yield. These findings provide a deeper understanding of the fundamental interactions in 2D HOIPs and may guide the design of more efficient light-emitting materials for advanced technological applications.


title: DeepLight: Reconstructing High-Resolution Observations of Nighttime Light With Multi-Modal Remote Sensing Data

abstract: Nighttime light (NTL) remote sensing observation serves as a unique proxy for quantitatively assessing progress toward meeting a series of Sustainable Development Goals (SDGs), such as poverty estimation, urban sustainable development, and carbon emission. However, existing NTL observations often suffer from pervasive degradation and inconsistency, limiting their utility for computing the indicators defined by the SDGs. In this study, we propose a novel approach to reconstruct high-resolution NTL images using multi-modal remote sensing data. To support this research endeavor, we introduce DeepLightMD, a comprehensive dataset comprising data from five heterogeneous sensors, offering fine spatial resolution and rich spectral information at a national scale. Additionally, we present DeepLightSR, a calibration-aware method for building bridges between spatially heterogeneous modality data in the multi-modality super-resolution. DeepLightSR integrates calibration-aware alignment, an auxiliary-to-main multi-modality fusion, and an auxiliary-embedded refinement to effectively address spatial heterogeneity, fuse diversely representative features, and enhance performance in $8\times$ super-resolution (SR) tasks. Extensive experiments demonstrate the superiority of DeepLightSR over 8 competing methods, as evidenced by improvements in PSNR (2.01 dB $ \sim $ 13.25 dB) and PIQE (0.49 $ \sim $ 9.32). Our findings underscore the practical significance of our proposed dataset and model in reconstructing high-resolution NTL data, supporting efficiently and quantitatively assessing the SDG progress.


title: Toric resolutions of strongly mixed weighted homogeneous polynomial germs of type $J_{10}^-$

abstract: We consider toric resolutions of some strongly mixed weighted homogeneous polynomials of type $J_{10}^-$. We show that the strongly mixed weighted homogeneous polynomial $f := f_{2,2,1,2,1,4}\ (k=3)$ (see \S 3) has no mixed critical points on ${\mathbb{C}^*}^2$ (Lemma 14), and moreover, show that the strict transform $\tilde V$ of the mixed hypersurface singularity $V := f^{-1}(0)$ via the toric modification $\hat{\pi} : X \to \mathbb{C}^2$, where we set $f := f_{2,2,1,2,1,4}\ (k=3)$, is not only a real analytic manifold outside of ${\tilde V} \cap \hat{\pi}^{-1}(\boldsymbol{0})$ but also a real analytic manifold as a germ of ${\tilde V} \cap \hat{\pi}^{-1}(\boldsymbol{0})$ (Theorem 15).


title: More on Property($M$) in separable Banach spaces

abstract: Property($M$) in separable Banach spaces has played an important role in metric fixed point theory. This paper explores some of the Banach space properties that can be associated with Property($M$) and Property($M^*$).


title: GiMeFive: Towards Interpretable Facial Emotion Classification

abstract: Deep convolutional neural networks have been shown to successfully recognize facial emotions for the past years in the realm of computer vision. However, the existing detection approaches are not always reliable or explainable, we here propose our model GiMeFive with interpretations, i.e., via layer activations and gradient-weighted class activation mapping. We compare against the state-of-the-art methods to classify the six facial emotions. Empirical results show that our model outperforms the previous methods in terms of accuracy on two Facial Emotion Recognition (FER) benchmarks and our aggregated FER GiMeFive. Furthermore, we explain our work in real-world image and video examples, as well as real-time live camera streams. Our code and supplementary material are available at https: //github.com/werywjw/SEP-CVDL.


title: Leveraging ChatGPT in Pharmacovigilance Event Extraction: An Empirical Study

abstract: With the advent of large language models (LLMs), there has been growing interest in exploring their potential for medical applications. This research aims to investigate the ability of LLMs, specifically ChatGPT, in the context of pharmacovigilance event extraction, of which the main goal is to identify and extract adverse events or potential therapeutic events from textual medical sources. We conduct extensive experiments to assess the performance of ChatGPT in the pharmacovigilance event extraction task, employing various prompts and demonstration selection strategies. The findings demonstrate that while ChatGPT demonstrates reasonable performance with appropriate demonstration selection strategies, it still falls short compared to fully fine-tuned small models. Additionally, we explore the potential of leveraging ChatGPT for data augmentation. However, our investigation reveals that the inclusion of synthesized data into fine-tuning may lead to a decrease in performance, possibly attributed to noise in the ChatGPT-generated labels. To mitigate this, we explore different filtering strategies and find that, with the proper approach, more stable performance can be achieved, although constant improvement remains elusive.


title: Ultrafast Superconducting Qubit Readout with the Quarton Coupler

abstract: Fast, high-fidelity, and quantum nondemolition (QND) qubit readout is an essential element of quantum information processing. For superconducting qubits, state-of-the-art readout is based on a dispersive cross-Kerr coupling between a qubit and its readout resonator. The resulting readout can be high-fidelity and QND, but readout times are currently limited to the order of 50 ns due to the dispersive cross-Kerr of magnitude 10 MHz. Here, we present a new readout scheme that uses the quarton coupler to facilitate a large (greater than 250 MHz) cross-Kerr between a transmon qubit and its readout resonator. Full master equation simulations show a 5 ns readout time with greater than 99% readout and QND fidelity. Unlike state-of-the-art dispersive readout, the proposed "quartonic readout" scheme relies on a transmon with linearized transitions as the readout resonator. Such operational points are found from a detailed theoretical treatment and parameter study of the coupled system. The quartonic readout circuit is also experimentally feasible and preserves the coherence properties of the qubit. Our work reveals a new path for order-of-magnitude improvements of superconducting qubit readout by engineering nonlinear light-matter couplings in parameter regimes unreachable by existing designs.


title: Teacher-Student Learning on Complexity in Intelligent Routing

abstract: Customer service is often the most time-consuming aspect for e-commerce websites, with each contact typically taking 10-15 minutes. Effectively routing customers to appropriate agents without transfers is therefore crucial for e-commerce success. To this end, we have developed a machine learning framework that predicts the complexity of customer contacts and routes them to appropriate agents accordingly. The framework consists of two parts. First, we train a teacher model to score the complexity of a contact based on the post-contact transcripts. Then, we use the teacher model as a data annotator to provide labels to train a student model that predicts the complexity based on pre-contact data only. Our experiments show that such a framework is successful and can significantly improve customer experience. We also propose a useful metric called complexity AUC that evaluates the effectiveness of customer service at a statistical level.


title: Universal Model in Online Customer Service

abstract: Building machine learning models can be a time-consuming process that often takes several months to implement in typical business scenarios. To ensure consistent model performance and account for variations in data distribution, regular retraining is necessary. This paper introduces a solution for improving online customer service in e-commerce by presenting a universal model for predict-ing labels based on customer questions, without requiring training. Our novel approach involves using machine learning techniques to tag customer questions in transcripts and create a repository of questions and corresponding labels. When a customer requests assistance, an information retrieval model searches the repository for similar questions, and statistical analysis is used to predict the corresponding label. By eliminating the need for individual model training and maintenance, our approach reduces both the model development cycle and costs. The repository only requires periodic updating to maintain accuracy.


title: Bass Numbers of the First Nonzero Local Cohomology Module

abstract: Let $R$ be a regular local ring containing a field, let $I$ be an ideal with $d=\text{ht}{I}$, and assume $\text{ht}{p}=d$ for every minimal prime $p$ of $I$. We compute the Bass numbers $\mu^{0}(q,H_{I}^{d}(R))$ and $\mu^{1}(q,H_{I}^{d}(R))$ for all primes $q$. We then study $\mu^{2}(q,H_{I}^{d}(R))$ by considering the associated primes of $H_{I}^{d+1}(R)$.


title: Pruned Pivot: Correlation Clustering Algorithm for Dynamic, Parallel, and Local Computation Models

abstract: Given a graph with positive and negative edge labels, the correlation clustering problem aims to cluster the nodes so to minimize the total number of between-cluster positive and within-cluster negative edges. This problem has many applications in data mining, particularly in unsupervised learning. Inspired by the prevalence of large graphs and constantly changing data in modern applications, we study correlation clustering in dynamic, parallel (MPC), and local computation (LCA) settings. We design an approach that improves state-of-the-art runtime complexities in all these settings. In particular, we provide the first fully dynamic algorithm that runs in an expected amortized constant time, without any dependence on the graph size. Moreover, our algorithm essentially matches the approximation guarantee of the celebrated Pivot algorithm.


title: Solution to an open problem on Laplacian ratio

abstract: Let G be a graph. The Laplacian ratio of G is the permanent of the Laplacian matrix of G divided by the product of degrees of all vertices. The computational complexity of Laplacian ratio is #P-complete. Brualdi and Goldwasser studied systematicly the properties of Laplacian ratios of graphs. And they proposed an open problem: what is the minimum value of the Laplacian ratios of trees with n vertices having diameter at least k ? In this paper, we give a solution to the problem.


title: A mathematical model for simultaneous personnel shift planning and unrelated parallel machine scheduling

abstract: This paper addresses a production scheduling problem derived from an industrial use case, focusing on unrelated parallel machine scheduling with the personnel availability constraint. The proposed model optimizes the production plan over a multi-period scheduling horizon, accommodating variations in personnel shift hours within each time period. It assumes shared personnel among machines, with one personnel required per machine for setup and supervision during job processing. Available personnel are fewer than the machines, thus limiting the number of machines that can operate in parallel. The model aims to minimize the total production time considering machine-dependent processing times and sequence-dependent setup times. The model handles practical scenarios like machine eligibility constraints and production time windows. A Mixed Integer Linear Programming (MILP) model is introduced to formulate the problem, taking into account both continuous and district variables. A two-step solution approach enhances computational speed, first maximizing accepted jobs and then minimizing production time. Validation with synthetic problem instances and a real industrial case study of a food processing plant demonstrates the performance of the model and its usefulness in personnel shift planning. The findings offer valuable insights for practical managerial decision-making in the context of production scheduling.


title: Towards a Participatory and Social Justice-Oriented Measure of Human-Robot Trust

abstract: Many measures of human-robot trust have proliferated across the HRI research literature because each attempts to capture the factors that impact trust despite its many dimensions. None of the previous trust measures, however, address the systems of inequity and structures of power present in HRI research or attempt to counteract the systematic biases and potential harms caused by HRI systems. This position paper proposes a participatory and social justice-oriented approach for the design and evaluation of a trust measure. This proposed process would iteratively co-design the trust measure with the community for whom the HRI system is being created. The process would prioritize that community's needs and unique circumstances to produce a trust measure that accurately reflects the factors that impact their trust in a robot.


title: Chaotic tides as a solution to the Hyperion problem

abstract: The dynamics of the outer regular satellites of Saturn are driven primarily by the outward migration of Titan, but several independent constraints on Titan's migration are difficult to reconcile with the current resonant orbit of the small satellite Hyperion. We argue that Hyperion's rapid irregular tumbling greatly increases tidal dissipation with a steep dependence on orbital eccentricity. Resonant excitation from a migrating Titan is then balanced by damping in a feedback mechanism that maintains Hyperion's eccentricity without fine-tuning. The inferred tidal parameters of Hyperion are most consistent with rapid Titan migration enabled by a resonance lock with an internal mode of Saturn, but a scenario with only equilibrium dissipation in Saturn is also possible.


title: Studying exotic hadrons in high energy nuclear collisions

abstract: Studies of exotic hadrons such as the $\chi_{cl}(3872)$ state provide crucial insights into the fundamental force governing the strong interaction dynamics, with an emerging new frontier to investigate their production in high energy nuclear collisions where a partonic medium is present. This contribution discusses the production mechanisms of exotic hadrons in such collisions and analyzes novel effects from the partonic medium, demonstrating the potential to use heavy ion measurements for deciphering their internal structure and understanding their in-medium evolutions.


title: Formally Verified C Code Generation from Hybrid Communicating Sequential Processes

abstract: Hybrid Communicating Sequential Processes (HCSP) is a formal model for hybrid systems, including primitives for evolution along an ordinary differential equation (ODE), communication, and parallel composition. Code generation is needed to convert HCSP models into code that can be executed in practice, and the correctness of this conversion is essential to ensure that the generated code accurately reflects the formal model. In this paper, we propose a code generation algorithm from HCSP to C with POSIX library for concurrency. The main difficulties include how to bridge the gap between the synchronized communication model in HCSP and the use of mutexes for synchronization in C, and how to discretize evolution along ODEs and support interrupt of ODE evolution by communication. To prove the correctness of code generation, we define a formal semantics for POSIX C, and build transition system models for both HCSP and C programs. We then define an approximate bisimulation relation between traces of transition systems, and show that under certain robustness conditions for HCSP, the generated C program is approximately bisimilar to the original model. Finally, we evaluate the code generation algorithm on a detailed model for automatic cruise control, showing its utility on real-world examples.


title: Einstein-Weyl geometry: A simple Weyl invariant equation for gravity

abstract: Elaborating on Einstein-Weyl geometries, we write a simple Weyl invariant equation for Gravity (with the metric and a vector field as geometrical data). The equation is linear in the curvature and a natural generalization of Einstein equations to Weyl geometry. The system has 5 physical polarizations, the graviton and a massive photon. An exact black hole solution is found. We study the dynamics on Friedman backgrounds and the evolution of cosmological perturbations. It is shown that cosmological vector modes do not decay in this theory.


title: On commutators of square-zero Hilbert space operators

abstract: Let $\mathcal{H}$ be a complex, separable Hilbert space, and set $\mathfrak{c}($NIL$_2)=\{ MN - NM : N, M \in \mathcal{B}(\mathcal{H}), M^2 = 0 = N^2 \}$. When $\dim\, \mathcal{H}$ is finite, we characterise the set $\mathfrak{c}($NIL$_2)$ and its norm-closure CLOS$(\mathfrak{c}($NIL$_2))$. In the infinite-dimensional setting, we characterise the intersection of CLOS$(\mathfrak{c}($NIL$_2))$ with the set of biquasitriangular operators, and we exhibit an index obstruction to belonging to CLOS$(\mathfrak{c}($NIL$_2))$.


title: Consensus seeking in diffusive multidimensional networks with a repeated interaction pattern and time-delays

abstract: This paper studies a consensus problem in multidimensional networks having the same agent-to-agent interaction pattern under both intra- and cross-layer time delays. Several conditions for the agents to globally asymptotically achieve a consensus are derived, which involve the overall network's structure, the local interacting pattern, and the values of the time delays. The validity of these conditions is proved by direct eigenvalue evaluation and supported by numerical simulations.


title: Minions: Accelerating Large Language Model Inference with Adaptive and Collective Speculative Decoding

abstract: Large language models (LLM) have recently attracted surging interest due to their outstanding capabilities across various domains. However, enabling efficient LLM inference is challenging due to its autoregressive decoding that generates tokens only one at a time. Although research works apply pruning or quantization to speed up LLM inference, they typically require fine-tuning the LLM, incurring significant time and economic costs. Meanwhile, speculative decoding has been proposed to use small speculative models (SSMs) to accelerate the inference of LLM. However, the low acceptance rate of SSM and the high verification cost of LLM prohibit further performance improvement of inference. In this paper, we propose Minions, an LLM inference system that accelerates LLM inference with a collective and adaptive speculative generation. Specifically, Minions proposes a majority-voted mechanism to leverage multiple SSMs to jointly speculate the outputs of LLM, which improves the inference performance without introducing prohibitive computation costs for LLM. To better trade off the number of tokens speculated from SSM and the verification cost of LLM, Minions proposes an adaptive mechanism to dynamically determine the optimal speculation length of SSM, which can achieve better inference performance across different models, datasets, and hyper-parameters. In addition, Minions decouples the SSM decoding and LLM verification efficiently and adopts a pipelined execution mechanism to further improve the inference performance of LLM. By comparing with the state-of-the-art LLM inference systems, we demonstrate that Minions can achieve higher inference throughput and lower inference time.


title: Scalable Density-based Clustering with Random Projections

abstract: We present sDBSCAN, a scalable density-based clustering algorithm in high dimensions with cosine distance. Utilizing the neighborhood-preserving property of random projections, sDBSCAN can quickly identify core points and their neighborhoods, the primary hurdle of density-based clustering. Theoretically, sDBSCAN outputs a clustering structure similar to DBSCAN under mild conditions with high probability. To further facilitate sDBSCAN, we present sOPTICS, a scalable OPTICS for interactive exploration of the intrinsic clustering structure. We also extend sDBSCAN and sOPTICS to L2, L1, $\chi^2$, and Jensen-Shannon distances via random kernel features. Empirically, sDBSCAN is significantly faster and provides higher accuracy than many other clustering algorithms on real-world million-point data sets. On these data sets, sDBSCAN and sOPTICS run in a few minutes, while the scikit-learn's counterparts demand several hours or cannot run due to memory constraints.


title: Overcoming Pitfalls in Graph Contrastive Learning Evaluation: Toward Comprehensive Benchmarks

abstract: The rise of self-supervised learning, which operates without the need for labeled data, has garnered significant interest within the graph learning community. This enthusiasm has led to the development of numerous Graph Contrastive Learning (GCL) techniques, all aiming to create a versatile graph encoder that leverages the wealth of unlabeled data for various downstream tasks. However, the current evaluation standards for GCL approaches are flawed due to the need for extensive hyper-parameter tuning during pre-training and the reliance on a single downstream task for assessment. These flaws can skew the evaluation away from the intended goals, potentially leading to misleading conclusions. In our paper, we thoroughly examine these shortcomings and offer fresh perspectives on how GCL methods are affected by hyper-parameter choices and the choice of downstream tasks for their evaluation. Additionally, we introduce an enhanced evaluation framework designed to more accurately gauge the effectiveness, consistency, and overall capability of GCL methods.


title: Study of Noncoherent Sparse Subarrays for Direction Finding Based on Low-Rank and Sparse Recovery

abstract: This paper investigates the problem of noncoherent direction-of-arrival (DOA) estimation using different sparse subarrays. In particular, we present a Multiple Measurements Vector (MMV) model for noncoherent DOA estimation based on a low-rank and sparse recovery optimization problem. Moreover, we develop two different practical strategies to obtain sparse arrays and subarrays: i) the subarrays are generated from a main sparse array geometry (Type-I sparse array), and ii) the sparse subarrays that are directly designed and grouped together to generate the whole sparse array (Type-II sparse array). Numerical results demonstrate that the proposed MMV model can benefit from multiple data records and that Type-II sparse noncoherent arrays are superior in performance for DOA estimation


title: MoEDAL search in the CMS beam pipe for magnetic monopoles produced via the Schwinger effect

abstract: We report on a search for magnetic monopoles (MMs) produced in ultraperipheral Pb--Pb collisions during Run-1 of the LHC. The beam pipe surrounding the interaction region of the CMS experiment was exposed to 174.29 $\mathrm{\mu}$b$^{-1}$ of Pb--Pb collisions at 2.76 TeV center-of-mass energy per collision in December 2011. It was scanned by the MoEDAL experiment using a SQUID magnetometer to search for trapped MMs. No MM signal was observed. The two distinctive features of this search are the use of a trapping volume very close to the collision point and ultra-high magnetic fields generated during the heavy-ion run that could produce MMs via the Schwinger effect. These two advantages allowed setting the first reliable, world-leading mass limits on MMs with high magnetic charge. In particular, the established limits are the strongest available in the range between 2 and 45 Dirac units, excluding MMs with masses of up to 80 GeV at 95% confidence level.


title: Exit Ripple Effects: Understanding the Disruption of Socialization Networks Following Employee Departures

abstract: Amidst growing uncertainty and frequent restructurings, the impacts of employee exits are becoming one of the central concerns for organizations. Using rich communication data from a large holding company, we examine the effects of employee departures on socialization networks among the remaining coworkers. Specifically, we investigate how network metrics change among people who historically interacted with departing employees. We find evidence of ``breakdown" in communication among the remaining coworkers, who tend to become less connected with fewer interactions after their coworkers' departure. This effect appears to be moderated by both external factors, such as periods of high organizational stress, and internal factors, such as the characteristics of the departing employee. At the external level, periods of high stress correspond to greater communication breakdown; at the internal level, however, we find patterns suggesting individuals may end up better positioned in their networks after a network neighbor's departure. Overall, our study provides critical insights into managing workforce changes and preserving communication dynamics in the face of employee exits.


title: Multiwavelength Catalog of 10,000 4XMM-DR13 Sources with Known Classifications

abstract: We present a collection of $\sim10,000$ X-ray sources from the 4th XMM-Newton Serendipitous Source Catalog (4XMM-DR13) with literature-verified classifications and multi-wavelength (MW) counterparts. We describe the process by which MW properties are obtained and an interactive online visualization tool we developed.


title: On formal non-commutative deformations of smooth varieties

abstract: We will develop a formal non-commutative (NC) deformation theory of smooth algebraic varieties $X$ defined over a field $k$, and describe a semi-universal deformation where the tangent space $T^1$ and the obstruction space $T^2$ are given as subspaces of Hochschild cohomology groups.


title: Lower bounds for quantum-inspired classical algorithms via communication complexity

abstract: Quantum-inspired classical algorithms provide us with a new way to understand the computational power of quantum computers for practically-relevant problems, especially in machine learning. In the past several years, numerous efficient algorithms for various tasks have been found, while an analysis of lower bounds is still missing. Using communication complexity, in this work we propose the first method to study lower bounds for these tasks. We mainly focus on lower bounds for solving linear regressions, supervised clustering, principal component analysis, recommendation systems, and Hamiltonian simulations. For those problems, we prove a quadratic lower bound in terms of the Frobenius norm of the underlying matrix. As quantum algorithms are linear in the Frobenius norm for those problems, our results mean that the quantum-classical separation is at least quadratic. As a generalisation, we extend our method to study lower bounds analysis of quantum query algorithms for matrix-related problems using quantum communication complexity. Some applications are given.


title: General Purpose Image Encoder DINOv2 for Medical Image Registration

abstract: Existing medical image registration algorithms rely on either dataset specific training or local texture-based features to align images. The former cannot be reliably implemented without large modality-specific training datasets, while the latter lacks global semantics thus could be easily trapped at local minima. In this paper, we present a training-free deformable image registration method, DINO-Reg, leveraging a general purpose image encoder DINOv2 for image feature extraction. The DINOv2 encoder was trained using the ImageNet data containing natural images. We used the pretrained DINOv2 without any finetuning. Our method feeds the DINOv2 encoded features into a discrete optimizer to find the optimal deformable registration field. We conducted a series of experiments to understand the behavior and role of such a general purpose image encoder in the application of image registration. Combined with handcrafted features, our method won the first place in the recent OncoReg Challenge. To our knowledge, this is the first application of general vision foundation models in medical image registration.


abstract: Anchor-based methods are a pivotal approach in handling clustering of large-scale data. However, these methods typically entail two distinct stages: selecting anchor points and constructing an anchor graph. This bifurcation, along with the initialization of anchor points, significantly influences the overall performance of the algorithm. To mitigate these issues, we introduce a novel method termed Anchor-free Clustering based on Anchor Graph Factorization (AFCAGF). AFCAGF innovates in learning the anchor graph, requiring only the computation of pairwise distances between samples. This process, achievable through straightforward optimization, circumvents the necessity for explicit selection of anchor points. More concretely, our approach enhances the Fuzzy k-means clustering algorithm (FKM), introducing a new manifold learning technique that obviates the need for initializing cluster centers. Additionally, we evolve the concept of the membership matrix between cluster centers and samples in FKM into an anchor graph encompassing multiple anchor points and samples. Employing Non-negative Matrix Factorization (NMF) on this anchor graph allows for the direct derivation of cluster labels, thereby eliminating the requirement for further post-processing steps. To solve the method proposed, we implement an alternating optimization algorithm that ensures convergence. Empirical evaluations on various real-world datasets underscore the superior efficacy of our algorithm compared to traditional approaches.


title: Revisiting Bohr Inequalities with Analytic and Harmonic Mappings on unit disk

abstract: In this paper, we study some improved and refined versions of the classical Bohr inequality applicable to the class $\mathcal{B}$, which consists of self-analytic mappings defined on the unit disk $\mathbb{D}$. First, we improve the Bohr inequality for the class $\mathcal{B}$ of analytic self-maps, incorporating the area measurements of sub-disks $\mathbb{D}_r$ of $\mathbb{D}$. Secondly, we establish a sharp inequality with suitable setting as an improved version of the classic Bohr inequality. Then we obtain a sharp refined Bohr inequality in which the coefficients $|a_k|$ $(k=0, 1, 2, 3)$ in the majorant series $M_f(r)$ of $f$ are replaced by $|f^{(k)}(z)|/k!$. Finally, for a certain class $\mathcal{P}^0_{\mathcal{H}}(M)$ of harmonic mappings of the form $f=h+\overline{g}$, we generalize the Bohr inequality incorporating a sequence $\{\varphi_n(r)\}_{n=0}^{\infty}$ of continuous functions of $r$ in $[0, 1)$ and give some applications.


title: Foot In The Door: Understanding Large Language Model Jailbreaking via Cognitive Psychology

abstract: Large Language Models (LLMs) have gradually become the gateway for people to acquire new knowledge. However, attackers can break the model's security protection ("jail") to access restricted information, which is called "jailbreaking." Previous studies have shown the weakness of current LLMs when confronted with such jailbreaking attacks. Nevertheless, comprehension of the intrinsic decision-making mechanism within the LLMs upon receipt of jailbreak prompts is noticeably lacking. Our research provides a psychological explanation of the jailbreak prompts. Drawing on cognitive consistency theory, we argue that the key to jailbreak is guiding the LLM to achieve cognitive coordination in an erroneous direction. Further, we propose an automatic black-box jailbreaking method based on the Foot-in-the-Door (FITD) technique. This method progressively induces the model to answer harmful questions via multi-step incremental prompts. We instantiated a prototype system to evaluate the jailbreaking effectiveness on 8 advanced LLMs, yielding an average success rate of 83.9%. This study builds a psychological perspective on the explanatory insights into the intrinsic decision-making logic of LLMs.


title: Orthogonal Gradient Boosting for Simpler Additive Rule Ensembles

abstract: Gradient boosting of prediction rules is an efficient approach to learn potentially interpretable yet accurate probabilistic models. However, actual interpretability requires to limit the number and size of the generated rules, and existing boosting variants are not designed for this purpose. Though corrective boosting refits all rule weights in each iteration to minimise prediction risk, the included rule conditions tend to be sub-optimal, because commonly used objective functions fail to anticipate this refitting. Here, we address this issue by a new objective function that measures the angle between the risk gradient vector and the projection of the condition output vector onto the orthogonal complement of the already selected conditions. This approach correctly approximate the ideal update of adding the risk gradient itself to the model and favours the inclusion of more general and thus shorter rules. As we demonstrate using a wide range of prediction tasks, this significantly improves the comprehensibility/accuracy trade-off of the fitted ensemble. Additionally, we show how objective values for related rule conditions can be computed incrementally to avoid any substantial computational overhead of the new method.


title: Designing for Human Operations on the Moon: Challenges and Opportunities of Navigational HUD Interfaces

abstract: Future crewed missions to the Moon will face significant environmental and operational challenges, posing risks to the safety and performance of astronauts navigating its inhospitable surface. Whilst head-up displays (HUDs) have proven effective in providing intuitive navigational support on Earth, the design of novel human-spaceflight solutions typically relies on costly and time-consuming analogue deployments, leaving the potential use of lunar HUDs largely under-explored. This paper explores an alternative approach by simulating navigational HUD concepts in a high-fidelity Virtual Reality (VR) representation of the lunar environment. In evaluating these concepts with astronauts and other aerospace experts (n=25), our mixed methods study demonstrates the efficacy of simulated analogues in facilitating rapid design assessments of early-stage HUD solutions. We illustrate this by elaborating key design challenges and guidelines for future lunar HUDs. In reflecting on the limitations of our approach, we propose directions for future design exploration of human-machine interfaces for the Moon.


title: Photolithography Control System : A Case Study For Cyber-Physical System

abstract: Photolithography control system (PCS) is an extremely complex distributed control system, which is composed of dozens of networked microprocessors, hundreds of actuators, hundreds of thousands of sensors, and millions of lines of code. Cyber-physical system (CPS), which deeply merges computation with physical processes together, copes with complex system from a higher level of abstraction. PCS is a representative CPS. This work points out that thinking under the framework of CPS, which includes holistic perspective, model-based design, hardware/software co-design and continuous integration, could solve the issues presented in the current PCS. Although the traditional embedded system approach and the CPS approach would be coexisting in the PCS for a long time, the CPS approach is definitely the future of the PCS development.


title: Touching the Moon: Leveraging Passive Haptics, Embodiment and Presence for Operational Assessments in Virtual Reality

abstract: Space agencies are in the process of drawing up carefully thought-out Concepts of Operations (ConOps) for future human missions on the Moon. These are typically assessed and validated through costly and logistically demanding analogue field studies. While interactive simulations in Virtual Reality (VR) offer a comparatively cost-effective alternative, they have faced criticism for lacking the fidelity of real-world deployments. This paper explores the applicability of passive haptic interfaces in bridging the gap between simulated and real-world ConOps assessments. Leveraging passive haptic props (equipment mockup and astronaut gloves), we virtually recreated the Apollo 12 mission procedure and assessed it with experienced astronauts and other space experts. Quantitative and qualitative findings indicate that haptics increased presence and embodiment, thus improving perceived simulation fidelity and validity of user reflections. We conclude by discussing the potential role of passive haptic modalities in facilitating early-stage ConOps assessments for human endeavours on the Moon and beyond.


title: Applied User Research in Virtual Reality: Tools, Methods, and Challenges

abstract: This chapter explores the practice of conducting user research studies and design assessments in virtual reality (VR). An overview of key VR hardware and software tools is provided, including game engines, such as Unity and Unreal Engine. Qualitative and quantitative research methods, along with their various synergies with VR, are likewise discussed, and some of the challenges associated with VR, such as limited sensory stimulation, are reflected upon. VR is proving particularly useful in the context of space systems development, where its utilisation offers a cost-effective and secure method for simulating extraterrestrial environments, allowing for rapid prototyping and evaluation of innovative concepts under representative operational conditions. To illustrate this, we present a case study detailing the application of VR to aid aerospace engineers testing their ideas with end-users and stakeholders during early design stages of the European Space Agency's (ESA) prospective Argonaut lunar lander. This case study demonstrates the effectiveness of VR simulations in gathering important feedback concerning the operability of the Argonaut lander in poor lighting conditions as well as surfacing relevant ergonomics considerations and constraints. The chapter concludes by discussing the strengths and weaknesses associated with VR-based user studies and proposes future research directions, emphasising the necessity for novel VR interfaces to overcome existing technical limitations.


title: Implications of self-identified race, ethnicity, and genetic ancestry on genetic association studies in biobanks within health systems

abstract: Precision medicine aims to create biomedical solutions tailored to specific factors that affect disease risk and treatment responses within the population. The success of the genomics era and recent widespread availability of electronic health records (EHR) has ushered in a new wave of genomic biobanks connected to EHR databases (EHR-linked biobanks). This perspective aims to discuss how race, ethnicity, and genetic ancestry are currently utilized to study common disease variation through genetic association studies. Although genetic ancestry plays a significant role in shaping the genetic landscape underlying disease risk in humans, the overall risk of a disease is caused by a complex combination of environmental, sociocultural, and genetic factors. When using EHR-linked biobanks to interrogate underlying disease etiology, it is also important to be aware of how the biases associated with commonly used descent-associated concepts such as race and ethnicity can propagate to downstream analyses. We intend for this resource to support researchers who perform or analyze genetic association studies in the EHR-linked biobank setting such as those involved in consortium-wide biobanking efforts. We provide background on how race, ethnicity, and genetic ancestry play a role in current association studies, highlight considerations where there is no consensus about best practices, and provide transparency about the current shortcomings.


title: Two universal pathways in demographic transition

abstract: Demographic transition, marked by declines in fertility and mortality, is a widespread phenomenon in modernization processes. By analyzing global data, it is illustrated that each country's change in crude birth rate $\lambda$ and life expectancy at birth $e_0$ follows one of two universal pathways conserving either $\lambda e_0$ or $\lambda \exp(e_0 /18)$. This signifies two fundamentally different phases, governed by distinct mechanisms. Phase I (and II), prevalent until the mid-20th century (more recent in occurrence), is characterized by a high (low) child mortality and steady growth of population (GDP per capita). Then, a simple model is proposed by considering the trade-off between reproduction and education. It demonstrates a transition between phases in which either the total population or total productivity is maximized, each conserving one of the above quantities. This work offers a novel theoretical lens to demography by extracting universal macroscopic laws from the data and elucidating background mechanisms.


title: Water-Ice Dominated Spectra of Saturn's Rings and Small Moons from JWST

abstract: JWST measured the infrared spectra of Saturn's rings and several of its small moons (Epimetheus, Pandora, Telesto and Pallene) as part of Guaranteed Time Observation program 1247. The NIRSpec instrument obtained near-infrared spectra of the small moons between 0.6 and 5.3 microns, which are all dominated by water-ice absorption bands. The shapes of the water-ice bands for these moons suggests that their surfaces contain variable mixes of crystalline and amorphous ice or variable amounts of contaminants and/or sub-micron ice grains. The near-infrared spectrum of Saturn's A ring has exceptionally high signal-to-noise between 2.7 and 5 microns and is dominated by features due to highly crystalline water ice. The ring spectrum also confirms that the rings possess a 2-3% deep absorption at 4.13 microns due to deuterated water-ice previously seen by the Visual and Infrared Mapping Spectrometer onboard the Cassini spacecraft. This spectrum also constrains the fundamental absorption bands of carbon dioxide and carbon monoxide and may contain evidence for a weak aliphatic hydrocarbon band. Meanwhile, the MIRI instrument obtained mid-infrared spectra of the rings between 4.9 and 27.9 microns, where the observed signal is a combination of reflected sunlight and thermal emission. This region shows a strong reflectance peak centered around 9.3 microns that can be attributed to crystalline water ice. Since both the near and mid-infrared spectra are dominated by highly crystalline water ice, they should provide a useful baseline for interpreting the spectra of other objects in the outer solar system with more complex compositions.


title: The qubit information logic theory for understanding multi-qubit entanglement and designing exotic entangled states

abstract: We develop a "qubit information logic" (QIL) theory that uses the "qubit information equation" (QIE) and logic to describe the correlation behaviors of multi-qubit entanglement. Introducing the "global information status" and "local information availability", the QIL gives an alternative and natural interpretation of the "spooky action" and the quantum no-communication theorem. Compared to the conventional entropy-based entanglement theories, the QIL directly describes the correlation of each possible pair of qubits and how the correlation changes when other qubits are measured. This makes the QIL more advantageous in describing the correlation properties of multi-qubit entanglement, which is illustrated by studying the dormant entanglement phenomenon. The QIL theory's usefulness is further demonstrated by designing an exotic quantum state where two qubits can be entangled but not correlated in any arbitrary basis. Overall the QIL provides an alternative and intuitive understanding of multi-qubit entanglement that is, compared to the conventional theories, directly focused on the correlation behaviors between qubits and thus more suitable for designing exotic quantum states that may be used in quantum algorithms.


title: CoRelation: Boosting Automatic ICD Coding Through Contextualized Code Relation Learning

abstract: Automatic International Classification of Diseases (ICD) coding plays a crucial role in the extraction of relevant information from clinical notes for proper recording and billing. One of the most important directions for boosting the performance of automatic ICD coding is modeling ICD code relations. However, current methods insufficiently model the intricate relationships among ICD codes and often overlook the importance of context in clinical notes. In this paper, we propose a novel approach, a contextualized and flexible framework, to enhance the learning of ICD code representations. Our approach, unlike existing methods, employs a dependent learning paradigm that considers the context of clinical notes in modeling all possible code relations. We evaluate our approach on six public ICD coding datasets and the experimental results demonstrate the effectiveness of our approach compared to state-of-the-art baselines.


title: Stabilizing remote entanglement via waveguide dissipation

abstract: Distributing entanglement between remote sites is integral to quantum networks. Here, we demonstrate the autonomous stabilization of remote entanglement between a pair of non-interacting superconducting qubits connected by an open waveguide on a chip. In this setting, the interplay between a classical continuous drive - supplied through the waveguide - and dissipation into the waveguide stabilizes the qubit pair in a dark state, which, asymptotically, takes the form of a Bell state. We use field-quadrature measurements of the photons emitted to the waveguide to perform quantum state tomography on the stabilized states, where we find a concurrence of $0.504^{+0.007}_{-0.029}$ in the optimal setting with a stabilization time constant of 56 $\pm$ 4 ns. We examine the imperfections within our system and discuss avenues for enhancing fidelities and achieving scalability in future work. The decoherence-protected, steady-state remote entanglement offered via dissipative stabilization may find applications in distributed quantum computing, sensing, and communication.


title: Edge states in super honeycomb structures with PT_]-symmetric deformations

abstract: The existence of edge states is one of the most vital properties of topological insulators. Although tremendous success has been accomplished in describing and explaining edge states associated with PT symmetry breaking, little work has been done on PT symmetry preserving cases. Two-dimensional Schroedinger operators with super honeycomb lattice potentials always have double Dirac cones at the Gamma point - the zero momentum point on their energy bands due to C6 symmetry, PT symmetry, and the "folding" symmetry - caused by an additional translation symmetry. There are two topologically different ways to deform such a system by PT symmetry preserving but folding symmetry breaking perturbations. Interestingly, there exist two gapped edge states on the interface between such two kinds of perturbed materials. In this paper, we illustrate the existence of such PT preserving edge states rigorously for the first time. We use a domain wall modulated Schroedinger operator to model the phenomenon under small perturbations and rigorously prove the existence of two gapped edge states. We also provide a brief interpretation from the point of view of "topology" by the parities of degenerate bulk modes. Our work thoroughly explains the existence of "helical" like edge states in super honeycomb configurations and lays a foundation for the descriptions of topologies of such systems.


title: Is Offline Decision Making Possible with Only Few Samples? Reliable Decisions in Data-Starved Bandits via Trust Region Enhancement

abstract: What can an agent learn in a stochastic Multi-Armed Bandit (MAB) problem from a dataset that contains just a single sample for each arm? Surprisingly, in this work, we demonstrate that even in such a data-starved setting it may still be possible to find a policy competitive with the optimal one. This paves the way to reliable decision-making in settings where critical decisions must be made by relying only on a handful of samples. Our analysis reveals that \emph{stochastic policies can be substantially better} than deterministic ones for offline decision-making. Focusing on offline multi-armed bandits, we design an algorithm called Trust Region of Uncertainty for Stochastic policy enhancemenT (TRUST) which is quite different from the predominant value-based lower confidence bound approach. Its design is enabled by localization laws, critical radii, and relative pessimism. We prove that its sample complexity is comparable to that of LCB on minimax problems while being substantially lower on problems with very few samples. Finally, we consider an application to offline reinforcement learning in the special case where the logging policies are known.


title: A Heterogeneous Dynamic Convolutional Neural Network for Image Super-resolution

abstract: Convolutional neural networks can automatically learn features via deep network architectures and given input samples. However, robustness of obtained models may have challenges in varying scenes. Bigger differences of a network architecture are beneficial to extract more complementary structural information to enhance robustness of an obtained super-resolution model. In this paper, we present a heterogeneous dynamic convolutional network in image super-resolution (HDSRNet). To capture more information, HDSRNet is implemented by a heterogeneous parallel network. The upper network can facilitate more contexture information via stacked heterogeneous blocks to improve effects of image super-resolution. Each heterogeneous block is composed of a combination of a dilated, dynamic, common convolutional layers, ReLU and residual learning operation. It can not only adaptively adjust parameters, according to different inputs, but also prevent long-term dependency problem. The lower network utilizes a symmetric architecture to enhance relations of different layers to mine more structural information, which is complementary with a upper network for image super-resolution. The relevant experimental results show that the proposed HDSRNet is effective to deal with image resolving. The code of HDSRNet can be obtained at https://github.com/hellloxiaotian/HDSRNet.


title: A Variational Approach for Modeling High-dimensional Spatial Generalized Linear Mixed Models

abstract: Gaussian and discrete non-Gaussian spatial datasets are prevalent across many fields such as public health, ecology, geosciences, and social sciences. Bayesian spatial generalized linear mixed models (SGLMMs) are a flexible class of models designed for these data, but SGLMMs do not scale well, even to moderately large datasets. State-of-the-art scalable SGLMMs (i.e., basis representations or sparse covariance/precision matrices) require posterior sampling via Markov chain Monte Carlo (MCMC), which can be prohibitive for large datasets. While variational Bayes (VB) have been extended to SGLMMs, their focus has primarily been on smaller spatial datasets. In this study, we propose two computationally efficient VB approaches for modeling moderate-sized and massive (millions of locations) Gaussian and discrete non-Gaussian spatial data. Our scalable VB method embeds semi-parametric approximations for the latent spatial random processes and parallel computing offered by modern high-performance computing systems. Our approaches deliver nearly identical inferential and predictive performance compared to 'gold standard' methods but achieve computational speedups of up to 1000x. We demonstrate our approaches through a comparative numerical study as well as applications to two real-world datasets. Our proposed VB methodology enables practitioners to model millions of non-Gaussian spatial observations using a standard laptop within a short timeframe.


title: Effects of Non-local Pseudopotentials on the Electrical and Thermal Transport Properties of Aluminum: A Density Functional Theory Study

abstract: Accurate prediction of electron transport coefficients is crucial for understanding warm dense matter. Utilizing the density functional theory (DFT) with the Kubo-Greenwood formula is widely used to evaluate the electrical and thermal conductivities of electrons. By adding the non-local potential correction term that appears in the dynamic Onsager coefficient and using two different norm-conserving pseudopotentials, we predict the electrical and thermal conductivities of electrons for liquid Al (1000 K) and warm dense Al (0.2 to 10 eV). We systematically investigate the effects of non-local terms in the pseudopotentials and the frozen-core approximation on the conductivities. We find that taking into account the non-local potential correction and validating the frozen core approximation is essential for accurately calculating the electrical and thermal transport properties of electrons across a wide range of temperatures.


title: A Quick Guide to Quantum Communication

abstract: This article provides a quick overview of quantum communication, bringing together several innovative aspects of quantum enabled transmission. We first take a neutral look at the role of quantum communication, presenting its importance for the forthcoming wireless. Then, we summarise the principles and basic mechanisms involved in quantum communication, including quantum entanglement, quantum superposition, and quantum teleportation. Further, we highlight its groundbreaking features, opportunities, challenges and future prospects.


title: Query Augmentation by Decoding Semantics from Brain Signals

abstract: Query augmentation is a crucial technique for refining semantically imprecise queries. Traditionally, query augmentation relies on extracting information from initially retrieved, potentially relevant documents. If the quality of the initially retrieved documents is low, then the effectiveness of query augmentation would be limited as well. We propose Brain-Aug, which enhances a query by incorporating semantic information decoded from brain signals. BrainAug generates the continuation of the original query with a prompt constructed with brain signal information and a ranking-oriented inference approach. Experimental results on fMRI (functional magnetic resonance imaging) datasets show that Brain-Aug produces semantically more accurate queries, leading to improved document ranking performance. Such improvement brought by brain signals is particularly notable for ambiguous queries.


title: Model theoretic events

abstract: How do we randomly sample an infinite sequence from a first order structure? What properties might hold on almost all random sequences? Which kinds of probabilistic processes can be meaningfully applied and studied in the model theory context? This paper takes these questions seriously and advances a plausible framework to engage with probabilistic phenomena. The central object of this paper is a probability space. The underlying set of our space is a standard model theoretic object, i.e. the space of types in countably many variables over a monster model. Our probability measure is the iterated Morley product of a fixed Borel-definable Keisler measure. Choosing a point randomly in this space with respect to our distribution yields a "random generic type" in countably many variables. We are interested in which events hold for almost all random generic types. We consider two different flavors of model theoretic events: (1) When is the induced structure on almost all random generic types isomorphic to a fixed structure? (2) For a fixed formula which is unstable, IP, sOP, etc., what is the probability that a random generic type witnesses this dividing line? For (1), we show that if our measure satisfies a particular extension axiom, then there exists a structure $N$ such that the induced structure on almost all random generic types is isomorphic to $N$. The proof echos a celebrated result of Glebskii et al. and Fagin concerning the existence of almost sure theories. We also provide examples where no such model exists. For (2), we show that if our initial distribution is fim, then almost no random generic types witness instability, IP, or sOP. In the local NIP context, we use results from combinatorics to prove that for any Borel-definable measure, the "average value of witnessing k-instability" across all permutations converges to 0. Some examples are provided.


title: A Statistical Analysis of Wasserstein Autoencoders for Intrinsically Low-dimensional Data

abstract: Variational Autoencoders (VAEs) have gained significant popularity among researchers as a powerful tool for understanding unknown distributions based on limited samples. This popularity stems partly from their impressive performance and partly from their ability to provide meaningful feature representations in the latent space. Wasserstein Autoencoders (WAEs), a variant of VAEs, aim to not only improve model efficiency but also interpretability. However, there has been limited focus on analyzing their statistical guarantees. The matter is further complicated by the fact that the data distributions to which WAEs are applied - such as natural images - are often presumed to possess an underlying low-dimensional structure within a high-dimensional feature space, which current theory does not adequately account for, rendering known bounds inefficient. To bridge the gap between the theory and practice of WAEs, in this paper, we show that WAEs can learn the data distributions when the network architectures are properly chosen. We show that the convergence rates of the expected excess risk in the number of samples for WAEs are independent of the high feature dimension, instead relying only on the intrinsic dimension of the data distribution.


title: Flows of Local Sheet Dwarfs in Relation to the Council of Giants

abstract: The kinematics of isolated dwarf galaxies in the Local Sheet have been studied to ascertain how the Council of Giants has affected flows. Peculiar velocities parallel to the Sheet in the frame of reference of the Council ascend steeply from negative to positive values on the near side of the Council at a heliocentric radius of $2.4 \pm 0.2$ Mpc. They descend to preponderantly negative values at a radius of $3.9^{+0.4}_{-0.5}$ Mpc, which is near the middle of the Council realm. Such behaviour is evidence for a flow field set up by the combined gravitational effects of the Local Group and Council, the ascending node being where their gravitational forces balance. Receding dwarfs on the near side of the Council are predominantly located in the direction of M94, although this may be a manifestation of the limitations of sampling. If M94 were entirely responsible for the placement of the ascending node, then the galaxy's total mass relative to the Local Group would have to be $0.8^{+0.4}_{-0.3}$, the same as indicated by the orbits of satellite galaxies. Rather, if the placement of the ascending node were set by matter distributed evenly in azimuth at the Council's radius, then the required total mass relative to the Local Group would have to be $4^{+3}_{-2}$, which is 30% to 40% lower than implied by satellite motions but still consistent within errors. The mere existence of the ascending node confirms that the Council of Giants limits the gravitational reach of the Local Group.


title: Cosmological imprints in the filament with DisPerSE

abstract: In the regime of cosmology and large-scale structure formation, filaments are vital components of the cosmic web. This study employs statistical methods to examine the formation, evolution, and cosmological constraints of filaments identified by DisPerSe. We run large-sample of N-body simulations to study the filament length and mass functions and their evolution. In general, the filament length function can be fitted by a power law with both the normalization and power index dependent on redshift and cosmological parameters. It is discovered that filament properties are influenced by various cosmological parameters, with $\sigma_8$ and $n_s$ exhibiting slightly stronger dependence than $\Omega_m$. We also uncover a three-stage filament formation process from $z \sim 3$ to $z \sim 1$: rapid formation of long and short filaments from $z \sim 3$ to $z \sim 2$, persistence of long filaments from $z \sim 2$ to $z \sim 1$, followed by fragmentation and increased prevalence of shorter filaments below $z \sim 1$. Additionally, both large and small-scale perturbations in power spectrum influence filament growth, with a characteristic scale around $k \sim 0.265$, wherein changes in matter fluctuations larger than this scale result in the formation of long filaments, while changes smaller than this scale have the opposite effect. These insights enhance our understanding of filament evolution and their cosmological relevance and also highlight their potential cosmological applications in observations.


title: Making Pre-trained Language Models Better Continual Few-Shot Relation Extractors

abstract: Continual Few-shot Relation Extraction (CFRE) is a practical problem that requires the model to continuously learn novel relations while avoiding forgetting old ones with few labeled training data. The primary challenges are catastrophic forgetting and overfitting. This paper harnesses prompt learning to explore the implicit capabilities of pre-trained language models to address the above two challenges, thereby making language models better continual few-shot relation extractors. Specifically, we propose a Contrastive Prompt Learning framework, which designs prompt representation to acquire more generalized knowledge that can be easily adapted to old and new categories, and margin-based contrastive learning to focus more on hard samples, therefore alleviating catastrophic forgetting and overfitting issues. To further remedy overfitting in low-resource scenarios, we introduce an effective memory augmentation strategy that employs well-crafted prompts to guide ChatGPT in generating diverse samples. Extensive experiments demonstrate that our method outperforms state-of-the-art methods by a large margin and significantly mitigates catastrophic forgetting and overfitting in low-resource scenarios.


title: Mapping fiber, loop and suspension graphs in naive discrete homotopy theory

abstract: Discrete homotopy theory or A-homotopy theory is a combinatorial homotopy theory defined on graphs, simplicial complexes and metric spaces, reflecting information about their connectivity. The purpose of the present paper is to further understanding of the similarities between the A-homotopy and ordinary homotopy theories. More precisely, we define the notion of a mapping fiber in the category of graphs and study its basic properties, providing non-compatibility with projection.


title: Operator Learning: Algorithms and Analysis

abstract: Operator learning refers to the application of ideas from machine learning to approximate (typically nonlinear) operators mapping between Banach spaces of functions. Such operators often arise from physical models expressed in terms of partial differential equations (PDEs). In this context, such approximate operators hold great potential as efficient surrogate models to complement traditional numerical methods in many-query tasks. Being data-driven, they also enable model discovery when a mathematical description in terms of a PDE is not available. This review focuses primarily on neural operators, built on the success of deep neural networks in the approximation of functions defined on finite dimensional Euclidean spaces. Empirically, neural operators have shown success in a variety of applications, but our theoretical understanding remains incomplete. This review article summarizes recent progress and the current state of our theoretical understanding of neural operators, focusing on an approximation theoretic point of view.


title: Instantons and Khovanov homology in $\mathbb{RP}^3$

abstract: We study the instanton Floer homology for links in $\mathbb{RP}^3$ and compute the second page of Kronheimer--Mrowka's spectral sequence. As an application, we show that Khovanov homology detects the unknot and the projective unknot in $\mathbb{RP}^3$.


title: New combinatorial formulae for nested Bethe vectors II

abstract: We give new combinatorial formulae for vector-valued weight functions (off-shell nested Bethe vectors) for the evaluation modules over the Yangian Y(gl_n). This paper extends the result for the Yangian Y(gl_4) established earlier in arXiv:2312.00980.


title: A Duality Analysis of Kernel Ridge Regression in the Noiseless Regime

abstract: In this paper, we conduct a comprehensive analysis of generalization properties of Kernel Ridge Regression (KRR) in the noiseless regime, a scenario crucial to scientific computing, where data are often generated via computer simulations. We prove that KRR can attain the minimax optimal rate, which depends on both the eigenvalue decay of the associated kernel and the relative smoothness of target functions. Particularly, when the eigenvalue decays exponentially fast, KRR achieves the spectral accuracy, i.e., a convergence rate faster than any polynomial. Moreover, the numerical experiments well corroborate our theoretical findings. Our proof leverages a novel extension of the duality framework introduced by Chen et al. (2023), which could be useful in analyzing kernel-based methods beyond the scope of this work.


title: "It Is Hard to Remove from My Eye": Design Makeup Residue Visualization System for Chinese Traditional Opera (Xiqu) Performers

abstract: Chinese traditional opera (Xiqu) performers often experience skin problems due to the long-term use of heavy-metal-laden face paints. To explore the current skincare challenges encountered by Xiqu performers, we conducted an online survey (N=136) and semi-structured interviews (N=15) as a formative study. We found that incomplete makeup removal is the leading cause of human-induced skin problems, especially the difficulty in removing eye makeup. Therefore, we proposed EyeVis, a prototype that can visualize the residual eye makeup and record the time make-up was worn by Xiqu performers. We conducted a 7-day deployment study (N=12) to evaluate EyeVis. Results indicate that EyeVis helps to increase Xiqu performers' awareness about removing makeup, as well as boosting their confidence and security in skincare. Overall, this work also provides implications for studying the work of people who wear makeup on a daily basis, and helps to promote and preserve the intangible cultural heritage of practitioners.


title: Relativistic and nonrelativistic Landau levels for the noncommutative quantum Hall effect with anomalous magnetic moment in a conical G\"odel-type spacetime

abstract: In this paper, we analyze the relativistic and nonrelativistic energy spectra (fermionic Landau levels) for the noncommutative quantum Hall effect with anomalous magnetic moment in the conical G\"odel-type spacetime in (2+1)-dimensions, where such spacetime is the combination of the flat G\"odel-type spacetime with a cosmic string (conical gravitational topological defect). To analyze these energy spectra, we start from the noncommutative Dirac equation with minimal and nonminimal couplings in polar coordinates. Using the tetrads formalism, we obtain a second-order differential equation. Next, we solve exactly this differential equation, where we obtain a generalized Laguerre equation, and also a quadratic polynomial equation for the total relativistic energy. By solving this polynomial equation, we obtain the relativistic energy spectrum of the fermion and antifermion. Besides, we also analyze the nonrelativistic limit of the system, where we obtain the nonrelativistic energy spectrum. In both cases (relativistic and nonrelativistic), we discuss in detail the characteristics of each spectrum as well as the influence of all parameters and physical quantities in such spectra. Comparing our problem with other works, we verified that our results generalize several particular cases in the literature.


title: Hal-Eval: A Universal and Fine-grained Hallucination Evaluation Framework for Large Vision Language Models

abstract: Large Vision Language Models exhibit remarkable capabilities but struggle with hallucinations inconsistencies between images and their descriptions. Previous hallucination evaluation studies on LVLMs have identified hallucinations in terms of objects, attributes, and relations but overlooked complex hallucinations that create an entire narrative around a fictional entity. In this paper, we introduce a refined taxonomy of hallucinations, featuring a new category: Event Hallucination. We then utilize advanced LLMs to generate and filter fine grained hallucinatory data consisting of various types of hallucinations, with a particular focus on event hallucinations, laying the groundwork for integrating discriminative and generative evaluation methods within our universal evaluation framework. The proposed benchmark distinctively assesses LVLMs ability to tackle a broad spectrum of hallucinations, making it a reliable and comprehensive tool for gauging LVLMs efficacy in handling hallucinations. We will release our code and data.


title: Enhancement of spin-orbit interaction and nearly perfect spin-conversion by 1D photonic crystal with the anisotropic defect layer

abstract: Although photon spin-orbit interaction (SOI) has been extensively studied, the vortex-conversion efficiency and the enhancement of spin Hall effect in abnormal modes in SOI remain to be investigated. Using an one-dimensional (1D) photonic crystal (PhC) system with the anisotropic defect layer(ADL), we firstly find that the generation efficiency of the vortex beam is close to 50\% when the number of periodic layers of the PhC reaches 5. Secondly, We also discussed the case where linearly polarized light is obliquely incident on a defect state system, and find that the destructive interference between the normal mode and the abnormal mode reaches the maximum, resulting in the enhancement of the spin hall displacement, and the effect can be enhanced at any angle of incidence in this system. Finally, we found that in the defect mode, the mutual conversion of normal and abnormal mode spins can be regulated, and the conversion efficiency can be close to 100\%.


title: FetchAid: Making Parcel Lockers More Accessible to Blind and Low Vision People With Deep-learning Enhanced Touchscreen Guidance, Error-Recovery Mechanism, and AR-based Search Support

abstract: Parcel lockers have become an increasingly prevalent last-mile delivery method. Yet, a recent study revealed its accessibility challenges to blind and low-vision people (BLV). Informed by the study, we designed FetchAid, a standalone intelligent mobile app assisting BLV in using a parcel locker in real-time by integrating computer vision and augmented reality (AR) technologies. FetchAid first uses a deep network to detect the user's fingertip and relevant buttons on the touch screen of the parcel locker to guide the user to reveal and scan the QR code to open the target compartment door and then guide the user to reach the door safely with AR-based context-aware audio feedback. Moreover, FetchAid provides an error-recovery mechanism and real-time feedback to keep the user on track. We show that FetchAid substantially improved task accomplishment and efficiency, and reduced frustration and overall effort in a study with 12 BLV participants, regardless of their vision conditions and previous experience.


title: Offline Learning of Decision Functions in Multiplayer Games with Expectation Constraints

abstract: We explore a class of stochastic multiplayer games where each player in the game aims to optimize its objective under uncertainty and adheres to some expectation constraints. The study employs an offline learning paradigm, leveraging a pre-existing dataset containing auxiliary features. While prior research in deterministic and stochastic multiplayer games primarily explored vector-valued decisions, this work departs by considering function-valued decisions that incorporate auxiliary features as input. We leverage the law of large deviations and degree theory to establish the almost sure convergence of the offline learning solution to the true solution as the number of data samples increases. Finally, we demonstrate the validity of our method via a multi-account portfolio optimization problem.


title: Text-guided HuBERT: Self-Supervised Speech Pre-training via Generative Adversarial Networks

abstract: Human language can be expressed in either written or spoken form, i.e. text or speech. Humans can acquire knowledge from text to improve speaking and listening. However, the quest for speech pre-trained models to leverage unpaired text has just started. In this paper, we investigate a new way to pre-train such a joint speech-text model to learn enhanced speech representations and benefit various speech-related downstream tasks. Specifically, we propose a novel pre-training method, text-guided HuBERT, or T-HuBERT, which performs self-supervised learning over speech to derive phoneme-like discrete representations. And these phoneme-like pseudo-label sequences are firstly derived from speech via the generative adversarial networks (GAN) to be statistically similar to those from additional unpaired textual data. In this way, we build a bridge between unpaired speech and text in an unsupervised manner. Extensive experiments demonstrate the significant superiority of our proposed method over various strong baselines, which achieves up to 15.3% relative Word Error Rate (WER) reduction on the LibriSpeech dataset.


title: CLIPose: Category-Level Object Pose Estimation with Pre-trained Vision-Language Knowledge

abstract: Most of existing category-level object pose estimation methods devote to learning the object category information from point cloud modality. However, the scale of 3D datasets is limited due to the high cost of 3D data collection and annotation. Consequently, the category features extracted from these limited point cloud samples may not be comprehensive. This motivates us to investigate whether we can draw on knowledge of other modalities to obtain category information. Inspired by this motivation, we propose CLIPose, a novel 6D pose framework that employs the pre-trained vision-language model to develop better learning of object category information, which can fully leverage abundant semantic knowledge in image and text modalities. To make the 3D encoder learn category-specific features more efficiently, we align representations of three modalities in feature space via multi-modal contrastive learning. In addition to exploiting the pre-trained knowledge of the CLIP's model, we also expect it to be more sensitive with pose parameters. Therefore, we introduce a prompt tuning approach to fine-tune image encoder while we incorporate rotations and translations information in the text descriptions. CLIPose achieves state-of-the-art performance on two mainstream benchmark datasets, REAL275 and CAMERA25, and runs in real-time during inference (40FPS).


title: LLMs Can Defend Themselves Against Jailbreaking in a Practical Manner: A Vision Paper

abstract: Jailbreaking is an emerging adversarial attack that bypasses the safety alignment deployed in off-the-shelf large language models (LLMs). A considerable amount of research exists proposing more effective jailbreak attacks, including the recent Greedy Coordinate Gradient (GCG) attack, jailbreak template-based attacks such as using "Do-Anything-Now" (DAN), and multilingual jailbreak. In contrast, the defensive side has been relatively less explored. This paper proposes a lightweight yet practical defense called SELFDEFEND, which can defend against all existing jailbreak attacks with minimal delay for jailbreak prompts and negligible delay for normal user prompts. Our key insight is that regardless of the kind of jailbreak strategies employed, they eventually need to include a harmful prompt (e.g., "how to make a bomb") in the prompt sent to LLMs, and we found that existing LLMs can effectively recognize such harmful prompts that violate their safety policies. Based on this insight, we design a shadow stack that concurrently checks whether a harmful prompt exists in the user prompt and triggers a checkpoint in the normal stack once a token of "No" or a harmful prompt is output. The latter could also generate an explainable LLM response to adversarial prompts. We demonstrate our idea of SELFDEFEND works in various jailbreak scenarios through manual analysis in GPT-3.5/4. We also list three future directions to further enhance SELFDEFEND.


title: Design and Implementation of Low-Cost Electric Vehicles (Evs) Supercharger: A Comprehensive Review

abstract: This article presents a probabilistic modeling method utilizing smart meter data and an innovative agent-based simulator for electric vehicles (EVs). The aim is to assess the effects of different cost-driven EV charging strategies on the power distribution network (PDN). We investigate the effects of a 40% EV adoption on three parts of Frederiksberg's low voltage distribution network (LVDN), a densely urbanized municipality in Denmark. Our findings indicate that cable and transformer overloading especially pose a challenge. However, the impact of EVs varies significantly between each LVDN area and charging scenario. Across scenarios and LVDNs, the share of cables facing congestion ranges between 5% and 60%. It is also revealed that time-of-use (ToU)-based and single-day cost-minimized charging could be beneficial for LVDNs with moderate EV adoption rates. In contrast, multiple-day optimization will likely lead to severe congestion, as such strategies concentrate demand on a single day that would otherwise be distributed over several days, thus raising concerns about how to prevent it. The broader implications of our research suggest that, despite initial worries primarily centered on congestion due to unregulated charging during peak hours, a transition to cost-based smart charging, propelled by an increasing awareness of time-dependent electricity prices, may lead to a significant rise in charging synchronization, bringing about undesirable consequences for the power distribution network (PDN).


title: How Do Humans Write Code? Large Models Do It the Same Way Too

abstract: Program-of-Thought (PoT) replaces natural language-based Chain-of-Thought (CoT) as the most popular method in Large Language Models (LLMs) mathematical reasoning tasks by utilizing external tool calls to circumvent computational errors. However, our evaluation of the GPT-4 and Llama series reveals that using PoT introduces more reasoning errors, such as incorrect formulas or flawed logic, compared to CoT. To address this issue, we propose Human-Think Language (HTL), which leverages a suite of strategies that help integrate PoT and CoT, encompassing: (1) a new generation paradigm that uses full CoT reasoning to control code generation. (2) Focus Attention, that directs model attention to the CoT reasoning during PoT to generate more logical code. (3) reinforcement learning that utilizes the accuracy of both CoT and PoT responses as rewards to prevent repetitive reasoning steps in LLMs when solving difficult math problems. Our method achieves an average improvement of 6.5% on the Llama-Base model and 4.3% on the Mistral-Base model across 8 mathematical calculation datasets. It also shows significant effectiveness on five out-of-domain datasets by controlling the model's information flow, exhibiting strong transferability. Additionally, HTL shows the most significant improvement in non-mathematical natural language inference task, contributing to a unified reasoning task framework


title: Understanding Missingness in Time-series Electronic Health Records for Individualized Representation

abstract: With the widespread of machine learning models for healthcare applications, there is increased interest in building applications for personalized medicine. Despite the plethora of proposed research for personalized medicine, very few focus on representing missingness and learning from the missingness patterns in time-series Electronic Health Records (EHR) data. The lack of focus on missingness representation in an individualized way limits the full utilization of machine learning applications towards true personalization. In this brief communication, we highlight new insights into patterns of missingness with real-world examples and implications of missingness in EHRs. The insights in this work aim to bridge the gap between theoretical assumptions and practical observations in real-world EHRs. We hope this work will open new doors for exploring directions for better representation in predictive modelling for true personalization.


title: Clustering in Dynamic Environments: A Framework for Benchmark Dataset Generation With Heterogeneous Changes

abstract: Clustering in dynamic environments is of increasing importance, with broad applications ranging from real-time data analysis and online unsupervised learning to dynamic facility location problems. While meta-heuristics have shown promising effectiveness in static clustering tasks, their application for tracking optimal clustering solutions or robust clustering over time in dynamic environments remains largely underexplored. This is partly due to a lack of dynamic datasets with diverse, controllable, and realistic dynamic characteristics, hindering systematic performance evaluations of clustering algorithms in various dynamic scenarios. This deficiency leads to a gap in our understanding and capability to effectively design algorithms for clustering in dynamic environments. To bridge this gap, this paper introduces the Dynamic Dataset Generator (DDG). DDG features multiple dynamic Gaussian components integrated with a range of heterogeneous, local, and global changes. These changes vary in spatial and temporal severity, patterns, and domain of influence, providing a comprehensive tool for simulating a wide range of dynamic scenarios.


title: The Hilbert series of the preprojective algebras

abstract: The aim of this short note is to prove the formula of the Hilbert series of the preprojective algebras in arbitrary characteristic by making effective use of the formulas of the Hilbert series of differential graded (dg) algebras with Adams grading. We also compute the Hilbert series of the quiver Heisenberg algebras, a special class of central extensions of preprojective algebras.


title: ArEEG_Chars: Dataset for Envisioned Speech Recognition using EEG for Arabic Characters

abstract: Brain-Computer-Interface (BCI) has been a hot research topic in the last few years that could help paralyzed people in their lives. Several researches were done to classify electroencephalography (EEG) signals automatically into English characters and words. Arabic language is one of the most used languages around the world. However, to the best of our knowledge, there is no dataset for Arabic characters EEG signals. In this paper, we have created an EEG dataset for Arabic characters and named it ArEEG_Chars. Moreover, several experiments were done on ArEEG_Chars using deep learning. Best results were achieved using LSTM and reached an accuracy of 97%. ArEEG_Chars dataset will be public for researchers.