title: Drug resistance revealed by in silico deep mutational scanning and mutation tracker

abstract: As COVID-19 enters its fifth year, it continues to pose a significant global health threat, with the constantly mutating SARS-CoV-2 virus challenging drug effectiveness. A comprehensive understanding of virus-drug interactions is essential for predicting and improving drug effectiveness, especially in combating drug resistance during the pandemic. In response, the Path Laplacian Transformer-based Prospective Analysis Framework (PLFormer-PAF) has been proposed, integrating historical data analysis and predictive modeling strategies. This dual-strategy approach utilizes path topology to transform protein-ligand complexes into topological sequences, enabling the use of advanced large language models for analyzing protein-ligand interactions and enhancing its reliability with factual insights garnered from historical data. It has shown unparalleled performance in predicting binding affinity tasks across various benchmarks, including specific evaluations related to SARS-CoV-2, and assesses the impact of virus mutations on drug efficacy, offering crucial insights into potential drug resistance. The predictions align with observed mutation patterns in SARS-CoV-2, indicating that the widespread use of the Pfizer drug has lead to viral evolution and reduced drug efficacy. PLFormer-PAF's capabilities extend beyond identifying drug-resistant strains, positioning it as a key tool in drug discovery research and the development of new therapeutic strategies against fast-mutating viruses like COVID-19.


title: UniDoorManip: Learning Universal Door Manipulation Policy Over Large-scale and Diverse Door Manipulation Environments

abstract: Learning a universal manipulation policy encompassing doors with diverse categories, geometries and mechanisms, is crucial for future embodied agents to effectively work in complex and broad real-world scenarios. Due to the limited datasets and unrealistic simulation environments, previous works fail to achieve good performance across various doors. In this work, we build a novel door manipulation environment reflecting different realistic door manipulation mechanisms, and further equip this environment with a large-scale door dataset covering 6 door categories with hundreds of door bodies and handles, making up thousands of different door instances. Additionally, to better emulate real-world scenarios, we introduce a mobile robot as the agent and use the partial and occluded point cloud as the observation, which are not considered in previous works while possessing significance for real-world implementations. To learn a universal policy over diverse doors, we propose a novel framework disentangling the whole manipulation process into three stages, and integrating them by training in the reversed order of inference. Extensive experiments validate the effectiveness of our designs and demonstrate our framework's strong performance. Code, data and videos are avaible on https://unidoormanip.github.io/.


title: Double Deeply Virtual Compton Scattering at Jefferson Lab Hall A

abstract: This paper presents our project and perspectives to measure for the first time beam spin asymmetries from Double Deeply Virtual Compton Scattering in the $eP\to e'P' \mu^+\mu^-$ reaction at Jefferson Lab. Our goal is to constrain the so-called Generalized Parton Distribution (GPDs) in a kinematic region that isn't accessible from other reactions, such as Deeply Virtual Compton Scattering, to allow for their extrapolation to "zero skewness", i.e. at a specific kinematic point enabling for tomographic interpretations of the nucleon's partonic structure. We are discussing DDVCS phenomenology and our approach, as well as our experimental project aimed at complementing the SoLID experiment at JLab Hall A with a new muon detector.


title: Fast Radio Bursts in the Disks of Active Galactic Nuclei

abstract: Fast radio bursts (FRBs) are luminous millisecond-duration radio pulses with extragalactic origin, which were discovered more than a decade ago. Despite the numerous samples, the physical origin of FRBs remains poorly understood. FRBs have been thought to originate from young magnetars or accreting compact objects (COs). Massive stars or COs are predicted to be embedded in the accretion disks of active galactic nuclei (AGNs). The dense disk absorbs FRBs severely, making them difficult to observe. However, progenitors ejecta or outflow feedback from the accreting COs interact with the disk material to form a cavity. The existence of the cavity can reduce the absorption by the dense disk materials, making FRBs escape. Here we investigate the production and propagation of FRBs in AGN disks and find that the AGN environments lead to the following unique observational properties, which can be verified in future observation. First, the dense material in the disk can cause large dispersion measure (DM) and rotation measure (RM). Second, the toroidal magnetic field in the AGN disk can cause Faraday conversion. Third, during the shock breakout, DM and RM show non-power-law evolution patterns over time. Fourth, for accreting-powered models, higher accretion rates lead to more bright bursts in AGN disks, accounting for up to 1% of total bright repeating FRBs.


title: MEBS: Multi-task End-to-end Bid Shading for Multi-slot Display Advertising

abstract: Online bidding and auction are crucial aspects of the online advertising industry. Conventionally, there is only one slot for ad display and most current studies focus on it. Nowadays, multi-slot display advertising is gradually becoming popular where many ads could be displayed in a list and shown as a whole to users. However, multi-slot display advertising leads to different cost-effectiveness. Advertisers have the incentive to adjust bid prices so as to win the most economical ad positions. In this study, we introduce bid shading into multi-slot display advertising for bid price adjustment with a Multi-task End-to-end Bid Shading(MEBS) method. We prove the optimality of our method theoretically and examine its performance experimentally. Through extensive offline and online experiments, we demonstrate the effectiveness and efficiency of our method, and we obtain a 7.01% lift in Gross Merchandise Volume, a 7.42% lift in Return on Investment, and a 3.26% lift in ad buy count.


title: DNNLasso: Scalable Graph Learning for Matrix-Variate Data

abstract: We consider the problem of jointly learning row-wise and column-wise dependencies of matrix-variate observations, which are modelled separately by two precision matrices. Due to the complicated structure of Kronecker-product precision matrices in the commonly used matrix-variate Gaussian graphical models, a sparser Kronecker-sum structure was proposed recently based on the Cartesian product of graphs. However, existing methods for estimating Kronecker-sum structured precision matrices do not scale well to large scale datasets. In this paper, we introduce DNNLasso, a diagonally non-negative graphical lasso model for estimating the Kronecker-sum structured precision matrix, which outperforms the state-of-the-art methods by a large margin in both accuracy and computational time. Our code is available at https://github.com/YangjingZhang/DNNLasso.


title: Search Intenion Network for Personalized Query Auto-Completion in E-Commerce

abstract: Query Auto-Completion(QAC), as an important part of the modern search engine, plays a key role in complementing user queries and helping them refine their search intentions.Today's QAC systems in real-world scenarios face two major challenges:1)intention equivocality(IE): during the user's typing process,the prefix often contains a combination of characters and subwords, which makes the current intention ambiguous and difficult to model.2)intention transfer (IT):previous works make personalized recommendations based on users' historical sequences, but ignore the search intention transfer.However, the current intention extracted from prefix may be contrary to the historical preferences.


title: ChatGPT4PCG 2 Competition: Prompt Engineering for Science Birds Level Generation

abstract: This paper presents the second ChatGPT4PCG competition at the 2024 IEEE Conference on Games. In this edition of the competition, we follow the first edition, but make several improvements and changes. We introduce a new evaluation metric along with allowing a more flexible format for participants' submissions and making several improvements to the evaluation pipeline. Continuing from the first edition, we aim to foster and explore the realm of prompt engineering (PE) for procedural content generation (PCG). While the first competition saw success, it was hindered by various limitations; we aim to mitigate these limitations in this edition. We introduce diversity as a new metric to discourage submissions aimed at producing repetitive structures. Furthermore, we allow submission of a Python program instead of a prompt text file for greater flexibility in implementing advanced PE approaches, which may require control flow, including conditions and iterations. We also make several improvements to the evaluation pipeline with a better classifier for similarity evaluation and better-performing function signatures. We thoroughly evaluate the effectiveness of the new metric and the improved classifier. Additionally, we perform an ablation study to select a function signature to instruct ChatGPT for level generation. Finally, we provide implementation examples of various PE techniques in Python and evaluate their preliminary performance. We hope this competition serves as a resource and platform for learning about PE and PCG in general.


title: A Unified Framework for Microscopy Defocus Deblur with Multi-Pyramid Transformer and Contrastive Learning

abstract: Defocus blur is a persistent problem in microscope imaging that poses harm to pathology interpretation and medical intervention in cell microscopy and microscope surgery. To address this problem, a unified framework including the multi-pyramid transformer (MPT) and extended frequency contrastive regularization (EFCR) is proposed to tackle two outstanding challenges in microscopy deblur: longer attention span and data deficiency. The MPT employs an explicit pyramid structure at each network stage that integrates the cross-scale window attention (CSWA), the intra-scale channel attention (ISCA), and the feature-enhancing feed-forward network (FEFN) to capture long-range cross-scale spatial interaction and global channel context. The EFCR addresses the data deficiency problem by exploring latent deblur signals from different frequency bands. It also enables deblur knowledge transfer to learn cross-domain information from extra data, improving deblur performance for labeled and unlabeled data. Extensive experiments and downstream task validation show the framework achieves state-of-the-art performance across multiple datasets. Project page: https://github.com/PieceZhang/MPT-CataBlur.


title: Modification to the Jeans criterion by external tides: Anisotropic fragmentation and formation of filaments

abstract: The Jeans criterion sets the foundation of our understanding of gravitational collapse. Jog studied the fragmentation of gas under external tides and derived a dispersion relation $$ l' = l_{\rm Jeans} \frac{1} {(1 + \lambda_0' / 4 \pi G \rho_0)^{1/2}} \;. $$ She further concludes that the Jeans mass is $m_{\rm incorrect}'=m_{\rm Jeans} ( 1/(1 + \lambda_0' / 4 \pi G \rho_0)^{3/2})$. We clarify that due to the inhomogeneous nature of tides, this characteristic mass is incorrect. Under weak tides, the mass is $m \approx \rho\, l_1 l_2 l_3$, where the modifications to Jeans lengths along all three dimensions need to be considered; when the tide is strong enough, collapse can only occur once 1 or 2 dimensions. In the latter case, tides can stretch the gas, leading to the formation of filaments.


title: Large Language Models and Video Games: A Preliminary Scoping Review

abstract: Large language models (LLMs) hold interesting potential for the design, development, and research of video games. Building on the decades of prior research on generative AI in games, many researchers have sped to investigate the power and potential of LLMs for games. Given the recent spike in LLM-related research in games, there is already a wealth of relevant research to survey. In order to capture a snapshot of the state of LLM research in games, and to help lay the foundation for future work, we carried out an initial scoping review of relevant papers published so far. In this paper, we review 76 papers published between 2022 to early 2024 on LLMs and video games, with key focus areas in game AI, game development, narrative, and game research and reviews. Our paper provides an early state of the field and lays the groundwork for future research and reviews on this topic.


title: Generation of True Quantum Random Numbers with On-Demand Probability Distributions via Single-Photon Quantum Walks

abstract: Random numbers are at the heart of diverse fields, ranging from simulations of stochastic processes to classical and quantum cryptography. The requirement for true randomness in these applications has motivated various proposals for generating random numbers based on the inherent randomness of quantum systems. The generation of true random numbers with arbitrarily defined probability distributions is highly desirable for applications, but it is very challenging. Here we show that single-photon quantum walks can generate multi-bit random numbers with on-demand probability distributions, when the required ``coin'' parameters are found with the gradient descent (GD) algorithm. Our theoretical and experimental results exhibit high fidelity for various selected distributions. This GD-enhanced single-photon system provides a convenient way for building flexible and reliable quantum random number generators. Multi-bit random numbers are a necessary resource for high-dimensional quantum key distribution.


title: Exploring the Limitations of Large Language Models in Compositional Relation Reasoning

abstract: We present a comprehensive evaluation of large language models(LLMs)' ability to reason about composition relations through a benchmark encompassing 1,500 test cases in English, designed to cover six distinct types of composition relations: Positional, Comparative, Personal, Mathematical, Identity, and Other. Acknowledging the significance of multilingual capabilities, we expanded our assessment to include translations of these cases into Chinese, Japanese, French, and Korean. Our Multilingual Composition Relation (MCR) benchmark aims at investigating the robustness and adaptability of LLMs in handling composition relation reasoning across diverse linguistic contexts.


title: Unsupervised Spatio-Temporal State Estimation for Fine-grained Adaptive Anomaly Diagnosis of Industrial Cyber-physical Systems

abstract: Accurate detection and diagnosis of abnormal behaviors such as network attacks from multivariate time series (MTS) are crucial for ensuring the stable and effective operation of industrial cyber-physical systems (CPS). However, existing researches pay little attention to the logical dependencies among system working states, and have difficulties in explaining the evolution mechanisms of abnormal signals. To reveal the spatio-temporal association relationships and evolution mechanisms of the working states of industrial CPS, this paper proposes a fine-grained adaptive anomaly diagnosis method (i.e. MAD-Transformer) to identify and diagnose anomalies in MTS. MAD-Transformer first constructs a temporal state matrix to characterize and estimate the change patterns of the system states in the temporal dimension. Then, to better locate the anomalies, a spatial state matrix is also constructed to capture the inter-sensor state correlation relationships within the system. Subsequently, based on these two types of state matrices, a three-branch structure of series-temporal-spatial attention module is designed to simultaneously capture the series, temporal, and space dependencies among MTS. Afterwards, three associated alignment loss functions and a reconstruction loss are constructed to jointly optimize the model. Finally, anomalies are determined and diagnosed by comparing the residual matrices with the original matrices. We conducted comparative experiments on five publicly datasets spanning three application domains (service monitoring, spatial and earth exploration, and water treatment), along with a petroleum refining simulation dataset collected by ourselves. The results demonstrate that MAD-Transformer can adaptively detect fine-grained anomalies with short duration, and outperforms the state-of-the-art baselines in terms of noise robustness and localization performance.


title: A Reduced-Order Resistive Force Model for Robotic Foot-Mud Interactions

abstract: Legged robots are well-suited for broad exploration tasks in complex environments with yielding terrain. Understanding robotic foot-terrain interactions is critical for safe locomotion and walking efficiency for legged robots. This paper presents a reduced-order resistive-force model for robotic-foot/mud interactions. We focus on vertical robot locomotion on mud and propose a visco-elasto-plastic analog to model the foot/mud interaction forces. Dynamic behaviors such as mud visco-elasticity, withdrawing cohesive suction, and yielding are explicitly discussed with the proposed model. Besides comparing with dry/wet granular materials, mud intrusion experiments are conducted to validate the force model. The dependency of the model parameter on water content and foot velocity is also studied to reveal in-depth model properties under various conditions. The proposed force model potentially provides an enabling tool for legged robot locomotion and control on muddy terrain.


title: TinyGC-Net: An Extremely Tiny Network for Calibrating MEMS Gyroscopes

abstract: This paper presents a learning-based method for calibrating and denoising microelectromechanical system (MEMS) gyroscopes, which is designed based on a convolutional network, and only contains hundreds of parameters, so the network can be trained on a graphics processing unit (GPU) before being deployed on a microcontroller unit (MCU) with limited computational resources. In this method, the neural network model takes only the raw measurements from the gyroscope as input values, and handles the calibration and noise reduction tasks separately to ensure interpretability. The proposed method is validated on public datasets and real-world experiments, without relying on a specific dataset for training in contrast to existing learning-based methods. The experimental results demonstrate the practicality and effectiveness of the proposed method, suggesting that this technique is a viable candidate for applications that require IMUs.


title: Training Machine Learning models at the Edge: A Survey

abstract: Edge Computing (EC) has gained significant traction in recent years, promising enhanced efficiency by integrating Artificial Intelligence (AI) capabilities at the edge. While the focus has primarily been on the deployment and inference of Machine Learning (ML) models at the edge, the training aspect remains less explored. This survey delves into Edge Learning (EL), specifically the optimization of ML model training at the edge. The objective is to comprehensively explore diverse approaches and methodologies in EL, synthesize existing knowledge, identify challenges, and highlight future trends. Utilizing Scopus' advanced search, relevant literature on EL was identified, revealing a concentration of research efforts in distributed learning methods, particularly Federated Learning (FL). This survey further provides a guideline for comparing techniques used to optimize ML for edge learning, along with an exploration of different frameworks, libraries, and simulation tools available for EL. In doing so, the paper contributes to a holistic understanding of the current landscape and future directions in the intersection of edge computing and machine learning, paving the way for informed comparisons between optimization methods and techniques designed for edge learning.


title: Polarization-Encoded Lenticular Nano-Printing with Single-Layer Metasurfaces

abstract: Metasurface-based nano-printing has enabled ultrahigh-resolution grayscale or color image display. However, the maximum number of independent nano-printing images allowed by one single-layer metasurface is still limited despite many multiplexing methods that have been proposed to increase the design degree of freedom. In this work, we substantially push the multiplexing limit of nano-printing by transforming images at different observation angles into mapping the corresponding images to different positions in the Fourier space, and simultaneously controlling the complex electric field across multiple polarization channels. Our proposed Polarization-Encoded Lenticular Nano-Printing (Pollen), aided by a modified evolutionary algorithm, allows the display of several images based on the viewing angle, similar to traditional lenticular printing but without requiring a lenticular layer. In addition, it extends the display capability to encompass multiple polarization states. Empowered by the ability to control the complex amplitude of three polarization channels, we numerically and experimentally demonstrate the generation of 13 distinguished gray-scale Chinese ink wash painting images, 49 binary patterns, and three sets of 3D nano-printing images, totaling 25 unique visuals. These results present the largest number of recorded images with ultra-high resolution to date. Our innovative Pollen technique is expected to benefit the development of modern optical applications, including but not limited to optical encryption, optical data storage, lightweight display, and augmented reality and virtual reality.


title: CSS_J154915.7+375506: A low-mass-ratio marginal contact binary system with a hierarchical third body

abstract: We presented the multi-filter light curves of CSS_J154915.7+375506 inaugurally, which were observed by the 1.5 m AZT-22 telescope at Maidanak Astronomical Observatory. A low-resolution spectrum obtained by LAMOST reveals it is an A-type close binary. By analyzing the BVRI total-eclipse light curves, we are able to derive a reliable photometric solution for this system, which indicates that CSS_J154915.7+375506 is an extremely low-mass-ratio (q=0.138) marginal contact binary system. The location in the HR diagram shows that its secondary component with a much smaller mass is the more evolved one, indicating the mass ratio reversal occurred. The present secondary component had transferred a significant amount of mass to the present primary one. By the combination of a total of 20 times of minimum, we investigated its O-C curve. A periodic oscillation and a possible period decrease have been detected. As the period decreases, the system will evolve towards the contact phase. This makes CSS\_J154915.7+375506 a valuable case to study the formation scenario of contact binaries through mass reversal. The periodic oscillation suggested a third body with a minimal mass of $0.91\,M_{\odot}$, which is larger than that of the less massive component in the central binary. This implies that the secondary body was not replaced by the third body during early stellar interactions, indicating that it is a fossil system and retains its original dynamical information.


title: World Models for Autonomous Driving: An Initial Survey

abstract: In the rapidly evolving landscape of autonomous driving, the capability to accurately predict future events and assess their implications is paramount for both safety and efficiency, critically aiding the decision-making process. World models have emerged as a transformative approach, enabling autonomous driving systems to synthesize and interpret vast amounts of sensor data, thereby predicting potential future scenarios and compensating for information gaps. This paper provides an initial review of the current state and prospective advancements of world models in autonomous driving, spanning their theoretical underpinnings, practical applications, and the ongoing research efforts aimed at overcoming existing limitations. Highlighting the significant role of world models in advancing autonomous driving technologies, this survey aspires to serve as a foundational reference for the research community, facilitating swift access to and comprehension of this burgeoning field, and inspiring continued innovation and exploration.


title: Stability investigations of de Sitter inflationary solutions in power-law extensions of the Starobinsky model

abstract: In this paper, we would like to examine whether stable de Sitter inflationary solutions appear within power-law extensions of the Starobinsky model. In particular, we will address general constraints for the existence along with the stability of de Sitter inflationary solutions in a general case involving not only the Starobinsky $R^2$ term but also an additional power-law $R^n$ one. According to the obtained results, we will be able to identify which extension is more suitable for an early inflationary phase rather than a late-time cosmic acceleration phase. To be more specific, we will consider several values of $n$ to see whether the corresponding de Sitter inflationary solutions are stable or not.


title: Pareto-Optimal Estimation and Policy Learning on Short-term and Long-term Treatment Effects

abstract: This paper focuses on developing Pareto-optimal estimation and policy learning to identify the most effective treatment that maximizes the total reward from both short-term and long-term effects, which might conflict with each other. For example, a higher dosage of medication might increase the speed of a patient's recovery (short-term) but could also result in severe long-term side effects. Although recent works have investigated the problems about short-term or long-term effects or the both, how to trade-off between them to achieve optimal treatment remains an open challenge. Moreover, when multiple objectives are directly estimated using conventional causal representation learning, the optimization directions among various tasks can conflict as well. In this paper, we systematically investigate these issues and introduce a Pareto-Efficient algorithm, comprising Pareto-Optimal Estimation (POE) and Pareto-Optimal Policy Learning (POPL), to tackle them. POE incorporates a continuous Pareto module with representation balancing, enhancing estimation efficiency across multiple tasks. As for POPL, it involves deriving short-term and long-term outcomes linked with various treatment levels, facilitating an exploration of the Pareto frontier emanating from these outcomes. Results on both the synthetic and real-world datasets demonstrate the superiority of our method.


title: Determining the Number of Common Functional Factors with Twice Cross-Validation

abstract: The semiparametric factor model serves as a vital tool to describe the dependence patterns in the data. It recognizes that the common features observed in the data are actually explained by functions of specific exogenous variables.Unlike traditional factor models, where the focus is on selecting the number of factors, our objective here is to identify the appropriate number of common functions, a crucial parameter in this model. In this paper, we develop a novel data-driven method to determine the number of functional factors using cross validation (CV). Our proposed method employs a two-step CV process that ensures the orthogonality of functional factors, which we refer to as Functional Twice Cross-Validation (FTCV). Extensive simulations demonstrate that FTCV accurately selects the number of common functions and outperforms existing methods in most cases.Furthermore, by specifying market volatility as the exogenous force, we provide real data examples that illustrate the interpretability of selected common functions in characterizing the influence on U.S. Treasury Yields and the cross correlations between Dow30 returns.


title: Modeling Collaborator: Enabling Subjective Vision Classification With Minimal Human Effort via LLM Tool-Use

abstract: From content moderation to wildlife conservation, the number of applications that require models to recognize nuanced or subjective visual concepts is growing. Traditionally, developing classifiers for such concepts requires substantial manual effort measured in hours, days, or even months to identify and annotate data needed for training. Even with recently proposed Agile Modeling techniques, which enable rapid bootstrapping of image classifiers, users are still required to spend 30 minutes or more of monotonous, repetitive data labeling just to train a single classifier. Drawing on Fiske's Cognitive Miser theory, we propose a new framework that alleviates manual effort by replacing human labeling with natural language interactions, reducing the total effort required to define a concept by an order of magnitude: from labeling 2,000 images to only 100 plus some natural language interactions. Our framework leverages recent advances in foundation models, both large language models and vision-language models, to carve out the concept space through conversation and by automatically labeling training data points. Most importantly, our framework eliminates the need for crowd-sourced annotations. Moreover, our framework ultimately produces lightweight classification models that are deployable in cost-sensitive scenarios. Across 15 subjective concepts and across 2 public image classification datasets, our trained models outperform traditional Agile Modeling as well as state-of-the-art zero-shot classification models like ALIGN, CLIP, CuPL, and large visual question-answering models like PaLI-X.


title: Eight-Partitioning Points in 3D, and Efficiently Too

abstract: An \emph{eight-partition} of a finite set of points (respectively, of a continuous mass distribution) in $\mathbb{R}^3$ consists of three planes that divide the space into $8$ octants, such that each open octant contains at most $1/8$ of the points (respectively, of the mass). In 1966, Hadwiger showed that any mass distribution in $\mathbb{R}^3$ admits an eight-partition; moreover, one can prescribe the normal direction of one of the three planes. The analogous result for finite point sets follows by a standard limit argument. We prove the following variant of this result: Any mass distribution (or point set) in $\mathbb{R}^3$ admits an eight-partition for which the intersection of two of the planes is a line with a prescribed direction. Moreover, we present an efficient algorithm for calculating an eight-partition of a set of $n$ points in~$\mathbb{R}^3$ (with prescribed normal direction of one of the planes) in time $O^{*}(n^{5/2})$.


title: Interactive Continual Learning: Fast and Slow Thinking

abstract: Advanced life forms, sustained by the synergistic interaction of neural cognitive mechanisms, continually acquire and transfer knowledge throughout their lifespan. In contrast, contemporary machine learning paradigms exhibit limitations in emulating the facets of continual learning (CL). Nonetheless, the emergence of large language models (LLMs) presents promising avenues for realizing CL via interactions with these models. Drawing on Complementary Learning System theory, this paper presents a novel Interactive Continual Learning (ICL) framework, enabled by collaborative interactions among models of various sizes. Specifically, we assign the ViT model as System1 and multimodal LLM as System2. To enable the memory module to deduce tasks from class information and enhance Set2Set retrieval, we propose the Class-Knowledge-Task Multi-Head Attention (CKT-MHA). Additionally, to improve memory retrieval in System1 through enhanced geometric representation, we introduce the CL-vMF mechanism, based on the von Mises-Fisher (vMF) distribution. Meanwhile, we introduce the von Mises-Fisher Outlier Detection and Interaction (vMF-ODI) strategy to identify hard examples, thus enhancing collaboration between System1 and System2 for complex reasoning realization. Comprehensive evaluation of our proposed ICL demonstrates significant resistance to forgetting and superior performance relative to existing methods. Code is available at github.com/ICL.


title: Towards Geometric-Photometric Joint Alignment for Facial Mesh Registration

abstract: This paper presents a Geometric-Photometric Joint Alignment(GPJA) method, for accurately aligning human expressions by combining geometry and photometric information. Common practices for registering human heads typically involve aligning landmarks with facial template meshes using geometry processing approaches, but often overlook photometric consistency. GPJA overcomes this limitation by leveraging differentiable rendering to align vertices with target expressions, achieving joint alignment in geometry and photometric appearances automatically, without the need for semantic annotation or aligned meshes for training. It features a holistic rendering alignment strategy and a multiscale regularized optimization for robust and fast convergence. The method utilizes derivatives at vertex positions for supervision and employs a gradient-based algorithm which guarantees smoothness and avoids topological defects during the geometry evolution. Experimental results demonstrate faithful alignment under various expressions, surpassing the conventional ICP-based methods and the state-of-the-art deep learning based method. In practical, our method enhances the efficiency of obtaining topology-consistent face models from multi-view stereo facial scanning.


title: FedHCDR: Federated Cross-Domain Recommendation with Hypergraph Signal Decoupling

abstract: In recent years, Cross-Domain Recommendation (CDR) has drawn significant attention, which utilizes user data from multiple domains to enhance the recommendation performance. However, current CDR methods require sharing user data across domains, thereby violating the General Data Protection Regulation (GDPR). Consequently, numerous approaches have been proposed for Federated Cross-Domain Recommendation (FedCDR). Nevertheless, the data heterogeneity across different domains inevitably influences the overall performance of federated learning. In this study, we propose FedHCDR, a novel Federated Cross-Domain Recommendation framework with Hypergraph signal decoupling. Specifically, to address the data heterogeneity across domains, we introduce an approach called hypergraph signal decoupling (HSD) to decouple the user features into domain-exclusive and domain-shared features. The approach employs high-pass and low-pass hypergraph filters to decouple domain-exclusive and domain-shared user representations, which are trained by the local-global bi-directional transfer algorithm. In addition, a hypergraph contrastive learning (HCL) module is devised to enhance the learning of domain-shared user relationship information by perturbing the user hypergraph. Extensive experiments conducted on three real-world scenarios demonstrate that FedHCDR outperforms existing baselines significantly.


title: Privacy in Multi-agent Systems

abstract: With the increasing awareness of privacy and the deployment of legislations in various multi-agent system application domains such as power systems and intelligent transportation, the privacy protection problem for multi-agent systems is gaining increased traction in recent years. This article discusses some of the representative advancements in the filed.


title: Human Activity Recognition with Low-Resolution Infrared Array Sensor Using Semi-supervised Cross-domain Neural Networks for Indoor Environment

abstract: Low-resolution infrared-based human activity recognition (HAR) attracted enormous interests due to its low-cost and private. In this paper, a novel semi-supervised crossdomain neural network (SCDNN) based on 8 $\times$ 8 low-resolution infrared sensor is proposed for accurately identifying human activity despite changes in the environment at a low-cost. The SCDNN consists of feature extractor, domain discriminator and label classifier. In the feature extractor, the unlabeled and minimal labeled target domain data are trained for domain adaptation to achieve a mapping of the source domain and target domain data. The domain discriminator employs the unsupervised learning to migrate data from the source domain to the target domain. The label classifier obtained from training the source domain data improves the recognition of target domain activities due to the semi-supervised learning utilized in training the target domain data. Experimental results show that the proposed method achieves 92.12\% accuracy for recognition of activities in the target domain by migrating the source and target domains. The proposed approach adapts superior to cross-domain scenarios compared to the existing deep learning methods, and it provides a low-cost yet highly adaptable solution for cross-domain scenarios.


title: Spatially Non-Stationary XL-MIMO Channel Estimation: A Three-Layer Generalized Approximate Message Passing Method

abstract: In this paper, channel estimation problem for extremely large-scale multi-input multi-output (XL-MIMO) systems is investigated with the considerations of the spherical wavefront effect and the spatially non-stationary (SnS) property. Due to the diversities of SnS characteristics among different propagation paths, the concurrent channel estimation of multiple paths becomes intractable. To address this challenge, we propose a two-phase channel estimation scheme. In the first phase, the angles of departure (AoDs) on the user side are estimated, and a carefully designed pilot transmission scheme enables the decomposition of the received signal from different paths. In the second phase, the subchannel estimation corresponding to different paths is formulated as a three-layer Bayesian inference problem. Specifically, the first layer captures block sparsity in the angular domain, the second layer promotes SnS property in the antenna domain, and the third layer decouples the subchannels from the observed signals. To efficiently facilitate Bayesian inference, we propose a novel three-layer generalized approximate message passing (TL-GAMP) algorithm based on structured variational massage passing and belief propagation rules. Simulation results validate the convergence and effectiveness of the proposed algorithm, showcasing its robustness to different channel scenarios.


title: Greedy receiver for photon-efficient optical communication

abstract: In optical communication the transmitter encodes information into a set of light states defined by the modulation format, selected to accommodate specific channel conditions and to remain sufficiently distinguishable at the output. Various receiver architectures have been designed to improve the demodulation performance, ultimately limited by quantum theory. In this work I introduce a new receiver based on a locally optimal greedy algorithm and apply it to pulse position modulation. The receiver reduces the error probabilities of previously proposed strategies in all signal strength regimes and achieves results comparable with those obtained by numerical optimization of the detection process. In contrast, however, it is conceptually simple and therefore can be scaled to arbitrarily high modulation orders for which numerical methods become intractable. In the photon-starved regime characteristic of deep space optical communication, the greedy receiver approaches the quantum-optimal Helstrom bound on state discrimination error probability. In the regime of few-photon pulses, the error reduction offered over the other methods grows up to an order of magnitude.


title: PPS-QMIX: Periodically Parameter Sharing for Accelerating Convergence of Multi-Agent Reinforcement Learning

abstract: Training for multi-agent reinforcement learning(MARL) is a time-consuming process caused by distribution shift of each agent. One drawback is that strategy of each agent in MARL is independent but actually in cooperation. Thus, a vertical issue in multi-agent reinforcement learning is how to efficiently accelerate training process. To address this problem, current research has leveraged a centralized function(CF) across multiple agents to learn contribution of the team reward for each agent. However, CF based methods introduce joint error from other agents in estimation of value network. In so doing, inspired by federated learning, we propose three simple novel approaches called Average Periodically Parameter Sharing(A-PPS), Reward-Scalability Periodically Parameter Sharing(RS-PPS) and Partial Personalized Periodically Parameter Sharing(PP-PPS) mechanism to accelerate training of MARL. Agents share Q-value network periodically during the training process. Agents which has same identity adapt collected reward as scalability and update partial neural network during period to share different parameters. We apply our approaches in classical MARL method QMIX and evaluate our approaches on various tasks in StarCraft Multi-Agent Challenge(SMAC) environment. Performance of numerical experiments yield enormous enhancement, with an average improvement of 10\%-30\%, and enable to win tasks that QMIX cannot. Our code can be downloaded from https://github.com/ColaZhang22/PPS-QMIX


title: Algorithms for Galois Words: Detection, Factorization, and Rotation

abstract: Lyndon words are extensively studied in combinatorics on words -- they play a crucial role on upper bounding the number of runs a word can have [Bannai+, SIAM J. Comput.'17]. We can determine Lyndon words, factorize a word into Lyndon words in lexicographically non-increasing order, and find the Lyndon rotation of a word, all in linear time within constant additional working space. A recent research interest emerged from the question of what happens when we change the lexicographic order, which is at the heart of the definition of Lyndon words. In particular, the alternating order, where the order of all odd positions becomes reversed, has been recently proposed. While a Lyndon word is, among all its cyclic rotations, the smallest one with respect to the lexicographic order, a Galois word exhibits the same property by exchanging the lexicographic order with the alternating order. Unfortunately, this exchange has a large impact on the properties Galois words exhibit, which makes it a nontrivial task to translate results from Lyndon words to Galois words. Up until now, it has only been conjectured that linear-time algorithms with constant additional working space in the spirit of Duval's algorithm are possible for computing the Galois factorization or the Galois rotation. Here, we affirm this conjecture as follows. Given a word $T$ of length $n$, we can determine whether $T$ is a Galois word, in $O(n)$ time with constant additional working space. Within the same complexities, we can also determine the Galois rotation of $T$, and compute the Galois factorization of $T$ online. The last result settles Open Problem~1 in [Dolce et al., TCS 2019] for Galois words.


title: BSDP: Brain-inspired Streaming Dual-level Perturbations for Online Open World Object Detection

abstract: Humans can easily distinguish the known and unknown categories and can recognize the unknown object by learning it once instead of repeating it many times without forgetting the learned object. Hence, we aim to make deep learning models simulate the way people learn. We refer to such a learning manner as OnLine Open World Object Detection(OLOWOD). Existing OWOD approaches pay more attention to the identification of unknown categories, while the incremental learning part is also very important. Besides, some neuroscience research shows that specific noises allow the brain to form new connections and neural pathways which may improve learning speed and efficiency. In this paper, we take the dual-level information of old samples as perturbations on new samples to make the model good at learning new knowledge without forgetting the old knowledge. Therefore, we propose a simple plug-and-play method, called Brain-inspired Streaming Dual-level Perturbations(BSDP), to solve the OLOWOD problem. Specifically, (1) we first calculate the prototypes of previous categories and use the distance between samples and the prototypes as the sample selecting strategy to choose old samples for replay; (2) then take the prototypes as the streaming feature-level perturbations of new samples, so as to improve the plasticity of the model through revisiting the old knowledge; (3) and also use the distribution of the features of the old category samples to generate adversarial data in the form of streams as the data-level perturbations to enhance the robustness of the model to new categories. We empirically evaluate BSDP on PASCAL VOC and MS-COCO, and the excellent results demonstrate the promising performance of our proposed method and learning manner.


title: Real-time portable muography with Hankuk Atmospheric-muon Wide Landscaping : HAWL

abstract: Cosmic ray muons prove valuable across various fields, from particle physics experiments to non-invasive tomography, thanks to their high flux and exceptional penetrating capability. Utilizing a scintillator detector, one can effectively study the topography of mountains situated above tunnels and underground spaces. The Hankuk Atmospheric-muon Wide Landscaping (HAWL) project successfully charts the mountainous region of eastern Korea by measuring cosmic ray muons with a detector in motion. The real-time muon flux measurement shows a tunnel length accuracy of 6.5 %, with a detectable overburden range spanning from 8 to 400 meter-water-equivalent depth. This is the first real-time portable muon tomography.


title: False Positive Sampling-based Data Augmentation for Enhanced 3D Object Detection Accuracy

abstract: Recent studies have focused on enhancing the performance of 3D object detection models. Among various approaches, ground-truth sampling has been proposed as an augmentation technique to address the challenges posed by limited ground-truth data. However, an inherent issue with ground-truth sampling is its tendency to increase false positives. Therefore, this study aims to overcome the limitations of ground-truth sampling and improve the performance of 3D object detection models by developing a new augmentation technique called false-positive sampling. False-positive sampling involves retraining the model using point clouds that are identified as false positives in the model's predictions. We propose an algorithm that utilizes both ground-truth and false-positive sampling and an algorithm for building the false-positive sample database. Additionally, we analyze the principles behind the performance enhancement due to false-positive sampling. Our experiments demonstrate that models utilizing false-positive sampling show a reduction in false positives and exhibit improved object detection performance. On the KITTI and Waymo Open datasets, models with false-positive sampling surpass the baseline models by a large margin.


title: HoloVIC: Large-scale Dataset and Benchmark for Multi-Sensor Holographic Intersection and Vehicle-Infrastructure Cooperative

abstract: Vehicle-to-everything (V2X) is a popular topic in the field of Autonomous Driving in recent years. Vehicle-infrastructure cooperation (VIC) becomes one of the important research area. Due to the complexity of traffic conditions such as blind spots and occlusion, it greatly limits the perception capabilities of single-view roadside sensing systems. To further enhance the accuracy of roadside perception and provide better information to the vehicle side, in this paper, we constructed holographic intersections with various layouts to build a large-scale multi-sensor holographic vehicle-infrastructure cooperation dataset, called HoloVIC. Our dataset includes 3 different types of sensors (Camera, Lidar, Fisheye) and employs 4 sensor-layouts based on the different intersections. Each intersection is equipped with 6-18 sensors to capture synchronous data. While autonomous vehicles pass through these intersections for collecting VIC data. HoloVIC contains in total on 100k+ synchronous frames from different sensors. Additionally, we annotated 3D bounding boxes based on Camera, Fisheye, and Lidar. We also associate the IDs of the same objects across different devices and consecutive frames in sequence. Based on HoloVIC, we formulated four tasks to facilitate the development of related research. We also provide benchmarks for these tasks.


title: On some path-critical Ramsey numbers

abstract: For graphs $G$ and $H$, the Ramsey number $R(G,H)$ is the smallest $r$ such that any red-blue edge coloring of $K_r$ contains a red $G$ or a blue $H$. The path-critical Ramsey number $R_{\pi}(G,H)$ is the largest $n$ such that any red-blue edge coloring of $K_r \setminus P_{n}$ contains a red $G$ or a blue $H$, where $r=R(G,H)$ and $P_{n}$ is a path of order $n$. In this note, we show a general upper bound for $R_{\pi}(G,H)$, and determine the exact values for some cases of $R_{\pi}(G,H)$.


title: UFO: Uncertainty-aware LiDAR-image Fusion for Off-road Semantic Terrain Map Estimation

abstract: Autonomous off-road navigation requires an accurate semantic understanding of the environment, often converted into a bird's-eye view (BEV) representation for various downstream tasks. While learning-based methods have shown success in generating local semantic terrain maps directly from sensor data, their efficacy in off-road environments is hindered by challenges in accurately representing uncertain terrain features. This paper presents a learning-based fusion method for generating dense terrain classification maps in BEV. By performing LiDAR-image fusion at multiple scales, our approach enhances the accuracy of semantic maps generated from an RGB image and a single-sweep LiDAR scan. Utilizing uncertainty-aware pseudo-labels further enhances the network's ability to learn reliably in off-road environments without requiring precise 3D annotations. By conducting thorough experiments using off-road driving datasets, we demonstrate that our method can improve accuracy in off-road terrains, validating its efficacy in facilitating reliable and safe autonomous navigation in challenging off-road settings.


title: Constructing Modular Tensor Categories with Hopf Algebras

abstract: A modular tensor category is a non-degenerate ribbon finite tensor category. And a ribbon factorizable Hopf algebra is exactly the Hopf algebra whose finite-dimensional representations form a modular tensor category. The goal of this paper is to construct both semisimple and non-semisimple modular categories with Hopf algebras. In particular, we study central extensions of Hopf algebras and characterize some conditions for a quotient Hopf algebra to be a factorizable one. Then we give a special way to obtain ribbon elements. As a result, we apply to some finite dimensional pointed Hopf algebras introduced by Andruskiewitsch etc and obtain two families of ribbon factorizable Hopf algebras. With little restrictions to their parameters, we prove that their representation categories are prime modular tensor categories which are not tensor equivalent to representation categories of small quantum groups. Lastly, we construct a family of semisimple ribbon factorizable Hopf algebas A(p,q), where p,q are prime numbers satisfying some conditions. And we decompose Rep(A(p,q)) into prime modular tensor categories and prove that A(p,q) can't be obtained by some obvious ways, i.e. it's not tensor product of trivial Hopf algebras (group algebras or their dual) and Drinfeld doubles.


title: Exact Nonclassical Symmetry Solutions of Lotka-Volterra Type Population Systems

abstract: New classes of conditionally integrable systems of nonlinear reaction-diffusion equations are introduced. They are obtained by extending a well known nonclassical symmetry of a scalar partial differential equation to a vector equation. New exact solutions of nonlinear predator-prey systems, related to the diffusive Lotka-Volterra system, are constructed. An infinite dimensional class of exact solutions is made available. Unlike in the standard Lotka-Volterra system, in the absence of predators, the prey population has a finite carrying capacity, as in the Fisher equation.


title: DT-DDNN: A Physical Layer Security Attack Detector in 5G RF Domain for CAVs

abstract: The Synchronization Signal Block (SSB) is a fundamental component of the 5G New Radio (NR) air interface, crucial for the initial access procedure of Connected and Automated Vehicles (CAVs), and serves several key purposes in the network's operation. However, due to the predictable nature of SSB transmission, including the Primary and Secondary Synchronization Signals (PSS and SSS), jamming attacks are critical threats. These attacks, which can be executed without requiring high power or complex equipment, pose substantial risks to the 5G network, particularly as a result of the unencrypted transmission of control signals. Leveraging RF domain knowledge, this work presents a novel deep learning-based technique for detecting jammers in CAV networks. Unlike the existing jamming detection algorithms that mostly rely on network parameters, we introduce a double-threshold deep learning jamming detector by focusing on the SSB. The detection method is focused on RF domain features and improves the robustness of the network without requiring integration with the pre-existing network infrastructure. By integrating a preprocessing block to extract PSS correlation and energy per null resource elements (EPNRE) characteristics, our method distinguishes between normal and jammed received signals with high precision. Additionally, by incorporating of Discrete Wavelet Transform (DWT), the efficacy of training and detection are optimized. A double-threshold double Deep Neural Network (DT-DDNN) is also introduced to the architecture complemented by a deep cascade learning model to increase the sensitivity of the model to variations of signal-to-jamming noise ratio (SJNR). Results show that the proposed method achieves 96.4% detection rate in extra low jamming power, i.e., SJNR between 15 to 30 dB. Further, performance of DT-DDNN is validated by analyzing real 5G signals obtained from a practical testbed.


title: The GMRT High-Resolution Southern Sky Survey for pulsars and transients -- VII: Timing of Spider MSP J1242-4712, A Bridge Between Redback and Black Widow Pulsars

abstract: We present the timing solution for the 5.31-ms spider millisecond pulsar (MSP) J1242-4712, discovered with the GMRT. PSR J1242-4712 orbits a companion of minimum mass 0.08 M$_{\odot}$ with an orbital period of 7.7 hrs and occupies a relatively unexplored region in the orbital period versus companion mass space. We did not detect gamma-ray pulsations for this MSP, and also could not identify the optical counterpart for PSR J1242-4712 in available optical/near-infrared data. The profile of J1242-4712 evolves with frequency showing a clear single component at lower frequencies and a three-component profile at 650 MHz. PSR J1242-4712 eclipses for a very short duration near superior conjunction (orbital phase ~ 0.23-0.25) below 360 MHz. Moreover, significant DM delays and errors in pulse times of arrivals are observed near inferior conjunction (orbital phase ~ 0.7), along with an observed eclipse in one epoch at 650 MHz. Observed eclipses and significant orbital period variability suggest that PSR J1242-4712 is possibly not a He-WD binary, but has a semi or non-degenerate companion, indicating that this is a ``spider" MSP lying in a region between typical black widows and redbacks. This system may represent a distinct category of spider MSPs, displaying characteristics that bridge the gap between known black widow and redback MSPs.


title: FinReport: Explainable Stock Earnings Forecasting via News Factor Analyzing Model

abstract: The task of stock earnings forecasting has received considerable attention due to the demand investors in real-world scenarios. However, compared with financial institutions, it is not easy for ordinary investors to mine factors and analyze news. On the other hand, although large language models in the financial field can serve users in the form of dialogue robots, it still requires users to have financial knowledge to ask reasonable questions. To serve the user experience, we aim to build an automatic system, FinReport, for ordinary investors to collect information, analyze it, and generate reports after summarizing. Specifically, our FinReport is based on financial news announcements and a multi-factor model to ensure the professionalism of the report. The FinReport consists of three modules: news factorization module, return forecasting module, risk assessment module. The news factorization module involves understanding news information and combining it with stock factors, the return forecasting module aim to analysis the impact of news on market sentiment, and the risk assessment module is adopted to control investment risk. Extensive experiments on real-world datasets have well verified the effectiveness and explainability of our proposed FinReport. Our codes and datasets are available at https://github.com/frinkleko/FinReport.


title: Remove that Square Root: A New Efficient Scale-Invariant Version of AdaGrad

abstract: Adaptive methods are extremely popular in machine learning as they make learning rate tuning less expensive. This paper introduces a novel optimization algorithm named KATE, which presents a scale-invariant adaptation of the well-known AdaGrad algorithm. We prove the scale-invariance of KATE for the case of Generalized Linear Models. Moreover, for general smooth non-convex problems, we establish a convergence rate of $O \left(\frac{\log T}{\sqrt{T}} \right)$ for KATE, matching the best-known ones for AdaGrad and Adam. We also compare KATE to other state-of-the-art adaptive algorithms Adam and AdaGrad in numerical experiments with different problems, including complex machine learning tasks like image classification and text classification on real data. The results indicate that KATE consistently outperforms AdaGrad and matches/surpasses the performance of Adam in all considered scenarios.


title: Few-shot Learner Parameterization by Diffusion Time-steps

abstract: Even when using large multi-modal foundation models, few-shot learning is still challenging -- if there is no proper inductive bias, it is nearly impossible to keep the nuanced class attributes while removing the visually prominent attributes that spuriously correlate with class labels. To this end, we find an inductive bias that the time-steps of a Diffusion Model (DM) can isolate the nuanced class attributes, i.e., as the forward diffusion adds noise to an image at each time-step, nuanced attributes are usually lost at an earlier time-step than the spurious attributes that are visually prominent. Building on this, we propose Time-step Few-shot (TiF) learner. We train class-specific low-rank adapters for a text-conditioned DM to make up for the lost attributes, such that images can be accurately reconstructed from their noisy ones given a prompt. Hence, at a small time-step, the adapter and prompt are essentially a parameterization of only the nuanced class attributes. For a test image, we can use the parameterization to only extract the nuanced class attributes for classification. TiF learner significantly outperforms OpenCLIP and its adapters on a variety of fine-grained and customized few-shot learning tasks. Codes are in https://github.com/yue-zhongqi/tif.


title: The spectrum of the Corona of Hypergraphs

abstract: The corona of hypergraphs is an extension of the corona operation applied to graphs. The corona $G_0^* \odot_1^n G_1^*$ of two hypergraphs is obtained by taking $n$ copies of $G_1^*$ (where $n$ is the order of $G_0^*$) and by joining the $i$-th vertex of $G_0^*$ with the $i$-th copy of $G_1^*$. In this paper, we estimate the complete spectrum(adjacency and Seidel) and eigenvectors of the corona $G_0^* \odot_1^n G_1^*$ of two hypergraphs when $G_1^*$ is regular. Additionally, we define the corona hypergraph $G_0^{*(m)}=G_0^{*(m-1)} \odot_1^n G_0^*$ and determined its adjacency spectrum. Also, we extend the definition coronal of the adjacency matrix. Moreover, we estimate the characteristic polynomial of Seidel matrix of the generalised corona of hypergraphs. Applying these results, we obtain infinitely many non-regular non-isomorphic adjacency and Seidel cospectral hypergraphs.


title: Learning at the Speed of Wireless: Online Real-Time Learning for AI-Enabled MIMO in NextG

abstract: Integration of artificial intelligence (AI) and machine learning (ML) into the air interface has been envisioned as a key technology for next-generation (NextG) cellular networks. At the air interface, multiple-input multiple-output (MIMO) and its variants such as multi-user MIMO (MU-MIMO) and massive/full-dimension MIMO have been key enablers across successive generations of cellular networks with evolving complexity and design challenges. Initiating active investigation into leveraging AI/ML tools to address these challenges for MIMO becomes a critical step towards an AI-enabled NextG air interface. At the NextG air interface, the underlying wireless environment will be extremely dynamic with operation adaptations performed on a sub-millisecond basis by MIMO operations such as MU-MIMO scheduling and rank/link adaptation. Given the enormously large number of operation adaptation possibilities, we contend that online real-time AI/ML-based approaches constitute a promising paradigm. To this end, we outline the inherent challenges and offer insights into the design of such online real-time AI/ML-based solutions for MIMO operations. An online real-time AI/ML-based method for MIMO-OFDM channel estimation is then presented, serving as a potential roadmap for developing similar techniques across various MIMO operations in NextG.


title: AlloyInEcore: Embedding of First-Order Relational Logic into Meta-Object Facility for Automated Model Reasoning

abstract: We present AlloyInEcore, a tool for specifying metamodels with their static semantics to facilitate automated, formal reasoning on models. Software development projects require that software systems be specified in various models (e.g., requirements models, architecture models, test models, and source code). It is crucial to reason about those models to ensure the correct and complete system specifications. AlloyInEcore allows the user to specify metamodels with their static semantics, while, using the semantics, it automatically detects inconsistent models, and completes partial models. It has been evaluated on three industrial case studies in the automotive domain (https://modelwriter.github.io/AlloyInEcore/).


title: Sengupta Transformations and Carrollian Relativistic Theory

abstract: A detailed and systematic formulation of Carrollian relativity is provided. Based on the transformations, first provided by Sengupta [19], we construct a mapping between Lorentz relativistic and Carrollian relativistic vectors. Using this map the Carroll theory is built from the standard Maxwell action. We show that we get self-consistent equations of motion from the action, both in electric and magnetic limits. We introduce Carroll electric and magnetic fields. A new set of maps is derived that connects Carroll electric and magnetic fields with the usual Maxwell ones and yields Carroll equations in terms of fields. Consistency of results with the potential formulation is shown. Carroll version of symmetries like duality, gauge, shift, Noether and boost are treated in details and their implications elaborated. Especially, boost symmetry provides a link to the various maps used in this paper.


title: Restricted Isometry Property of Rank-One Measurements with Random Unit-Modulus Vectors

abstract: The restricted isometry property (RIP) is essential for the linear map to guarantee the successful recovery of low-rank matrices. The existing works show that the linear map generated by the measurement matrices with independent and identically distributed (i.i.d.) entries satisfies RIP with high probability. However, when dealing with non-i.i.d. measurement matrices, such as the rank-one measurements, the RIP compliance may not be guaranteed. In this paper, we show that the RIP can still be achieved with high probability, when the rank-one measurement matrix is constructed by the random unit-modulus vectors. Compared to the existing works, we first address the challenge of establishing RIP for the linear map in non-i.i.d. scenarios. As validated in the experiments, this linear map is memory-efficient, and not only satisfies the RIP but also exhibits similar recovery performance of the low-rank matrices to that of conventional i.i.d. measurement matrices.


title: The Mass Gap of the Space-time and its Shape

abstract: Snyder's quantum space-time which is Lorentz invariant is investigated. It is found that the quanta of space-time have a positive mass that is interpreted as a positive real mass gap of space-time. This mass gap is related to the minimal length of measurement which is provided by Snyder's algebra. Several reasons to consider the space-time quanta as a 24-cell are discussed. Geometric reasons include its self-duality property and its 24 vertices that may represent the standard model of elementary particles. The 24-cell symmetry group is the Weyl/Coxeter group of the $F_4$ group which was found recently to generate the gauge group of the standard model. It is found that 24-cell may provide a geometric interpretation of the mass generation, Avogadro number, color confinement, and the flatness of the observable universe. The phenomenology and consistency with measurements is discussed.


title: Hardware requirements for trapped-ion based verifiable blind quantum computing with a measurement-only client

abstract: In blind quantum computing, a user with a simple client device can perform a quantum computation on a remote quantum server such that the server cannot gain knowledge about the computation. Here, we numerically investigate hardware requirements for verifiable blind quantum computing using an ion trap as server and a distant measurement-only client. While the client has no direct access to quantum-computing resources, it can remotely execute quantum programs on the server by measuring photons emitted by the trapped ion. We introduce a numerical model for trapped-ion quantum devices in NetSquid, a discrete-event simulator for quantum networks. Using this, we determine the minimal hardware requirements on a per-parameter basis to perform the verifiable blind quantum computing protocol. We benchmark these for a five-qubit linear graph state, with which any single-qubit rotation can be performed, where client and server are separated by 50 km. Current state-of-the-art ion traps satisfy the minimal requirements on a per-parameter basis, but all current imperfections combined make it impossible to perform the blind computation securely over 50 km using existing technology. Using a genetic algorithm, we determine the set of hardware parameters that minimises the total improvements required, finding directions along which to improve hardware to reach our threshold error probability that would enable experimental demonstration. In this way, we lay a path for the near-term experimental progress required to realise the implementation of verifiable blind quantum computing over a 50 km distance.


title: Modified scattering operator for nonlinear Schr\"odinger equations with time-decaying harmonic potentials

abstract: This paper is concerned with nonlinear Schr\"odinger equations with a time-decaying harmonic potential. The nonlinearity is gauge-invariant of the long-range critical order. In [24] and [22], it is proved that the equation admits a nontrivial solution that behaves like a free solution with a logarithmic phase correction in the frameworks of both the final state problem and the initial value problem. Furthermore, a modified scattering operator has been established in the case without the potential in [15]. In this paper, we construct a modified scattering operator for our equation by utilizing a generator of the Galilean transformation. Moreover, we remove a restriction for the coefficient of the potential which is required in [22].


title: Large deviations for occupation and waiting times of infinite ergodic transformations

abstract: We establish large deviation estimates related to the Darling--Kac theorem and generalized arcsine laws for occupation and waiting times of ergodic transformations preserving an infinite measure, such as non-uniformly expanding interval maps with indifferent fixed points. For the proof, we imitate the study of generalized arcsine laws for occupation times of one-dimensional diffusion processes and adopt a method of double Laplace transform.


title: Quantum Advantage: A Single Qubit's Experimental Edge in Classical Data Storage

abstract: We implement an experiment on a photonic quantum processor establishing efficacy of an elementary quantum system in classical information storage. The advantage is established by considering a class of simple bipartite games played with the communication resource qubit and classical bit (c-bit), respectively. Conventional wisdom, as articulated by the no-go theorems of Holevo and Frenkel-Weiner, suggests that such a quantum advantage is unattainable in scenarios wherein sender and receiver possess shared randomness or classical correlation between them. Notably, the advantage we report is demonstrated in a scenario where participating players lack any form of shared randomness. Our experiment involves the development of a variational triangular polarimeter, enabling the realization of positive operator value measurements crucial for establishing the targeted quantum advantage. In addition to demonstrating a robust communication advantage of a single qubit our experiment also opens avenues for immediate applications in near-term quantum technologies. Furthermore, it constitutes a semi-device-independent non-classicality certification scheme for the quantum encoding-decoding apparatus, underscoring the broader implications of our work beyond its immediate technological applications.


title: A randomized lattice rule without component-by-component construction

abstract: We study the multivariate integration problem for periodic functions from the weighted Korobov space in the randomized setting. We introduce a new randomized rank-1 lattice rule with a randomly chosen number of points, which avoids the need for component-by-component construction in the search for good generating vectors while still achieving nearly the optimal rate of the randomized error. Our idea is to exploit the fact that at least half of the possible generating vectors yield nearly the optimal rate of the worst-case error in the deterministic setting. By randomly choosing generating vectors $r$ times and comparing their corresponding worst-case errors, one can find one generating vector with a desired worst-case error bound with a very high probability, and the (small) failure probability can be controlled by increasing $r$ logarithmically as a function of the number of points. Numerical experiments are conducted to support our theoretical findings.


title: How to Save My Gas Fees: Understanding and Detecting Real-world Gas Issues in Solidity Programs

abstract: The execution of smart contracts on Ethereum, a public blockchain system, incurs a fee called gas fee for its computation and data-store consumption. When programmers develop smart contracts (e.g., in the Solidity programming language), they could unknowingly write code snippets that unnecessarily cause more gas fees. These issues, or what we call gas wastes, could lead to significant monetary waste for users. Yet, there have been no systematic examination of them or effective tools for detecting them. This paper takes the initiative in helping Ethereum users reduce their gas fees in two important steps: we conduct the first empirical study on gas wastes in popular smart contracts written in Solidity by understanding their root causes and fixing strategies; we then develop a static tool, PeCatch, to effectively detect gas wastes with simple fixes in Solidity programs based on our study findings. Overall, we make seven insights and four suggestions from our gas-waste study, which could foster future tool development, language improvement, and programmer awareness, and develop eight gas-waste checkers, which pinpoint 383 previously unknown gas wastes from famous Solidity libraries.


title: Solutions to q-hypergeometric equations associated with q-middle convolution

abstract: We investigate the integral representations of solutions to q-hypergeometric equation and its variant obtained through q-middle convolution by using transformation formulas for q-hypergeometric series. We show the correspondence between these integral solutions and solutions obtained through other methods. We also show the linear relationships among the integral solutions. Specifically, we provide an alternative proof for the connection formula for the standard form of q-hypergeometric equation.


title: The Influence of Validation Data on Logical and Scientific Interpretations of Forensic Expert Opinions

abstract: Forensic experts use specialized training and knowledge to enable other members of the judicial system to make better informed and more just decisions. Factfinders, in particular, are tasked with judging how much weight to give to experts' reports and opinions. Many references describe assessing evidential weight from the perspective of a forensic expert. Some recognize that stakeholders are each responsible for evaluating their own weight of evidence. Morris (1971, 1974, 1977) provided a general framework for recipients to update their own uncertainties after learning an expert's opinion. Although this framework is normative under Bayesian axioms and several forensic scholars advocate the use of Bayesian reasoning, few resources describe its application in forensic science. This paper addresses this gap by examining how recipients can combine principles of science and Bayesian reasoning to evaluate their own likelihood ratios for expert opinions. This exercise helps clarify how an expert's role depends on whether one envisions recipients to be logical and scientific or deferential. Illustrative examples with an expert's opinion expressed as a categorical conclusion, likelihood ratio, or range of likelihood ratios, or with likelihood ratios from multiple experts, each reveal the importance and influence of validation data for logical recipients' interpretations.


title: Elemental abundances in the diffuse ISM from joint FUV and X-ray spectroscopy: iron, oxygen, carbon and sulfur

abstract: In this study, we investigate interstellar absorption lines along the line of sight toward the galactic low-mass X-ray binary Cygnus X-2. We combine absorption line data obtained from high-resolution X-ray spectra collected with Chandra and XMM-Newton satellites, along with Far-UV absorption lines observed by the Hubble Space Telescope's (HST) Cosmic Origins Spectrograph (COS) Instrument. Our primary objective is to understand the abundance and depletion of oxygen, iron, sulfur, and carbon. To achieve this, we have developed an analysis pipeline that simultaneously fits both the UV and X-ray datasets. This novel approach takes into account the line spread function (LSF) of HST/COS, enhancing the precision of our results. We examine the absorption lines of FeII, SII, CII, and CI present in the FUV spectrum of Cygnus X-2, revealing the presence of at least two distinct absorbers characterized by different velocities. Additionally, we employ Cloudy simulations to compare our findings concerning the ionic ratios for the studied elements. We find that gaseous iron and sulfur exist in their singly ionized forms, Fe II and S II, respectively, while the abundances of CII and CI do not agree with the Cloudy simulations of the neutral ISM. Finally, we explore discrepancies in the X-ray atomic data of iron and discuss their impact on the overall abundance and depletion of iron.


title: DGAP: Efficient Dynamic Graph Analysis on Persistent Memory

abstract: Dynamic graphs, featuring continuously updated vertices and edges, have grown in importance for numerous real-world applications. To accommodate this, graph frameworks, particularly their internal data structures, must support both persistent graph updates and rapid graph analysis simultaneously, leading to complex designs to orchestrate `fast but volatile' and `persistent but slow' storage devices. Emerging persistent memory technologies, such as Optane DCPMM, offer a promising alternative to simplify the designs by providing data persistence, low latency, and high IOPS together. In light of this, we propose DGAP, a framework for efficient dynamic graph analysis on persistent memory. Unlike traditional dynamic graph frameworks, which combine multiple graph data structures (e.g., edge list or adjacency list) to achieve the required performance, DGAP utilizes a single mutable Compressed Sparse Row (CSR) graph structure with new designs for persistent memory to construct the framework. Specifically, DGAP introduces a \textit{per-section edge log} to reduce write amplification on persistent memory; a \textit{per-thread undo log} to enable high-performance, crash-consistent rebalancing operations; and a data placement schema to minimize in-place updates on persistent memory. Our extensive evaluation results demonstrate that DGAP can achieve up to $3.2\times$ better graph update performance and up to $3.77\times$ better graph analysis performance compared to state-of-the-art dynamic graph frameworks for persistent memory, such as XPGraph, LLAMA, and GraphOne.


title: Passive and active suppression of transduced noise in silicon spin qubits

abstract: Addressing and mitigating decoherence sources plays an essential role in the development of a scalable quantum computing system, which requires low gate errors to be consistently maintained throughout the circuit execution. While nuclear spin-free materials, such as isotopically purified silicon, exhibit intrinsically promising coherence properties for electron spin qubits, the omnipresent charge noise, when converted to magnetic noise under a strong magnetic field gradient, often hinders stable qubit operation within a time frame comparable to the data acquisition time. Here, we demonstrate both open- and closed-loop suppression techniques for the transduced noise in silicon spin qubits, resulting in a more than two-fold (ten-fold) improvement of the inhomogeneous coherence time (Rabi oscillation quality) that leads to a single-qubit gate fidelity of over 99.6% even in the presence of a strong decoherence field gradient. Utilizing gate set tomography, we show that adaptive qubit control also reduces the non-Markovian noise in the system, which validates the stability of the gate fidelity. The technique can be used to learn multiple Hamiltonian parameters and is useful for the intermittent calibration of the circuit parameters with affordable experimental overhead, providing a useful subroutine during the repeated execution of general quantum circuits.


title: G-EvoNAS: Evolutionary Neural Architecture Search Based on Network Growth

abstract: The evolutionary paradigm has been successfully applied to neural network search(NAS) in recent years. Due to the vast search complexity of the global space, current research mainly seeks to repeatedly stack partial architectures to build the entire model or to seek the entire model based on manually designed benchmark modules. The above two methods are attempts to reduce the search difficulty by narrowing the search space. To efficiently search network architecture in the global space, this paper proposes another solution, namely a computationally efficient neural architecture evolutionary search framework based on network growth (G-EvoNAS). The complete network is obtained by gradually deepening different Blocks. The process begins from a shallow network, grows and evolves, and gradually deepens into a complete network, reducing the search complexity in the global space. Then, to improve the ranking accuracy of the network, we reduce the weight coupling of each network in the SuperNet by pruning the SuperNet according to elite groups at different growth stages. The G-EvoNAS is tested on three commonly used image classification datasets, CIFAR10, CIFAR100, and ImageNet, and compared with various state-of-the-art algorithms, including hand-designed networks and NAS networks. Experimental results demonstrate that G-EvoNAS can find a neural network architecture comparable to state-of-the-art designs in 0.2 GPU days.


title: An Experimentally Benchmarked Geant4 SiPM-Based Scintillator Detector Simulation Platform for Gamma Ray Detection

abstract: Radiation detection is vital for naturally occurring radioactive material detection, port and border monitoring, and homeland security operations. SiPM-based single-volume scintillator detectors offer a cost-effective and robust solution that enables timely radioactive site surveys, while retaining accuracy and sensitivity sufficient for isotope identification. Enhanced site surveying can be achieved by optimising scintillator detector design. In this work, a detailed GAGG:Ce, CLLBC:Ce, BGO, NaI:Tl, and CsI:Tl SiPM-based scintillator detector simulation platform was developed with the Monte Carlo radiation transport toolkit, Geant4, and experimentally benchmarked. This simulation platform successfully predicted the spectral features for selected gamma ray emitting isotopes with energies between 30 keV to 2 MeV. The full width half maximum (FWHM) and normalised cross-correlation coefficient (NCCC) between simulated and experimental energy spectra were also compared. The majority of simulated FWHM values reproduced the experimental results within 2% and the NCCC values demonstrated agreement between the simulated and experimental energy spectra. Discrepancies in these figures of merit can be attributed to detector signal processing electronics modelling, geometry approximations, and multiple Compton scattering within the detector and surrounding environment.


title: Coexistence of topological semimetal states in holography

abstract: We introduce a holographic model that exhibits a coexistence state of the Weyl semimetal and the topological nodal line state, providing us with a valuable tool to investigate the system's behavior in the strong coupling regime. Nine types of bulk solutions exhibiting different IR behaviors have been identified, corresponding to nine different types of boundary states. These nine states include four distinct phases, namely the Weyl-nodal phase, the gap-nodal phase, the Weyl gap phase and the gap-gap phase, four phase boundaries, which are the Weyl-Dirac phase, the gap-Dirac phase, the Dirac-gap phase and the Dirac-nodal phase, and finally a double critical point. A phase diagram is plotted that exhibits qualitative similarity to the one obtained in the weak coupling limit. The anomalous Hall conductivity, which serves as an order parameter, and the free energy are calculated, with the latter showing the continuity of the topological phase transitions within the system. Our study highlights the similarities and differences in such a topological system between the weak and strong coupling regimes, paving the way for further experimental observations.


title: Better-than-average uniform random variables and Eulerian numbers, or: How many candidates should a voter approve?

abstract: Consider $n$ independent random numbers with a uniform distribution on $[0,1]$. The number of them that exceed their mean is shown to have an Eulerian distribution, i.e., it is described by the Eulerian numbers. This is related to, but distinct from, the well known fact that the integer part of the sum of independent random numbers uniform on $[0,1]$ has an Eulerian distribution. One motivation for this problem comes from voting theory.


title: On the convergence of conditional gradient method for unbounded multiobjective optimization problems

abstract: This paper focuses on developing a conditional gradient algorithm for multiobjective optimization problems with an unbounded feasible region. We employ the concept of recession cone to establish the well-defined nature of the algorithm. The asymptotic convergence property and the iteration-complexity bound are established under mild assumptions. Numerical examples are provided to verify the algorithmic performance.


title: A note on the slicing of fibrations

abstract: We describe the construction of the slice fibration of a given one.


title: On General Weighted Extropy of Extreme Ranked Set Sampling

abstract: The extropy measure, introduced by Lad, Sanfilippo, and Agro in their (2015) paper in Statistical Science, has garnered significant interest over the past years. In this study, we present a novel representation for the weighted extropy within the context of extreme ranked set sampling. Additionally, we offer related findings such as stochastic orders, characterizations, and precise bounds. Our results shed light onthe comparison between the weighted extropy of extreme ranked set sampling and its counterpart in simple random sampling.


title: Revisiting Meta-evaluation for Grammatical Error Correction

abstract: Metrics are the foundation for automatic evaluation in grammatical error correction (GEC), with their evaluation of the metrics (meta-evaluation) relying on their correlation with human judgments. However, conventional meta-evaluations in English GEC encounter several challenges including biases caused by inconsistencies in evaluation granularity, and an outdated setup using classical systems. These problems can lead to misinterpretation of metrics and potentially hinder the applicability of GEC techniques. To address these issues, this paper proposes SEEDA, a new dataset for GEC meta-evaluation. SEEDA consists of corrections with human ratings along two different granularities: edit-based and sentence-based, covering 12 state-of-the-art systems including large language models (LLMs), and two human corrections with different focuses. The results of improved correlations by aligning the granularity in the sentence-level meta-evaluation, suggest that edit-based metrics may have been underestimated in existing studies. Furthermore, correlations of most metrics decrease when changing from classical to neural systems, indicating that traditional metrics are relatively poor at evaluating fluently corrected sentences with many edits.


title: Probabilistic assessment of the reactor vessel lifetime

abstract: A simple and rapid method is proposed for assessing the reduction in the lifetime of steel walls of the reactor vessel under neutron irradiation. The method is based on modeling the number of radiation defects by the behavior of a general time-dependent random process of death and birth and queuing theory. Necessary data for assessments: the estimated operating time of the reactor (in years), the actual operating time of the reactor, the accumulated fluence depending on time, the temperature on the walls of the reactor vessel, the neutron absorption cross section of the steel of the reactor walls, the energy of fast neutrons striking the walls. The main problem: getting this accurate data.


title: Novel Dipole-Lattice coupling in the Quantum-Spin-Liquid Material $\kappa$-(BEDT-TTF)$_2$Cu$_2$(CN)$_3$

abstract: A family of molecular Mott insulators on triangular lattice provided a few S=1/2 triangular quantum spin liquid candidates, with $\kappa$-(BEDT-TTF)$_2$Cu$_2$(CN)$_3$ being the most studied material of this group. The large number experimental works present a conflicting set of evidence, with some suggesting spin liquid behavior, while others point towards a valence bond solid with orphan spins. In this work we use Raman scattering spectroscopy to probe both local charge on molecular sites and lattice phonons as a function of temperature down to 6~K. Based on the analysis of the line shape of the BEDT-TTF charge sensitive vibration $\nu_2$ on cooling below 40 K, we suggest a development of disordered fluctuating charge disproportionation on (BEDT-TTF)$_2$ dimers of amplitude as small as 0.06$e$. The lattice phonons show strong anomalous broadening on cooling only in the (c,c) scattering channel, associated with the developing charge disproportionation. We suggest an interpretation, where the coupling of disordered charge dipoles on dimers to the lattice results in anisotropic modulation of charge transfer integrals between dimer lattice sites. Such fluctuations would result in modulation of magnetic coupling between spins which can produce fluctuating charge ordered spin-singlet pairs.


title: Finetuned Multimodal Language Models Are High-Quality Image-Text Data Filters

abstract: We propose a novel framework for filtering image-text data by leveraging fine-tuned Multimodal Language Models (MLMs). Our approach outperforms predominant filtering methods (e.g., CLIPScore) via integrating the recent advances in MLMs. We design four distinct yet complementary metrics to holistically measure the quality of image-text data. A new pipeline is established to construct high-quality instruction data for fine-tuning MLMs as data filters. Comparing with CLIPScore, our MLM filters produce more precise and comprehensive scores that directly improve the quality of filtered data and boost the performance of pre-trained models. We achieve significant improvements over CLIPScore on popular foundation models (i.e., CLIP and BLIP2) and various downstream tasks. Our MLM filter can generalize to different models and tasks, and be used as a drop-in replacement for CLIPScore. An additional ablation study is provided to verify our design choices for the MLM filter.


title: Machine Learning Refinements to Metallicity-Dependent Isotopic Abundances

abstract: The project aims to use machine learning algorithms to fit the free parameters of an isotopic scaling model to elemental observations. The processes considered are massive star nucleosynthesis, Type Ia SNe, the s-process, the r-process, and p-isotope production. The analysis on the successful fits seeks to minimize the reduced chi squared between the model and the data. Based upon the successful refinement of the isotopic parameterized scaling model, a table providing the 287 stable isotopic abundances as a function of metallicity, separated into astrophysical processes, is useful for identifying the chemical history of them. The table provides a complete averaged chemical history for the Galaxy, subject to the underlying model constraints.


title: An Optimal Baseband Delay-Based Beam Squint Removal Scheme across a Range of Steering Angles for Digital Wideband Beamformers in Radars

abstract: This paper is an attempt to mitigate the beam squint happening due to frequency-dependent phase shifts in the wideband beamforming scenario, specifically in radar applications. The estimation of the direction of arrival is significant for precise target detection in radars. The undesirable beam squint effect due to the phase shift-only mechanism in conventional phased array systems, which becomes exacerbated when dealing with wide bandwidth signals, is analyzed for a large set of steering angles in this paper. An optimum baseband delay combined with the phase shift technique is proposed for wideband radar beamforming to mitigate beam squint effectively. This technique has been demonstrated to function properly with 1-GHz carrier frequency for signals with wide bandwidths of up to +/-250MHz and for steering angles ranging from 0 to 90 degrees.


title: A Dual-Level Cancelable Framework for Palmprint Verification and Hack-Proof Data Storage

abstract: In recent years, palmprints have been widely used for individual verification. The rich privacy information in palmprint data necessitates its protection to ensure security and privacy without sacrificing system performance. Existing systems often use cancelable technologies to protect templates, but these technologies ignore the potential risk of data leakage. Upon breaching the system and gaining access to the stored database, a hacker could easily manipulate the stored templates, compromising the security of the verification system. To address this issue, we propose a dual-level cancelable palmprint verification framework in this paper. Specifically, the raw template is initially encrypted using a competition hashing network with a first-level token, facilitating the end-to-end generation of cancelable templates. Different from previous works, the protected template undergoes further encryption to differentiate the second-level protected template from the first-level one. The system specifically creates a negative database (NDB) with the second-level token for dual-level protection during the enrollment stage. Reversing the NDB is NP-hard and a fine-grained algorithm for NDB generation is introduced to manage the noise and specified bits. During the verification stage, we propose an NDB matching algorithm based on matrix operation to accelerate the matching process of previous NDB methods caused by dictionary-based matching rules. This approach circumvents the need to store templates identical to those utilized for verification, reducing the risk of potential data leakage. Extensive experiments conducted on public palmprint datasets have confirmed the effectiveness and generality of the proposed framework. Upon acceptance of the paper, the code will be accessible at https://github.com/Deep-Imaging-Group/NPR.


title: SGD with Partial Hessian for Deep Neural Networks Optimization

abstract: Due to the effectiveness of second-order algorithms in solving classical optimization problems, designing second-order optimizers to train deep neural networks (DNNs) has attracted much research interest in recent years. However, because of the very high dimension of intermediate features in DNNs, it is difficult to directly compute and store the Hessian matrix for network optimization. Most of the previous second-order methods approximate the Hessian information imprecisely, resulting in unstable performance. In this work, we propose a compound optimizer, which is a combination of a second-order optimizer with a precise partial Hessian matrix for updating channel-wise parameters and the first-order stochastic gradient descent (SGD) optimizer for updating the other parameters. We show that the associated Hessian matrices of channel-wise parameters are diagonal and can be extracted directly and precisely from Hessian-free methods. The proposed method, namely SGD with Partial Hessian (SGD-PH), inherits the advantages of both first-order and second-order optimizers. Compared with first-order optimizers, it adopts a certain amount of information from the Hessian matrix to assist optimization, while compared with the existing second-order optimizers, it keeps the good generalization performance of first-order optimizers. Experiments on image classification tasks demonstrate the effectiveness of our proposed optimizer SGD-PH. The code is publicly available at \url{https://github.com/myingysun/SGDPH}.


title: Time Weaver: A Conditional Time Series Generation Model

abstract: Imagine generating a city's electricity demand pattern based on weather, the presence of an electric vehicle, and location, which could be used for capacity planning during a winter freeze. Such real-world time series are often enriched with paired heterogeneous contextual metadata (weather, location, etc.). Current approaches to time series generation often ignore this paired metadata, and its heterogeneity poses several practical challenges in adapting existing conditional generation approaches from the image, audio, and video domains to the time series domain. To address this gap, we introduce Time Weaver, a novel diffusion-based model that leverages the heterogeneous metadata in the form of categorical, continuous, and even time-variant variables to significantly improve time series generation. Additionally, we show that naive extensions of standard evaluation metrics from the image to the time series domain are insufficient. These metrics do not penalize conditional generation approaches for their poor specificity in reproducing the metadata-specific features in the generated time series. Thus, we innovate a novel evaluation metric that accurately captures the specificity of conditional generation and the realism of the generated time series. We show that Time Weaver outperforms state-of-the-art benchmarks, such as Generative Adversarial Networks (GANs), by up to 27% in downstream classification tasks on real-world energy, medical, air quality, and traffic data sets.


title: Learning to Defer to a Population: A Meta-Learning Approach

abstract: The learning to defer (L2D) framework allows autonomous systems to be safe and robust by allocating difficult decisions to a human expert. All existing work on L2D assumes that each expert is well-identified, and if any expert were to change, the system should be re-trained. In this work, we alleviate this constraint, formulating an L2D system that can cope with never-before-seen experts at test-time. We accomplish this by using meta-learning, considering both optimization- and model-based variants. Given a small context set to characterize the currently available expert, our framework can quickly adapt its deferral policy. For the model-based approach, we employ an attention mechanism that is able to look for points in the context set that are similar to a given test point, leading to an even more precise assessment of the expert's abilities. In the experiments, we validate our methods on image recognition, traffic sign detection, and skin lesion diagnosis benchmarks.