title: Universal Symmetry Constraints on Spin Polarization in Non-centrosymmetric Crystals

abstract: The current understanding of spin-polarization phenomena in crystals relying on the crystalline symmetries is far from complete. Here, we develop a universal theory, consisting of five basic symmetry-constrained rules, to capture the diverse spin textures (STs) in non-centrosymmetric crystals, via exhaustively classifying the crystalline symmetry operations and their combinations with time-reversal operation in symmetry-preserved k-invariant subspace. Our theory is verified by extensive material examples based on the first-principles calculations, explaining their kaleidoscopic STs or even vanishing spin-polarization effect. Interestingly, based on our theory, we argue that the generally accepted radial STs in chiral crystals cannot be rigorous. More importantly, combining with topological band theory, we propose the symmetry-constrained three-dimensional persistent STs, which is long sought but never be discovered, could be abundant in two families of nonsymmorphic crystals. Our theory could broaden our understanding of spin-polarization effect and enable the dream of ab initio design of desirable STs in crystals.


title: Superpolynomial period lengths of the winning positions in the subtraction game

abstract: Given a finite set of positive integers, $A$, and starting with a heap of $n$ chips, Alice and Bob alternate turns and on each turn a player chooses $x\in A$ with $x$ smaller or equal than the current number of chips and subtract $x$ chips from the heap. The game terminates when the current number of chips becomes smaller than $\min\{A\}$ and no moves are possible. The player who makes the last move is the winner. We can define $w^A(n)$ to be $1$ if Alice has a winning strategy with a starting heap of $n$ chips and $0$ if Bob has a winning strategy. By the Pigeonhole Principle, $w^A(n)$ becomes periodic, and it is easy to see that the period length is at most an exponential function of $\max\{A\}$. The typical period length is a linear function of $\max\{A\}$, and it is a long time open question if exponential period length is possible. We consider a slight modification of this game by introducing an initial seed $S$ that tells for the few initial numbers of chips whether the current or the opposite player is the winner. In this paper we show that the initial seed cannot change the period length of $w^A(n)$ if the size of $A$ is $1$ or $2$, but it can change the period length with $|A| \geq 3$. Further, we exhibit a class of sets $A$ of size $3$ and corresponding initial seeds such that the period length becomes a superpolynomial function of $\max\{A\}$.


title: Borcherds's Lie algebra and $C_2$-cofiniteness of vertex operator algebras of moonshine type

abstract: We precisely determined an $\bN$-graded structure of Zhu's poisson algebra $V/C_2(V)$ of vertex operator algebras $V$ of moonshine type. Namely, if $V$ is a vertex operator algebra of moonshine type with a central charge $24$, then $C_2(V)=\sum_{n=5}^{\infty}V_n+L(-1)V$.


title: FreestyleRet: Retrieving Images from Style-Diversified Queries

abstract: Image Retrieval aims to retrieve corresponding images based on a given query. In application scenarios, users intend to express their retrieval intent through various query styles. However, current retrieval tasks predominantly focus on text-query retrieval exploration, leading to limited retrieval query options and potential ambiguity or bias in user intention. In this paper, we propose the Style-Diversified Query-Based Image Retrieval task, which enables retrieval based on various query styles. To facilitate the novel setting, we propose the first Diverse-Style Retrieval dataset, encompassing diverse query styles including text, sketch, low-resolution, and art. We also propose a light-weighted style-diversified retrieval framework. For various query style inputs, we apply the Gram Matrix to extract the query's textural features and cluster them into a style space with style-specific bases. Then we employ the style-init prompt tuning module to enable the visual encoder to comprehend the texture and style information of the query. Experiments demonstrate that our model, employing the style-init prompt tuning strategy, outperforms existing retrieval models on the style-diversified retrieval task. Moreover, style-diversified queries~(sketch+text, art+text, etc) can be simultaneously retrieved in our model. The auxiliary information from other queries enhances the retrieval performance within the respective query.


title: PEFA: Parameter-Free Adapters for Large-scale Embedding-based Retrieval Models

abstract: Embedding-based Retrieval Models (ERMs) have emerged as a promising framework for large-scale text retrieval problems due to powerful large language models. Nevertheless, fine-tuning ERMs to reach state-of-the-art results can be expensive due to the extreme scale of data as well as the complexity of multi-stages pipelines (e.g., pre-training, fine-tuning, distillation). In this work, we propose the PEFA framework, namely ParamEter-Free Adapters, for fast tuning of ERMs without any backward pass in the optimization. At index building stage, PEFA equips the ERM with a non-parametric k-nearest neighbor (kNN) component. At inference stage, PEFA performs a convex combination of two scoring functions, one from the ERM and the other from the kNN. Based on the neighborhood definition, PEFA framework induces two realizations, namely PEFA-XL (i.e., extra large) using double ANN indices and PEFA-XS (i.e., extra small) using a single ANN index. Empirically, PEFA achieves significant improvement on two retrieval applications. For document retrieval, regarding Recall@100 metric, PEFA improves not only pre-trained ERMs on Trivia-QA by an average of 13.2%, but also fine-tuned ERMs on NQ-320K by an average of 5.5%, respectively. For product search, PEFA improves the Recall@100 of the fine-tuned ERMs by an average of 5.3% and 14.5%, for PEFA-XS and PEFA-XL, respectively. Our code is available at https://github.com/amzn/pecos/tree/mainline/examples/pefa-wsdm24.


title: Almost-Sure Safety Guarantees of Stochastic Zero-Control Barrier Functions Do Not Hold

abstract: The 2021 paper "Control barrier functions for stochastic systems" provides theorems that give almost sure safety guarantees given stochastic zero control barrier function (ZCBF). Unfortunately, both the theorem and its proof is invalid. In this letter, we illustrate on a toy example that the almost sure safety guarantees for stochastic ZCBF do not hold and explain why the proof is flawed. Although stochastic reciprocal barrier functions (RCBF) also uses the same proof technique, we provide a different proof technique that verifies that stochastic RCBFs are indeed safe with probability one. Using the RCBF, we derive a modified ZCBF condition that guarantees safety with probability one. Finally, we provide some discussion on the role of unbounded controls in the almost-sure safety guarantees of RCBFs, and show that the rate of divergence of the ratio of the drift and diffusion is the key for whether a system has almost sure safety guarantees.


title: Visually Grounded Language Learning: a review of language games, datasets, tasks, and models

abstract: In recent years, several machine learning models have been proposed. They are trained with a language modelling objective on large-scale text-only data. With such pretraining, they can achieve impressive results on many Natural Language Understanding and Generation tasks. However, many facets of meaning cannot be learned by ``listening to the radio" only. In the literature, many Vision+Language (V+L) tasks have been defined with the aim of creating models that can ground symbols in the visual modality. In this work, we provide a systematic literature review of several tasks and models proposed in the V+L field. We rely on Wittgenstein's idea of `language games' to categorise such tasks into 3 different families: 1) discriminative games, 2) generative games, and 3) interactive games. Our analysis of the literature provides evidence that future work should be focusing on interactive games where communication in Natural Language is important to resolve ambiguities about object referents and action plans and that physical embodiment is essential to understand the semantics of situations and events. Overall, these represent key requirements for developing grounded meanings in neural models.


title: Orthogonal Adaptation for Modular Customization of Diffusion Models

abstract: Customization techniques for text-to-image models have paved the way for a wide range of previously unattainable applications, enabling the generation of specific concepts across diverse contexts and styles. While existing methods facilitate high-fidelity customization for individual concepts or a limited, pre-defined set of them, they fall short of achieving scalability, where a single model can seamlessly render countless concepts. In this paper, we address a new problem called Modular Customization, with the goal of efficiently merging customized models that were fine-tuned independently for individual concepts. This allows the merged model to jointly synthesize concepts in one image without compromising fidelity or incurring any additional computational costs. To address this problem, we introduce Orthogonal Adaptation, a method designed to encourage the customized models, which do not have access to each other during fine-tuning, to have orthogonal residual weights. This ensures that during inference time, the customized models can be summed with minimal interference. Our proposed method is both simple and versatile, applicable to nearly all optimizable weights in the model architecture. Through an extensive set of quantitative and qualitative evaluations, our method consistently outperforms relevant baselines in terms of efficiency and identity preservation, demonstrating a significant leap toward scalable customization of diffusion models.


title: Lenna: Language Enhanced Reasoning Detection Assistant

abstract: With the fast-paced development of multimodal large language models (MLLMs), we can now converse with AI systems in natural languages to understand images. However, the reasoning power and world knowledge embedded in the large language models have been much less investigated and exploited for image perception tasks. In this paper, we propose Lenna, a language-enhanced reasoning detection assistant, which utilizes the robust multimodal feature representation of MLLMs, while preserving location information for detection. This is achieved by incorporating an additional <DET> token in the MLLM vocabulary that is free of explicit semantic context but serves as a prompt for the detector to identify the corresponding position. To evaluate the reasoning capability of Lenna, we construct a ReasonDet dataset to measure its performance on reasoning-based detection. Remarkably, Lenna demonstrates outstanding performance on ReasonDet and comes with significantly low training costs. It also incurs minimal transferring overhead when extended to other tasks. Our code and model will be available at https://git.io/Lenna.


title: FINER: Flexible spectral-bias tuning in Implicit NEural Representation by Variable-periodic Activation Functions

abstract: Implicit Neural Representation (INR), which utilizes a neural network to map coordinate inputs to corresponding attributes, is causing a revolution in the field of signal processing. However, current INR techniques suffer from a restricted capability to tune their supported frequency set, resulting in imperfect performance when representing complex signals with multiple frequencies. We have identified that this frequency-related problem can be greatly alleviated by introducing variable-periodic activation functions, for which we propose FINER. By initializing the bias of the neural network within different ranges, sub-functions with various frequencies in the variable-periodic function are selected for activation. Consequently, the supported frequency set of FINER can be flexibly tuned, leading to improved performance in signal representation. We demonstrate the capabilities of FINER in the contexts of 2D image fitting, 3D signed distance field representation, and 5D neural radiance fields optimization, and we show that it outperforms existing INRs.


title: Embedding Probability Distributions into Low Dimensional $\ell_1$: Tree Ising Models via Truncated Metrics

abstract: Given an arbitrary set of high dimensional points in $\ell_1$, there are known negative results that preclude the possibility of always mapping them to a low dimensional $\ell_1$ space while preserving distances with small multiplicative distortion. This is in stark contrast with dimension reduction in Euclidean space ($\ell_2$) where such mappings are always possible. While the first non-trivial lower bounds for $\ell_1$ dimension reduction were established almost 20 years ago, there has been limited progress in understanding what sets of points in $\ell_1$ are conducive to a low-dimensional mapping. In this work, we study a new characterization of $\ell_1$ metrics that are conducive to dimension reduction in $\ell_1$. Our characterization focuses on metrics that are defined by the disagreement of binary variables over a probability distribution -- any $\ell_1$ metric can be represented in this form. We show that, for configurations of $n$ points in $\ell_1$ obtained from tree Ising models, we can reduce dimension to $\mathrm{polylog}(n)$ with constant distortion. In doing so, we develop technical tools for embedding truncated metrics which have been studied because of their applications in computer vision, and are objects of independent interest in metric geometry. Among other tools, we show how any $\ell_1$ metric can be truncated with $O(1)$ distortion and $O(\log(n))$ blowup in dimension.


title: MUFFIN: Curating Multi-Faceted Instructions for Improving Instruction-Following

abstract: In the realm of large language models (LLMs), enhancing instruction-following capability often involves curating expansive training data. This is achieved through two primary schemes: i) Scaling-Inputs: Amplifying (input, output) pairs per task instruction, aiming for better instruction adherence. ii) Scaling Input-Free Tasks: Enlarging tasks, each composed of an (instruction, output) pair (without requiring a separate input anymore). However, LLMs under Scaling-Inputs tend to be overly sensitive to inputs, leading to misinterpretation or non-compliance with instructions. Conversely, Scaling Input-Free Tasks demands a substantial number of tasks but is less effective in instruction following when dealing with instances in Scaling-Inputs. This work introduces MUFFIN, a new scheme of instruction-following dataset curation. Specifically, we automatically Scale Tasks per Input by diversifying these tasks with various input facets. Experimental results across four zero-shot benchmarks, spanning both Scaling-Inputs and Scaling Input-Free Tasks schemes, reveal that LLMs, at various scales, trained on MUFFIN generally demonstrate superior instruction-following capabilities compared to those trained on the two aforementioned schemes.


title: GDN: A Stacking Network Used for Skin Cancer Diagnosis

abstract: Skin cancer, the primary type of cancer that can be identified by visual recognition, requires an automatic identification system that can accurately classify different types of lesions. This paper presents GoogLe-Dense Network (GDN), which is an image-classification model to identify two types of skin cancer, Basal Cell Carcinoma, and Melanoma. GDN uses stacking of different networks to enhance the model performance. Specifically, GDN consists of two sequential levels in its structure. The first level performs basic classification tasks accomplished by GoogLeNet and DenseNet, which are trained in parallel to enhance efficiency. To avoid low accuracy and long training time, the second level takes the output of the GoogLeNet and DenseNet as the input for a logistic regression model. We compare our method with four baseline networks including ResNet, VGGNet, DenseNet, and GoogLeNet on the dataset, in which GoogLeNet and DenseNet significantly outperform ResNet and VGGNet. In the second level, different stacking methods such as perceptron, logistic regression, SVM, decision trees and K-neighbor are studied in which Logistic Regression shows the best prediction result among all. The results prove that GDN, compared to a single network structure, has higher accuracy in optimizing skin cancer detection.


title: Adaptive Instrument Design for Indirect Experiments

abstract: Indirect experiments provide a valuable framework for estimating treatment effects in situations where conducting randomized control trials (RCTs) is impractical or unethical. Unlike RCTs, indirect experiments estimate treatment effects by leveraging (conditional) instrumental variables, enabling estimation through encouragement and recommendation rather than strict treatment assignment. However, the sample efficiency of such estimators depends not only on the inherent variability in outcomes but also on the varying compliance levels of users with the instrumental variables and the choice of estimator being used, especially when dealing with numerous instrumental variables. While adaptive experiment design has a rich literature for direct experiments, in this paper we take the initial steps towards enhancing sample efficiency for indirect experiments by adaptively designing a data collection policy over instrumental variables. Our main contribution is a practical computational procedure that utilizes influence functions to search for an optimal data collection policy, minimizing the mean-squared error of the desired (non-linear) estimator. Through experiments conducted in various domains inspired by real-world applications, we showcase how our method can significantly improve the sample efficiency of indirect experiments.


title: Let's Think Outside the Box: Exploring Leap-of-Thought in Large Language Models with Creative Humor Generation

abstract: Chain-of-Thought (CoT) guides large language models (LLMs) to reason step-by-step, and can motivate their logical reasoning ability. While effective for logical tasks, CoT is not conducive to creative problem-solving which often requires out-of-box thoughts and is crucial for innovation advancements. In this paper, we explore the Leap-of-Thought (LoT) abilities within LLMs -- a non-sequential, creative paradigm involving strong associations and knowledge leaps. To this end, we study LLMs on the popular Oogiri game which needs participants to have good creativity and strong associative thinking for responding unexpectedly and humorously to the given image, text, or both, and thus is suitable for LoT study. Then to investigate LLMs' LoT ability in the Oogiri game, we first build a multimodal and multilingual Oogiri-GO dataset which contains over 130,000 samples from the Oogiri game, and observe the insufficient LoT ability or failures of most existing LLMs on the Oogiri game. Accordingly, we introduce a creative Leap-of-Thought (CLoT) paradigm to improve LLM's LoT ability. CLoT first formulates the Oogiri-GO dataset into LoT-oriented instruction tuning data to train pretrained LLM for achieving certain LoT humor generation and discrimination abilities. Then CLoT designs an explorative self-refinement that encourages the LLM to generate more creative LoT data via exploring parallels between seemingly unrelated concepts and selects high-quality data to train itself for self-refinement. CLoT not only excels in humor generation in the Oogiri game but also boosts creative abilities in various tasks like cloud guessing game and divergent association task. These findings advance our understanding and offer a pathway to improve LLMs' creative capacities for innovative applications across domains. The dataset, code, and models will be released online. https://zhongshsh.github.io/CLoT/.


title: Beam Operation for Particle Physics and Photon Science with Pulse-to-Pulse Modulation at KEK injector LINAC

abstract: The electron and positron accelerator complex at KEK offers unique experimental opportunities in the fields of elementary particle physics with SuperKEKB collider and photon science with two light sources. In order to maximize the experimental performances at those facilities the injector LINAC employs pulse-to-pulse modulation at 50 Hz, injecting beams with diverse properties. The event-based control system effectively manages different beam configurations. This injection scheme was initially designed 15 years ago and has been in full operation since 2019. Over the years, quite a few enhancements have been implemented. As the event-based controls are tightly coupled with microwave systems, machine protection systems and so on, their modifications require meticulous planning. However, the diverse requirements from particle physics and photon science, stemming from the distinct nature of those experiments, often necessitate patient negotiation to meet the demands of both fields. This presentation discusses those operational aspects of the multidisciplinary facility.


title: MedDM:LLM-executable clinical guidance tree for clinical decision-making

abstract: It is becoming increasingly emphasis on the importance of LLM participating in clinical diagnosis decision-making. However, the low specialization refers to that current medical LLMs can not provide specific medical advice, which are more like a medical Q\&A. And there is no suitable clinical guidance tree data set that can be used directly with LLM. To address this issue, we first propose LLM-executavle clinical guidance tree(CGT), which can be directly used by large language models, and construct medical diagnostic decision-making dataset (MedDM), from flowcharts in clinical practice guidelines. We propose an approach to screen flowcharts from medical literature, followed by their identification and conversion into standardized diagnostic decision trees. Constructed a knowledge base with 1202 decision trees, which came from 5000 medical literature and covered 12 hospital departments, including internal medicine, surgery, psychiatry, and over 500 diseases.Moreover, we propose a method for reasoning on LLM-executable CGT and a Patient-LLM multi-turn dialogue framework.


title: A Comparative Study Between M30 and M92 : M92 Is A Merger Remnant With A Large Helium Enhancement

abstract: We perform a comparative study of the ex--situ second--parameter pair globular clusters (GCs) M30 and M92, having similar metallicities but different horizontal branch morphologies. We obtain the similar mean primordial carbon abundances for both clusters. However, M92 shows a large dispersion in carbon due to a more extended C--N anticorrelation, while M30 exhibits a higher primordial nitrogen abundance, suggesting that they have different chemical enrichment histories. Our new results confirm our previous result that M92 is a metal--complex GC showing a bimodal metallicity distribution. We also find that the metal--rich group of stars in M92 shows a helium enhancement as large as $\Delta Y$ $\sim$ 0.05 from the red giant branch bump (RGBB) $V$ magnitudes, which can also be supported by (i) a lack of bright RGB stars, (ii) synthetic evolutionary HB population models and (iii) the more extended spatial distribution due to different degree of the diffusion process from their lower masses. We reinterpret the [Eu/Fe] measurements by other, finding that the two metallicity groups of stars in M92 have significantly different [Eu/Fe] abundances with small scatters. This strongly suggests that they formed independently out of well mixed interstellar media in different environments. We suggest that M92 is a more complex system than a normal GC, most likely a merger remnant of two GCs or a even more complex system. In Appendix, we address the problems with the recently developed color--temperature relations and the usage of broadband photometry in the populational taggings.


title: E4SRec: An Elegant Effective Efficient Extensible Solution of Large Language Models for Sequential Recommendation

abstract: The recent advancements in Large Language Models (LLMs) have sparked interest in harnessing their potential within recommender systems. Since LLMs are designed for natural language tasks, existing recommendation approaches have predominantly transformed recommendation tasks into open-domain natural language generation tasks. However, this approach necessitates items to possess rich semantic information, often generates out-of-range results, and suffers from notably low efficiency and limited extensibility. Furthermore, practical ID-based recommendation strategies, reliant on a huge number of unique identities (IDs) to represent users and items, have gained prominence in real-world recommender systems due to their effectiveness and efficiency. Nevertheless, the incapacity of LLMs to model IDs presents a formidable challenge when seeking to leverage LLMs for personalized recommendations. In this paper, we introduce an Elegant Effective Efficient Extensible solution for large language models for Sequential Recommendation (E4SRec), which seamlessly integrates LLMs with traditional recommender systems that exclusively utilize IDs to represent items. Specifically, E4SRec takes ID sequences as inputs, ensuring that the generated outputs fall within the candidate lists. Furthermore, E4SRec possesses the capability to generate the entire ranking list in a single forward process, and demands only a minimal set of pluggable parameters, which are trained for each dataset while keeping the entire LLM frozen. We substantiate the effectiveness, efficiency, and extensibility of our proposed E4SRec through comprehensive experiments conducted on four widely-used real-world datasets. The implementation code is accessible at https://github.com/HestiaSky/E4SRec/.


title: Magnetic instability under ferroaxial moment

abstract: Magnetic anisotropy is one of the important factors in determining magnetic structures. A type of magnetic anisotropy is closely related to the symmetry of crystals. We theoretically investigate magnetic anisotropy and its related magnetic instability arising from an electric axial moment, which appears under the breaking of the mirror symmetry parallel to the moment but does not require the breakings of both spatial inversion and time-reversal symmetries. By performing perturbation and mean-field calculations in a complementary way, we show the appearance of the in-plane magnetic anisotropy when the electric axial moment occurs, which tends to tilt in-plane spin moments from the crystal axes in collaboration with relativistic spin--orbit coupling. We demonstrate such a tendency for single-site and four-site cluster models, the latter of which leads to the instability toward a spin vortex phase accompanying magnetic monopole and magnetic toroidal dipole.


title: LLaRA: Large Language-Recommendation Assistant

abstract: Sequential recommendation aims to predict users' next interaction with items based on their past engagement sequence. Recently, the advent of Large Language Models (LLMs) has sparked interest in leveraging them for sequential recommendation, viewing it as language modeling. Previous studies represent items within LLMs' input prompts as either ID indices or textual metadata. However, these approaches often fail to either encapsulate comprehensive world knowledge or exhibit sufficient behavioral understanding. To combine the complementary strengths of conventional recommenders in capturing behavioral patterns of users and LLMs in encoding world knowledge about items, we introduce Large Language-Recommendation Assistant (LLaRA). Specifically, it uses a novel hybrid prompting method that integrates ID-based item embeddings learned by traditional recommendation models with textual item features. Treating the "sequential behaviors of users" as a distinct modality beyond texts, we employ a projector to align the traditional recommender's ID embeddings with the LLM's input space. Moreover, rather than directly exposing the hybrid prompt to LLMs, a curriculum learning strategy is adopted to gradually ramp up training complexity. Initially, we warm up the LLM using text-only prompts, which better suit its inherent language modeling ability. Subsequently, we progressively transition to the hybrid prompts, training the model to seamlessly incorporate the behavioral knowledge from the traditional sequential recommender into the LLM. Empirical results validate the effectiveness of our proposed framework. Codes are available at https://github.com/ljy0ustc/LLaRA.


title: Electrical control and transport of tightly bound interlayer excitons in a MoSe2/hBN/MoSe2 heterostructure

abstract: Controlling interlayer excitons in van der Waals heterostructures holds promise for exploring Bose-Einstein condensates and developing novel optoelectronic applications, such as excitonic integrated circuits. Despite intensive studies, several key fundamental properties of interlayer excitons, such as their binding energies and interactions with charges, remain not well understood. Here we report the formation of momentum-direct interlayer excitons in a high-quality MoSe2/hBN/MoSe2 heterostructure under an electric field, characterized by bright photoluminescence (PL) emission with high quantum yield and a narrow linewidth of less than 4 meV. These interlayer excitons show electrically tunable emission energy spanning ~180 meV through the Stark effect, and exhibit a sizable binding energy of ~81 meV in the intrinsic regime, along with trion binding energies of a few millielectronvolts. Remarkably, we demonstrate the long-range transport of interlayer excitons with a characteristic diffusion length exceeding ten micrometers, which can be attributed, in part, to their dipolar repulsive interactions. Spatially and polarization-resolved spectroscopic studies reveal rich exciton physics in the system, such as valley polarization, local trapping, and the possible existence of dark interlayer excitons. The formation and transport of tightly bound interlayer excitons with narrow linewidth, coupled with the ability to electrically manipulate their properties, open exciting new avenues for exploring quantum many-body physics, including excitonic condensate and superfluidity, and for developing novel optoelectronic devices, such as exciton and photon routers.


title: Fast non-autoregressive inverse folding with discrete diffusion

abstract: Generating protein sequences that fold into a intended 3D structure is a fundamental step in de novo protein design. De facto methods utilize autoregressive generation, but this eschews higher order interactions that could be exploited to improve inference speed. We describe a non-autoregressive alternative that performs inference using a constant number of calls resulting in a 23 times speed up without a loss in performance on the CATH benchmark. Conditioned on the 3D structure, we fine-tune ProteinMPNN to perform discrete diffusion with a purity prior over the index sampling order. Our approach gives the flexibility in trading off inference speed and accuracy by modulating the diffusion speed. Code: https://github.com/johnyang101/pmpnndiff


title: Time-Relative RTK-GNSS: GNSS Loop Closure in Pose Graph Optimization

abstract: A pose-graph-based optimization technique is widely used to estimate robot poses using various sensor measurements from devices such as laser scanners and cameras. The global navigation satellite system (GNSS) has recently been used to estimate the absolute 3D position of outdoor mobile robots. However, since the accuracy of GNSS single-point positioning is only a few meters, the GNSS is not used for the loop closure of a pose graph. The main purpose of this study is to generate a loop closure of a pose graph using a time-relative real-time kinematic GNSS (TR-RTK-GNSS) technique. The proposed TR-RTK-GNSS technique uses time-differential carrier phase positioning, which is based on carrier-phase-based differential GNSS with a single GNSS receiver. Unlike a conventional RTK-GNSS, we can directly compute the robot's relative position using only a stand-alone GNSS receiver. The initial pose graph is generated from the accumulated velocity computed from GNSS Doppler measurements. To reduce the accumulated error of velocity, we use the TR-RTK-GNSS technique for the loop closure in the graph-based optimization framework. The kinematic positioning tests were performed using an unmanned aerial vehicle to confirm the effectiveness of the proposed technique. From the tests, we can estimate the vehicle's trajectory with approximately 3 cm accuracy using only a stand-alone GNSS receiver.


title: Adaptive unified gas-kinetic scheme for diatomic gases with rotational and vibrational nonequilibrium

abstract: Multiscale non-equilibrium physics at large variations of local Knudsen number are encountered in applications of aerospace engineering and micro-electro-mechanical systems, such as high-speed flying vehicles and low pressure of the encapsulation. An accurate description of flow physics in all flow regimes within a single computation requires a genuinely multiscale method. The adaptive unified gas-kinetic scheme (AUGKS) is developed for such multiscale flow simulation. The AUGKS applies discretized velocity space to accurately capture the non-equilibrium physics in the multiscale UGKS, and adaptively employs continuous distribution functions following Chapman-Enskog expansion to efficiently recover near-equilibrium flow region in GKS. The UGKS and GKS are dynamically connected at the cell interface through the fluxes from the discretized and continuous gas distribution functions, which avoids any buffer zone between them. In this study, the AUGKS method with rotation and vibration non-equilibrium is developed. The real gas effect in different flow regimes has been captured. To capture aerodynamic heating accurately, the heat flux modifications are also included. Unstructured discrete particle velocity space is adopted to further improve the computational performance. Numerical tests, including Sod tube, normal shock structure, high-speed flow around the two-dimensional cylinder and three-dimensional sphere and space vehicles, and an unsteady nozzle plume flow from the continuum flow to the background vacuum, have been conducted to validate the current scheme. In comparison with the original UGKS, the current scheme speeds up the computation, reduces the memory requirement, and maintains the equivalent accuracy for multiscale flow simulation, which provides an effective tool for non-equilibrium flow simulations, especially for the flows at low and medium speed.


title: GIT-Net: Generalized Integral Transform for Operator Learning

abstract: This article introduces GIT-Net, a deep neural network architecture for approximating Partial Differential Equation (PDE) operators, inspired by integral transform operators. GIT-NET harnesses the fact that differential operators commonly used for defining PDEs can often be represented parsimoniously when expressed in specialized functional bases (e.g., Fourier basis). Unlike rigid integral transforms, GIT-Net parametrizes adaptive generalized integral transforms with deep neural networks. When compared to several recently proposed alternatives, GIT-Net's computational and memory requirements scale gracefully with mesh discretizations, facilitating its application to PDE problems on complex geometries. Numerical experiments demonstrate that GIT-Net is a competitive neural network operator, exhibiting small test errors and low evaluations across a range of PDE problems. This stands in contrast to existing neural network operators, which typically excel in just one of these areas.


title: Evaluating the Convergence Limit of Quantum Neural Tangent Kernel

abstract: Quantum variational algorithms have been one of major applications of quantum computing with current quantum devices. There are recent attempts to establish the foundation for these algorithms. A possible approach is to characterize the training dynamics with quantum neural tangent kernel. In this work, we construct the kernel for two models, Quantun Ensemble and Quantum Neural Network, and show the convergence of these models in the limit of infinitely many qubits. We also show applications of the kernel limit in regression tasks.


title: Arbitrary interaction quench phenomena in harmonically trapped two-body systems

abstract: We consider the evolution of two contact-interacting harmonically-trapped particles following an arbitrary quench in interaction strength. We calculate the post-quench particle separation as a function of time and the total post-quench energy. When quenching from any non-zero interaction strength to zero interaction strength we observe that the total energy and particle separation diverge. In particular, the divergent behaviour arises always and exclusively when quenching to the non-interacting regime. The source of the divergence is a power-law tail in the probability distribution of particle separation. This validates and builds upon previous work that found divergent behaviour arises when quenching from the strongly interacting limit to the non-interacting limit in both the two and three-body cases.


title: Entangling Excitons with Microcavity Photons

abstract: We provide a systemic theory to entangle excitons with microcavity photons. This is realized by adopting an exciton-optomechanics system and introducing a nonlinear dispersive interaction with a mechanical oscillator. We show that when either the exciton and cavity modes in the weak-coupling regime, or the two exciton-polariton modes in the strong-coupling regime, are respectively resonant with the optomechanical Stokes and anti-Stokes sidebands, entanglement between excitons and cavity photons, or between two exciton polaritons, can be established. The entanglement is in the steady state and can potentially be achievable at room temperature. In both cases, genuine tripartite entanglement is shown to be present.


title: Pole determination of $X(3960)$ and $X_0(4140)$ in decay $B^+\to K^+D_s^+D_s^-$

abstract: Two near-threshold peaking structures with spin-parities $J^{PC}=0^{++}$ were recently discovered by the LHCb Collaboration in the $D_s^+D_s^-$ invariant mass distribution of the decay process $B^+\to D_s^+D_s^-K^+$. In our study, we employed a coupled-channel model to fit the experimental results published by the LHCb collaboration, simultaneously fitting the model to the invariant mass distributions of $M_{D_s^+D_s^-}$, $M_{D_s^+K^+}$, and $M_{D_s^-K^+}$. We utilized a coupled-channel model to search for the poles of $X(3960)$ and $X_0(4140)$. The determination of the poles is meaningful in itself, and it also lays an foundation for the future research on $X(3960)$ and $X_0(4140)$. Upon turning off the coupled-channel and performing another fit, we observed a change in the fitting quality, the effect was almost entirely due to the peak of $X(3960)$, so we suggest that $X(3960)$ may not be a kinematic effect.


title: Boundary Harnack principle for non-local operators on metric measure spaces

abstract: In this paper, a necessary and sufficient condition is obtained for the scale invariant boundary Harnack inequality (BHP in abbreviation) for a large class of Hunt processes on metric measure spaces that are in weak duality with another Hunt process. We next consider a discontinuous subordinate Brownian motion with Gaussian component $X_t=W_{S_t}$ in ${\bf R}^d$ for which the L\'evy density of the subordinator $S$ satisfies some mild comparability condition. We show that the scale invariant BHP holds for the subordinate Brownian motion $X$ in any Lipschitz domain satisfying the interior cone condition with common angle $\theta\in (\cos^{-1}(1/\sqrt d), \pi)$, but fails in any truncated circular cone with angle $\theta \leq \cos^{-1}(1/\sqrt d)$, a Lipschitz domain whose Lipschitz constant is larger than or equal to $1/\sqrt{d-1}.$


title: Watermarking for Neural Radiation Fields by Invertible Neural Network

abstract: To protect the copyright of the 3D scene represented by the neural radiation field, the embedding and extraction of the neural radiation field watermark are considered as a pair of inverse problems of image transformations. A scheme for protecting the copyright of the neural radiation field is proposed using invertible neural network watermarking, which utilizes watermarking techniques for 2D images to achieve the protection of the 3D scene. The scheme embeds the watermark in the training image of the neural radiation field through the forward process in the invertible network and extracts the watermark from the image rendered by the neural radiation field using the inverse process to realize the copyright protection of both the neural radiation field and the 3D scene. Since the rendering process of the neural radiation field can cause the loss of watermark information, the scheme incorporates an image quality enhancement module, which utilizes a neural network to recover the rendered image and then extracts the watermark. The scheme embeds a watermark in each training image to train the neural radiation field and enables the extraction of watermark information from multiple viewpoints. Simulation experimental results demonstrate the effectiveness of the method.


title: Linear Weightings and Deformations of Vector Bundles

abstract: We define and explore the notion of linear weightings for vector bundles, extending the recent work by Loizides and Meinrenken. We construct weighted normal bundles and deformation spaces in the category of vector bundles. We explain how a linear weighting determines a filtration on differential operators, and an interpolation between a differential operator and its ``weighted" linearization. We close by explaining how our constructions capture the rescaled spinor bundle of Higson and Yi, and a related construction by \v{S}evera.


title: Three Puzzles with Covariance and Supertranslation Invariance of Angular Momentum Flux (with Solutions)

abstract: We describe and solve three puzzles arising in covariant and supertranslation-invariant formulas for the flux of angular momentum and other Lorentz charges in asymptotically flat spacetimes: 1) Supertranslation-invariance and covariance imply invariance under spacetime translations; 2) the flux depends on redundant auxiliary degrees of freedom that cannot be set to zero in all Lorentz frames without breaking Lorentz covariance; 3) supertranslation-invariant Lorentz charges do not generate the transformations of the Bondi mass aspect implied by the isometries of the asymptotic metric. In this letter, we solve the first two puzzles by presenting covariant formulas that unambiguously determine the auxiliary degrees of freedom and clarify the last puzzle by explaining the different role played by covariant and canonical charges. Our construction makes explicit the choice of reference frame underpinning seemingly unambiguous results presented in the current literature.


title: An adaptive preconditioning scheme for the self-consistent field iteration and generalized stacking-fault energy calculations

abstract: The generalized stacking-fault energy (GSFE) is the fundamental but key parameter for the plastic deformation of materials. We perform first-principles calculations by full-potential linearized augmented planewave (FLAPW) method to evaluate the GSFE based on the single-shift and triple-shift supercell models. Different degrees of defects are introduced in the two models, thereby affecting the convergence of the self-consistent field (SCF) iterations. We present an adaptive preconditioning scheme which can identify the long-wavelength divergence behavior of the Jacobian during the SCF iteration and automatically switch on the Kerker preconditioning to accelerate the convergence. We implement this algorithm in Elk-7.2.42 package and calculate the GSFE curves for Al, Cu, and Si (111) plane <-1-12> direction. We found that the single-shift and triple-shift supercell models have equivalent calculation accuracy and are within the experimental data uncertainty. For computational efficiency, the triple-shift supercell model is preferable due to its better convergence, exhibiting lower degree of defect compared to the single-shift supercell model.


title: Optimal Proposal Particle Filters for Detecting Anomalies and Manoeuvres from Two Line Element Data

abstract: Detecting anomalous behaviour of satellites is an important goal within the broader task of space situational awareness. The Two Line Element (TLE) data published by NORAD is the only widely-available, comprehensive source of data for satellite orbits. We present here a filtering approach for detecting anomalies in satellite orbits from TLE data. Optimal proposal particle filters are deployed to track the state of the satellites' orbits. New TLEs that are unlikely given our belief of the current orbital state are designated as anomalies. The change in the orbits over time is modelled using the SGP4 model with some adaptations. A model uncertainty is derived to handle the errors in SGP4 around singularities in the orbital elements. The proposed techniques are evaluated on a set of 15 satellites for which ground truth is available and the particle filters are shown to be superior at detecting the subtle in-track and cross-track manoeuvres in the simulated dataset, as well as providing a measure of uncertainty of detections.


title: Conjugate gradient methods without line search for multiobjective optimization

abstract: This paper addresses an unconstrained multiobjective optimization problem where two or more continuously differentiable functions have to be minimized. We delve into the conjugate gradient methods proposed by Lucambio P\'{e}rez and Prudente (SIAM J Optim, 28(3): 2690--2720, 2018) for this type of problem. Instead of the Wolfe-type line search procedure used in their work, we employ a fixed stepsize formula (or no-line-search scheme), which can mitigate the selection pressure caused by multiple inequalities and avoid the computational cost associated with objective function evaluations in specific applications. The no-line-search scheme is utilized to derive the condition of Zoutendijk's type. Global convergence encompasses the vector extensions of Fletcher-Reeves, conjugate descent, Dai-Yuan, Polak-Ribi\`{e}re-Polyak and Hestenes-Stiefel parameters, subject to certain mild assumptions. Additionally, numerical experiments are conducted to demonstrate the practical performance of the proposed stepsize rule, and comparative analyses are made with the multiobjective steepest descent methods using the Armijo line search and the multiobjective conjugate gradient methods using the Wolfe-type line search.


title: Dimensionality Reduction and Dynamical Mode Recognition of Circular Arrays of Flame Oscillators Using Deep Neural Network

abstract: Oscillatory combustion in aero engines and modern gas turbines often has significant adverse effects on their operation, and accurately recognizing various oscillation modes is the prerequisite for understanding and controlling combustion instability. However, the high-dimensional spatial-temporal data of a complex combustion system typically poses considerable challenges to the dynamical mode recognition. Based on a two-layer bidirectional long short-term memory variational autoencoder (Bi-LSTM-VAE) dimensionality reduction model and a two-dimensional Wasserstein distance-based classifier (WDC), this study proposes a promising method (Bi-LSTM-VAE-WDC) for recognizing dynamical modes in oscillatory combustion systems. Specifically, the Bi-LSTM-VAE dimension reduction model was introduced to reduce the high-dimensional spatial-temporal data of the combustion system to a low-dimensional phase space; Gaussian kernel density estimates (GKDE) were computed based on the distribution of phase points in a grid; two-dimensional WD values were calculated from the GKDE maps to recognize the oscillation modes. The time-series data used in this study were obtained from numerical simulations of circular arrays of laminar flame oscillators. The results show that the novel Bi-LSTM-VAE method can produce a non-overlapping distribution of phase points, indicating an effective unsupervised mode recognition and classification. Furthermore, the present method exhibits a more prominent performance than VAE and PCA (principal component analysis) for distinguishing dynamical modes in complex flame systems, implying its potential in studying turbulent combustion.


title: Pairwise annihilation of Weyl nodes induced by magnetic fields in the Hofstadter regime

abstract: Weyl semimetal, which does not require any symmetry except translation for protection, is a robust gapless state of quantum matters in three dimensions. When translation symmetry is preserved, the only way to destroy a Weyl semimetal state is to bring two Weyl nodes of opposite chirality close to each other to annihilate pairwise. An external magnetic field can destroy a pair of Weyl nodes (which are separated by a momentum space distance $2k_0$) of opposite chirality, when the magnetic length $l_B$ becomes close to or smaller than the inverse separation $1/2k_0$. In this work, we investigate pairwise annihilation of Weyl nodes induced by external magnetic field which ranges all the way from small to a very large value in the Hofstadter regime $l_B \sim a$. We show that this pairwise annihilation in a WSM featuring two Weyl nodes leads to the emergence of either a normal insulator or a layered Chern insulator. In the case of a Weyl semimetal with multiple Weyl nodes, the potential for generating a variety of states through external magnetic fields emerges. Our study introduces a straightforward and intuitive representation of the pairwise annihilation process induced by magnetic fields, enabling accurate predictions of the phases that may appear after pairwise annihilation of Weyl nodes.


title: SAM-Assisted Remote Sensing Imagery Semantic Segmentation with Object and Boundary Constraints

abstract: Semantic segmentation of remote sensing imagery plays a pivotal role in extracting precise information for diverse down-stream applications. Recent development of the Segment Anything Model (SAM), an advanced general-purpose segmentation model, has revolutionized this field, presenting new avenues for accurate and efficient segmentation. However, SAM is limited to generating segmentation results without class information. Consequently, the utilization of such a powerful general vision model for semantic segmentation in remote sensing images has become a focal point of research. In this paper, we present a streamlined framework aimed at leveraging the raw output of SAM by exploiting two novel concepts called SAM-Generated Object (SGO) and SAM-Generated Boundary (SGB). More specifically, we propose a novel object loss and further introduce a boundary loss as augmentative components to aid in model optimization in a general semantic segmentation framework. Taking into account the content characteristics of SGO, we introduce the concept of object consistency to leverage segmented regions lacking semantic information. By imposing constraints on the consistency of predicted values within objects, the object loss aims to enhance semantic segmentation performance. Furthermore, the boundary loss capitalizes on the distinctive features of SGB by directing the model's attention to the boundary information of the object. Experimental results on two well-known datasets, namely ISPRS Vaihingen and LoveDA Urban, demonstrate the effectiveness of our proposed method. The source code for this work will be accessible at https://github.com/sstary/SSRS.


title: Robust Design of Persuasion Games

abstract: We analyze many-sender Bayesian persuasion games where receiver can contract their action on senders' choices of Blackwell experiment and realized signals. We characterize robust mechanisms: those that induce the same joint distributions of actions and senders' private types for all possible prior beliefs. These mechanisms take a simple form: they (1) incentivize maximally informative experiments, and (2) depend only on the induced posterior. We prove a grim-trigger-like principle for unilateral deviations, and show robustness is pinned down by a finite set of linear inequalities. We apply our model to allocation problems with either type-dependent outside options or allocation externalities and identify conditions where the efficient outcome is robust. Finally, we uncover a novel justification for deferred acceptance via informational incentives in two-sided matching when school preferences depend on students' unknown ability.


title: Merger Tree-based Galaxy Matching: A Comparative Study Across Different Resolutions

abstract: We introduce a novel halo/galaxy matching technique between two cosmological simulations with different resolutions, which utilizes the positions and masses of halos along their subhalo merger tree. With this tool, we conduct a study of resolution biases through the {\it galaxy-by-galaxy} inspection of a pair of simulations that have the same simulation configuration but different mass resolutions, utilizing a suite of {\sc IllustrisTNG} simulations to assess the impact on galaxy properties. We find that, with the subgrid physics model calibrated for TNG100-1, subhalos in TNG100-1 (high resolution) have $\lesssim0.5$ dex higher stellar masses than their counterparts in the TNG100-2 (low-resolution). It is also discovered that the subhalos with $M_{\mathrm{gas}}\sim10^{8.5}\,{\rm M}_\odot$ in TNG100-1 have $\sim0.5$ dex higher gas mass than those in TNG100-2. The mass profiles of the subhalos reveal that the dark matter masses of subhalos in TNG100-2 converge well with those from TNG100-1, except within 4 kpc of the resolution limit. The differences in stellar mass and hot gas mass are most pronounced in the central region. We exploit machine learning to build a correction mapping for the physical quantities of subhalos from low- to high-resolution simulations (TNG300-1 and TNG100-1), which enables us to find an efficient way to compile a high-resolution galaxy catalog even from a low-resolution simulation. Our tools can easily be applied to other large cosmological simulations, testing and mitigating the resolution biases of their numerical codes and subgrid physics models.


title: Object Importance Estimation using Counterfactual Reasoning for Intelligent Driving

abstract: The ability to identify important objects in a complex and dynamic driving environment is essential for autonomous driving agents to make safe and efficient driving decisions. It also helps assistive driving systems decide when to alert drivers. We tackle object importance estimation in a data-driven fashion and introduce HOIST - Human-annotated Object Importance in Simulated Traffic. HOIST contains driving scenarios with human-annotated importance labels for vehicles and pedestrians. We additionally propose a novel approach that relies on counterfactual reasoning to estimate an object's importance. We generate counterfactual scenarios by modifying the motion of objects and ascribe importance based on how the modifications affect the ego vehicle's driving. Our approach outperforms strong baselines for the task of object importance estimation on HOIST. We also perform ablation studies to justify our design choices and show the significance of the different components of our proposed approach.


title: Terrain-Based UAV Deployment: Providing Coverage for Outdoor Users

abstract: Deploying unmanned aerial vehicle (UAV) networks to provide coverage for outdoor users has attracted great attention during the last decade. However, outdoor coverage is challenging due to the high mobility of crowds and the diverse terrain configurations causing building blockage. Most studies use stochastic channel models to characterize the impact of building blockage on user performance and do not take into account terrain information. On the other hand, real-time search methods use terrain information, but they are only practical when a single UAV serves a single user.In this paper, we put forward two methods to avoid building blockage in a multi-user system by collecting prior terrain information and using real-time search.We proposed four algorithms related to the combinations of the above methods and their performances are evaluated and compared in different scenarios.By adjusting the height of the UAV based on terrain information collected before networking, the performance is significantly enhanced compared to the one when no terrain information is available.The algorithm based on real-time search further improves the coverage performance by avoiding the shadow of buildings. During the execution of the real-time search algorithm, the search distance is reduced using the collected terrain information.


title: Learning Energy-based Model via Dual-MCMC Teaching

abstract: This paper studies the fundamental learning problem of the energy-based model (EBM). Learning the EBM can be achieved using the maximum likelihood estimation (MLE), which typically involves the Markov Chain Monte Carlo (MCMC) sampling, such as the Langevin dynamics. However, the noise-initialized Langevin dynamics can be challenging in practice and hard to mix. This motivates the exploration of joint training with the generator model where the generator model serves as a complementary model to bypass MCMC sampling. However, such a method can be less accurate than the MCMC and result in biased EBM learning. While the generator can also serve as an initializer model for better MCMC sampling, its learning can be biased since it only matches the EBM and has no access to empirical training examples. Such biased generator learning may limit the potential of learning the EBM. To address this issue, we present a joint learning framework that interweaves the maximum likelihood learning algorithm for both the EBM and the complementary generator model. In particular, the generator model is learned by MLE to match both the EBM and the empirical data distribution, making it a more informative initializer for MCMC sampling of EBM. Learning generator with observed examples typically requires inference of the generator posterior. To ensure accurate and efficient inference, we adopt the MCMC posterior sampling and introduce a complementary inference model to initialize such latent MCMC sampling. We show that three separate models can be seamlessly integrated into our joint framework through two (dual-) MCMC teaching, enabling effective and efficient EBM learning.


title: Generator Born from Classifier

abstract: In this paper, we make a bold attempt toward an ambitious task: given a pre-trained classifier, we aim to reconstruct an image generator, without relying on any data samples. From a black-box perspective, this challenge seems intractable, since it inevitably involves identifying the inverse function for a classifier, which is, by nature, an information extraction process. As such, we resort to leveraging the knowledge encapsulated within the parameters of the neural network. Grounded on the theory of Maximum-Margin Bias of gradient descent, we propose a novel learning paradigm, in which the generator is trained to ensure that the convergence conditions of the network parameters are satisfied over the generated distribution of the samples. Empirical validation from various image generation tasks substantiates the efficacy of our strategy.


title: Congestion-aware Distributed Task Offloading in Wireless Multi-hop Networks Using Graph Neural Networks

abstract: Computational offloading has become an enabling component for edge intelligence in mobile and smart devices. Existing offloading schemes mainly focus on mobile devices and servers, while ignoring the potential network congestion caused by tasks from multiple mobile devices, especially in wireless multi-hop networks. To fill this gap, we propose a low-overhead, congestion-aware distributed task offloading scheme by augmenting a distributed greedy framework with graph-based machine learning. In simulated wireless multi-hop networks with 20-110 nodes and a resource allocation scheme based on shortest path routing and contention-based link scheduling, our approach is demonstrated to be effective in reducing congestion or unstable queues under the context-agnostic baseline, while improving the execution latency over local computing.


title: An explanation for the distribution characteristics of stock returns

abstract: Observations indicate that the distributions of stock returns in financial markets usually do not conform to normal distributions, but rather exhibit characteristics of high peaks, fat tails and biases. In this work, we assume that the effects of events or information on prices obey normal distribution, while financial markets often overreact or underreact to events or information, resulting in non normal distributions of stock returns. Based on the above assumptions, we propose a reaction function for a financial market reacting to events or information, and a model based on it to describe the distribution of real stock returns. Our analysis of the returns of China Securities Index 300 (CSI 300), the Standard & Poor's 500 Index (SPX or S&P 500) and the Nikkei 225 Index (N225) at different time scales shows that financial markets often underreact to events or information with minor impacts, overreact to events or information with relatively significant impacts, and react slightly stronger to positive events or information than to negative ones. In addition, differences in financial markets and time scales of returns can also affect the shapes of the reaction functions.


title: NeutronStream: A Dynamic GNN Training Framework with Sliding Window for Graph Streams

abstract: Existing Graph Neural Network (GNN) training frameworks have been designed to help developers easily create performant GNN implementations. However, most existing GNN frameworks assume that the input graphs are static, but ignore that most real-world graphs are constantly evolving. Though many dynamic GNN models have emerged to learn from evolving graphs, the training process of these dynamic GNNs is dramatically different from traditional GNNs in that it captures both the spatial and temporal dependencies of graph updates. This poses new challenges for designing dynamic GNN training frameworks. First, the traditional batched training method fails to capture real-time structural evolution information. Second, the time-dependent nature makes parallel training hard to design. Third, it lacks system supports for users to efficiently implement dynamic GNNs. In this paper, we present NeutronStream, a framework for training dynamic GNN models. NeutronStream abstracts the input dynamic graph into a chronologically updated stream of events and processes the stream with an optimized sliding window to incrementally capture the spatial-temporal dependencies of events. Furthermore, NeutronStream provides a parallel execution engine to tackle the sequential event processing challenge to achieve high performance. NeutronStream also integrates a built-in graph storage structure that supports dynamic updates and provides a set of easy-to-use APIs that allow users to express their dynamic GNNs. Our experimental results demonstrate that, compared to state-of-the-art dynamic GNN implementations, NeutronStream achieves speedups ranging from 1.48X to 5.87X and an average accuracy improvement of 3.97%.


title: Laser induced Flqouet topological phases in a 2D weak topological insulator with unconventional nonlinear dispersion

abstract: Recently, we presented a two-dimensional (2D) model of a weak topological insulator formed by stacking an $N$ number of Su-Schrieffer-Heeger (SSH) chains \cite{Agrawal_2022-02}. We now study the influence of periodic driving on the topological properties of this system, which has all the fundamental symmetries, by shining it with circularly polarized light (CPL). The CPL is chosen because it breaks the time-reversal symmetry, which induces more exotic topological properties in the system. We investigate two different formations of the $N$ stacked SSH chains: all the SSH chains are topologically trivial in one formation and nontrivial in the other one. In contrast to the undriven or static case, both formations exhibit distinct topological behaviors. Here, we particularly derive the Floquet or the effective Hamiltonian using the replica method, which facilitates the study of high- and low-frequency regimes. We have discovered that this model exhibits laser-induced Floquet topological phases with higher Chern numbers. This system has nonlinear dispersion along both directions with additional $k_x-k_y$ coupling terms, which made the dispersion of this system {\it unconventional}. We closely study the role of this unconventional dispersion in the system at the low-energy limit and its response to periodic driving. The low-energy Hamiltonian also reveals a hierarchy in the gaps of the neighboring Floquet bands. Interestingly, though this model has nonlinear quasi-energy dispersion, it still shows some signatures of hierarchy, which was observed in the system with linear dispersion like graphene. Furthermore, we study the effect of linearly polarized light (LPL) on the topological properties of the system. In response to the LPL driving, the band-touching point either opens up or splits into two band-touching points.


title: Accurate Machine Learning Predictions of Coercivity in High-Performance Permanent Magnets

abstract: Increased demand for high-performance permanent magnets in the electric vehicle and wind turbine industries has prompted the search for cost-effective alternatives. Nevertheless, the discovery of new magnetic materials with the desired intrinsic and extrinsic permanent magnet properties presents a significant challenge. Traditional density functional theory (DFT) accurately predicts intrinsic permanent magnet properties such as magnetic moments, magneto-crystalline anisotropy constants, and exchange interactions. However, it cannot compute extrinsic macroscopic properties, such as coercivity ($H_c$), which are influenced by factors like microscopic defects and internal grain structures. Although micromagnetic simulation helps compute $H_c$, it overestimates the values almost by an order of magnitude due to Brown's paradox. To circumvent these limitations, we employ machine learning (ML) methods in an extensive database obtained from experiments, DFT calculations, and micromagnetic modeling. Our novel ML approach is computationally much faster than the micromagnetic simulation program, the mumax$^3$. We successfully utilize it to predict $H_c$ values for materials like cerium-doped $\mathrm{Nd}_2\mathrm{Fe}_{14}\mathrm{B}$, and subsequently compare the predicted values with experimental results. Remarkably, our ML model accurately identifies uniaxial magnetic anisotropy as the primary contributor to $H_c$. With DFT calculations, we predict the Nd-site dependent magnetic anisotropy behavior in $\mathrm{Nd}_2\mathrm{Fe}_{14}\mathrm{B}$, confirming $4f$-site planar and $4g$-site uniaxial to crystalline $c$-direction in good agreement with experiment. The Green's function atomic sphere approximation calculated a Curie temperature ($T_{\rm C}$) for $\mathrm{Nd}_2\mathrm{Fe}_{14}\mathrm{B}$ that also agrees well with experiment.


title: Higher-order FEM and CIP-FEM for Helmholtz equation with high wave number and perfectly matched layer truncation

abstract: The high-frequency Helmholtz equation on the entire space is truncated into a bounded domain using the perfectly matched layer (PML) technique and subsequently, discretized by the higher-order finite element method (FEM) and the continuous interior penalty finite element method (CIP-FEM). By formulating an elliptic problem involving a linear combination of a finite number of eigenfunctions related to the PML differential operator, a wave-number-explicit decomposition lemma is proved for the PML problem, which implies that the PML solution can be decomposed into a non-oscillating elliptic part and an oscillating but analytic part. The preasymptotic error estimates in the energy norm for both the $p$-th order CIP-FEM and FEM are proved to be $C_1(kh)^p + C_2k(kh)^{2p} +C_3 E^{\rm PML}$ under the mesh condition that $k^{2p+1}h^{2p}$ is sufficiently small, where $k$ is the wave number, $h$ is the mesh size, and $E^{\rm PML}$ is the PML truncation error which is exponentially small. In particular, the dependences of coefficients $C_j~(j=1,2)$ on the source $f$ are improved. Numerical experiments are presented to validate the theoretical findings, illustrating that the higher-order CIP-FEM can greatly reduce the pollution errors.


title: Josephus Nim

abstract: Here, we present a variant of Nim with two piles. In the first pile, we have stones with a weight of 1, and in the second pile, we have stones with a weight of -2. Two Players take turns to take stones from one of the piles, and the total weight of stones to be removed should be equal to or less than half of the total weight of the stones in the pile. The player who removed the last stone or stones is the winner of the game. The authors discovered that when (n,m) is a previous player's winning position, 2m+1 is the last remaining number of the Josephus problem, where there are n -numbers, and every second number is to be removed. There are similar relations between the position of which the Grundy number is s and the (n-s)-th removed number.


title: RL-Based Cargo-UAV Trajectory Planning and Cell Association for Minimum Handoffs, Disconnectivity, and Energy Consumption

abstract: Unmanned aerial vehicle (UAV) is a promising technology for last-mile cargo delivery. However, the limited on-board battery capacity, cellular unreliability, and frequent handoffs in the airspace are the main obstacles to unleash its full potential. Given that existing cellular networks were primarily designed to service ground users, re-utilizing the same architecture for highly mobile aerial users, e.g., cargo-UAVs, is deemed challenging. Indeed, to ensure a safe delivery using cargo-UAVs, it is crucial to utilize the available energy efficiently, while guaranteeing reliable connectivity for command-and-control and avoiding frequent handoff. To achieve this goal, we propose a novel approach for joint cargo-UAV trajectory planning and cell association. Specifically, we formulate the cargo-UAV mission as a multi-objective problem aiming to 1) minimize energy consumption, 2) reduce handoff events, and 3) guarantee cellular reliability along the trajectory. We leverage reinforcement learning (RL) to jointly optimize the cargo-UAV's trajectory and cell association. Simulation results demonstrate a performance improvement of our proposed method, in terms of handoffs, disconnectivity, and energy consumption, compared to benchmarks.


title: Applications of Domain Adversarial Neural Network in phase transition of 3D Potts model

abstract: Machine learning techniques exhibit significant performance in discriminating different phases of matter and provide a new avenue for studying phase transitions. We investigate the phase transitions of three dimensional $q$-state Potts model on cubic lattice by using a transfer learning approach, Domain Adversarial Neural Network (DANN). With the unique neural network architecture, it could evaluate the high-temperature (disordered) and low-temperature (ordered) phases, and identify the first and second order phase transitions. Meanwhile, by training the DANN with a few labeled configurations, the critical points for $q=2,3,4$ and $5$ can be predicted with high accuracy, which are consistent with those of the Monte Carlo simulations. These findings would promote us to learn and explore the properties of phase transitions in high-dimensional systems.


title: Differentiable Point-based Inverse Rendering

abstract: We present differentiable point-based inverse rendering, DPIR, an analysis-by-synthesis method that processes images captured under diverse illuminations to estimate shape and spatially-varying BRDF. To this end, we adopt point-based rendering, eliminating the need for multiple samplings per ray, typical of volumetric rendering, thus significantly enhancing the speed of inverse rendering. To realize this idea, we devise a hybrid point-volumetric representation for geometry and a regularized basis-BRDF representation for reflectance. The hybrid geometric representation enables fast rendering through point-based splatting while retaining the geometric details and stability inherent to SDF-based representations. The regularized basis-BRDF mitigates the ill-posedness of inverse rendering stemming from limited light-view angular samples. We also propose an efficient shadow detection method using point-based shadow map rendering. Our extensive evaluations demonstrate that DPIR outperforms prior works in terms of reconstruction accuracy, computational efficiency, and memory footprint. Furthermore, our explicit point-based representation and rendering enables intuitive geometry and reflectance editing.


title: Learning to Holistically Detect Bridges from Large-Size VHR Remote Sensing Imagery

abstract: Bridge detection in remote sensing images (RSIs) plays a crucial role in various applications, but it poses unique challenges compared to the detection of other objects. In RSIs, bridges exhibit considerable variations in terms of their spatial scales and aspect ratios. Therefore, to ensure the visibility and integrity of bridges, it is essential to perform holistic bridge detection in large-size very-high-resolution (VHR) RSIs. However, the lack of datasets with large-size VHR RSIs limits the deep learning algorithms' performance on bridge detection. Due to the limitation of GPU memory in tackling large-size images, deep learning-based object detection methods commonly adopt the cropping strategy, which inevitably results in label fragmentation and discontinuous prediction. To ameliorate the scarcity of datasets, this paper proposes a large-scale dataset named GLH-Bridge comprising 6,000 VHR RSIs sampled from diverse geographic locations across the globe. These images encompass a wide range of sizes, varying from 2,048*2,048 to 16,38*16,384 pixels, and collectively feature 59,737 bridges. Furthermore, we present an efficient network for holistic bridge detection (HBD-Net) in large-size RSIs. The HBD-Net presents a separate detector-based feature fusion (SDFF) architecture and is optimized via a shape-sensitive sample re-weighting (SSRW) strategy. Based on the proposed GLH-Bridge dataset, we establish a bridge detection benchmark including the OBB and HBB tasks, and validate the effectiveness of the proposed HBD-Net. Additionally, cross-dataset generalization experiments on two publicly available datasets illustrate the strong generalization capability of the GLH-Bridge dataset.


title: Treatment heterogeneity with right-censored outcomes using grf

abstract: This article walks through how to estimate conditional average treatment effects (CATEs) with right-censored time-to-event outcomes using the function causal_survival_forest (Cui et al., 2023) in the R package grf (Athey et al., 2019, Tibshirani et al., 2024) using data from the National Job Training Partnership Act.


title: EtC: Temporal Boundary Expand then Clarify for Weakly Supervised Video Grounding with Multimodal Large Language Model

abstract: Early weakly supervised video grounding (WSVG) methods often struggle with incomplete boundary detection due to the absence of temporal boundary annotations. To bridge the gap between video-level and boundary-level annotation, explicit-supervision methods, i.e., generating pseudo-temporal boundaries for training, have achieved great success. However, data augmentations in these methods might disrupt critical temporal information, yielding poor pseudo boundaries. In this paper, we propose a new perspective that maintains the integrity of the original temporal content while introducing more valuable information for expanding the incomplete boundaries. To this end, we propose EtC (Expand then Clarify), first use the additional information to expand the initial incomplete pseudo boundaries, and subsequently refine these expanded ones to achieve precise boundaries. Motivated by video continuity, i.e., visual similarity across adjacent frames, we use powerful multimodal large language models (MLLMs) to annotate each frame within initial pseudo boundaries, yielding more comprehensive descriptions for expanded boundaries. To further clarify the noise of expanded boundaries, we combine mutual learning with a tailored proposal-level contrastive objective to use a learnable approach to harmonize a balance between incomplete yet clean (initial) and comprehensive yet noisy (expanded) boundaries for more precise ones. Experiments demonstrate the superiority of our method on two challenging WSVG datasets.


title: Deformation of discrete conformal structures on surfaces

abstract: Glickenstein introduced the discrete conformal structures on polyhedral surfaces in an axiomatic approach from Riemannian geometry perspective. It includes Thurston's circle packings, Bowers-Stephenson's inversive distance circle packings and Luo's vertex scalings as special cases. In this paper, we study the deformation of Glickenstein's discrete conformal structures by combinatorial curvature flows. The combinatorial Ricci flow for Glickenstein's discrete conformal structures on triangulated surfaces is a generalization of Chow-Luo's combinatorial Ricci flow for Thurston's circle packings and Luo's combinatorial Yamabe flow for vertex scalings. We prove that the solution of the combinatorial Ricci flow for Glickenstein's discrete conformal structures on triangulated surfaces can be uniquely extended. Furthermore, under some necessary conditions, we prove that the solution of the extended combinatorial Ricci flow on a triangulated surface exists for all time and converges exponentially fast for any initial value. We further introduce the combinatorial Calabi flow for Glickenstein's discrete conformal structures on triangulated surfaces and study the basic properties of the flow. These combinatorial curvature flows provide effective algorithms for finding piecewise constant curvature metrics on surfaces with prescribed combinatorial curvatures.


title: Robust UAV Position and Attitude Estimation using Multiple GNSS Receivers for Laser-based 3D Mapping

abstract: Small-sized unmanned aerial vehicles (UAVs) have been widely investigated for use in a variety of applications such as remote sensing and aerial surveying. Direct three-dimensional (3D) mapping using a small-sized UAV equipped with a laser scanner is required for numerous remote sensing applications. In direct 3D mapping, the precise information about the position and attitude of the UAV is necessary for constructing 3D maps. In this study, we propose a novel and robust technique for estimating the position and attitude of small-sized UAVs by employing multiple low-cost and light-weight global navigation satellite system (GNSS) antennas/receivers. Using the "redundancy" of multiple GNSS receivers, we enhance the performance of real-time kinematic (RTK)-GNSS by employing single-frequency GNSS receivers. This method consists of two approaches: hybrid GNSS fix solutions and consistency examination of the GNSS signal strength. The fix rate of RTK-GNSS using single-frequency GNSS receivers can be highly enhanced to combine multiple RTK-GNSS to fix solutions in the multiple antennas. In addition, positioning accuracy and fix rate can be further enhanced to detect multipath signals by using multiple GNSS antennas. In this study, we developed a prototype UAV that is equipped with six GNSS antennas/receivers. From the static test results, we conclude that the proposed technique can enhance the accuracy of the position and attitude estimation in multipath environments. From the flight test, the proposed system could generate a 3D map with an accuracy of 5 cm.


title: Probing the vector charge of Sagittarius A* with pulsar timing

abstract: Timing a pulsar orbiting around Sagittarius A* (Sgr A*) can provide us with a unique opportunity of testing gravity theories. We investigate the detectability of a vector charge carried by the Sgr A* black hole (BH) in the bumblebee gravity model with simulated future pulsar timing observations. The spacetime of a bumblebee BH introduces characteristic changes to the orbital dynamics of the pulsar and the light propagation of radio signals. Assuming a timing precision of 1 ms, our simulation shows that a 5-yr observation of a pulsar with an orbital period $P_b\sim 0.5\,{\rm yr}$ and an orbital eccentricity $e\sim 0.8$ can probe a vector charge-to-mass ratio as small as $Q/M\sim 10^{-3}$, which is much more stringent than the current constraint from the Event Horizon Telescope (EHT) observations, and comparable to the prospective constraint from extreme mass-ratio inspirals with the Laser Interferometer Space Antenna (LISA).


title: Metasurface Sensing Approach to DOA Estimation of Coherent Signals

abstract: The DOA estimation method of coherent signals based on periodical coding metasurface is proposed. After periodical coding, the DOA information of incident signals in the time domain is represented as the amplitude and phase information at different frequency points in the frequency domain. Finite time Fourier transform (FTFT) is performed on the received signal and appropriate frequency points are selected to reconstruct the frequency domain snapshot, then pattern smoothing (PS) technique is applied to execute DOA estimation. Compared with conventional DOA estimation methods, the proposed method has two main advantages: one is that only a single receiving channel is needed to avoid the appearance of channel mismatch errors, the other is that it can process with multiple coherent signals. The performance curves of the proposed method are analyzed under different conditions and compared with existing methods. Simulation results show the effectiveness of the proposed method.


title: Uncertainty-Aware Shared Autonomy System with Hierarchical Conservative Skill Inference

abstract: Shared autonomy imitation learning, in which robots share workspace with humans for learning, enables correct actions in unvisited states and the effective resolution of compounding errors through expert's corrections. However, it demands continuous human attention and supervision to lead the demonstrations, without considering the risks associated with human judgment errors and delayed interventions. This can potentially lead to high levels of fatigue for the demonstrator and the additional errors. In this work, we propose an uncertainty-aware shared autonomy system that enables the robot to infer conservative task skills considering environmental uncertainties and learning from expert demonstrations and corrections. To enhance generalization and scalability, we introduce a hierarchical structure-based skill uncertainty inference framework operating at more abstract levels. We apply this to robot motion to promote a more stable interaction. Although shared autonomy systems have demonstrated high-level results in recent research and play a critical role, specific system design details have remained elusive. This paper provides a detailed design proposal for a shared autonomy system considering various robot configurations. Furthermore, we experimentally demonstrate the system's capability to learn operational skills, even in dynamic environments with interference, through pouring and pick-and-place tasks. Our code will be released soon.


title: Infrared spectroscopy of phase transitions in the lowest Landau levels of bilayer graphene

abstract: We perform infrared magneto-spectroscopy of Landau level (LL) transitions in dual-gated bilayer graphene. At $\nu=4$ when the zeroth LL (octet) is filled, two resonances are observed indicating the opening of a gap. At $\nu=0$ when the octet is half-filled, multiple resonances are found to disperse non-monotonically with increasing displacement field, $D$, perpendicular to the sheet, showing a phase transition at modest displacement fields to the layer-polarized state with a gap that opens linearly in $D$. When $D=0$ and $\nu$ is varied, resonances at $\pm\nu$ show an electron-hole asymmetry with multiple line splittings as the octet is progressively filled. Broadly these data show good agreement with predictions from a mean-field Hartree-Fock calculation, but only by accounting for multiple tight-binding terms in a four-band model of bilayer graphene that also incorporates valley interaction anisotropy. Our results are consistent with the presence of a canted anti-ferromagnet (CAFM) ground state at $\nu=0$, and imply the existence of intermediate phases in the transition from the CAFM to the layer-polarized regime.


title: Constrained Twin Variational Auto-Encoder for Intrusion Detection in IoT Systems

abstract: Intrusion detection systems (IDSs) play a critical role in protecting billions of IoT devices from malicious attacks. However, the IDSs for IoT devices face inherent challenges of IoT systems, including the heterogeneity of IoT data/devices, the high dimensionality of training data, and the imbalanced data. Moreover, the deployment of IDSs on IoT systems is challenging, and sometimes impossible, due to the limited resources such as memory/storage and computing capability of typical IoT devices. To tackle these challenges, this article proposes a novel deep neural network/architecture called Constrained Twin Variational Auto-Encoder (CTVAE) that can feed classifiers of IDSs with more separable/distinguishable and lower-dimensional representation data. Additionally, in comparison to the state-of-the-art neural networks used in IDSs, CTVAE requires less memory/storage and computing power, hence making it more suitable for IoT IDS systems. Extensive experiments with the 11 most popular IoT botnet datasets show that CTVAE can boost around 1% in terms of accuracy and Fscore in detection attack compared to the state-of-the-art machine learning and representation learning methods, whilst the running time for attack detection is lower than 2E-6 seconds and the model size is lower than 1 MB. We also further investigate various characteristics of CTVAE in the latent space and in the reconstruction representation to demonstrate its efficacy compared with current well-known methods.


title: Pseudo Replay-based Class Continual Learning for Online New Category Anomaly Detection in Additive Manufacturing

abstract: The incorporation of advanced sensors and machine learning techniques has enabled modern manufacturing enterprises to perform data-driven in-situ quality monitoring based on the sensor data collected in manufacturing processes. However, one critical challenge is that newly presented defect category may manifest as the manufacturing process continues, resulting in monitoring performance deterioration of previously trained machine learning models. Hence, there is an increasing need for empowering machine learning model to learn continually. Among all continual learning methods, memory-based continual learning has the best performance but faces the constraints of data storage capacity. To address this issue, this paper develops a novel pseudo replay-based continual learning by integrating class incremental learning and oversampling-based data generation. Without storing all the data, the developed framework could generate high-quality data representing previous classes to train machine learning model incrementally when new category anomaly occurs. In addition, it could even enhance the monitoring performance since it also effectively improves the data quality. The effectiveness of the proposed framework is validated in an additive manufacturing process, which leverages supervised classification problem for anomaly detection. The experimental results show that the developed method is very promising in detecting novel anomaly while maintaining a good performance on the previous task and brings up more flexibility in model architecture.


title: Cosmological reconstruction and $\Lambda$CDM universe in $f(Q,C)$ gravity

abstract: Symmetric Teleparallel Gravity allows for the reformulation of gravity in the form of nonmetricity by vanishing the contorsion term in the generic affine connection. Our focus is on investigating a recently proposed extension of this theory in which the Lagrangian has the form $f(Q,C)$ by incorporating the boundary term $C$. In this work, we first use a reconstruction approach in $f(Q,C)$ gravity that might admit the $\Lambda$CDM expansion history. Furthermore, we perform a novel approach for cosmological reconstruction of $f(Q,C)$ gravity in terms of e-folding, and it shows how any FLRW cosmology can arise from a specific $f(Q,C)$ gravity. A variety of instances are provided using this approach in which $f(Q, C)$ gravity is reconstructed to yield the well-known cosmic evolution: $\Lambda$CDM era, acceleration/deceleration era which is equivalent to the presence of phantom and non-phantom matter, late-time acceleration with the crossing of phantom-divide line and transient phantom era.


title: Flexible Communication for Optimal Distributed Learning over Unpredictable Networks

abstract: Gradient compression alleviates expensive communication in distributed deep learning by sending fewer values and its corresponding indices, typically via Allgather (AG). Training with high compression ratio (CR) achieves high accuracy like DenseSGD, but has lower parallel scaling due to high communication cost (i.e., parallel efficiency). Using lower CRs improves parallel efficiency by lowering synchronization cost, but degrades model accuracy as well (statistical efficiency). Further, speedup attained with different models and CRs also varies with network latency, effective bandwidth and collective op used for aggregation. In many cases, collectives like Allreduce (AR) have lower cost than AG to exchange the same amount of data. In this paper, we propose an AR-compatible Topk compressor that is bandwidth-optimal and thus performs better than AG in certain network configurations. We develop a flexible communication strategy that switches between AG and AR based on which collective is optimal in the current settings, and model the pareto-relationship between parallel and statistical efficiency as a multi-objective optimization (MOO) problem to dynamically adjust CR and accelerate training while still converging to high accuracy.


title: ReconU-Net: a direct PET image reconstruction using U-Net architecture with back projection-induced skip connection

abstract: [Objective] This study aims to introduce a novel back projection-induced U-Net-shaped architecture, called ReconU-Net, for deep learning-based direct positron emission tomography (PET) image reconstruction. Additionally, our objective is to analyze the behavior of direct PET image reconstruction and gain deeper insights by comparing the proposed ReconU-Net architecture with other encoder-decoder architectures without skip connections. [Approach] The proposed ReconU-Net architecture uniquely integrates the physical model of the back projection operation into the skip connection. This distinctive feature facilitates the effective transfer of intrinsic spatial information from the input sinogram to the reconstructed image via an embedded physical model. The proposed ReconU-Net was trained using Monte Carlo simulation data from the Brainweb phantom and tested on both simulated and real Hoffman brain phantom data. [Main results] The proposed ReconU-Net method generated a reconstructed image with a more accurate structure compared to other deep learning-based direct reconstruction methods. Further analysis showed that the proposed ReconU-Net architecture has the ability to transfer features of multiple resolutions, especially non-abstract high-resolution information, through skip connections. Despite limited training on simulated data, the proposed ReconU-Net successfully reconstructed the real Hoffman brain phantom, unlike other deep learning-based direct reconstruction methods, which failed to produce a reconstructed image. [Significance] The proposed ReconU-Net can improve the fidelity of direct PET image reconstruction, even when dealing with small training datasets, by leveraging the synergistic relationship between data-driven modeling and the physics model of the imaging process.


title: $(n,k)$-Besicovitch sets do not exist in $\mathbb{Z}_p^n$ and $\hat{\mathbb{Z}}^n$ for $k\ge 2$

abstract: Besicovitch showed that a compact set in $\mathbb{R}^n$ which contains a unit line segment in every direction can have measure $0$. These constructions also work over other metric spaces like the $p$-adics and profinite integers. It is conjectured that it is impossible to construct sets with measure $0$ which contain a unit $2$-disk in every direction in $\mathbb{R}^n$. We prove that over the $p$-adics and profinite integers any set which contains a 2-flat in every direction must have positive measure. The main ingredients are maximal Kakeya estimates for $(\mathbb{Z}/N\mathbb{Z})^n$ proven in [Dha22] and adapting Fourier analytic arguments of Oberlin [Obe05]. In general, we prove $L^{n-1}$ to $L^{n-1}$ estimates for the maximal operator corresponding to $2$-flats.


title: MKA: A Scalable Medical Knowledge Assisted Mechanism for Generative Models on Medical Conversation Tasks

abstract: Using natural language processing (NLP) technologies to develop medical chatbots makes the diagnosis of the patient more convenient and efficient, which is a typical application in healthcare AI. Because of its importance, lots of research have been come out. Recently, the neural generative models have shown their impressive ability as the core of chatbot, while it cannot scale well when directly applied to medical conversation due to the lack of medical-specific knowledge. To address the limitation, a scalable Medical Knowledge Assisted mechanism, MKA, is proposed in this paper. The mechanism aims to assist general neural generative models to achieve better performance on the medical conversation task. The medical-specific knowledge graph is designed within the mechanism, which contains 6 types of medical-related information, including department, drug, check, symptom, disease, food. Besides, the specific token concatenation policy is defined to effectively inject medical information into the input data. Evaluation of our method is carried out on two typical medical datasets, MedDG and MedDialog-CN. The evaluation results demonstrate that models combined with our mechanism outperform original methods in multiple automatic evaluation metrics. Besides, MKA-Bert-GPT achieves state-of-the-art performance. The open-sourced codes are public: https://github.com/LIANGKE23/Knowledge_Assisted_Medical_Dialogue_Generation_Mechanism


title: On a variational model for the continuous mechanics exhibiting hexagonal to square Phase Transitions

abstract: Inspired by Conti and Zanzotto \cite{Conti2004A}, we reformulate a simple variational model for reconstructive phase transitions in crystals arising in continuum mechanics in the framework of Landau's theory of phase transition(with slight modification). We provide and prove that this class of modular invariant functions admit exactly hexagonal-square lattices minimizers without passing through rhombic lattices, being the first rigorous result in this regard. Our result gives an affirmative answer to an open problem by in \cite{Conti2004A}. In addition, our result has independent interest from number theory.


title: Provable Reinforcement Learning for Networked Control Systems with Stochastic Packet Disordering

abstract: This paper formulates a stochastic optimal control problem for linear networked control systems featuring stochastic packet disordering with a unique stabilizing solution certified. The problem is solved by proposing reinforcement learning algorithms. A measurement method is first presented to deal with PD and calculate the newest control input. The NCSs with stochastic PD are modeled as stochastic NCSs. Then, given a cost function, a modified algebraic Riccati equation is derived within the formulation. We propose offline policy iteration and value iteration algorithms to solve the MARE associated with provable convergence. These two algorithms require knowledge of NCS dynamics and PD probabilities. To release that, we further design online model-free off-policy and Q-learning algorithms with an online estimation method for PD probability. Both model-free algorithms solve the optimal control problem using real-time system states, control inputs, and PD probability estimates. Simulation results verify the proposed formulation and algorithms at last.


title: Geometry of bundle-valued multisymplectic structures with Lie algebroids

abstract: We study multisymplectic structures taking values in vector bundles with connections from the viewpoint of the Hamiltonian symmetry. We introduce the notion of bundle-valued $n$-plectic structures and exhibit some properties of them. In addition, we define bundle-valued homotopy momentum sections for bundle-valued $n$-plectic manifolds with Lie algebroids to discuss momentum map theories in both cases of quaternionic K\"{a}hler manifolds and hyper-K\"{a}hler manifolds. Furthermore, we generalize the Marsden-Weinstein-Meyer reduction theorem for symplectic manifolds and construct two kinds of reductions of vector-valued 1-plectic manifolds.


title: Calculation of Relativistic Single-Particle States

abstract: A computational method is proposed to calculate bound and resonant states by solving the Klein-Gordon and Dirac equations for real and complex energies, respectively. The method is an extension of a non-relativistic one, where the potential is represented in a Coulomb-Sturmian basis. This basis facilitates the exact analytic evaluation of the Coulomb Green's operator in terms of a continued fraction. In the extension to relativistic problems, we cast the Klein-Gordon and Dirac equations into an effective Schr\"odinger form. Then the solution method is basically an analytic continuation of non-relativistic quantities like the angular momentum, charge, energy and potential into the effective relativistic counterparts.