title: Pruner: An Efficient Cross-Platform Tensor Compiler with Dual Awareness

abstract: Tensor program optimization on Deep Learning Accelerators (DLAs) is critical for efficient model deployment. Although search-based Deep Learning Compilers (DLCs) have achieved significant performance gains compared to manual methods, they still suffer from the persistent challenges of low search efficiency and poor cross-platform adaptability. In this paper, we propose $\textbf{Pruner}$, following hardware/software co-design principles to hierarchically boost tensor program optimization. Pruner comprises two primary components: a Parameterized Static Analyzer ($\textbf{PSA}$) and a Pattern-aware Cost Model ($\textbf{PaCM}$). The former serves as a hardware-aware and formulaic performance analysis tool, guiding the pruning of the search space, while the latter enables the performance prediction of tensor programs according to the critical data-flow patterns. Furthermore, to ensure effective cross-platform adaptation, we design a Momentum Transfer Learning ($\textbf{MTL}$) strategy using a Siamese network, which establishes a bidirectional feedback mechanism to improve the robustness of the pre-trained cost model. The extensive experimental results demonstrate the effectiveness and advancement of the proposed Pruner in various tensor program tuning tasks across both online and offline scenarios, with low resource overhead. The code is available at https://github.com/qiaolian9/Pruner.


title: Unification of Symmetries Inside Neural Networks: Transformer, Feedforward and Neural ODE

abstract: Understanding the inner workings of neural networks, including transformers, remains one of the most challenging puzzles in machine learning. This study introduces a novel approach by applying the principles of gauge symmetries, a key concept in physics, to neural network architectures. By regarding model functions as physical observables, we find that parametric redundancies of various machine learning models can be interpreted as gauge symmetries. We mathematically formulate the parametric redundancies in neural ODEs, and find that their gauge symmetries are given by spacetime diffeomorphisms, which play a fundamental role in Einstein's theory of gravity. Viewing neural ODEs as a continuum version of feedforward neural networks, we show that the parametric redundancies in feedforward neural networks are indeed lifted to diffeomorphisms in neural ODEs. We further extend our analysis to transformer models, finding natural correspondences with neural ODEs and their gauge symmetries. The concept of gauge symmetries sheds light on the complex behavior of deep learning models through physics and provides us with a unifying perspective for analyzing various machine learning architectures.


title: Revisiting the top-quark pair production at future $e^+e^-$ colliders

abstract: In this paper, we reanalyze the top-quark pair production at the next-to-next-to-leading order (NNLO) in QCD at future $e^+e^-$ colliders by using the Principle of Maximum Conformality (PMC) method. The PMC renormalization scales in $\alpha_s$ are determined by absorbing the non-conformal $\beta$ terms by recursively using the Renormalization Group Equation (RGE). Unlike the conventional scale-setting method of fixing the scale at the center-of-mass energy $\mu_r=\sqrt{s}$, the determined PMC scale $Q_\star$ is far smaller than the $\sqrt{s}$ and increases with the $\sqrt{s}$, yielding the correct physical behavior for the top-quark pair production process. Moreover, the convergence of the pQCD series for the top-quark pair production is greatly improved due to the elimination of the renormalon divergence. For a typical collision energy of $\sqrt{s}=500$ GeV, the PMC scale is $Q_\star=107$ GeV; the QCD correction factor $K$ for conventional results is $K\sim1+0.1244^{+0.0102+0.0012}_{-0.0087-0.0011}+0.0184^{-0.0086+0.0002}_{+0.0061-0.0003}$, where the first error is caused by varying the scale $\mu_r\in[\sqrt{s}/2, 2\sqrt{s}]$ and the second error is from the top-quark mass $\Delta{m_t}=\pm0.7$ GeV. After applying the PMC, the renormalization scale uncertainty is eliminated and the QCD correction factor $K$ is improved to $K\sim 1+0.1507^{+0.0015}_{-0.0015}-0.0057^{+0.0001}_{-0.0000}$, where the error is from the top-quark mass $\Delta{m_t}=\pm0.7$ GeV. The PMC improved predictions for the top-quark pair production are helpful for detailed studies of properties of the top-quark at future $e^+e^-$ colliders.


title: The Developmental Landscape of In-Context Learning

abstract: We show that in-context learning emerges in transformers in discrete developmental stages, when they are trained on either language modeling or linear regression tasks. We introduce two methods for detecting the milestones that separate these stages, by probing the geometry of the population loss in both parameter space and function space. We study the stages revealed by these new methods using a range of behavioral and structural metrics to establish their validity.


title: Differentiable maps on links of complex isolated hypersurface singularities

abstract: We consider links of complex isolated hypersurface singularities in $\mathbb{C}^{n+1}$ and study differentiable maps defined by restricting holomorphic functions to the links. We give an explicit example in which such a restriction gives a fold map into the plane $\mathbb{C} = \mathbb{R}^2$ whose singular value set consists of concentric circles.


title: Transolver: A Fast Transformer Solver for PDEs on General Geometries

abstract: Transformers have empowered many milestones across various fields and have recently been applied to solve partial differential equations (PDEs). However, since PDEs are typically discretized into large-scale meshes with complex geometries, it is challenging for Transformers to capture intricate physical correlations directly from massive individual points. Going beyond superficial and unwieldy meshes, we present Transolver based on a more foundational idea, which is learning intrinsic physical states hidden behind discretized geometries. Specifically, we propose a new Physics-Attention to adaptively split the discretized domain into a series of learnable slices of flexible shapes, where mesh points under similar physical states will be ascribed to the same slice. By calculating attention to physics-aware tokens encoded from slices, Transovler can effectively capture intricate physical correlations under complex geometrics, which also empowers the solver with endogenetic geometry-general modeling capacity and can be efficiently computed in linear complexity. Transolver achieves consistent state-of-the-art with 22% relative gain across six standard benchmarks and also excels in large-scale industrial simulations, including car and airfoil designs. Code is available at https://github.com/thuml/Transolver.


title: Exploring Intrinsic Properties of Medical Images for Self-Supervised Binary Semantic Segmentation

abstract: Recent advancements in self-supervised learning have unlocked the potential to harness unlabeled data for auxiliary tasks, facilitating the learning of beneficial priors. This has been particularly advantageous in fields like medical image analysis, where labeled data are scarce. Although effective for classification tasks, this methodology has shown limitations in more complex applications, such as medical image segmentation. In this paper, we introduce Medical imaging Enhanced with Dynamic Self-Adaptive Semantic Segmentation (MedSASS), a dedicated self-supervised framework tailored for medical image segmentation. We evaluate MedSASS against existing state-of-the-art methods across four diverse medical datasets, showcasing its superiority. MedSASS outperforms existing CNN-based self-supervised methods by 3.83% and matches the performance of ViT-based methods. Furthermore, when MedSASS is trained end-to-end, covering both encoder and decoder, it demonstrates significant improvements of 14.4% for CNNs and 6% for ViT-based architectures compared to existing state-of-the-art self-supervised strategies.


title: Timer: Generative Pre-trained Transformers Are Large Time Series Models

abstract: Deep learning has contributed remarkably to the advancement of time series analysis. Still, deep models can encounter performance bottlenecks in real-world data-scarce scenarios, which can be concealed due to the performance saturation with small models on current benchmarks. Meanwhile, large models have demonstrated great powers in these scenarios through large-scale pre-training. Continuous progress has been achieved with the emergence of large language models, exhibiting unprecedented abilities such as few-shot generalization, scalability, and task generality, which are however absent in small deep models. To change the status quo of training scenario-specific small models from scratch, this paper aims at the early development of large time series models (LTSM). During pre-training, we curate large-scale datasets with up to 1 billion time points, unify heterogeneous time series into single-series sequence (S3) format, and develop the GPT-style architecture toward LTSMs. To meet diverse application needs, we convert forecasting, imputation, and anomaly detection of time series into a unified generative task. The outcome of this study is a Time Series Transformer (Timer), which is generative pre-trained by next token prediction and adapted to various downstream tasks with promising capabilities as an LTSM. Code and datasets are available at: https://github.com/thuml/Large-Time-Series-Model.


title: M$^3$Face: A Unified Multi-Modal Multilingual Framework for Human Face Generation and Editing

abstract: Human face generation and editing represent an essential task in the era of computer vision and the digital world. Recent studies have shown remarkable progress in multi-modal face generation and editing, for instance, using face segmentation to guide image generation. However, it may be challenging for some users to create these conditioning modalities manually. Thus, we introduce M3Face, a unified multi-modal multilingual framework for controllable face generation and editing. This framework enables users to utilize only text input to generate controlling modalities automatically, for instance, semantic segmentation or facial landmarks, and subsequently generate face images. We conduct extensive qualitative and quantitative experiments to showcase our frameworks face generation and editing capabilities. Additionally, we propose the M3CelebA Dataset, a large-scale multi-modal and multilingual face dataset containing high-quality images, semantic segmentations, facial landmarks, and different captions for each image in multiple languages. The code and the dataset will be released upon publication.


title: AutoTimes: Autoregressive Time Series Forecasters via Large Language Models

abstract: Foundation models of time series have not been fully developed due to the limited availability of time series corpora and the underexploration of scalable pre-training. Based on the similar sequential formulation of time series and natural language, increasing research demonstrates the feasibility of leveraging large language models (LLM) for time series. Nevertheless, the inherent autoregressive property and decoder-only architecture of LLMs have not been fully considered, resulting in insufficient utilization of LLM abilities. To further exploit the general-purpose token transition and multi-step generation ability of large language models, we propose AutoTimes to repurpose LLMs as autoregressive time series forecasters, which independently projects time series segments into the embedding space and autoregressively generates future predictions with arbitrary lengths. Compatible with any decoder-only LLMs, the consequent forecaster exhibits the flexibility of the lookback length and scalability of the LLM size. Further, we formulate time series as prompts, extending the context for prediction beyond the lookback window, termed in-context forecasting. By adopting textual timestamps as position embeddings, AutoTimes integrates multimodality for multivariate scenarios. Empirically, AutoTimes achieves state-of-the-art with 0.1% trainable parameters and over 5 times training/inference speedup compared to advanced LLM-based forecasters.


title: The gauge coupling unification in Grand Unified Theories based on the group $E_8$

abstract: We consider a theory with the gauge group $E_8$ assuming that the gauge symmetry breaking pattern is $E_8 \to E_7 \times U_1 \to E_6 \times U_1 \to SO_{10} \times U_1 \to SU_5 \times U_1 \to SU_3 \times SU_2 \times U_1$ and vacuum expectation values are acquired only by components of the representations 248. It is demonstrated that in this case there are several options for the relations between the gauge couplings of the resulting theory, but only one of them gives $\alpha_3 = \alpha_2$ and $\sin^2\theta_W = 3/8$. Also, it is the only option for which the resulting theory can include all MSSM superfields.


title: High-Harmonic Generation from Engineered Graphene for Polarization Tailoring

abstract: Strain engineering is a versatile method to boost the carrier mobility of two-dimensional materials-based electronics and optoelectronic devices. In addition, strain is ubiquitous during device fabrication via material deposition on a substrate with a different lattice structure. Here, we show that the polarization properties of the harmonics in graphene under uniaxial strain are strongly yet differently affected in the lower and higher orders. The polarization plane of the lower-order emitted harmonics is rotated -- a manifestation of Faraday rotation due to the broken symmetry planes. In contrast, we observe elliptically-polarized higher-order harmonics due to the intricate interplay of the interband and intraband electron dynamics. The implications of these findings are twofold: First, we show how the rotation of the polarization plane of the lower-order harmonics can be used as a probe to characterize the strain's nature, strength, and angle. Second, we demonstrate how strain engineering can be used to alter the polarization properties of higher-order harmonics, relevant for applications in ultrafast chiral-sensitive studies. Our research opens a promising avenue for strain-tailored polarization properties of higher-order harmonics in engineered solids.

categories: cond-mat.mes-hall cond-mat.mtrl-sci cond-mat.str-el physics.optics


title: Non-adiabatic holonomic quantum operations in continuous variable systems

abstract: Quantum operations by utilizing the underlying geometric phases produced in physical systems are favoured due to its potential robustness. When a system in a non-degenerate eigenstate undergoes an adiabatically cyclic evolution dominated by its Hamiltonian, it will get a geometric phase, referred to as the Berry Phase. While a non-adiabatically cyclic evolution produces an Aharonov-Anandan geometric phase. The two types of Abelian geometric phases are extended to the non-Abelian cases, where the phase factors become matrix-valued and the transformations associated with different loops are non-commutable. Abelian and non-Abelian (holonomic) operations are prevalent in discrete variable systems, whose limited (say, two) energy levels, form the qubit. While their developments in continuous systems have also been investigated, mainly due to that, bosonic modes (in, such as, cat states) with large Hilbert spaces, provide potential advantages in fault-tolerant quantum computation. Here we propose a feasible scheme to realize non-adiabatic holonomic quantum logic operations in continuous variable systems with cat codes. We construct arbitrary single-qubit (two-qubit) gates with the combination of single- and two-photon drivings applied to a Kerr Parametric Oscillator (KPO) (the coupled KPOs). Our scheme relaxes the requirements of the previously proposed quantum geometric operation strategies in continuous variable systems, providing an effective way for quantum control.


title: PromptRR: Diffusion Models as Prompt Generators for Single Image Reflection Removal

abstract: Existing single image reflection removal (SIRR) methods using deep learning tend to miss key low-frequency (LF) and high-frequency (HF) differences in images, affecting their effectiveness in removing reflections. To address this problem, this paper proposes a novel prompt-guided reflection removal (PromptRR) framework that uses frequency information as new visual prompts for better reflection performance. Specifically, the proposed framework decouples the reflection removal process into the prompt generation and subsequent prompt-guided restoration. For the prompt generation, we first propose a prompt pre-training strategy to train a frequency prompt encoder that encodes the ground-truth image into LF and HF prompts. Then, we adopt diffusion models (DMs) as prompt generators to generate the LF and HF prompts estimated by the pre-trained frequency prompt encoder. For the prompt-guided restoration, we integrate specially generated prompts into the PromptFormer network, employing a novel Transformer-based prompt block to effectively steer the model toward enhanced reflection removal. The results on commonly used benchmarks show that our method outperforms state-of-the-art approaches. The codes and models are available at https://github.com/TaoWangzj/PromptRR.


title: Formation of a streamer blob via the merger of multiple plasma clumps below 2Rs

abstract: Context. Propagating streamer blobs could be an important source of disturbances in the solar wind. Direct observations on formation of streamer blobs could be a proxy for understanding the formation of small-scale structures and disturbances in the solar wind. Aims. We aim to investigate how a streamer blob is formed before it is observed in the outer corona. Methods. Usingspecialcoordinated-observationsfromSOHO/LASCO,GOES/SUVIandSDO/AIA, we study the precursors of a streamer blob as seen in the corona below 2.0 solar radii (Rs). Results. We found that the streamer blob was formed due to the gradual merging of three clumps of brightenings initiated from the lower corona at about 1.8Rs, which is likely driven by expansion of the loop system at the base of the streamer. The acceleration of the blob starts from 1.9Rs or lower. It propagates along the south flank of the streamer where an expanding elongated brightening occurs coincidently. Conclusions. Our observations demonstrate that formation of a streamer blob is a complex process. We suggest that the expansion of the loop results in a pinching-off flux-rope-like blob at the loop apex below 2Rs. When the blob moves outward, it can be transferred across the overlying loops through interchange/component magnetic reconnection and then is released into the open field system. When the blob moves toward open field lines, interchange magnetic reconnections might also occur, and that can accelerate the plasma blob intermittently whilst allow it to transfer across the open field lines. Such dynamics in a streamer blob might further trigger small-scale disturbances in the solar wind such as switchbacks in the inner heliosphere.


title: Variational Quantum AdaBoost with Supervised Learning Guarantee

abstract: Although variational quantum algorithms based on parameterized quantum circuits promise to achieve quantum advantages, in the noisy intermediate-scale quantum (NISQ) era, their capabilities are greatly constrained due to limited number of qubits and depth of quantum circuits. Therefore, we may view these variational quantum algorithms as weak learners in supervised learning. Ensemble methods are a general technique in machine learning for combining weak learners to construct a more accurate one. In this paper, we theoretically prove and numerically verify a learning guarantee for variational quantum adaptive boosting (AdaBoost). To be specific, we theoretically depict how the prediction error of variational quantum AdaBoost on binary classification decreases with the increase of the number of boosting rounds and sample size. By employing quantum convolutional neural networks, we further demonstrate that variational quantum AdaBoost can not only achieve much higher accuracy in prediction, but also help mitigate the impact of noise. Our work indicates that in the current NISQ era, introducing appropriate ensemble methods is particularly valuable in improving the performance of quantum machine learning algorithms.


title: NOAH: Learning Pairwise Object Category Attentions for Image Classification

abstract: A modern deep neural network (DNN) for image classification tasks typically consists of two parts: a backbone for feature extraction, and a head for feature encoding and class predication. We observe that the head structures of mainstream DNNs adopt a similar feature encoding pipeline, exploiting global feature dependencies while disregarding local ones. In this paper, we revisit the feature encoding problem, and propose Non-glObal Attentive Head (NOAH) that relies on a new form of dot-product attention called pairwise object category attention (POCA), efficiently exploiting spatially dense category-specific attentions to augment classification performance. NOAH introduces a neat combination of feature split, transform and merge operations to learn POCAs at local to global scales. As a drop-in design, NOAH can be easily used to replace existing heads of various types of DNNs, improving classification performance while maintaining similar model efficiency. We validate the effectiveness of NOAH on ImageNet classification benchmark with 25 DNN architectures spanning convolutional neural networks, vision transformers and multi-layer perceptrons. In general, NOAH is able to significantly improve the performance of lightweight DNNs, e.g., showing 3.14\%|5.3\%|1.9\% top-1 accuracy improvement to MobileNetV2 (0.5x)|Deit-Tiny (0.5x)|gMLP-Tiny (0.5x). NOAH also generalizes well when applied to medium-size and large-size DNNs. We further show that NOAH retains its efficacy on other popular multi-class and multi-label image classification benchmarks as well as in different training regimes, e.g., showing 3.6\%|1.1\% mAP improvement to large ResNet101|ViT-Large on MS-COCO dataset. Project page: https://github.com/OSVAI/NOAH.


title: Maximizing the scientific return of Roman and Rubin with a joint wide-sky observing strategy

abstract: This work presents the case for a single-band LSST-matched depth Roman Community Survey over the footprint of the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) Wide-Fast-Deep to enhance the key science programs of both missions. We propose to observe the ~18K sq deg LSST Wide-Fast-Deep footprint in the F146 filter to mAB~25; this will take approximately 5 months of Roman observing time. The combination of the multiwavelength nature of LSST and angular resolution of Roman would lead to enhanced scientific returns for both the Roman and LSST surveys. Galaxy deblending and crowded field photometry will be significantly improved. The extension of Rubin LSST six-band optical photometry to IR wavelengths would improve photometric redshift (photo-z) estimation, leading to improved cosmological parameter estimation, penetrate interstellar dust in the Galactic plane, improve differential chromatic refraction derived Spectral Energy Distributions, maximize galaxy-star separation and minimize crowding confusion through improved angular resolution. Conversely, the LSST survey will provide a time-domain extension of the Roman survey on the shared footprint and 6-band optical photometry with sensitivity extending all the way to ultraviolet wavelengths.


title: Rethinking the Evaluation of Pre-trained Text-and-Layout Models from an Entity-Centric Perspective

abstract: Recently developed pre-trained text-and-layout models (PTLMs) have shown remarkable success in multiple information extraction tasks on visually-rich documents. However, the prevailing evaluation pipeline may not be sufficiently robust for assessing the information extraction ability of PTLMs, due to inadequate annotations within the benchmarks. Therefore, we claim the necessary standards for an ideal benchmark to evaluate the information extraction ability of PTLMs. We then introduce EC-FUNSD, an entity-centric benckmark designed for the evaluation of semantic entity recognition and entity linking on visually-rich documents. This dataset contains diverse formats of document layouts and annotations of semantic-driven entities and their relations. Moreover, this dataset disentangles the falsely coupled annotation of segment and entity that arises from the block-level annotation of FUNSD. Experiment results demonstrate that state-of-the-art PTLMs exhibit overfitting tendencies on the prevailing benchmarks, as their performance sharply decrease when the dataset bias is removed.


title: Evaluating Large Language Models in Analysing Classroom Dialogue

abstract: This study explores the application of Large Language Models (LLMs), specifically GPT-4, in the analysis of classroom dialogue, a crucial research task for both teaching diagnosis and quality improvement. Recognizing the knowledge-intensive and labor-intensive nature of traditional qualitative methods in educational research, this study investigates the potential of LLM to streamline and enhance the analysis process. The study involves datasets from a middle school, encompassing classroom dialogues across mathematics and Chinese classes. These dialogues were manually coded by educational experts and then analyzed using a customised GPT-4 model. This study focuses on comparing manual annotations with the outputs of GPT-4 to evaluate its efficacy in analyzing educational dialogues. Time efficiency, inter-coder agreement, and inter-coder reliability between human coders and GPT-4 are evaluated. Results indicate substantial time savings with GPT-4, and a high degree of consistency in coding between the model and human coders, with some discrepancies in specific codes. These findings highlight the strong potential of LLM in teaching evaluation and facilitation.


title: Empowering Computing and Networks Convergence System with Distributed Cooperative Routing

abstract: The emergence of intelligent applications and recent advances in the fields of computing and networks are driving the development of computing and networks convergence (CNC) system. However, existing researches failed to achieve comprehensive scheduling optimization of computing and network resources. This shortfall results in some requirements of computing requests unable to be guaranteed in an end-to-end service pattern, negatively impacting the development of CNC systems. In this article, we propose a distributed cooperative routing framework for the CNC system to ensure the deadline requirements and minimize the computation cost of requests. The framework includes trading plane, management plane, control plane and forwarding plane. The cross-plane cooperative end-to-end routing schemes consider both computation efficiency of heterogeneous servers and the network congestion degrees while making routing plan, thereby determining where to execute requests and corresponding routing paths. Simulations results substantiates the performance of our routing schemes in scheduling computing requests in the CNC system.


title: Revisiting the Power of Prompt for Visual Tuning

abstract: Visual prompt tuning (VPT) is a promising solution incorporating learnable prompt tokens to customize pre-trained models for downstream tasks. However, VPT and its variants often encounter challenges like prompt initialization, prompt length, and subpar performance in self-supervised pretraining, hindering successful contextual adaptation. This study commences by exploring the correlation evolvement between prompts and patch tokens during proficient training. Inspired by the observation that the prompt tokens tend to share high mutual information with patch tokens, we propose initializing prompts with downstream token prototypes. The strategic initialization, a stand-in for the previous initialization, substantially improves performance in fine-tuning. To refine further, we optimize token construction with a streamlined pipeline that maintains excellent performance with almost no increase in computational expenses compared to VPT. Exhaustive experiments show our proposed approach outperforms existing methods by a remarkable margin. For instance, it surpasses full fine-tuning in 19 out of 24 tasks, using less than 0.4% of learnable parameters on the FGVC and VTAB-1K benchmarks. Notably, our method significantly advances the adaptation for self-supervised pretraining, achieving impressive task performance gains of at least 10% to 30%. Besides, the experimental results demonstrate the proposed SPT is robust to prompt lengths and scales well with model capacity and training data size. We finally provide an insightful exploration into the amount of target data facilitating the adaptation of pre-trained models to downstream tasks. The code is available at https://github.com/WangYZ1608/Self-Prompt-Tuning.


title: On payload architecture and pointing control strategies for TianQin

abstract: TianQin is a proposed mission for space-based gravitational-wave detection that features a triangular constellation in circular high Earth orbits. The mission entails three drag-free controlled satellites and long-range laser interferometry with stringent beam pointing requirements at remote satellites. For the payload architecture and pointing control strategies, having two test masses per satellite, one for each laser arm, and rotating entire opto-mechanical assemblies (each consisting of a telescope, an optical bench, an inertial sensor, etc.) for constellation breathing angle compensation represent an important option for TianQin. In this paper, we examine its applicability from the perspectives of test mass and satellite control in the science mode, taking into account of perturbed orbits and orbital gravity gradients. First, based on the orbit-attitude coupling relationship, the required electrostatic forces and torques for the test mass suspension control are estimated and found to be sufficiently small for the acceleration noise budget. Further optimization favors configuring the centers of masses of the two test masses collinear and equidistant with the center of mass of the satellite, and slightly offsetting the assembly pivots from the electrode housing centers forward along the sensitive axes. Second, the required control forces and torques on the satellites are calculated, and thrust allocation solutions are found under the constraint of having a flat-top sunshield on the satellite with varying solar angles. The findings give a green light to adopting the two test masses and telescope pointing scheme for TianQin.


title: Acoustic Local Positioning With Encoded Emission Beacons

abstract: Acoustic local positioning systems (ALPSs) are an interesting alternative for indoor positioning due to certain advantages over other approaches, including their relatively high accuracy, low cost, and room-level signal propagation. Centimeter-level or fine-grained indoor positioning can be an asset for robot navigation, guiding a person to, for instance, a particular piece in a museum or to a specific product in a shop, targeted advertising, or augmented reality. In airborne system applications, acoustic positioning can be based on using opportunistic signals or sounds produced by the person or object to be located (e.g., noise from appliances or the speech from a speaker) or from encoded emission beacons (or anchors) specifically designed for this purpose. This work presents a review of the different challenges that designers of systems based on encoded emission beacons must address in order to achieve suitable performance. At low-level processing, the waveform design (coding and modulation) and the processing of the received signal are key factors to address such drawbacks as multipath propagation, multiple-access interference, nearfar effect, or Doppler shifting. With regards to high-level system design, the issues to be addressed are related to the distribution of beacons, ease of deployment, and calibration and positioning algorithms, including the possible fusion of information. Apart from theoretical discussions, this work also includes the description of an ALPS that was implemented, installed in a large area and tested for mobile robot navigation. In addition to practical interest for real applications, airborne ALPSs can also be used as an excellent platform to test complex algorithms, which can be subsequently adapted for other positioning systems, such as underwater acoustic systems or ultrawideband radiofrequency (UWB RF) systems.


title: A Survey on Robotics with Foundation Models: toward Embodied AI

abstract: While the exploration for embodied AI has spanned multiple decades, it remains a persistent challenge to endow agents with human-level intelligence, including perception, learning, reasoning, decision-making, control, and generalization capabilities, so that they can perform general-purpose tasks in open, unstructured, and dynamic environments. Recent advances in computer vision, natural language processing, and multi-modality learning have shown that the foundation models have superhuman capabilities for specific tasks. They not only provide a solid cornerstone for integrating basic modules into embodied AI systems but also shed light on how to scale up robot learning from a methodological perspective. This survey aims to provide a comprehensive and up-to-date overview of foundation models in robotics, focusing on autonomous manipulation and encompassing high-level planning and low-level control. Moreover, we showcase their commonly used datasets, simulators, and benchmarks. Importantly, we emphasize the critical challenges intrinsic to this field and delineate potential avenues for future research, contributing to advancing the frontier of academic and industrial discourse.


title: On point-ahead angle control strategies for TianQin

abstract: Pointing-related displacement noises are crucial in space-based gravitational wave detectors, where point-ahead angle control of transmitted laser beams may contribute significantly. For TianQin that features a geocentric concept, the circular high orbit design with a nearly fixed constellation plane gives rise to small variations of the point-ahead angles within $\pm 25$ nrad in-plane and $\pm 10$ nrad off-plane, in addition to a static bias of 23 $\mu$rad predominantly within the constellation plane. Accordingly, TianQin may adopt fixed-value compensation for the point-ahead angles and absorb the small and slow variations into the pointing biases. To assess the in-principle feasibility, the far-field tilt-to-length (TTL) coupling effect is discussed, and preliminary requirements on far-field wavefront quality are derived, which have taken into account of TTL noise subtraction capability in post processing. The proposed strategy has benefits in simplifying the interferometry design, payload operation, and TTL noise mitigation for TianQin.


title: Brain-Body-Task Co-Adaptation can Improve Autonomous Learning and Speed of Bipedal Walking

abstract: Inspired by animals that co-adapt their brain and body to interact with the environment, we present a tendon-driven and over-actuated (i.e., n joint, n+1 actuators) bipedal robot that (i) exploits its backdrivable mechanical properties to manage body-environment interactions without explicit control, and (ii) uses a simple 3-layer neural network to learn to walk after only 2 minutes of 'natural' motor babbling (i.e., an exploration strategy that is compatible with leg and task dynamics; akin to childsplay). This brain-body collaboration first learns to produce feet cyclical movements 'in air' and, without further tuning, can produce locomotion when the biped is lowered to be in slight contact with the ground. In contrast, training with 2 minutes of 'naive' motor babbling (i.e., an exploration strategy that ignores leg task dynamics), does not produce consistent cyclical movements 'in air', and produces erratic movements and no locomotion when in slight contact with the ground. When further lowering the biped and making the desired leg trajectories reach 1cm below ground (causing the desired-vs-obtained trajectories error to be unavoidable), cyclical movements based on either natural or naive babbling presented almost equally persistent trends, and locomotion emerged with naive babbling. Therefore, we show how continual learning of walking in unforeseen circumstances can be driven by continual physical adaptation rooted in the backdrivable properties of the plant and enhanced by exploration strategies that exploit plant dynamics. Our studies also demonstrate that the bio-inspired codesign and co-adaptations of limbs and control strategies can produce locomotion without explicit control of trajectory errors.


title: Solution-oriented Agent-based Models Generation with Verifier-assisted Iterative In-context Learning

abstract: Agent-based models (ABMs) stand as an essential paradigm for proposing and validating hypothetical solutions or policies aimed at addressing challenges posed by complex systems and achieving various objectives. This process demands labor-intensive endeavors and multidisciplinary expertise. Large language models (LLMs) encapsulating cross-domain knowledge and programming proficiency could potentially alleviate the difficulty of this process. However, LLMs excel in handling sequential information, making it challenging for analyzing the intricate interactions and nonlinear dynamics inherent in ABMs. Additionally, due to the lack of self-evaluation capability of LLMs, relying solely on LLMs is insufficient to effectively accomplish this process. In this paper, we present SAGE, a general solution-oriented ABM generation framework designed for automatic modeling and generating solutions for targeted problems. Unlike approaches reliant on expert handcrafting or resource-intensive neural network training, SAGE establishes a verifier-assisted iterative in-context learning process employing large language models (LLMs) to leverages their inherent cross-domain knowledge for tackling intricate demands from diverse domain scenarios. In SAGE, we introduce an semi-structured conceptual representation expliciting the intricate structures of ABMs and an objective representation to guide LLMs in modeling scenarios and proposing hypothetical solutions through in-context learning. To ensure the model executability and solution feasibility, SAGE devises a two-level verifier with chain-of-thought prompting tailored to the complex interactions and non-linear dynamics of ABMs, driving the iterative generation optimization. Moreover, we construct an evaluation dataset of solution-oriented ABMs from open sources.It contains practical models across various domains.


title: KICGPT: Large Language Model with Knowledge in Context for Knowledge Graph Completion

abstract: Knowledge Graph Completion (KGC) is crucial for addressing knowledge graph incompleteness and supporting downstream applications. Many models have been proposed for KGC. They can be categorized into two main classes: triple-based and text-based approaches. Triple-based methods struggle with long-tail entities due to limited structural information and imbalanced entity distributions. Text-based methods alleviate this issue but require costly training for language models and specific finetuning for knowledge graphs, which limits their efficiency. To alleviate these limitations, in this paper, we propose KICGPT, a framework that integrates a large language model (LLM) and a triple-based KGC retriever. It alleviates the long-tail problem without incurring additional training overhead. KICGPT uses an in-context learning strategy called Knowledge Prompt, which encodes structural knowledge into demonstrations to guide the LLM. Empirical results on benchmark datasets demonstrate the effectiveness of KICGPT with smaller training overhead and no finetuning.


title: Improved Upper Bound for the Size of a Trifferent Code

abstract: A subset $\mathcal{C}\subseteq\{0,1,2\}^n$ is said to be a $\textit{trifferent}$ code (of block length $n$) if for every three distinct codewords $x,y, z \in \mathcal{C}$, there is a coordinate $i\in \{1,2,\ldots,n\}$ where they all differ, that is, $\{x(i),y(i),z(i)\}$ is same as $\{0,1,2\}$. Let $T(n)$ denote the size of the largest trifferent code of block length $n$. Understanding the asymptotic behavior of $T(n)$ is closely related to determining the zero-error capacity of the $(3/2)$-channel defined by Elias'88, and is a long-standing open problem in the area. Elias had shown that $T(n)\leq 2\times (3/2)^n$ and prior to our work the best upper bound was $T(n)\leq 0.6937 \times (3/2)^n$ due to Kurz'23. We improve this bound to $T(n)\leq c \times n^{-2/5}\times (3/2)^n$ where $c$ is an absolute constant.


title: Multipath Compensation Algorithm for TDMA-Based Ultrasonic Local Positioning Systems

abstract: This paper proposes a multipath compensation algorithm (MCA) to enhance the performance of an ultrasonic local positioning system under adverse multipath conditions. The proposed algorithm is based on the accurate estimation of the environment impulse response from which the corresponding line of sight for each channel is obtained. Experimental results in two different environments and with different conditions have been conducted in order to evaluate the performance of this proposal. In both environments, results confirm the expected improvements, even under severe multipath conditions where positioning errors have been reduced from 44 to 9 cm for the 95% of the measurements.


title: DeLLMa: A Framework for Decision Making Under Uncertainty with Large Language Models

abstract: The potential of large language models (LLMs) as decision support tools is increasingly being explored in fields such as business, engineering, and medicine, which often face challenging tasks of decision-making under uncertainty. In this paper, we show that directly prompting LLMs on these types of decision-making problems can yield poor results, especially as the problem complexity increases. To aid in these tasks, we propose DeLLMa (Decision-making Large Language Model assistant), a framework designed to enhance decision-making accuracy in uncertain environments. DeLLMa involves a multi-step scaffolding procedure, drawing upon principles from decision theory and utility theory, to provide a rational and human-auditable decision-making process. We validate our framework on multiple realistic decision-making environments, demonstrating that DeLLMa can consistently enhance the decision-making performance of leading language models, and achieve up to a 40% increase in accuracy over competing methods.


title: Gas content and evolution of a sample of YSO associations at $d \lesssim$ 3.5 kpc from the Sun

abstract: Young Stellar Objects (YSO) are newly formed stars from molecular clouds. They stay close to where they were born and serve as good tracers to study gas and star formation. During cloud evolution, young massive stars can disrupt the surrounding gas through stellar feedback, changing the gas distribution. We study the distribution of the gas around a sample of YSO associations located at $d \lesssim 3.5 \;\rm kpc$ from the Sun by comparing the location and morphology between $^{12}$CO (J = 1$-$0) emission, Planck 870 $\mu$m maps and YSO associations. Based on the spatial distribution of the gas compared to that of the YSOs, we classify the YSO associations into six types: direct, close, bubble, complex, diffuse, and clean associations. The complex associations are large structures consisting of both gas-rich and gas-poor segments. We study the velocity dispersion-size relation toward different association types. From the ratio between different types, we estimate a feedback time of $\approx$ 1.7 Myr in the solar neighborhood. The sample sets a solid foundation to explore the relationship between interstellar medium evolution, star formation, and Galaxy structure.


title: Frustration - no frustration crossover and phase transitions in 2D spin models with zig-zag structure

abstract: Three 2D spin models made of frustrated zig-zag chains with competing interactions which by exact summation with respect to some degrees of freedom can be replaced by an effective temperature-dependent interaction were considered. The first model, exactly solvable Ising chains coupled by only four-spin interactions does not exhibit any finite temperature phase transition, nevertheless temperature can trigger a frustration - no frustration crossover accompanied by gigantic specific heat. A similar effect was observed in several two-leg ladder models [Yin Weiguo, arXiv:2006.08921v2 (2020), 2006.15087v1 (2020)]. The anisotropic Ising chains coupled by a direct interchain interaction and competing with it indirect interaction via spins located between chains are analyzed by using exact Onsager's equation and linear perturbation renormalization group (LPRG). Depending on the parameter set such a model exhibits one antiferromagnetic (AF) or ferromagnetic (FM) phase transition or three phase transitions with reentrant disordered phase between AF and FM ones. The LPRG method was also used to study coupled uniaxial $XXZ$ chains which, for example, can be a minimal model to describe the magnetic properties of compounds in which uranium and rare earth atoms form zig-zag chains. As with the Ising model for a certain set of parameters the model can undergo three phase transitions. However, both inchain and interchain plain interactions $s_{i,j}^x s_{k,l}^x+s_{i,j}^y s_{k,l}^y$ can eliminate the reentrant disordered phase and then only one transition takes place. Additionally, the $XXZ$ model can undergo temperature-induced metamagnetic transition.


title: A fast and gridless ORKA algorithm for tracking moving and deforming objects

abstract: Identifying objects in given data is a task frequently encountered in many applications. Finding vehicles or persons in video data, tracking seismic waves in geophysical exploration data, or predicting a storm front movement from meteorological measurements are only some of the possible applications. In many cases, the object of interest changes its form or position from one measurement to another. For example, vehicles in a video may change its position or angle to the camera in each frame. Seismic waves can change its arrival time, frequency, or intensity depending on the sensor position. Storm fronts can change its form and position over time. This complicates the identification and tracking as the algorithm needs to deal with the changing object over the given measurements. In a previous work, the authors presented a new algorithm to solve this problem - Object reconstruction using K-approximation (ORKA). The algorithm can solve the problem at hand but suffers from two disadvantages. On the one hand, the reconstructed object movement is bound to a grid that depends on the data resolution. On the other hand, the complexity of the algorithm increases exponentially with the resolution. We overcome both disadvantages by introducing an iterative strategy that uses a resampling method to create multiple resolutions of the data. In each iteration the resolution is increased to reconstruct more details of the object of interest. This way, we can even go beyond the original resolution by artificially upsampling the data. We give error bounds and a complexity analysis of the new method. Furthermore, we analyze its performance in several numerical experiments as well as on real data. We also give a brief introduction on the original ORKA algorithm. Knowledge of the previous work is thus not required.


title: Selected aspects of tractability analysis

abstract: We give an overview of certain aspects of tractability analysis of multivariate problems. This paper is not intended to give a complete account of the subject, but provides an insight into how the theory works for particular types of problems. We mainly focus on linear problems on Hilbert spaces, and mostly allow arbitrary linear information. In such cases, tractability analysis is closely linked to an analysis of the singular values of the operator under consideration. We also highlight the more recent developments regarding exponential and generalized tractability. The theoretical results are illustrated by several examples throughout the article.


title: Multiplexed all-optical permutation operations using a reconfigurable diffractive optical network

abstract: Large-scale and high-dimensional permutation operations are important for various applications in e.g., telecommunications and encryption. Here, we demonstrate the use of all-optical diffractive computing to execute a set of high-dimensional permutation operations between an input and output field-of-view through layer rotations in a diffractive optical network. In this reconfigurable multiplexed material designed by deep learning, every diffractive layer has four orientations: 0, 90, 180, and 270 degrees. Each unique combination of these rotatable layers represents a distinct rotation state of the diffractive design tailored for a specific permutation operation. Therefore, a K-layer rotatable diffractive material is capable of all-optically performing up to 4^K independent permutation operations. The original input information can be decrypted by applying the specific inverse permutation matrix to output patterns, while applying other inverse operations will lead to loss of information. We demonstrated the feasibility of this reconfigurable multiplexed diffractive design by approximating 256 randomly selected permutation matrices using K=4 rotatable diffractive layers. We also experimentally validated this reconfigurable diffractive network using terahertz radiation and 3D-printed diffractive layers, providing a decent match to our numerical results. The presented rotation-multiplexed diffractive processor design is particularly useful due to its mechanical reconfigurability, offering multifunctional representation through a single fabrication process.


title: Relative eta invariant and uniformly positive scalar curvature on non-compact manifolds

abstract: On complete non-compact manifolds with bounded sectional curvature, we consider a class of self-adjoint Dirac-type operators called Dirac-Schr\"odinger operators. Assuming two Dirac-Schr\"odinger operators coincide at infinity, by previous work, one can define their relative eta invariant. A typical example of Dirac-Schr\"odinger operators is the (twisted) spin Dirac operators on spin manifolds which admit a Riemannian metric of uniformly positive scalar curvature. In this case, using the relative eta invariant, we get a geometric formula for the spectral flow on non-compact manifolds, which induces a new proof of Gromov-Lawson's result about compact area enlargeable manifolds in odd dimensions. When two such spin Dirac operators are the boundary restriction of an operator on a manifold with non-compact boundary, under certain conditions, we obtain an index formula involving the relative eta invariant. This generalizes the Atiyah-Patodi-Singer index theorem to non-compact boundary situation. As a result, we can use the relative eta invariant to study the space of uniformly positive scalar curvature metrics on some non-compact connected sums.


title: FreDF: Learning to Forecast in Frequency Domain

abstract: Time series modeling is uniquely challenged by the presence of autocorrelation in both historical and label sequences. Current research predominantly focuses on handling autocorrelation within the historical sequence but often neglects its presence in the label sequence. Specifically, emerging forecast models mainly conform to the direct forecast (DF) paradigm, generating multi-step forecasts under the assumption of conditional independence within the label sequence. This assumption disregards the inherent autocorrelation in the label sequence, thereby limiting the performance of DF-based models. In response to this gap, we introduce the Frequency-enhanced Direct Forecast (FreDF), which bypasses the complexity of label autocorrelation by learning to forecast in the frequency domain. Our experiments demonstrate that FreDF substantially outperforms existing state-of-the-art methods including iTransformer and is compatible with a variety of forecast models.


title: Evaluation of Zadoff-Chu, Kasami and Chirp based encoding schemes for Acoustic Local Positioning Systems

abstract: The task of determining the physical coordinates of a target in indoor environments is still a key factor for many applications including people and robot navigation, user tracking, location-based advertising, augmented reality, gaming, emergency response or ambient assisted living environments. Among the different possibilities for indoor positioning, Acoustic Local Positioning Systems (ALPS) have the potential for centimeter level positioning accuracy with coverage distances up to tens of meters. In addition, acoustic transducers are small, low cost and reliable thanks to the room constrained propagation of these mechanical waves. Waveform design (coding and modulation) is usually incorporated into these systems to facilitate the detection of the transmitted signals at the receiver. The aperiodic correlation properties of the emitted signals have a large impact on how the ALPS cope with common impairment factors such as multipath propagation, multiple access interference, Doppler shifting, near-far effect or ambient noise. This work analyzes three of the most promising families of codes found in the literature for ALPS: Kasami codes, Zadoff-Chu and Orthogonal Chirp signals. The performance of these codes is evaluated in terms of time of arrival accuracy and characterized by means of model simulation under realistic conditions and by means of experimental tests in controlled environments. The results derived from this study can be of interest for other applications based on spreading sequences, such as underwater acoustic systems, ultrasonic imaging or even Code Division Multiple Access (CDMA) communications systems.


title: AI-Generated Content Enhanced Computer-Aided Diagnosis Model for Thyroid Nodules: A ChatGPT-Style Assistant

abstract: An artificial intelligence-generated content-enhanced computer-aided diagnosis (AIGC-CAD) model, designated as ThyGPT, has been developed. This model, inspired by the architecture of ChatGPT, could assist radiologists in assessing the risk of thyroid nodules through semantic-level human-machine interaction. A dataset comprising 19,165 thyroid nodule ultrasound cases from Zhejiang Cancer Hospital was assembled to facilitate the training and validation of the model. After training, ThyGPT could automatically evaluate thyroid nodule and engage in effective communication with physicians through human-computer interaction. The performance of ThyGPT was rigorously quantified using established metrics such as the receiver operating characteristic (ROC) curve, area under the curve (AUC), sensitivity, and specificity. The empirical findings revealed that radiologists, when supplemented with ThyGPT, markedly surpassed the diagnostic acumen of their peers utilizing traditional methods as well as the performance of the model in isolation. These findings suggest that AIGC-CAD systems, exemplified by ThyGPT, hold the promise to fundamentally transform the diagnostic workflows of radiologists in forthcoming years.


title: Machine Learning Analysis of the Impact of Increasing the Minimum Wage on Income Inequality in Spain from 2001 to 2021

abstract: This paper analyzes the impact of the National Minimum Wage from 2001 to 2021. The MNW increased from 505.7/month (2001) to 1,108.3/month (2021). Using the data provided by the Spanish Tax Administration Agency, databases that represent the entire population studied can be analyzed. More accurate results and more efficient predictive models are provided by these counts. This work is characterized by the database used, which is a national census and not a sample or projection. Therefore, the study reflects results and analyses based on historical data from the Spanish Salary Census 2001-2021. Various machine-learning models show that income inequality has been reduced by raising the minimum wage. Raising the minimum wage has not led to inflation or increased unemployment. On the contrary, it has been consistent with increased net employment, contained prices, and increased corporate profit margins. The most important conclusion is that an increase in the minimum wage in the period analyzed has led to an increase in the wealth of the country, increasing employment and company profits, and is postulated, under the conditions analyzed, as an effective method for the redistribution of wealth.


title: Full Characterization of the Depth Overhead for Quantum Circuit Compilation with Arbitrary Qubit Connectivity Constraint

abstract: In some physical implementations of quantum computers, 2-qubit operations can be applied only on certain pairs of qubits. Compilation of a quantum circuit into one compliant to such qubit connectivity constraint results in an increase of circuit depth. Various compilation algorithms were studied, yet what this depth overhead is remains elusive. In this paper, we fully characterize the depth overhead by the routing number of the underlying constraint graph, a graph-theoretic measure which has been studied for 3 decades. We also give reduction algorithms between different graphs, which allow compilation for one graph to be transferred to one for another. These results, when combined with existing routing algorithms, give asymptotically optimal compilation for all commonly seen connectivity graphs in quantum computing.


title: Regular octagons in Poincare model of Lobachevsky geometry

abstract: To investigate the topological structure of Morse flows on the 2-disk we use the planar graphs as destinguished graph of the flow. We assume, that the flow is transversal to the boundary of the 2-disk. We give a list of all planar graph with at least 3 edges and describe all planar graphs with 4 edges. We use a list of spherical graph with at least 4 edges.


title: Angle Robustness Unmanned Aerial Vehicle Navigation in GNSS-Denied Scenarios

abstract: Due to the inability to receive signals from the Global Navigation Satellite System (GNSS) in extreme conditions, achieving accurate and robust navigation for Unmanned Aerial Vehicles (UAVs) is a challenging task. Recently emerged, vision-based navigation has been a promising and feasible alternative to GNSS-based navigation. However, existing vision-based techniques are inadequate in addressing flight deviation caused by environmental disturbances and inaccurate position predictions in practical settings. In this paper, we present a novel angle robustness navigation paradigm to deal with flight deviation in point-to-point navigation tasks. Additionally, we propose a model that includes the Adaptive Feature Enhance Module, Cross-knowledge Attention-guided Module and Robust Task-oriented Head Module to accurately predict direction angles for high-precision navigation. To evaluate the vision-based navigation methods, we collect a new dataset termed as UAV_AR368. Furthermore, we design the Simulation Flight Testing Instrument (SFTI) using Google Earth to simulate different flight environments, thereby reducing the expenses associated with real flight testing. Experiment results demonstrate that the proposed model outperforms the state-of-the-art by achieving improvements of 26.0% and 45.6% in the success rate of arrival under ideal and disturbed circumstances, respectively.


title: Conformal vector fields on compact connected homogeneous Finsler manifolds

abstract: Let $(M,F)$ be a compact connected homogeneous non-Riemannian Finsler manifold with $\dim M>1$. We prove that any conformal vector field on $(M,F)$ is a Killing vector field. Further more, we prove that $\rho F$ is a homogeneous Finsler metric on $M$ if and only if $\rho$ is a positive constant function.


title: Defining Neural Network Architecture through Polytope Structures of Dataset

abstract: Current theoretical and empirical research in neural networks suggests that complex datasets require large network architectures for thorough classification, yet the precise nature of this relationship remains unclear. This paper tackles this issue by defining upper and lower bounds for neural network widths, which are informed by the polytope structure of the dataset in question. We also delve into the application of these principles to simplicial complexes and specific manifold shapes, explaining how the requirement for network width varies in accordance with the geometric complexity of the dataset. Moreover, we develop an algorithm to investigate a converse situation where the polytope structure of a dataset can be inferred from its corresponding trained neural networks. Through our algorithm, it is established that popular datasets such as MNIST, Fashion-MNIST, and CIFAR10 can be efficiently encapsulated using no more than two polytopes with a small number of faces.


title: GLaPE: Gold Label-agnostic Prompt Evaluation and Optimization for Large Language Model

abstract: Despite the rapid progress of large language models (LLMs), their task performance remains sensitive to prompt design. Recent studies have explored leveraging the LLM itself as an optimizer to identify optimal prompts that maximize task accuracy. However, when evaluating prompts, such approaches heavily rely on elusive manually annotated gold labels to calculate task accuracy for each candidate prompt, which hinders the widespread implementation and generality. To overcome the limitation, this work proposes a gold label-agnostic prompt evaluation (GLaPE) to alleviate dependence on gold labels. Motivated by the observed correlation between self-consistency and the accuracy of the answer, we adopt self-consistency as the initial evaluation score. Subsequently, we refine the scores of prompts producing identical answers to be mutually consistent. Experimental results show that GLaPE provides reliable evaluations uniform with accuracy, even in the absence of gold labels. Moreover, on six popular reasoning tasks, our GLaPE-based prompt optimization yields effective prompts comparable to accuracy-based ones. The code is publicly available at https://github.com/thunderous77/GLaPE.


title: Loading-effect-based 3-D microfabrication empowers on-chip Brillouin optomechanics

abstract: The acousto-optic interaction known as stimulated Brillouin scattering (SBS) has emerged as fundamental principles for realizing crucial components and functionalities in integrated photonics. However, the main challenge of integrated Brillouin devices is how to effectively confine both optical and acoustic waves. Apart from that, the manufacturing processes for these devices need to be compatible with standard fabrication platforms, and streamlined to facilitate their large-scale integration. Here, we demonstrate a novel suspended nanowire structure that can tightly confine photons and phonons. Furthermore, tailored for this structure, we introduce a loading-effect-based three-dimensional microfabrication technique, compatible with complementary metal-oxide-semiconductor (CMOS) technology. This innovative technique allows for the fabrication of the entire structure using a single-step lithography exposure, significantly streamlining the fabrication process. Leveraging this structure and fabrication scheme, we have achieved a Brillouin gain coefficient of 1100 1/W/m on the silicon-on-insulator platform within a compact footprint. It can support a Brillouin net gain over 4.1 dB with modest pump powers. We believe that this structure can significantly advance the development of SBS on chip, unlocking new opportunities for the large-scale integration of Brillouin-based photonic devices.


title: Block-Sparse Tensor Recovery

abstract: This work explores the fundamental problem of the recoverability of a sparse tensor being reconstructed from its compressed embodiment. We present a generalized model of block-sparse tensor recovery as a theoretical foundation, where concepts measuring holistic mutual incoherence property (MIP) of the measurement matrix set are defined. A representative algorithm based on the orthogonal matching pursuit (OMP) framework, called tensor generalized block OMP (T-GBOMP), is applied to the theoretical framework elaborated for analyzing both noiseless and noisy recovery conditions. Specifically, we present the exact recovery condition (ERC) and sufficient conditions for establishing it with consideration of different degrees of restriction. Reliable reconstruction conditions, in terms of the residual convergence, the estimated error and the signal-to-noise ratio bound, are established to reveal the computable theoretical interpretability based on the newly defined MIP, which we introduce. The flexibility of tensor recovery is highlighted, i.e., the reliable recovery can be guaranteed by optimizing MIP of the measurement matrix set. Analytical comparisons demonstrate that the theoretical results developed are tighter and less restrictive than the existing ones (if any). Further discussions provide tensor extensions for several classic greedy algorithms, indicating that the sophisticated results derived are universal and applicable to all these tensorized variants.


title: Physics-Inspired Degradation Models for Hyperspectral Image Fusion

abstract: The fusion of a low-spatial-resolution hyperspectral image (LR-HSI) with a high-spatial-resolution multispectral image (HR-MSI) has garnered increasing research interest. However, most fusion methods solely focus on the fusion algorithm itself and overlook the degradation models, which results in unsatisfactory performance in practical scenarios. To fill this gap, we propose physics-inspired degradation models (PIDM) to model the degradation of LR-HSI and HR-MSI, which comprises a spatial degradation network (SpaDN) and a spectral degradation network (SpeDN). SpaDN and SpeDN are designed based on two insights. First, we employ spatial warping and spectral modulation operations to simulate lens aberrations, thereby introducing non-uniformity into the spatial and spectral degradation processes. Second, we utilize asymmetric downsampling and parallel downsampling operations to separately reduce the spatial and spectral resolutions of the images, thus ensuring the matching of spatial and spectral degradation processes with specific physical characteristics. Once SpaDN and SpeDN are established, we adopt a self-supervised training strategy to optimize the network parameters and provide a plug-and-play solution for fusion methods. Comprehensive experiments demonstrate that our proposed PIDM can boost the fusion performance of existing fusion methods in practical scenarios.


title: On Approximation Schemes for Stabbing Rectilinear Polygons

abstract: We study the problem of stabbing rectilinear polygons, where we are given $n$ rectilinear polygons in the plane that we want to stab, i.e., we want to select horizontal line segments such that for each given rectilinear polygon there is a line segment that intersects two opposite (parallel) edges of it. Our goal is to find a set of line segments of minimum total length such that all polygons are stabbed. For the special case of rectangles, there is a $O(1)$-approximation algorithm and the problem is $\mathsf{NP}$-hard [Chan et al.]. Also, the problem admits a QPTAS [Eisenbrand et al.] and even a PTAS [Khan et al.]. However, the approximability for the setting of more general polygons, e.g., L-shapes or T-shapes, is completely open. In this paper, we characterize the conditions under which the problem admits a $(1+\varepsilon)$-approximation algorithm. We assume that each input polygon is composed of rectangles that are placed on top of each other such that, for each pair of adjacent edges between rectangles, one edge contains the other. We show that if all input polygons satisfy the hourglass condition, then the problem admits a QPTAS. In particular, it is thus unlikely that this case is $\mathsf{APX}$-hard. Furthermore, we show that there exists a PTAS if each input polygon is composed out of rectangles with a bounded range of widths. On the other hand, if the input polygons do not satisfy these conditions, we prove that the problem is $\mathsf{APX}$-hard, already if all input polygons have only eight edges. We remark that all polygons with fewer edges automatically satisfy the hourglass condition. On the other hand, for arbitrary rectilinear polygons we even show a lower bound of $\Omega(\log n)$ for the possible approximation ratio, which implies that the best possible ratio is in $\Theta(\log n)$ since the problem is a special case of Set Cover.


title: Quantum Secret Sharing Enhanced: Utilizing W States for Anonymous and Secure Communication

abstract: Quantum secret sharing (QSS) is the result of merging the principles of quantum mechanics with secret information sharing. It enables a sender to share a secret among receivers, and the receivers can then collectively recover the secret when the need arises. To enhance the practicality of these quantum protocols, an innovative concept of quantum anonymous secret sharing (QASS) is advanced. In this paper, we propose a QASS protocol via W states, which can share secrets while ensuring recover-ability, recover-security, and recover-anonymity. We have rigorously evaluated our protocols, verifying their accuracy and fortifying their security against scenarios involving the active adversary. This includes considerations for dishonest receivers and non-receivers. Moreover, acknowledging the imperfections inherent in real-world communication channels, we have also undertaken an exhaustive analysis of our protocol's security and effectiveness in a quantum network where some form of noise is present. Our investigations reveal that W states exhibit good performance in mitigating noise interference, making them apt for practical applications.


title: Navigate Biopsy with Ultrasound under Augmented Reality Device: Towards Higher System Performance

abstract: Purpose: Biopsies play a crucial role in determining the classification and staging of tumors. Ultrasound is frequently used in this procedure to provide real-time anatomical information. Using augmented reality (AR), surgeons can visualize ultrasound data and spatial navigation information seamlessly integrated with real tissues. This innovation facilitates faster and more precise biopsy operations. Methods: We developed an AR biopsy navigation system with low display latency and high accuracy. Ultrasound data is initially read by an image capture card and streamed to Unity via net communication. In Unity, navigation information is rendered and transmitted to the HoloLens 2 device using holographic remoting. Retro-reflective tool tracking is implemented on the HoloLens 2, enabling simultaneous tracking of the ultrasound probe and biopsy needle. Distinct navigation information is provided during in-plane and out-of-plane punctuation. To evaluate the effectiveness of our system, we conducted a study involving ten participants, for puncture accuracy and biopsy time, comparing to traditional methods. Results: Our proposed framework enables ultrasound visualization in AR with only $16.22\pm11.45ms$ additional latency. Navigation accuracy reached $1.23\pm 0.68mm$ in the image plane and $0.95\pm 0.70mm$ outside the image plane. Remarkably, the utilization of our system led to $98\%$ and $95\%$ success rate in out-of-plane and in-plane biopsy. Conclusion: To sum up, this paper introduces an AR-based ultrasound biopsy navigation system characterized by high navigation accuracy and minimal latency. The system provides distinct visualization contents during in-plane and out-of-plane operations according to their different characteristics. Use case study in this paper proved that our system can help young surgeons perform biopsy faster and more accurately.


title: A narrow-band parameterization for the stochastic gravitational wave background

abstract: In light of the non-perturbative resonance effects that may occur during inflation, we introduce a parametrization for the power spectrum of the stochastic gravitational wave background (SGWB) characterized by narrow-band amplification. We utilize the universal $\Omega_\text{GW}\propto k^3$ infrared limit, applicable to a wide array of gravitational wave sources, to devise a robust yet straightforward parameterization optimized for Markov Chain Monte Carlo (MCMC) analyses. This parameterization is demonstrated through select examples where its application is pertinent, and we discuss the advantages of this approach over traditional parametrizations for narrow-band scenarios. To evaluate the sensitivity of our proposed model parameters, we apply a mock likelihood based on the CMB-Stage4 data. Furthermore, we explicate the computational process for the mapping relationship between the foundational model parameters and our parameterized framework, using a two-field inflation model that resonantly amplifies gravitational waves (GWs) as an example.


title: Aligner: Efficient Alignment by Learning to Correct

abstract: With the rapid development of large language models (LLMs) and ever-evolving practical requirements, finding an efficient and effective alignment method has never been more critical. However, the tension between the complexity of current alignment methods and the need for rapid iteration in deployment scenarios necessitates the development of a model-agnostic alignment approach that can operate under these constraints. In this paper, we introduce Aligner, a novel and simple alignment paradigm that learns the correctional residuals between preferred and dispreferred answers using a small model. Designed as a model-agnostic, plug-and-play module, Aligner can be directly applied to various open-source and API-based models with only one-off training, making it suitable for rapid iteration. Notably, Aligner can be applied to any powerful, large-scale upstream models. Moreover, it can even iteratively bootstrap the upstream models using corrected responses as synthetic human preference data, breaking through the model's performance ceiling. Our experiments demonstrate performance improvements by deploying the same Aligner model across 11 different LLMs, evaluated on the 3H dimensions (helpfulness, harmlessness, and honesty). Specifically, Aligner-7B has achieved an average improvement of 68.9% in helpfulness and 23.8% in harmlessness across the tested LLMs while also effectively reducing hallucination. In the Alpaca-Eval leaderboard, stacking Aligner-2B on GPT-4 Turbo improved its LC Win Rate from 55.0% to 58.3%, surpassing GPT-4 Omni's 57.5% Win Rate (community report).


title: Revealing flat bands and hybridization gaps in a twisted bilayer graphene device with microARPES

abstract: Controlling the electronic structure of two-dimensional materials using the combination of twist angle and electrostatic doping is an effective means to induce emergent phenomena. In bilayer graphene with an interlayer twist angle near the magic angle, the electronic dispersion is strongly modified by a manifold of hybridizing moir\'e Dirac cones leading to flat band segments with strong electronic correlations. Numerous technical challenges arising from spatial inhomogeneity of interlayer interactions, twist angle and device functionality have so far limited momentum-resolved electronic structure measurements of these systems to static conditions. Here, we present a detailed characterization of the electronic structure exhibiting miniband dispersions for twisted bilayer graphene, near the magic angle, integrated in a functional device architecture using micro-focused angle-resolved photoemission spectroscopy. The optimum conditions for visualizing the miniband dispersion are determined by exploiting the spatial resolution and photon energy tunability of the light source and applied to extract a hybridization gap size of $(0.14 \pm 0.03)$~eV and flat band segments extending across a moir\'e mini Brillouin zone. \textit{In situ} electrostatic gating of the sample enables significant electron-doping, causing the conduction band states to shift below the Fermi energy. Our work emphasizes key challenges in probing the electronic structure of magic angle bilayer graphene devices and outlines conditions for exploring the doping-dependent evolution of the dispersion that underpins the ability to control many-body interactions in the material.


title: eXplainable Bayesian Multi-Perspective Generative Retrieval

abstract: Modern deterministic retrieval pipelines prioritize achieving state-of-the-art performance but often lack interpretability in decision-making. These models face challenges in assessing uncertainty, leading to overconfident predictions. To overcome these limitations, we integrate uncertainty calibration and interpretability into a retrieval pipeline. Specifically, we introduce Bayesian methodologies and multi-perspective retrieval to calibrate uncertainty within a retrieval pipeline. We incorporate techniques such as LIME and SHAP to analyze the behavior of a black-box reranker model. The importance scores derived from these explanation methodologies serve as supplementary relevance scores to enhance the base reranker model. We evaluate the resulting performance enhancements achieved through uncertainty calibration and interpretable reranking on Question Answering and Fact Checking tasks. Our methods demonstrate substantial performance improvements across three KILT datasets.


title: On the local streamline pattern of planar polynomial velocity field with nonzero linear part

abstract: The streamline pattern of planar polynomial velocity field is far from fully understood. In the community of fluid mechanics, most studies simply focus on the velocity gradient, or the linear part of the velocity field, but few studies on high-order terms. This paper is concerned with the local streamline pattern (LSP) of velocity field around an isotropic point. In virtue of the concept and method of dynamical systems, where the streamline pattern is equivalent to the phase portrait, we make clear the classification of LSPs of planar velocity fields with nonzero linear part, especially the cases where the determinant of velocity gradient vanishes at the isotropic point.


title: Factuality of Large Language Models in the Year 2024

abstract: Large language models (LLMs), especially when instruction-tuned for chat, have become part of our daily lives, freeing people from the process of searching, extracting, and integrating information from multiple sources by offering a straightforward answer to a variety of questions in a single place. Unfortunately, in many cases, LLM responses are factually incorrect, which limits their applicability in real-world scenarios. As a result, research on evaluating and improving the factuality of LLMs has attracted a lot of research attention recently. In this survey, we critically analyze existing work with the aim to identify the major challenges and their associated causes, pointing out to potential solutions for improving the factuality of LLMs, and analyzing the obstacles to automated factuality evaluation for open-ended text generation. We further offer an outlook on where future research should go.


title: Phase field cohesive zone modeling for fatigue crack propagation in quasi-brittle materials

abstract: The phase field method has gathered significant attention in the past decade due to its versatile applications in engineering contexts, including fatigue crack propagation modeling. Particularly, the phase field cohesive zone method (PF-CZM) has emerged as a promising approach for modeling fracture behavior in quasi-brittle materials, such as concrete. The present contribution expands the applicability of the PF-CZM to include the modeling of fatigue-induced crack propagation. This study critically examines the validity of the extended PF-CZM approach by evaluating its performance across various fatigue behaviours, encompassing hysteretic behavior, S-N curves, fatigue creep curves, and the Paris law. The experimental investigations and validation span a diverse spectrum of loading scenarios, encompassing pre- and post-peak cyclic loading, as well as low- and high-cyclic fatigue loading. The validation process incorporates 2D and 3D boundary value problems, considering mode I and mixed-modes fatigue crack propagation. The results obtained from this study show a wide range of validity, underscoring the remarkable potential of the proposed PF-CZM approach to accurately capture the propagation of fatigue cracks in concrete-like materials. Furthermore, the paper outlines recommendations to improve the predictive capabilities of the model concerning key fatigue characteristics.


title: Fermion-soliton scattering in a modified $\mathbb{CP}^{1}$ model

abstract: The scattering of fermions in the background field of a topological soliton of the modified $(2 + 1)$-dimensional $\mathbb{CP}^{1}$ model is studied here both analytically and numerically. Unlike the original $\mathbb{CP}^{1}$ model, the Lagrangian of the modified model contains a potential term. Due to this, a dilatation zero mode of the topological soliton disappears, which results in stability of the fermion-soliton system. The symmetry properties of the fermion-soliton system are established, and the asymptotic forms of fermionic radial wave functions are studied. Questions related to the bound states of the fermion-soliton system are then discussed. General formulae describing the scattering of fermions are presented. The amplitudes of the fermion-soliton scattering are obtained in an analytical form within the framework of the Born approximation, and their symmetry properties and asymptotic forms are studied. The energy levels of the fermionic bound states and the partial phase shifts of fermionic scattering are obtained by numerical methods, and the ultrarelativistic limits of the partial phase shifts are found.


title: Uni-RLHF: Universal Platform and Benchmark Suite for Reinforcement Learning with Diverse Human Feedback

abstract: Reinforcement Learning with Human Feedback (RLHF) has received significant attention for performing tasks without the need for costly manual reward design by aligning human preferences. It is crucial to consider diverse human feedback types and various learning methods in different environments. However, quantifying progress in RLHF with diverse feedback is challenging due to the lack of standardized annotation platforms and widely used unified benchmarks. To bridge this gap, we introduce Uni-RLHF, a comprehensive system implementation tailored for RLHF. It aims to provide a complete workflow from real human feedback, fostering progress in the development of practical problems. Uni-RLHF contains three packages: 1) a universal multi-feedback annotation platform, 2) large-scale crowdsourced feedback datasets, and 3) modular offline RLHF baseline implementations. Uni-RLHF develops a user-friendly annotation interface tailored to various feedback types, compatible with a wide range of mainstream RL environments. We then establish a systematic pipeline of crowdsourced annotations, resulting in large-scale annotated datasets comprising more than 15 million steps across 30+ popular tasks. Through extensive experiments, the results in the collected datasets demonstrate competitive performance compared to those from well-designed manual rewards. We evaluate various design choices and offer insights into their strengths and potential areas of improvement. We wish to build valuable open-source platforms, datasets, and baselines to facilitate the development of more robust and reliable RLHF solutions based on realistic human feedback. The website is available at https://uni-rlhf.github.io/.


title: Influence of $f(\mathcal{R},\mathcal{T},\mathcal{Q})$ Gravity on Cylindrical Collapse

abstract: This article examines the dynamics of gravitational collapse in $f(\mathcal{R},\mathcal{T},\mathcal{Q})$ gravity, where $\mathcal{Q}=\mathcal{R}_{\mathrm{ab}}\mathcal{T}^{\mathrm{ab}}$. We consider self-gravitating anisotropic cylindrical geometry whose interior is filled with dissipative matter configuration and match it with exterior cylindrically symmetric spacetime at the hypersurface through junction conditions. We employ the Misner-Sharp and M\"{u}ler-Israel Stewart formalisms to derive the dynamical as well as transport equations corresponding to the model $\mathcal{R}+\Phi\sqrt{\mathcal{T}}+\Psi\mathcal{Q}$, where $\Phi$ and $\Psi$ are arbitrary coupling constants. We then establish some relations between these equations through which the impact of effective matter variables, heat dissipation and the bulk viscosity on the collapse rate is studied. Further, we express the Weyl scalar in terms of the effective matter sector. We also obtain the conformal flatness by applying some restrictions on the considered model and taking dust configuration into the account. Finally, we investigate various cases to check whether the modified corrections increase or decrease the collapse rate.


title: DeepLag: Discovering Deep Lagrangian Dynamics for Intuitive Fluid Prediction

abstract: Accurately predicting the future fluid is vital to extensive areas such as meteorology, oceanology, and aerodynamics. However, since the fluid is usually observed from the Eulerian perspective, its moving and intricate dynamics are seriously obscured and confounded in static grids, bringing thorny challenges to the prediction. This paper introduces a new Lagrangian-Eulerian combined paradigm to tackle the tanglesome fluid dynamics. Instead of solely predicting the future based on Eulerian observations, we propose DeepLag to discover hidden Lagrangian dynamics within the fluid by tracking the movements of adaptively sampled key particles. Further, DeepLag presents a new paradigm for fluid prediction, where the Lagrangian movement of the tracked particles is inferred from Eulerian observations, and their accumulated Lagrangian dynamics information is incorporated into global Eulerian evolving features to guide future prediction respectively. Tracking key particles not only provides a transparent and interpretable clue for fluid dynamics but also makes our model free from modeling complex correlations among massive grids for better efficiency. Experimentally, DeepLag excels in three challenging fluid prediction tasks covering 2D and 3D, simulated and real-world fluids.


title: Hybrid-Prediction Integrated Planning for Autonomous Driving

abstract: Autonomous driving systems require the ability to fully understand and predict the surrounding environment to make informed decisions in complex scenarios. Recent advancements in learning-based systems have highlighted the importance of integrating prediction and planning modules. However, this integration has brought forth three major challenges: inherent trade-offs by sole prediction, consistency between prediction patterns, and social coherence in prediction and planning. To address these challenges, we introduce a hybrid-prediction integrated planning (HPP) system, which possesses three novelly designed modules. First, we introduce marginal-conditioned occupancy prediction to align joint occupancy with agent-wise perceptions. Our proposed MS-OccFormer module achieves multi-stage alignment per occupancy forecasting with consistent awareness from agent-wise motion predictions. Second, we propose a game-theoretic motion predictor, GTFormer, to model the interactive future among individual agents with their joint predictive awareness. Third, hybrid prediction patterns are concurrently integrated with Ego Planner and optimized by prediction guidance. HPP achieves state-of-the-art performance on the nuScenes dataset, demonstrating superior accuracy and consistency for end-to-end paradigms in prediction and planning. Moreover, we test the long-term open-loop and closed-loop performance of HPP on the Waymo Open Motion Dataset and CARLA benchmark, surpassing other integrated prediction and planning pipelines with enhanced accuracy and compatibility.


title: The second largest eigenvalue of some nonnormal Cayley graphs on symmetric groups

abstract: A Cayley graph on the symmetric group $S_n$ is said to have the Aldous property if its strictly second largest eigenvalue (that is, the largest eigenvalue strictly smaller than the degree) is attained by the standard representation of $S_n$. For $1\leq r < k < n$, let $C(n,k;r)$ be the set of $k$-cycles of $S_n$ moving every point in $\{1, \ldots, r\}$. Recently, Siemons and Zalesski [J. Algebraic Combin. 55 (2022) 989--1005] posed a conjecture which is equivalent to saying that for any $n \ge 5$ and $1\leq r<k<n$ the nonnormal Cayley graph $\mathrm{Cay}(S_n, C(n,k;r))$ on $S_n$ with connection set $C(n,k;r)$ has the Aldous property. Solving this conjecture, we prove that all these graphs have the Aldous property except when (i) $(n, k, r) = (6, 5, 1)$ or (ii) $n$ is odd, $k = n-1$, and $1 \le r < \frac{n}{2}$. Along the way we determine all irreducible representations of $S_n$ that can achieve the strictly second largest eigenvalue of $\mathrm{Cay}(S_n, C(n,n-1;r))$ as well as the smallest eigenvalue of this graph.


title: On the Stability of Strategic Energy Storage Operation in Wholesale Electricity Markets (Extended Version)

abstract: High shares of variable renewable energy necessitate substantial energy storage capacity. However, it remains unclear how to design a market that, on the one hand, ensures a stable and sufficient income for storage firms, and, on the other hand, maintains stable and affordable electricity costs for the consumers. Here, we use a game theoretic model to study storage competition in wholesale electricity markets. A main result is that these types of games are not necessarily stable. In particular, we find that under certain conditions, which imply a combination of a high share of variable renewable energy sources and low flexibility of conventional power plants, the system will not converge to an equilibrium. However, we demonstrate that a price cap on storage price bids can ensure convergence to a stable solution. Moreover, we find that when the flexibility of conventional power plants is low, while the storage usage for energy balancing increases with renewable energy generation, the profitability of using storage for the sole purpose of energy arbitrage decreases.


title: Towards an Information Theoretic Framework of Context-Based Offline Meta-Reinforcement Learning

abstract: As a marriage between offline RL and meta-RL, the advent of offline meta-reinforcement learning (OMRL) has shown great promise in enabling RL agents to multi-task and quickly adapt while acquiring knowledge safely. Among which, Context-based OMRL (COMRL) as a popular paradigm, aims to learn a universal policy conditioned on effective task representations. In this work, by examining several key milestones in the field of COMRL, we propose to integrate these seemingly independent methodologies into a unified information theoretic framework. Most importantly, we show that the pre-existing COMRL algorithms are essentially optimizing the same mutual information objective between the task variable $\boldsymbol{M}$ and its latent representation $\boldsymbol{Z}$ by implementing various approximate bounds. Based on the theoretical insight and the information bottleneck principle, we arrive at a novel algorithm dubbed UNICORN, which exhibits remarkable generalization across a broad spectrum of RL benchmarks, context shift scenarios, data qualities and deep learning architectures, attaining the new state-of-the-art. We believe that our framework could open up avenues for new optimality bounds and COMRL algorithms.


title: Exploiting Low-level Representations for Ultra-Fast Road Segmentation

abstract: Achieving real-time and accuracy on embedded platforms has always been the pursuit of road segmentation methods. To this end, they have proposed many lightweight networks. However, they ignore the fact that roads are "stuff" (background or environmental elements) rather than "things" (specific identifiable objects), which inspires us to explore the feasibility of representing roads with low-level instead of high-level features. Surprisingly, we find that the primary stage of mainstream network models is sufficient to represent most pixels of the road for segmentation. Motivated by this, we propose a Low-level Feature Dominated Road Segmentation network (LFD-RoadSeg). Specifically, LFD-RoadSeg employs a bilateral structure. The spatial detail branch is firstly designed to extract low-level feature representation for the road by the first stage of ResNet-18. To suppress texture-less regions mistaken as the road in the low-level feature, the context semantic branch is then designed to extract the context feature in a fast manner. To this end, in the second branch, we asymmetrically downsample the input image and design an aggregation module to achieve comparable receptive fields to the third stage of ResNet-18 but with less time consumption. Finally, to segment the road from the low-level feature, a selective fusion module is proposed to calculate pixel-wise attention between the low-level representation and context feature, and suppress the non-road low-level response by this attention. On KITTI-Road, LFD-RoadSeg achieves a maximum F1-measure (MaxF) of 95.21% and an average precision of 93.71%, while reaching 238 FPS on a single TITAN Xp and 54 FPS on a Jetson TX2, all with a compact model size of just 936k parameters. The source code is available at https://github.com/zhouhuan-hust/LFD-RoadSeg.


title: Learning Mutual Excitation for Hand-to-Hand and Human-to-Human Interaction Recognition

abstract: Recognizing interactive actions, including hand-to-hand interaction and human-to-human interaction, has attracted increasing attention for various applications in the field of video analysis and human-robot interaction. Considering the success of graph convolution in modeling topology-aware features from skeleton data, recent methods commonly operate graph convolution on separate entities and use late fusion for interactive action recognition, which can barely model the mutual semantic relationships between pairwise entities. To this end, we propose a mutual excitation graph convolutional network (me-GCN) by stacking mutual excitation graph convolution (me-GC) layers. Specifically, me-GC uses a mutual topology excitation module to firstly extract adjacency matrices from individual entities and then adaptively model the mutual constraints between them. Moreover, me-GC extends the above idea and further uses a mutual feature excitation module to extract and merge deep features from pairwise entities. Compared with graph convolution, our proposed me-GC gradually learns mutual information in each layer and each stage of graph convolution operations. Extensive experiments on a challenging hand-to-hand interaction dataset, i.e., the Assembely101 dataset, and two large-scale human-to-human interaction datasets, i.e., NTU60-Interaction and NTU120-Interaction consistently verify the superiority of our proposed method, which outperforms the state-of-the-art GCN-based and Transformer-based methods.


title: The flavor composition of ultra-high-energy cosmic neutrinos: measurement forecasts for in-ice radio-based EeV neutrino telescopes

abstract: In-ice radio-detection is a promising technique to discover and characterize ultra-high-energy (UHE) neutrinos, with energies above 100 PeV, adopted by present - ARA, ARIANNA, and RNO-G - and planned - IceCube-Gen2. So far, their ability to measure neutrino flavor has remained unexplored. We show and quantify how the neutrino flavor can be measured with in-ice radio detectors using two complementary detection channels. The first channel, sensitive to $\nu_e$, identifies them via their charged-current interactions, whose radio emission is elongated in time due to the Landau-Pomeranchuk-Migdal effect. The second channel, sensitive to $\nu_\mu$ and $\nu_\tau$, identifies events made up of multiple showers generated by the muons and taus they generate. We show this in state-of-the-art forecasts geared at IceCube-Gen2, for representative choices of the UHE neutrino flux. This newfound sensitivity could allow us to infer the UHE neutrino flavor composition at their sources - and thus the neutrino production mechanism - and to probe UHE neutrino physics.


title: Uncertainty-Aware Perceiver

abstract: The Perceiver makes few architectural assumptions about the relationship among its inputs with quadratic scalability on its memory and computation time. Indeed, the Perceiver model outpaces or is competitive with ResNet-50 and ViT in terms of accuracy to some degree. However, the Perceiver does not take predictive uncertainty and calibration into account. The Perceiver also generalizes its performance on three datasets, three models, one evaluation metric, and one hyper-parameter setting. Worst of all, the Perceiver's relative performance improvement against other models is marginal. Furthermore, its reduction of architectural prior is not substantial; is not equivalent to its quality. Thereby, I invented five mutations of the Perceiver, the Uncertainty-Aware Perceivers, that obtain uncertainty estimates and measured their performance on three metrics. Experimented with CIFAR-10 and CIFAR-100, the Uncertainty-Aware Perceivers make considerable performance enhancement compared to the Perceiver.


title: Stability of Schur's iterates and fast solution of the discrete integrable NLS

abstract: We prove a sharp stability estimate for Schur iterates of contractive analytic functions in the open unit disk. We then apply this result in the setting of the inverse scattering approach and obtain a fast algorithm for solving the discrete integrable nonlinear Schr\"odinger equation (Ablowitz-Ladik equation) on the integer lattice, $\mathbb{Z}$. We also give a self-contained introduction to the theory of the nonlinear Fourier transform from the perspective of Schur functions and orthogonal polynomials on the unit circle.