title: Self-Attentive Pooling for Efficient Deep Learning

abstract: Efficient custom pooling techniques that can aggressively trim the dimensions of a feature map and thereby reduce inference compute and memory footprint for resource-constrained computer vision applications have recently gained significant traction. However, prior pooling works extract only the local context of the activation maps, limiting their effectiveness. In contrast, we propose a novel non-local self-attentive pooling method that can be used as a drop-in replacement to the standard pooling layers, such as max/average pooling or strided convolution. The proposed self-attention module uses patch embedding, multi-head self-attention, and spatial-channel restoration, followed by sigmoid activation and exponential soft-max. This self-attention mechanism efficiently aggregates dependencies between non-local activation patches during down-sampling. Extensive experiments on standard object classification and detection tasks with various convolutional neural network (CNN) architectures demonstrate the superiority of our proposed mechanism over the state-of-the-art (SOTA) pooling techniques. In particular, we surpass the test accuracy of existing pooling techniques on different variants of MobileNet-V2 on ImageNet by an average of 1.2%. With the aggressive down-sampling of the activation maps in the initial layers (providing up to 22x reduction in memory consumption), our approach achieves 1.43% higher test accuracy compared to SOTA techniques with iso-memory footprints. This enables the deployment of our models in memory-constrained devices, such as micro-controllers (without losing significant accuracy), because the initial activation maps consume a significant amount of on-chip memory for high-resolution images required for complex vision tasks. Our proposed pooling method also leverages the idea of channel pruning to further reduce memory footprints.


title: Sequential Bayesian Optimization for Adaptive Informative Path Planning with Multimodal Sensing

abstract: Adaptive Informative Path Planning with Multimodal Sensing (AIPPMS) considers the problem of an agent equipped with multiple sensors, each with different sensing accuracy and energy costs. The agent's goal is to explore the environment and gather information subject to its resource constraints in unknown, partially observable environments. Previous work has focused on the less general Adaptive Informative Path Planning (AIPP) problem, which considers only the effect of the agent's movement on received observations. The AIPPMS problem adds additional complexity by requiring that the agent reasons jointly about the effects of sensing and movement while balancing resource constraints with information objectives. We formulate the AIPPMS problem as a belief Markov decision process with Gaussian process beliefs and solve it using a sequential Bayesian optimization approach with online planning. Our approach consistently outperforms previous AIPPMS solutions by more than doubling the average reward received in almost every experiment while also reducing the root-mean-square error in the environment belief by 50%. We completely open-source our implementation to aid in further development and comparison.


title: On the Relation between Sensitivity and Accuracy in In-context Learning

abstract: In-context learning (ICL) suffers from oversensitivity to the prompt, making it unreliable in real-world scenarios. We study the sensitivity of ICL with respect to multiple perturbation types. First, we find that label bias obscures the true sensitivity, and therefore prior work may have significantly underestimated ICL sensitivity. Second, we observe a strong negative correlation between ICL sensitivity and accuracy: predictions sensitive to perturbations are less likely to be correct. Motivated by these findings, we propose \textsc{SenSel}, a few-shot selective prediction method that abstains from sensitive predictions. Experiments on ten classification datasets show that \textsc{SenSel} consistently outperforms two commonly used confidence-based and entropy-based baselines on abstention decisions.


title: NELLIE: A Neuro-Symbolic Inference Engine for Grounded, Compositional, and Explainable Reasoning

abstract: Our goal is a modern approach to answering questions via systematic reasoning where answers are supported by human interpretable proof trees grounded in an NL corpus of authoritative facts. Such a system would help alleviate the challenges of interpretability and hallucination with modern LMs, and the lack of grounding of current explanation methods (e.g., Chain-of-Thought). This paper proposes a new take on Prolog-based inference engines, where we replace handcrafted rules with a combination of neural language modeling, guided generation, and semiparametric dense retrieval. Our implementation, NELLIE, is the first system to demonstrate fully interpretable, end-to-end grounded QA as entailment tree proof search, going beyond earlier work explaining known-to-be-true facts from text. In experiments, NELLIE outperforms a similar-sized state-of-the-art reasoner [Tafjord et al., 2022] while producing knowledge-grounded explanations. We also find NELLIE can exploit both semi-structured and NL text corpora to guide reasoning. Together these suggest a new way to jointly reap the benefits of both modern neural methods and traditional symbolic reasoning.


title: Monolith: Real Time Recommendation System With Collisionless Embedding Table

abstract: Building a scalable and real-time recommendation system is vital for many businesses driven by time-sensitive customer feedback, such as short-videos ranking or online ads. Despite the ubiquitous adoption of production-scale deep learning frameworks like TensorFlow or PyTorch, these general-purpose frameworks fall short of business demands in recommendation scenarios for various reasons: on one hand, tweaking systems based on static parameters and dense computations for recommendation with dynamic and sparse features is detrimental to model quality; on the other hand, such frameworks are designed with batch-training stage and serving stage completely separated, preventing the model from interacting with customer feedback in real-time. These issues led us to reexamine traditional approaches and explore radically different design choices. In this paper, we present Monolith, a system tailored for online training. Our design has been driven by observations of our application workloads and production environment that reflects a marked departure from other recommendations systems. Our contributions are manifold: first, we crafted a collisionless embedding table with optimizations such as expirable embeddings and frequency filtering to reduce its memory footprint; second, we provide an production-ready online training architecture with high fault-tolerance; finally, we proved that system reliability could be traded-off for real-time learning. Monolith has successfully landed in the BytePlus Recommend product.


title: The evolution of the electric field along optical fiber for the type-2 and 3 PAFs in Minkowski 3-space

abstract: In this paper, we introduce the type-2 and the type-3 Positional Adapted Frame(PAF) of spacelike curve and timelike curve in Minkowski 3-space. From these PAFs, we study the evolutions of the electric field vectors of the type-2 and type-3 PAFs. As a result, we also investigate the Fermi-Walker parallel and the Lorentz force equation of the electric field vectors for the type-2 and type-3 PAFs in Minkowski 3-space.


title: Dynamical Systems under Aluthge transforms

abstract: In this note, we verify that the bounded shadowing property and quasi-hyperbolicity of bounded linear operators on Hilbert spaces are preserved under Aluthge transforms.


title: Large Bilinear Magnetoresistance from Rashba Spin-Splitting on the Surface of a Topological Insulator

abstract: In addition to the topologically protected linear dispersion, a band-bending-confined two-dimensional electron gas with tunable Rashba spin-splitting (RSS) was found to coexist with the topological surface states on the surface of topological insulators (TIs). Here, we report the observation of large bilinear magnetoresistance (BMR) in Bi2Se3 films decorated with transition metal atoms. The magnitude of the BMR sensitively depends on the type and amount of atoms deposited, with a maximum achieved value close to those of strong Rashba semiconductors. Our first-principles calculations reproduce the quantum well states and reveal sizable RSS in all Bi2Se3 heterostructures with broken inversion symmetry. Our results show that charge-spin interconversion through RSS states in TIs can be fine-tuned through surface atom deposition and easily detected via BMR for potential spintronic applications.


title: Can There be Art Without an Artist?

abstract: Generative AI based art has proliferated in the past year, with increasingly impressive use cases from generating fake human faces to the creation of systems that can generate thousands of artistic images from text prompts - some of these images have even been "good" enough to win accolades from qualified judges. In this paper, we explore how Generative Models have impacted artistry, not only from a qualitative point of view, but also from an angle of exploitation of artists -- both via plagiarism, where models are trained on their artwork without permission, and via profit shifting, where profits in the art market have shifted from art creators to model owners. However, we posit that if deployed responsibly, AI generative models have the possibility of being a positive, new modality in art that does not displace or harm existing artists.


title: Summary Report of AF1 to Snowmass 2021: Beam Physics and Accelerator Education within the Accelerator Frontier

abstract: This report summarizes the findings of the AF1 Topical Subgroup to Snowmass 2021, which investigates beam physics and accelerator education within the accelerator frontiers (AF). The report focuses primarily on opportunities for basic accelerator and beam physics, formulated into four grand challenges. In addition, the report also studies the current status of accelerator education, outreach and diversity issues. Physics limits of ultimate beams for future colliders are also briefly discussed.


title: Stability Constrained Reinforcement Learning for Decentralized Real-Time Voltage Control

abstract: Deep reinforcement learning has been recognized as a promising tool to address the challenges in real-time control of power systems. However, its deployment in real-world power systems has been hindered by a lack of explicit stability and safety guarantees. In this paper, we propose a stability-constrained reinforcement learning (RL) method for real-time voltage control, that guarantees system stability both during policy learning and deployment of the learned policy. The key idea underlying our approach is an explicitly constructed Lyapunov function that leads to a sufficient structural condition for stabilizing policies, i.e., monotonically decreasing policies guarantee stability. We incorporate this structural constraint with RL, by parameterizing each local voltage controller using a monotone neural network, thus ensuring the stability constraint is satisfied by design. We demonstrate the effectiveness of our approach in both single-phase and three-phase IEEE test feeders, where the proposed method can reduce the transient control cost by more than 25% and shorten the voltage recovery time by 21.5% on average compared to the widely used linear policy, while always achieving voltage stability. In contrast, standard RL methods often fail to achieve voltage stability.


title: Reducing Variance in Temporal-Difference Value Estimation via Ensemble of Deep Networks

abstract: In temporal-difference reinforcement learning algorithms, variance in value estimation can cause instability and overestimation of the maximal target value. Many algorithms have been proposed to reduce overestimation, including several recent ensemble methods, however none have shown success in sample-efficient learning through addressing estimation variance as the root cause of overestimation. In this paper, we propose MeanQ, a simple ensemble method that estimates target values as ensemble means. Despite its simplicity, MeanQ shows remarkable sample efficiency in experiments on the Atari Learning Environment benchmark. Importantly, we find that an ensemble of size 5 sufficiently reduces estimation variance to obviate the lagging target network, eliminating it as a source of bias and further gaining sample efficiency. We justify intuitively and empirically the design choices in MeanQ, including the necessity of independent experience sampling. On a set of 26 benchmark Atari environments, MeanQ outperforms all tested baselines, including the best available baseline, SUNRISE, at 100K interaction steps in 16/26 environments, and by 68% on average. MeanQ also outperforms Rainbow DQN at 500K steps in 21/26 environments, and by 49% on average, and achieves average human-level performance using 200K ($\pm$100K) interaction steps. Our implementation is available at https://github.com/indylab/MeanQ.


title: Observation of anisotropic Dirac cones in the topological material Ti2Te2P

abstract: Anisotropic bulk Dirac (or Weyl) cones in three dimensional systems have recently gained intense research interest as they are examples of materials with tilted Dirac (or Weyl) cones indicatig the violation of Lorentz invariance. In contrast, the studies on anisotropic surface Dirac cones in topological materials which contribute to anisotropic carrier mobility have been limited. By employing angle-resolved photoemission spectroscopy and first-principles calculations, we reveal the anisotropic surface Dirac dispersion in a tetradymite material Ti2Te2P on the (001) plane of the Brillioun zone. We observe the quasi-elliptical Fermi pockets at the M -point of the Brillouin zone forming the anisotropic surface Dirac cones. Our calculations of the Z2 indices confirm that the system is topologically non-trivial with multiple topological phases in the same material. In addition, the observed nodal-line like feature formed by bulk bands makes this system topologically rich.


title: Nonparametric Estimation via Mixed Gradients

abstract: Traditional nonparametric estimation methods often lead to a slow convergence rate in large dimensions and require unrealistically enormous sizes of datasets for reliable conclusions. We develop an approach based on mixed gradients, either observed or estimated, to effectively estimate the function at near-parametric convergence rates. The novel approach and computational algorithm could lead to methods useful to practitioners in many areas of science and engineering. Our theoretical results reveal a behavior universal to this class of nonparametric estimation problems. We explore a general setting involving tensor product spaces and build upon the smoothing spline analysis of variance (SS-ANOVA) framework. For $d$-dimensional models under full interaction, the optimal rates with gradient information on $p$ covariates are identical to those for the $(d-p)$-interaction models without gradients and, therefore, the models are immune to the "curse of interaction". For additive models, the optimal rates using gradient information are root-$n$, thus achieving the "parametric rate". We demonstrate aspects of the theoretical results through synthetic and real data applications.


title: Towards Super-resolution via Iterative multi-exposure Coaddition

abstract: In this article, we provide an alternative up-sampling and PSF deconvolution method for the iterative multi-exposure coaddition. Different from the previous works, the new method has a ratio-correction term, which allows the iterations to converge more rapidly to an accurate representation of the underlying image than those with difference-correction terms. By employing this method, one can coadd the under-sampled multi-exposures to a super-resolution and obtain a higher peak signal-to-noise ratio. A set of simulations show that we can take many advantages of the new method, e.g. in the signal-to-noise ratio, the average deviation of all source fluxes, super-resolution, and source distortion ratio, etc., which are friendly to astronomical photometry and morphology, and benefits faint source detection and shear measurement of weak gravitational lensing. It provides an improvement in fidelity over the previous works tested in this paper.


title: Free-Space Optical Communications for 6G Wireless Networks: Challenges, Opportunities, and Prototype Validation

abstract: Numerous researchers have studied innovations in future sixth-generation (6G) wireless communications. Indeed, a critical issue that has emerged is to contend with society's insatiable demand for high data rates and massive 6G connectivity. Some scholars consider one innovation to be a breakthrough--the application of free-space optical (FSO) communication. Owing to its exceedingly high carrier frequency/bandwidth and the potential of the unlicensed spectrum domain, FSO communication provides an excellent opportunity to develop ultrafast data links that can be applied in a variety of 6G applications, including heterogeneous networks with enormous connectivity and wireless backhauls for cellular systems. In this study, we perform video signal transmissions via an FPGA-based FSO communication prototype to investigate the feasibility of an FSO link with a distance of up to 20~km. We use a channel emulator to reliably model turbulence, scintillation, and power attenuation of the long-range FSO channel. We use the FPGA-based real-time SDR prototype to process the transmitted and received video signals. Our study also presents the channel-generation process of a given long-distance FSO link. To enhance the link quality, we apply spatial selective filtering to suppress the background noise generated by sunlight. To measure the misalignment of the transceiver, we use sampling-based pointing, acquisition, and tracking to compensate for it by improving the signal-to-noise ratio. For the main video signal transmission testbed, we consider various environments by changing the amount of turbulence and wind speed. We demonstrate that the testbed even permits the successful transmission of ultra-high-definition (UHD: 3840 x 2160 resolution) 60 fps videos under severe turbulence and high wind speeds.


title: An exact category approach to Hecke endomorphism algebras

abstract: Let $G$ be a finite group of Lie type. In studying the cross-characteristic representation theory of $G$, the (specialized) Hecke algebra $H=\End_G(\ind_B^G1_B)$ has played a important role. In particular, when $G=GL_n(\mathbb F_q)$ is a finite general linear group, this approach led to the Dipper-James theory of $q$-Schur algebras $A$. These algebras can be constructed over $\sZ:=\mathbb Z[t,t^{-1}]$ as the $q$-analog (with $q=t^2$) of an endomorphism algebra larger than $H$, involving parabolic subgroups. The algebra $A$ is quasi-hereditary over $\sZ$. An analogous algebra, still denoted $A$, can always be constructed in other types. However, these algebras have so far been less useful than in the $GL_n$ case, in part because they are not generally quasi-hereditary. Several years ago, reformulating a 1998 conjecture, the authors proposed (for all types) the existence of a $\sZ$-algebra $A^+$ having a stratified derived module category, with strata constructed via Kazhdan-Lusztig cell theory. The algebra $A$ is recovered as $A=eA^+e$ for an idempotent $e\in A^+$. A main goal of this monograph is to prove this conjecture completely. The proof involves several new homological techniques using exact categories. Following the proof, we show that $A^+$ does become quasi-hereditary after the inversion of the bad primes. Some first applications of the result -- e.g., to decomposition matrices -- are presented, together with several open problems.


title: Conservative Dual Policy Optimization for Efficient Model-Based Reinforcement Learning

abstract: Provably efficient Model-Based Reinforcement Learning (MBRL) based on optimism or posterior sampling (PSRL) is ensured to attain the global optimality asymptotically by introducing the complexity measure of the model. However, the complexity might grow exponentially for the simplest nonlinear models, where global convergence is impossible within finite iterations. When the model suffers a large generalization error, which is quantitatively measured by the model complexity, the uncertainty can be large. The sampled model that current policy is greedily optimized upon will thus be unsettled, resulting in aggressive policy updates and over-exploration. In this work, we propose Conservative Dual Policy Optimization (CDPO) that involves a Referential Update and a Conservative Update. The policy is first optimized under a reference model, which imitates the mechanism of PSRL while offering more stability. A conservative range of randomness is guaranteed by maximizing the expectation of model value. Without harmful sampling procedures, CDPO can still achieve the same regret as PSRL. More importantly, CDPO enjoys monotonic policy improvement and global optimality simultaneously. Empirical results also validate the exploration efficiency of CDPO.


title: Decoherence dynamics induced by two-level system defects on driven qubits

abstract: Recent experimental evidences point to two-level defects, located in the oxides and on the interfaces of the Josephson junctions, as the major constituents of decoherence in superconducting qubits. How these defects affect the qubit evolution with the presence of external driving is less well understood since the semiclassical qubit-field coupling renders the Jaynes-Cummings model for qubit-defect coupling undiagonalizable. We analyze the decoherence dynamics in the continuous coherent state space induced by the driving and solve the master equation with an extra decay-cladded driving term as a Fokker-Planck equation. The solution as a distribution in the quadrature plane is Gaussian with a moving mean and expanding variance. Its steady-state reveals as a super-Poissonian over displaced Fock states, which reduces to a Gibbs state of effective temperature decided by the defect at zero driving limit. The mean follows one out of four distinct dynamic phases during its convergence to a limit cycle determined by the competing driving strength and defect decays. The rate of convergence differs according to the initial state, illustrated by a Poincare map.


title: ConFiguRe: Exploring Discourse-level Chinese Figures of Speech

abstract: Figures of speech, such as metaphor and irony, are ubiquitous in literature works and colloquial conversations. This poses great challenge for natural language understanding since figures of speech usually deviate from their ostensible meanings to express deeper semantic implications. Previous research lays emphasis on the literary aspect of figures and seldom provide a comprehensive exploration from a view of computational linguistics. In this paper, we first propose the concept of figurative unit, which is the carrier of a figure. Then we select 12 types of figures commonly used in Chinese, and build a Chinese corpus for Contextualized Figure Recognition (ConFiguRe). Different from previous token-level or sentence-level counterparts, ConFiguRe aims at extracting a figurative unit from discourse-level context, and classifying the figurative unit into the right figure type. On ConFiguRe, three tasks, i.e., figure extraction, figure type classification and figure recognition, are designed and the state-of-the-art techniques are utilized to implement the benchmarks. We conduct thorough experiments and show that all three tasks are challenging for existing models, thus requiring further research. Our dataset and code are publicly available at https://github.com/pku-tangent/ConFiguRe.


title: Learning Pair Potentials using Differentiable Simulations

abstract: Learning pair interactions from experimental or simulation data is of great interest for molecular simulations. We propose a general stochastic method for learning pair interactions from data using differentiable simulations (DiffSim). DiffSim defines a loss function based on structural observables, such as the radial distribution function, through molecular dynamics (MD) simulations. The interaction potentials are then learned directly by stochastic gradient descent, using backpropagation to calculate the gradient of the structural loss metric with respect to the interaction potential through the MD simulation. This gradient-based method is flexible and can be configured to simulate and optimize multiple systems simultaneously. For example, it is possible to simultaneously learn potentials for different temperatures or for different compositions. We demonstrate the approach by recovering simple pair potentials, such as Lennard-Jones systems, from radial distribution functions. We find that DiffSim can be used to probe a wider functional space of pair potentials compared to traditional methods like Iterative Boltzmann Inversion. We show that our methods can be used to simultaneously fit potentials for simulations at different compositions and temperatures to improve the transferability of the learned potentials.


title: Recovery of a spatially-dependent coefficient from the NLS scattering map

abstract: We follow up on work of Strauss, Weder, and Watanabe concerning scattering and inverse scattering for nonlinear Schr\"odinger equations with nonlinearities of the form $\alpha(x)|u|^p u$.


title: Observation of thermodynamics originating from a mixed-spin ferromagnetic chain

abstract: We present a model compound that forms a mixed-spin ferromagnetic chain. Our material design, based on the organic radicals, affords a verdazyl-based complex (p-Py-V)2[Mn(hfac)2]. The molecular orbital calculations of the compound indicate the formation of a mixed spin-(1/2, 1/2, 5/2) ferromagnetic chain. The temperature dependence of magnetic susceptibility reveals its ferromagnetic behavior. The magnetic specific heat exhibits a double-peak structure and indicates a phase transition at the low-temperature peak. The observed characteristics are explained using the quantum Monte Carlo calculations. Furthermore, the modified spin-wave theory verifies that the double-peak structure of the specific heat significantly reflects the relative ration of the acoustic excitation band and the optical excitation gap.


title: Masked Imitation Learning: Discovering Environment-Invariant Modalities in Multimodal Demonstrations

abstract: Multimodal demonstrations provide robots with an abundance of information to make sense of the world. However, such abundance may not always lead to good performance when it comes to learning sensorimotor control policies from human demonstrations. Extraneous data modalities can lead to state over-specification, where the state contains modalities that are not only useless for decision-making but also can change data distribution across environments. State over-specification leads to issues such as the learned policy not generalizing outside of the training data distribution. In this work, we propose Masked Imitation Learning (MIL) to address state over-specification by selectively using informative modalities. Specifically, we design a masked policy network with a binary mask to block certain modalities. We develop a bi-level optimization algorithm that learns this mask to accurately filter over-specified modalities. We demonstrate empirically that MIL outperforms baseline algorithms in simulated domains including MuJoCo and a robot arm environment using the Robomimic dataset, and effectively recovers the environment-invariant modalities on a multimodal dataset collected on a real robot. Our project website presents supplemental details and videos of our results at: https://tinyurl.com/masked-il


title: SQ-Swin: a Pretrained Siamese Quadratic Swin Transformer for Lettuce Browning Prediction

abstract: Packaged fresh-cut lettuce is widely consumed as a major component of vegetable salad owing to its high nutrition, freshness, and convenience. However, enzymatic browning discoloration on lettuce cut edges significantly reduces product quality and shelf life. While there are many research and breeding efforts underway to minimize browning, the progress is hindered by the lack of a rapid and reliable methodology to evaluate browning. Current methods to identify and quantify browning are either too subjective, labor intensive, or inaccurate. In this paper, we report a deep learning model for lettuce browning prediction. To the best of our knowledge, it is the first-of-its-kind on deep learning for lettuce browning prediction using a pretrained Siamese Quadratic Swin (SQ-Swin) transformer with several highlights. First, our model includes quadratic features in the transformer model which is more powerful to incorporate real-world representations than the linear transformer. Second, a multi-scale training strategy is proposed to augment the data and explore more of the inherent self-similarity of the lettuce images. Third, the proposed model uses a siamese architecture which learns the inter-relations among the limited training samples. Fourth, the model is pretrained on the ImageNet and then trained with the reptile meta-learning algorithm to learn higher-order gradients than a regular one. Experiment results on the fresh-cut lettuce datasets show that the proposed SQ-Swin outperforms the traditional methods and other deep learning-based backbones.


title: Report of the Topical Group on Environmental and Societal Impacts of Particle Physics for Snowmass 2021

abstract: We report on the work of the Topical Group on Environmental and Societal Impacts of Particle Physics for the Snowmass 2021 Community Summer Study. Topics include impacts on climate, impacts on local communities, and impacts on non-proliferation.


title: Neural Koopman Control Barrier Functions for Safety-Critical Control of Unknown Nonlinear Systems

abstract: We consider the problem of synthesis of safe controllers for nonlinear systems with unknown dynamics using Control Barrier Functions (CBF). We utilize Koopman operator theory (KOT) to associate the (unknown) nonlinear system with a higher dimensional bilinear system and propose a data-driven learning framework that uses a learner and a falsifier to simultaneously learn the Koopman operator based bilinear system and a corresponding CBF. We prove that the learned CBF for the latter bilinear system is also a valid CBF for the unknown nonlinear system by characterizing the $\ell^2$-norm error bound between these two systems. We show that this error can be partially tuned by using the Lipschitz constant of the Koopman based observables. The CBF is then used to formulate a quadratic program to compute inputs that guarantee safety of the unknown nonlinear system. Numerical simulations are presented to validate our approach.


title: Text and Patterns: For Effective Chain of Thought, It Takes Two to Tango

abstract: The past decade has witnessed dramatic gains in natural language processing and an unprecedented scaling of large language models. These developments have been accelerated by the advent of few-shot techniques such as chain of thought (CoT) prompting. Specifically, CoT pushes the performance of large language models in a few-shot setup by augmenting the prompts with intermediate steps. Despite impressive results across various tasks, the reasons behind their success have not been explored. This work uses counterfactual prompting to develop a deeper understanding of CoT-based few-shot prompting mechanisms in large language models. We first systematically identify and define the key components of a prompt: symbols, patterns, and text. Then, we devise and conduct an exhaustive set of experiments across four different tasks, by querying the model with counterfactual prompts where only one of these components is altered. Our experiments across three models (PaLM, GPT-3, and CODEX) reveal several surprising findings and brings into question the conventional wisdom around few-shot prompting. First, the presence of factual patterns in a prompt is practically immaterial to the success of CoT. Second, our results conclude that the primary role of intermediate steps may not be to facilitate learning how to solve a task. The intermediate steps are rather a beacon for the model to realize what symbols to replicate in the output to form a factual answer. Further, text imbues patterns with commonsense knowledge and meaning. Our empirical and qualitative analysis reveals that a symbiotic relationship between text and patterns explains the success of few-shot prompting: text helps extract commonsense from the question to help patterns, and patterns enforce task understanding and direct text generation.


title: Comprehensive Evaluation of Emergency Shelters in Wuhan City Based on GIS

abstract: Emergency shelters, which reflect the city's ability to respond to and deal with major public emergencies to a certain extent, are essential to a modern urban emergency management system. This paper is based on spatial analysis methods, using Analytic Hierarchy Process to analyze the suitability of the 28 emergency shelters in Wuhan City. The Technique for Order Preference by Similarity to an Ideal Solution is further used to evaluate the accommodation capacity of emergency shelters in central urban areas, which provides a reference for the optimization of existing shelters and the site selection of new shelters, and provides a basis for improving the service capacity of shelters. The results show that the overall situation of emergency shelters in Wuhan is good, with 96\% of the places reaching the medium level or above, but the suitability level needs to be further improved, especially the effectiveness and accessibility. Among the seven central urban areas in Wuhan, Hongshan District has the strongest accommodation capacity while Jianghan District has the weakest, with noticeable differences.


title: Perfect state transfer, Equitable partition and Continuous-time quantum walk based search

abstract: In this paper, we consider a continuous-time quantum walk based search algorithm. We introduce equitable partition of the graph and perfect state transfer on it. By these two methods, we can calculate the success probability and the finding time of the search algorithm. In addition, we gave some examples of graphs that we can calculate the success probability and the finding time.


title: A Unified Multi-Task Semantic Communication System for Multimodal Data

abstract: Task-oriented semantic communications have achieved significant performance gains. However, the employed deep neural networks in semantic communications have to be updated when the task is changed or multiple models need to be stored for performing different tasks. To address this issue, we develop a unified deep learning-enabled semantic communication system (U-DeepSC), where a unified end-to-end framework can serve many different tasks with multiple modalities of data. As the number of required features varies from task to task, we propose a vector-wise dynamic scheme that can adjust the number of transmitted symbols for different tasks. Moreover, our dynamic scheme can also adaptively adjust the number of transmitted features under different channel conditions to optimize the transmission efficiency. Particularly, we devise a lightweight feature selection module (FSM) to evaluate the importance of feature vectors, which can hierarchically drop redundant feature vectors and significantly accelerate the inference. To reduce the transmission overhead, we then design a unified codebook for feature representation to serve multiple tasks, where only the indices of these task-specific features in the codebook are transmitted. According to the simulation results, the proposed U-DeepSC achieves comparable performance to the task-oriented semantic communication system designed for a specific task but with significant reduction in both transmission overhead and model size.


title: New Constraints on Macroscopic Dark Matter Using Radar Meteor Detectors

abstract: We show that dark-matter candidates with large masses and large nuclear interaction cross sections are detectable with terrestrial radar systems. We develop our results in close comparison to successful radar searches for tiny meteoroids, aggregates of ordinary matter. The path of a meteoroid (or suitable dark-matter particle) through the atmosphere produces ionization deposits that reflect incident radio waves. We calculate the equivalent radar echoing area or `radar cross section' for dark matter. By comparing the expected number of dark-matter-induced echoes with observations, we set new limits in the plane of dark-matter mass and cross section, complementary to pre-existing cosmological limits. Our results are valuable because (A) they open a new detection technique for which the reach can be greatly improved and (B) in case of a detection, the radar technique provides differential sensitivity to the mass and cross section, unlike cosmological probes.


title: Conditional HI mass functions and the HI-to-halo mass relation in the local Universe

abstract: We present a new HI mass estimator which relates the HI-to-stellar mass ratio to four galaxy properties: stellar surface mass density, color index $u-r$, stellar mass and concentration index, with the scatter of individual galaxies around the mean HI mass modeled with a Gaussian distribution. We calibrate the estimator using the xGASS sample, including both HI detection and non-detection, and constrain the model parameters through Bayesian inferences. Tests with mock catalogs demonstrate that our estimator provides unbiased HI masses for optical samples like the SDSS, thus suitable for statistical studies of HI gas contents in galaxies and dark matter halos. We apply our estimator to the SDSS spectroscopic sample to estimate the local HI mass function (HIMF), the conditional HI mass function (CHIMF) in galaxy groups and the HI-halo mass (HIHM) relation. Our HIMF agrees with the ALFALFA measurements at $M_{HI}\gtrsim 5\times 10^9M_{\odot}$, but with higher amplitude and a steeper slope at lower masses. We show that this discrepancy is caused primarily by the cosmic variance which is corrected for the SDSS sample but not for the ALFALFA. The CHIMFs for all halo masses can be described by a single Schechter function, and this is true for red, blue and satellite galaxies. For central galaxies the CHIMFs show a double-Gaussian profile, with the two components contributed by the red and blue galaxies, respectively. The total HI mass in a group increases monotonically with halo mass. The HI mass of central galaxies in galaxy groups increases rapidly with halo mass only at $M_h\lesssim10^{12}M_{\odot}$, while the mass dependence becomes much weaker at higher halo masses. The observed HI-halo mass relation is not reproduced by current hydrodynamic simulations and semi-analytic models of galaxy formation.


title: Answering Numerical Reasoning Questions in Table-Text Hybrid Contents with Graph-based Encoder and Tree-based Decoder

abstract: In the real-world question answering scenarios, hybrid form combining both tabular and textual contents has attracted more and more attention, among which numerical reasoning problem is one of the most typical and challenging problems. Existing methods usually adopt encoder-decoder framework to represent hybrid contents and generate answers. However, it can not capture the rich relationship among numerical value, table schema, and text information on the encoder side. The decoder uses a simple predefined operator classifier which is not flexible enough to handle numerical reasoning processes with diverse expressions. To address these problems, this paper proposes a \textbf{Re}lational \textbf{G}raph enhanced \textbf{H}ybrid table-text \textbf{N}umerical reasoning model with \textbf{T}ree decoder (\textbf{RegHNT}). It models the numerical question answering over table-text hybrid contents as an expression tree generation task. Moreover, we propose a novel relational graph modeling method, which models alignment between questions, tables, and paragraphs. We validated our model on the publicly available table-text hybrid QA benchmark (TAT-QA). The proposed RegHNT significantly outperform the baseline model and achieve state-of-the-art results. We openly released the source code and data at https://github.com/lfy79001/RegHNT (2022-05-05).


title: Gravitational waves from primordial scalar and tensor perturbations

abstract: We investigate the second order gravitational waves induced by the primordial scalar and tensor perturbations during radiation-dominated era. The explicit expressions of the power spectra of the second order GWs are presented. We calculate the energy density spectra of the second order GWs for a monochromatic primordial power spectra. For large $k$ $\left( k>k_* \right)$, the effects of the primordial tensor perturbation with tensor-to-scalar ratio $r=A_{h}/A_{\zeta}=0.2$ lead to an around $50\% $ increase of the signal-to-noise ratio (SNR) for LISA observations.


title: An Extrinsic Calibration Method between LiDAR and GNSS/INS for Autonomous Driving

abstract: Accurate and reliable sensor calibration is critical for fusing LiDAR and inertial measurements in autonomous driving. This paper proposes a novel three-stage extrinsic calibration method between LiDAR and GNSS/INS for autonomous driving. The first stage can quickly calibrate the extrinsic parameters between the sensors through point cloud surface features so that the extrinsic can be narrowed from a large initial error to a small error range in little time. The second stage can further calibrate the extrinsic parameters based on LiDAR-mapping space occupancy while removing motion distortion. In the final stage, the z-axis errors caused by the plane motion of the autonomous vehicle are corrected, and an accurate extrinsic parameter is finally obtained. Specifically, This method utilizes the planar features in the environment, making it possible to quickly carry out calibration. Experimental results on real-world data sets demonstrate the reliability and accuracy of our method. The codes are open-sourced on the Github website. The code link is https://github.com/OpenCalib/LiDAR2INS.


title: Deliberated Domain Bridging for Domain Adaptive Semantic Segmentation

abstract: In unsupervised domain adaptation (UDA), directly adapting from the source to the target domain usually suffers significant discrepancies and leads to insufficient alignment. Thus, many UDA works attempt to vanish the domain gap gradually and softly via various intermediate spaces, dubbed domain bridging (DB). However, for dense prediction tasks such as domain adaptive semantic segmentation (DASS), existing solutions have mostly relied on rough style transfer and how to elegantly bridge domains is still under-explored. In this work, we resort to data mixing to establish a deliberated domain bridging (DDB) for DASS, through which the joint distributions of source and target domains are aligned and interacted with each in the intermediate space. At the heart of DDB lies a dual-path domain bridging step for generating two intermediate domains using the coarse-wise and the fine-wise data mixing techniques, alongside a cross-path knowledge distillation step for taking two complementary models trained on generated intermediate samples as 'teachers' to develop a superior 'student' in a multi-teacher distillation manner. These two optimization steps work in an alternating way and reinforce each other to give rise to DDB with strong adaptation power. Extensive experiments on adaptive segmentation tasks with different settings demonstrate that our DDB significantly outperforms state-of-the-art methods. Code is available at https://github.com/xiaoachen98/DDB.git.


title: Towards A Unified Policy Abstraction Theory and Representation Learning Approach in Markov Decision Processes

abstract: Lying on the heart of intelligent decision-making systems, how policy is represented and optimized is a fundamental problem. The root challenge in this problem is the large scale and the high complexity of policy space, which exacerbates the difficulty of policy learning especially in real-world scenarios. Towards a desirable surrogate policy space, recently policy representation in a low-dimensional latent space has shown its potential in improving both the evaluation and optimization of policy. The key question involved in these studies is by what criterion we should abstract the policy space for desired compression and generalization. However, both the theory on policy abstraction and the methodology on policy representation learning are less studied in the literature. In this work, we make very first efforts to fill up the vacancy. First, we propose a unified policy abstraction theory, containing three types of policy abstraction associated to policy features at different levels. Then, we generalize them to three policy metrics that quantify the distance (i.e., similarity) of policies, for more convenient use in learning policy representation. Further, we propose a policy representation learning approach based on deep metric learning. For the empirical study, we investigate the efficacy of the proposed policy metrics and representations, in characterizing policy difference and conveying policy generalization respectively. Our experiments are conducted in both policy optimization and evaluation problems, containing trust-region policy optimization (TRPO), diversity-guided evolution strategy (DGES) and off-policy evaluation (OPE). Somewhat naturally, the experimental results indicate that there is no a universally optimal abstraction for all downstream learning problems; while the influence-irrelevance policy abstraction can be a generally preferred choice.


title: Selecting Stickers in Open-Domain Dialogue through Multitask Learning

abstract: With the increasing popularity of online chatting, stickers are becoming important in our online communication. Selecting appropriate stickers in open-domain dialogue requires a comprehensive understanding of both dialogues and stickers, as well as the relationship between the two types of modalities. To tackle these challenges, we propose a multitask learning method comprised of three auxiliary tasks to enhance the understanding of dialogue history, emotion and semantic meaning of stickers. Extensive experiments conducted on a recent challenging dataset show that our model can better combine the multimodal information and achieve significantly higher accuracy over strong baselines. Ablation study further verifies the effectiveness of each auxiliary task. Our code is available at \url{https://github.com/nonstopfor/Sticker-Selection}


title: Hitting a prime in 2.43 dice rolls (on average)

abstract: What is the number of rolls of fair 6-sided dice until the first time the total sum of all rolls is a prime? We compute the expectation and the variance of this random variable up to an additive error of less than 10^{-4}. This is a solution to a puzzle suggested by DasGupta (2017) in the Bulletin of the Institute of Mathematical Statistics, where the published solution is incomplete. The proof is simple, combining a basic dynamic programming algorithm with a quick Matlab computation and basic facts about the distribution of primes.


title: Graph Contrastive Learning with Cross-view Reconstruction

abstract: Among different existing graph self-supervised learning strategies, graph contrastive learning (GCL) has been one of the most prevalent approaches to this problem. Despite the remarkable performance those GCL methods have achieved, existing GCL methods that heavily depend on various manually designed augmentation techniques still struggle to alleviate the feature suppression issue without risking losing task-relevant information. Consequently, the learned representation is either brittle or unilluminating. In light of this, we introduce the Graph Contrastive Learning with Cross-View Reconstruction (GraphCV), which follows the information bottleneck principle to learn minimal yet sufficient representation from graph data. Specifically, GraphCV aims to elicit the predictive (useful for downstream instance discrimination) and other non-predictive features separately. Except for the conventional contrastive loss which guarantees the consistency and sufficiency of the representation across different augmentation views, we introduce a cross-view reconstruction mechanism to pursue the disentanglement of the two learned representations. Besides, an adversarial view perturbed from the original view is added as the third view for the contrastive loss to guarantee the intactness of the global semantics and improve the representation robustness. We empirically demonstrate that our proposed model outperforms the state-of-the-art on graph classification task over multiple benchmark datasets.


title: The Effects of Space Weather on Flight Delays

abstract: Although the sun is really far away from us, some solar activities could still influence the performance and reliability of space-borne and ground-based technological systems on Earth. Those time-varying conditions in space caused by the sun are also called space weather, as the atmospheric conditions that can affect weather on the ground. It is known that aviation activities can be affected during space weather events, but the exact effects of space weather on aviation are still unclear. Especially how the flight delays, the top topic concerned by most people, will be affected by space weather has never been thoroughly researched. By analyzing huge amount of flight data (~5X106 records), for the first time, we demonstrate that space weather events could have systematically modulating effects on flight delays. The average arrival delay time and 30-minute delay rate during space weather events are significantly increased by 81.34% and 21.45% respectively compared to those during quiet periods. The evident negative correlation between the yearly flight regularity rate and the yearly mean total sunspot number during 22 years also confirms such delay effects. Further studies indicate that the interference in communication and navigation caused by geomagnetic field fluctuations and ionospheric disturbances associated with the space weather events will increase the flight delay time and delay rate. These results expand the traditional field of space weather research and could also provide us with brand new views for improving the flight delay predications.


title: Characteristics of Flight Delays during Solar Flares

abstract: Solar flare is one of the severest solar activities on the sun, and it has many important impacts on the near-earth space. It has been found that flight arrival delays will increase during solar flare. However, the detailed intrinsic mechanism of how solar flares influence the delays is still unknown. Based on 5-years huge amount of flight data, here we comprehensively analyze the flight departure delays during 57 solar flares. It is found that the averaged flight departure delay time during solar flares increased by 20.68% (7.67 min) compared to those during quiet periods. It is also shown that solar flare related flight delays reveal apparent time and latitude dependencies. Flight delays during dayside solar flares are more serious than those during nightside flares, and the longer (shorter) delays tend to occur in the lower (higher) latitude airport. Further analyses suggest that flight delay time and delay rate would be directly modulated by the solar intensity (soft X-ray flux) and the Solar Zenith Angle. For the first time, these results indicate that the communication interferences caused by solar flares will directly affect flight departure delay time and delay rate. This work also expands our conventional understandings to the impacts of solar flares on human society, and it could also provide us with brand new views to help prevent or cope with flight delays.


title: Federated Coordinate Descent for Privacy-Preserving Multiparty Linear Regression

abstract: Distributed privacy-preserving regression schemes have been developed and extended in various fields, where multiparty collaboratively and privately run optimization algorithms, e.g., Gradient Descent, to learn a set of optimal parameters. However, traditional Gradient-Descent based methods fail to solve problems which contains objective functions with L1 regularization, such as Lasso regression. In this paper, we present Federated Coordinate Descent, a new distributed scheme called FCD, to address this issue securely under multiparty scenarios. Specifically, through secure aggregation and added perturbations, our scheme guarantees that: (1) no local information is leaked to other parties, and (2) global model parameters are not exposed to cloud servers. The added perturbations can eventually be eliminated by each party to derive a global model with high performance. We show that the FCD scheme fills the gap of multiparty secure Coordinate Descent methods and is applicable for general linear regressions, including linear, ridge and lasso regressions. Theoretical security analysis and experimental results demonstrate that FCD can be performed effectively and efficiently, and provide as low MAE measure as centralized methods under tasks of three types of linear regressions on real-world UCI datasets.


title: Analyses of Flight Time During Solar Proton Events and Solar Flares

abstract: Analyzing the effects of space weather on aviation is a new and developing topic. It has been commonly accepted that the flight time of the polar flights may increase during solar proton events because the flights have to change their route to avoid the high-energy particles. However, apart from such phenomenon, researches related to the flight time during space weather events is very rare. Based on the analyses of 39 representative international air routes around westerlies, it is found that 97.44% (94.87%) of the commercial airplanes on the westbound (eastbound) air routes reveal shorter (longer) flight time during solar proton events compared to those during quiet periods, and the averaged magnitude of change in flight time is ~10 min or 0.21%-4.17% of the total flight durations. Comparative investigations reassure the certainty of such phenomenon that the directional differences in flight time are still incontrovertible regardless of over-land routes (China-Europe) or over-sea routes (China-Western America). Further analyses suggest that the solar proton events associated atmospheric heating will change the flight durations by weakening certain atmospheric circulations, such as the polar jet stream. While the polar jet stream will not be obviously altered during solar flares so that the directional differences in flight time are not found. Besides the conventional space weather effects already known, this paper is the first report that indicates a distinct new scenario of how the solar proton events affect flight time. These analyses are also important for aviation since our discoveries could help the airways optimize the air routes to save passenger time costs, reduce fuel costs and even contribute to the global warming issues.


title: Hybrid Window Attention Based Transformer Architecture for Brain Tumor Segmentation

abstract: As intensities of MRI volumes are inconsistent across institutes, it is essential to extract universal features of multi-modal MRIs to precisely segment brain tumors. In this concept, we propose a volumetric vision transformer that follows two windowing strategies in attention for extracting fine features and local distributional smoothness (LDS) during model training inspired by virtual adversarial training (VAT) to make the model robust. We trained and evaluated network architecture on the FeTS Challenge 2022 dataset. Our performance on the online validation dataset is as follows: Dice Similarity Score of 81.71%, 91.38% and 85.40%; Hausdorff Distance (95%) of 14.81 mm, 3.93 mm, 11.18 mm for the enhancing tumor, whole tumor, and tumor core, respectively. Overall, the experimental results verify our method's effectiveness by yielding better performance in segmentation accuracy for each tumor sub-region. Our code implementation is publicly available : https://github.com/himashi92/vizviva_fets_2022


title: Automatic Tumor Segmentation via False Positive Reduction Network for Whole-Body Multi-Modal PET/CT Images

abstract: Multi-modality Fluorodeoxyglucose (FDG) positron emission tomography / computed tomography (PET/CT) has been routinely used in the assessment of common cancers, such as lung cancer, lymphoma, and melanoma. This is mainly attributed to the fact that PET/CT combines the high sensitivity for tumor detection of PET and anatomical information from CT. In PET/CT image assessment, automatic tumor segmentation is an important step, and in recent years, deep learning based methods have become the state-of-the-art. Unfortunately, existing methods tend to over-segment the tumor regions and include regions such as the normal high uptake organs, inflammation, and other infections. In this study, we introduce a false positive reduction network to overcome this limitation. We firstly introduced a self-supervised pre-trained global segmentation module to coarsely delineate the candidate tumor regions using a self-supervised pre-trained encoder. The candidate tumor regions were then refined by removing false positives via a local refinement module. Our experiments with the MICCAI 2022 Automated Lesion Segmentation in Whole-Body FDG-PET/CT (AutoPET) challenge dataset showed that our method achieved a dice score of 0.9324 with the preliminary testing data and was ranked 1st place in dice on the leaderboard. Our method was also ranked in the top 7 methods on the final testing data, the final ranking will be announced during the 2022 MICCAI AutoPET workshop. Our code is available at: https://github.com/YigePeng/AutoPET_False_Positive_Reduction.


title: Understanding NFT Price Moves through Tweets Keywords Analysis

abstract: Non-Fungible Token (NFT) is evolving with the rise of the cryptocurrency market and the development of blockchain techniques, which leads to an emerging NFT market that has become prosperous rapidly then followed by a cooldown. Nevertheless, the overall rise procedure of the NFT market has not been well understood. To this end, we consider that social media communities evolving alongside the market growth, are worth exploring and reasoning about, as the mineable information might unveil the market behaviors. We explore the procedure from the perspective of NFT Twitter communities and its impact on the NFT price moves with two experiments. We perform a Granger causality test on the number of tweets and the NFT price time series and find that the number of tweets has a positive impact on (Granger-causes) the price or reversely for larger part of the 19 top authentic projects but seldom copycat projects. Besides, to investigate the price moves predictability, we experiment on predicting Markov normalized NFT price (representing the direction and magnitude of price moves) given tweets-extracted word features and interpret the feature importance to find insights. Our results show that social media words as the predictors result in all 19 top projects having a testing accuracy evidently above the baseline. Based on the feature importance analysis, we find that both general market-related words and NFT event-related words have a markedly positive contribution in predicting price moves. We summarize the characteristics including categorization and sentiment for the words with the top and least feature importance.


title: Variations on theorems of Mertens

abstract: We present variations on theorems of Mertens as special cases of Density Hypothesis. Moreover, we study a Serre's estimate concerning Lang-Weil estimate.


title: Maximum Likelihood Estimation for Semiparametric Regression Models with Interval-Censored Multi-State Data

abstract: Interval-censored multi-state data arise in many studies of chronic diseases, where the health status of a subject can be characterized by a finite number of disease states and the transition between any two states is only known to occur over a broad time interval. We formulate the effects of potentially time-dependent covariates on multi-state processes through semiparametric proportional intensity models with random effects. We adopt nonparametric maximum likelihood estimation (NPMLE) under general interval censoring and develop a stable expectation-maximization (EM) algorithm. We show that the resulting parameter estimators are consistent and that the finite-dimensional components are asymptotically normal with a covariance matrix that attains the semiparametric efficiency bound and can be consistently estimated through profile likelihood. In addition, we demonstrate through extensive simulation studies that the proposed numerical and inferential procedures perform well in realistic settings. Finally, we provide an application to a major epidemiologic cohort study.


title: LO-Det: Lightweight Oriented Object Detection in Remote Sensing Images

abstract: A few lightweight convolutional neural network (CNN) models have been recently designed for remote sensing object detection (RSOD). However, most of them simply replace vanilla convolutions with stacked separable convolutions, which may not be efficient due to a lot of precision losses and may not be able to detect oriented bounding boxes (OBB). Also, the existing OBB detection methods are difficult to constrain the shape of objects predicted by CNNs accurately. In this paper, we propose an effective lightweight oriented object detector (LO-Det). Specifically, a channel separation-aggregation (CSA) structure is designed to simplify the complexity of stacked separable convolutions, and a dynamic receptive field (DRF) mechanism is developed to maintain high accuracy by customizing the convolution kernel and its perception range dynamically when reducing the network complexity. The CSA-DRF component optimizes efficiency while maintaining high accuracy. Then, a diagonal support constraint head (DSC-Head) component is designed to detect OBBs and constrain their shapes more accurately and stably. Extensive experiments on public datasets demonstrate that the proposed LO-Det can run very fast even on embedded devices with the competitive accuracy of detecting oriented objects.


title: Linearly implicit energy-preserving integrating factor methods for the 2D nonlinear Schr\"odinger equation with wave operator and convergence analysis

abstract: In this paper, we develop a novel class of linear energy-preserving integrating factor methods for the 2D nonlinear Schr\"odinger equation with wave operator (NLSW), combining the scalar auxiliary variable approach and the integrating factor methods. A second-order scheme is first proposed, which is rigorously proved to be energy-preserving. By using the energy methods, we analyze its optimal convergence in the $H^1$ norm without any restrictions on the grid ratio, where a novel technique and an improved induction argument are proposed to overcome the difficulty posed by the unavailability of a priori $L^\infty$ estimates of numerical solutions. Based on the integrating factor Runge-Kutta methods, we extend the proposed scheme to arbitrarily high order, which is also linear and conservative. Numerical experiments are presented to confirm the theoretical analysis and demonstrate the advantages of the proposed methods.


title: Shock-induced stripping of satellite ISM/CGM in IllustrisTNG clusters at $z\sim0$

abstract: Using the IllustrisTNG simulation, we study the interaction of large-scale shocks with the circumgalactic medium (CGM) and interstellar medium (ISM) of star-forming (SF) satellite galaxies in galaxy clusters. These shocks are usually produced by mergers and massive accretion. Our visual inspection shows that approximately half of SF satellites have encountered shocks in their host clusters at $z\leq0.11$. After a satellite crosses a shock front and enters the postshock region, the ram pressure on it is boosted significantly. Both the CGM and ISM can be severely impacted, either by striping or compression. The stripping of the ISM is particularly important for low-mass galaxies with $\log (M_{*}/M_{\odot})<10$ and can occur even in the outskirts of galaxy clusters. In comparison, satellites that do not interact with shocks lose their ISM only in the inner regions of clusters. About half of the ISM is stripped within about 0.6 Gyr after it crosses the shock front. Our results show that shock-induced stripping plays an important role in quenching satellite galaxies in clusters.


title: Continual Learning with Dependency Preserving Hypernetworks

abstract: Humans learn continually throughout their lifespan by accumulating diverse knowledge and fine-tuning it for future tasks. When presented with a similar goal, neural networks suffer from catastrophic forgetting if data distributions across sequential tasks are not stationary over the course of learning. An effective approach to address such continual learning (CL) problems is to use hypernetworks which generate task dependent weights for a target network. However, the continual learning performance of existing hypernetwork based approaches are affected by the assumption of independence of the weights across the layers in order to maintain parameter efficiency. To address this limitation, we propose a novel approach that uses a dependency preserving hypernetwork to generate weights for the target network while also maintaining the parameter efficiency. We propose to use recurrent neural network (RNN) based hypernetwork that can generate layer weights efficiently while allowing for dependencies across them. In addition, we propose novel regularisation and network growth techniques for the RNN based hypernetwork to further improve the continual learning performance. To demonstrate the effectiveness of the proposed methods, we conducted experiments on several image classification continual learning tasks and settings. We found that the proposed methods based on the RNN hypernetworks outperformed the baselines in all these CL settings and tasks.


title: The Ariki--Koike algebras and Rogers--Ramanujan type partitions

abstract: In 2000, Ariki and Mathas showed that the simple modules of the Ariki--Koike algebras $\mathcal{H}_{\mathbb{C},q;Q_1,\ldots, Q_m}\big(G(m, 1, n)\big)$ (when the parameters are roots of unity and $q\neq 1$) are labeled by the so-called Kleshchev multipartitions. This together with Ariki's categorification theorem enabled Ariki and Mathas to obtain the generating function for the number of Kleshchev multipartitions by making use of the Weyl--Kac character formula. In this paper, we revisit this generating function for the $q=-1$ case. This $q=-1$ case is particularly interesting, for the corresponding Kleshchev multipartitions have a very close connection to generalized Rogers--Ramanujan type partitions when $Q_1=\cdots=Q_a=-1$ and $Q_{a+1}=\cdots =Q_m =1$. Based on this connection, we provide an analytic proof of the result of Ariki and Mathas for $q=Q_1=\cdots Q_a=-1$ and $Q_{a+1}=\cdots =Q_m =1$. Our second objective is to investigate simple modules of the Ariki--Koike algebra in a fixed block. It is known that these simple modules in a fixed block are labeled by the Kleshchev multiparitions with a fixed partition residue statistic. This partition statistic is also studied in the works of Berkovich, Garvan, and Uncu. Employing their results, we provide two bivariate generating function identities when $m=2$.


title: Variational quantum algorithm for measurement extraction from the Navier-Stokes, Einstein, Maxwell, B-type, Lin-Tsien, Camassa-Holm, DSW, H-S, KdV-B, non-homogeneous KdV, generalized KdV, KdV, translational KdV, sKdV, B-L and Airy equations

abstract: Classical-quantum hybrid algorithms have recently garnered significant attention, which are characterized by combining quantum and classical computing protocols to obtain readout from quantum circuits of interest. Recent progress due to Lubasch et al in a 2019 paper provides readout for solutions to the Schrodinger and Inviscid Burgers equations, by making use of a new variational quantum algorithm (VQA) which determines the ground state of a cost function expressed with a superposition of expectation values and variational parameters. In the following, we analyze additional computational prospects in which the VQA can reliably produce solutions to other PDEs that are comparable to solutions that have been previously realized classically, which are characterized with noiseless quantum simulations. To determine the range of nonlinearities that the algorithm can process for other IVPs, we study several PDEs, first beginning with the Navier-Stokes equations and progressing to other equations underlying physical phenomena ranging from electromagnetism, gravitation, and wave propagation, from simulations of the Einstein, Boussniesq-type, Lin-Tsien, Camassa-Holm, Drinfeld-Sokolov-Wilson (DSW), and Hunter-Saxton equations. To formulate optimization routines that the VQA undergoes for numerical approximations of solutions that are obtained as readout from quantum circuits, cost functions corresponding to each PDE are provided in the supplementary section after which simulations results from hundreds of ZGR-QFT ansatzae are generated.

categories: quant-ph cs.IT cs.NA math.IT math.NA math.OC physics.comp-ph


title: Comments on "Iteratively Re-weighted Algorithm for Fuzzy c-Means"

abstract: In this comment, we present a simple alternate derivation to the IRW-FCM algorithm presented in "Iteratively Re-weighted Algorithm for Fuzzy c-Means" for Fuzzy c-Means problem. We show that the iterative steps derived for IRW-FCM algorithm are nothing but steps of the popular Majorization Minimization (MM) algorithm. The derivation presented in this note is much simpler and straightforward and, unlike the derivation of IRW-FCM, the derivation here does not involve introduction of any auxiliary variable. Moreover, by showing the steps of IRW-FCM as the MM algorithm, the inner loop of the IRW-FCM algorithm can be eliminated and the algorithm can be effectively run as a "single loop" algorithm. More precisely, the new MM-based derivation deduces that a single inner loop of IRW-FCM is sufficient to decrease the Fuzzy c-means objective function, which speeds up the IRW-FCM algorithm.


title: Renyi Differential Privacy of Propose-Test-Release and Applications to Private and Robust Machine Learning

abstract: Propose-Test-Release (PTR) is a differential privacy framework that works with local sensitivity of functions, instead of their global sensitivity. This framework is typically used for releasing robust statistics such as median or trimmed mean in a differentially private manner. While PTR is a common framework introduced over a decade ago, using it in applications such as robust SGD where we need many adaptive robust queries is challenging. This is mainly due to the lack of Renyi Differential Privacy (RDP) analysis, an essential ingredient underlying the moments accountant approach for differentially private deep learning. In this work, we generalize the standard PTR and derive the first RDP bound for it when the target function has bounded global sensitivity. We show that our RDP bound for PTR yields tighter DP guarantees than the directly analyzed $(\eps, \delta)$-DP. We also derive the algorithm-specific privacy amplification bound of PTR under subsampling. We show that our bound is much tighter than the general upper bound and close to the lower bound. Our RDP bounds enable tighter privacy loss calculation for the composition of many adaptive runs of PTR. As an application of our analysis, we show that PTR and our theoretical results can be used to design differentially private variants for byzantine robust training algorithms that use robust statistics for gradients aggregation. We conduct experiments on the settings of label, feature, and gradient corruption across different datasets and architectures. We show that PTR-based private and robust training algorithm significantly improves the utility compared with the baseline.


title: Field-direction Dependence of Majorana-mediated Spin Transport

abstract: We study the field-direction dependence of the Majorana-mediated spin transport in the Kitaev clusters with zigzag and armchair edges, applying a static magnetic field to one of the edges and a magnetic pulsed field to the other edges. By means of the exact diagonalization method, we calculate the time-evolution of the spin moments in both edge regions to clarify how the directions of two fields and shape of the edges affect the Majorana-mediated spin transport.


title: A Mosquito is Worth 16x16 Larvae: Evaluation of Deep Learning Architectures for Mosquito Larvae Classification

abstract: Mosquito-borne diseases (MBDs), such as dengue virus, chikungunya virus, and West Nile virus, cause over one million deaths globally every year. Because many such diseases are spread by the Aedes and Culex mosquitoes, tracking these larvae becomes critical in mitigating the spread of MBDs. Even as citizen science grows and obtains larger mosquito image datasets, the manual annotation of mosquito images becomes ever more time-consuming and inefficient. Previous research has used computer vision to identify mosquito species, and the Convolutional Neural Network (CNN) has become the de-facto for image classification. However, these models typically require substantial computational resources. This research introduces the application of the Vision Transformer (ViT) in a comparative study to improve image classification on Aedes and Culex larvae. Two ViT models, ViT-Base and CvT-13, and two CNN models, ResNet-18 and ConvNeXT, were trained on mosquito larvae image data and compared to determine the most effective model to distinguish mosquito larvae as Aedes or Culex. Testing revealed that ConvNeXT obtained the greatest values across all classification metrics, demonstrating its viability for mosquito larvae classification. Based on these results, future research includes creating a model specifically designed for mosquito larvae classification by combining elements of CNN and transformer architecture.


title: Equivalence classes of dessins d'enfants with two vertices

abstract: Let $N$ be a positive integer. For any positive integer $L\leq N$ and any positive divisor $r$ of $N$, we enumerate the equivalence classes of dessins d'enfants with $N$ edges, $L$ faces and two vertices whose automorphism groups are cyclic of order $r$. Further, for any non-negative integer $h$, we enumerate the equivalence classes of dessins with $N$ edges, $h$ faces of degree $2$ with $h\leq N$, and two vertices, whose automorphism groups are cyclic of order $r$. Our arguments are essentially based upon a natural one-to-one correspondence of the equivalence classes of all dessins with $N$ edges to the equivalence classes of all pairs of permutations with components generating transitive subgroups of the symmetric group of degree $N$.


title: $q$-birational morphisms and divisors

abstract: In this paper, we define the notions $q$-birational morphism and $q$-birational divisor and develop the theory about them. We state and prove versions of Kodaira-type vanishing theorem and Zariski decomposition theorem for $q$-birational divisors.


title: Holographic two-point functions in a disorder system

abstract: We study the holographic dual of two-point correlation functions for nonconformal field theories. We first take into account a Lifshitz geometry as the dual of a Lifshitz field theory which may appear at a critical or IR fixed point. We explicitly show the holographic relation between a Lifshitz geometry and a Lifshitz field theory by calculating two-point correlators and equation of state parameter on both sides. We also investigate a disorder deformation, which allows a UV conformal field theory to flow into a new IR Lifshitz field theory. In this deformed theory, we investigate an anomalous dimension representing the change of an operator's scaling dimension along the RG flow.


title: Decoration of graphene nanoribbons by $5d$ transition-metal elements

abstract: Graphene is a famous truly two-dimensional (2D) material, possessing a cone-like energy structure near the Fermi level and treated as a gapless semiconductor. Its unique properties trigger researchers to find applications of it. The gapless feature shrinks the development of graphene nanoelectronics. Making one-dimensional (1D) strips of graphene nanoribbons (GNRs) could be one of the promising routes to modulating the electronic and optical properties of graphene. The electronic and optical properties of GNRs are highly sensitive to the edge and width. The tunability in electronic and optical properties further implies the possibilities of GNR application. However, the dangling bonds at ribbon edges remain an open question in GNR systems. Various passivation at the ribbon edge might change the essential physical properties. In this work, $5d$ transition-metal elements are considered as the guest atoms at the edges. The geometric structure, energy bands, density of states, charge distribution, and optical transitions are discussed.


title: Rashba-like spin-orbit interaction and spin texture at the KTaO$_\text{3}$ (001) surface from DFT calculations

abstract: Rashba-like spin-orbit interaction at oxide heterostructures emerges as a much sought-after feature in the context of oxide spintronics and spin-orbitronics. KTaO$_3$ (KTO) is one of the best substrates available for the purpose, owing to its strong spin-orbit interaction and alternating $+1|-1$ charged layers along the (001) direction. Employing first-principles calculations within density functional theory (DFT) and proposing a possible electrostatic model for charge transfer to the surfaces of KTO slabs, we comprehensively analyze Rashba-like spin-orbit interaction with the help of three-dimensional band dispersion, isoenergetic contours, and projected spin textures $-$ all directly obtained from our DFT results $-$ in a thin insulating slab and a conducting thick slab of KTO. Our results reveal reasonably strong linear Rashba interaction with no signature of Dresselhaus or higher order Rashba interactions in the systems considered here. The rigorous analysis presented here may be crucial for future developments in oxide spintronics.


title: q-deformed integers derived from pairs of coprime integers and its applications

abstract: In connection with cluster algebras, snake graphs and q-integers, Kyungyong Lee and Ralf Schiffler recently found a formula for computing the (normalized) Jones polynomials of rational links in terms of continued fraction expansion of rational numbers. Sophie Morier-Genoud and Valentin Ovsienko introduced q-deformed continued fractions, and showed that by using them each coefficient of the normalized Jones polynomial counted quiver representations of type A_n. In this paper we introduce q-deformed integers defined by pairs of coprime integers, which are motivated by the denominators and the numerators of their q-deformed continued fractions, and give an efficient algorithm for computing the (normalized) Jones polynomials of rational links. Various properties of q-integers defined by pairs of coprime integers are investigated and shown its applications.


title: VINet: Visual and Inertial-based Terrain Classification and Adaptive Navigation over Unknown Terrain

abstract: We present a visual and inertial-based terrain classification network (VINet) for robotic navigation over different traversable surfaces. We use a novel navigation-based labeling scheme for terrain classification and generalization on unknown surfaces. Our proposed perception method and adaptive scheduling control framework can make predictions according to terrain navigation properties and lead to better performance on both terrain classification and navigation control on known and unknown surfaces. Our VINet can achieve 98.37% in terms of accuracy under supervised setting on known terrains and improve the accuracy by 8.51% on unknown terrains compared to previous methods. We deploy VINet on a mobile tracked robot for trajectory following and navigation on different terrains, and we demonstrate an improvement of 10.3% compared to a baseline controller in terms of RMSE.


title: Spin fluctuations in the 112-type iron-based superconductor Ca$_{0.82}$La$_{0.18}$Fe$_{0.96}$Ni$_{0.04}$As$_{2}$

abstract: We report time-of-flight inelastic neutron scattering (INS) investigations on the spin fluctuation spectrum in the 112-type iron-based superconductor (FeSC) Ca$_{0.82}$La$_{0.18}$Fe$_{0.96}$Ni$_{0.04}$As$_{2}$ (CaLa-112). In comparison to the 122-type FeSCs with a centrosymmetric tetragonal lattice structure (space group $I4/mmm$) at room temperature and an in-plane stripe-type antiferromagnetic (AF) order at low temperature, the 112 system has a noncentrosymmetric structure (space group $P2_{1}$) with additional zigzag arsenic chains between Ca/La layers and a magnetic ground state with similar wavevector $\mathbf{Q}_{\mathrm{AF}}$ but different orientations of ordered moments in the parent compounds. Our INS study clearly reveals that the in-plane dispersions and the bandwidth of spin excitations in the superconducting CaLa-112 closely resemble to those in 122 systems. While the total fluctuating moments $\langle m^2 \rangle\approx 4.6\pm0.2 \mu_B^2$/Fe are larger than 122 system, the dynamic correlation lengths are similar ($\xi\approx 10$ \AA). These results suggest that superconductivity in iron arsenides may have a common magnetic origin under similar magnetic exchange couplings with a dual nature from local moments and itinerant electrons, despite their different magnetic patterns and lattice symmetries.


title: Jet from the enigmatic high-latitude star BP Psc and evolutionary status of its driving source

abstract: BP Psc is an active late-type (sp:G9) star with unclear evolutionary status lying at high galactic latitude $b=-57^{\circ}$. It is also the source of the well collimated bipolar jet. We present results of the proper motion and radial velocity study of BP Psc outflow based on the archival $H\alpha$ imaging with the GMOS camera at 8.1-m Gemini-North telescope as well as recent imaging and long-slit spectroscopy with the SCORPIO multi-mode focal reducer at 6-m BTA telescope of SAO RAS. The 3D kinematics of the jet revealed the full spatial velocity up to $\sim$140 km$\cdot$s$^{-1}$ and allows us to estimate the distance to BP Psc system as $D=135\pm40$ pc. This distance leads to an estimation of the central source luminosity $L_*\approx1.2L_{\odot}$, indicating that it is the $\approx$1.3$M_{\odot}$ T Tauri star with an age $t\lesssim$ 7 Myr. We measured the electron density of order $N_e\sim10^2$ cm$^{-3}$ and mean ionization fraction $f\approx0.04$ within the jet knots and estimated upper limit of the mass-loss rate in NE lobe as $\dot{M}_{out}\approx1.2\cdot10^{-8}M_{\odot}\cdot yr^{-1}$. The physical characteristics of the outflow are typical for the low-excitation YSO jets and consistent with the magnetocentrifugal mechanism of its launching and collimation. Prominent wiggling pattern revealed in $H\alpha$ images allowed us to suppose the existence of a secondary substellar companion in a non-coplanar orbit and estimate its most plausible mass as $M_p\approx 30M_{Jup}$. We conclude that BP Psc is one of the closest to the Sun young jet-driving systems and its origin is possibly related to the episode of star formation triggered by expanding supershells in Second Galactic quadrant.


title: The Quantum Geometric Tensor in a Parameter Dependent Curved Space

abstract: We introduce a quantum geometric tensor in a curved space with a parameter-dependent metric, which contains the quantum metric tensor as the symmetric part and the Berry curvature corresponding to the antisymmetric part. This parameter-dependent metric modifies the usual inner product, which induces modifications in the quantum metric tensor and Berry curvature by adding terms proportional to the derivatives with respect to the parameters of the determinant of the metric. The quantum metric tensor is obtained in two ways: By using the definition of the infinitesimal distance between two states in the parameter-dependent curved space and via the fidelity susceptibility approach. The usual Berry connection acquires an additional term with which the curved inner product converts the Berry connection into an object that transforms as a connection and density of weight one. Finally, we provide three examples in one dimension with a nontrivial metric: an anharmonic oscillator, a Morse-like potential, and a generalized anharmonic oscillator; and one in two dimensions: the coupled anharmonic oscillator in a curved space.


title: On Weighted Graph Sparsification by Linear Sketching

abstract: A seminal work of [Ahn-Guha-McGregor, PODS'12] showed that one can compute a cut sparsifier of an unweighted undirected graph by taking a near-linear number of linear measurements on the graph. Subsequent works also studied computing other graph sparsifiers using linear sketching, and obtained near-linear upper bounds for spectral sparsifiers [Kapralov-Lee-Musco-Musco-Sidford, FOCS'14] and first non-trivial upper bounds for spanners [Filtser-Kapralov-Nouri, SODA'21]. All these linear sketching algorithms, however, only work on unweighted graphs. In this paper, we initiate the study of weighted graph sparsification by linear sketching by investigating a natural class of linear sketches that we call incidence sketches, in which each measurement is a linear combination of the weights of edges incident on a single vertex. Our results are: 1. Weighted cut sparsification: We give an algorithm that computes a $(1 + \epsilon)$-cut sparsifier using $\tilde{O}(n \epsilon^{-3})$ linear measurements, which is nearly optimal. 2. Weighted spectral sparsification: We give an algorithm that computes a $(1 + \epsilon)$-spectral sparsifier using $\tilde{O}(n^{6/5} \epsilon^{-4})$ linear measurements. Complementing our algorithm, we then prove a superlinear lower bound of $\Omega(n^{21/20-o(1)})$ measurements for computing some $O(1)$-spectral sparsifier using incidence sketches. 3. Weighted spanner computation: We focus on graphs whose largest/smallest edge weights differ by an $O(1)$ factor, and prove that, for incidence sketches, the upper bounds obtained by~[Filtser-Kapralov-Nouri, SODA'21] are optimal up to an $n^{o(1)}$ factor.


title: Supergravity and p-brane Ansatz

abstract: This project explores the $D=11$ supergravity model and the properties of its p-brane ansatz. The initial field content (graviton, gravitino and the anti-symmetric tensor field) in the action of $D=11$ supergravity is explained in the context of supersymmetry. The action is then decomposed to the bosonic sector, which is compared with the $\sigma$-model in string theory at a low energy limit $\alpha'\xrightarrow{}0$. The dilaton in the $D=10$ string theory can be realised from the dimensional reduction of $D=11$ supergravity, which gives the scalar contribution in the action to form the single-charge action. The field equation of the single-charged action is then derived. An $SO(D-d)\times Poincare_{d}$ ansatz is introduced to simplify the field equation. The solution of the field equation bifurcates into the electric ansatz and the magnetic ansatz. These ansatzes are called p-branes which are string-like objects that exist in their p-dimensional world volume embedded in the ambient spacetime. The BPS bounds are saturated for these p-branes, and upon dimensional reduction, they are similar to extremal Riessner-Nordstrom black holes up to the scalar. The branic motion is then derived and a special case of parallel brane orbit is explored. Similar to the Riessner-Nordstrom black hole, the circular orbit is found to require a specific angular momentum that increases further from the central brane. The circular orbit always exists for the extremal case, but the black branes that do not saturate the BPS bound may not have a circular orbit below a threshold angular momentum.


title: Peripheral Poisson Boundary

abstract: It is shown that the operator space generated by peripheral eigenvectors of a unital completely positive map on a von Neumann algebra has a $C^*$-algebra structure. This extends the notion of non-commutative Poisson boundary by including the point spectrum of the map contained in the unit circle. The main ingredient is dilation theory. This theory provides a simple formula for the new product. The notion has implications to our understanding of quantum dynamics. For instance, it is shown that the peripheral Poisson boundary remains invariant in discrete quantum dynamics.


title: Monte Carlo study of cuprate superconductors in a four-band $d$-$p$ model: Role of orbital degrees of freedom

abstract: Understanding the complex phase diagram of cuprate superconductors is a long-standing challenging problem. Recent studies have shown that orbital degrees of freedom, both Cu $e_g$ orbitals and O $p$ orbitals, are a key ingredient for a unified understanding of cuprate superconductors, including the material dependence. Here we investigate a four-band $d$-$p$ model derived from the first-principles calculations with the variational Monte Carlo method, which allows us to elucidate competing orders on an equal footing. The obtained results can consistently explain the doping dependence of superconductivity, antiferromagnetic and stripe phases, phase separation in the underdoped region, and also novel magnetism in the heavily-overdoped region. Our four-band $d$-$p$ model with neighbouring intersite interactions is a minimal model to describe the phase diagram comprehensively. The presence of $p$ orbitals is critical to the charge-stripe features, which induce two types of stripe phases with $s'$-wave and $d$-wave bond stripe. On the other hand, the presence of $d_{z^2}$ orbital is indispensable to material dependence of the superconducting transition temperature ($T_{\mathrm{c}}$), and enhances local magnetic moment as a source of novel magnetism in the heavily-overdoped region as well. These findings beyond one-band description could provide a major step toward a full explanation of unconventional normal state and high $T_{\mathrm{c}}$ in cuprate supercondutors.


title: Boosting the convergence of low-variance DSMC by GSIS

abstract: The low-variance direct simulation Monte Carlo (LVDSMC) is a powerful method to simulate low-speed rarefied gas flows. However, in the near-continuum flow regime, due to limitations on the time step and spatial cell size, it takes plenty of time to find the steady-state solution. Here we remove these deficiencies by coupling the LVDSMC with the general synthetic iterative scheme (GSIS) which permits the simulation at the hydrodynamic scale rather than the much smaller kinetic scale. As a proof of concept, we propose the stochastic-deterministic coupling method based on the Bhatnagar-Gross-Krook kinetic model. First, macroscopic synthetic equations are derived exactly from the kinetic equation, which not only contain the Navier-Stokes-Fourier constitutive relation, but also encompass the higher-order terms describing the rarefaction effects. Then, the high-order terms are extracted from LVDSMC and fed into synthetic equations to predict macroscopic properties which are closer to the steady-state solution than LVDSMC. Finally, the state of simulation particles in LVDSMC is updated to reflect the change of macroscopic properties. As a result, the convergence to steady state is greatly accelerated, and the restriction on cell size and the time step are removed: after simulating several canonical rarefied gas flows, we demonstrate that the LVDSMC-GSIS reduces the computational cost by two orders of magnitude in the near-continuum flow regime.


title: CenterLineDet: CenterLine Graph Detection for Road Lanes with Vehicle-mounted Sensors by Transformer for HD Map Generation

abstract: With the fast development of autonomous driving technologies, there is an increasing demand for high-definition (HD) maps, which provide reliable and robust prior information about the static part of the traffic environments. As one of the important elements in HD maps, road lane centerline is critical for downstream tasks, such as prediction and planning. Manually annotating centerlines for road lanes in HD maps is labor-intensive, expensive and inefficient, severely restricting the wide applications of autonomous driving systems. Previous work seldom explores the lane centerline detection problem due to the complicated topology and severe overlapping issues of lane centerlines. In this paper, we propose a novel method named CenterLineDet to detect lane centerlines for automatic HD map generation. Our CenterLineDet is trained by imitation learning and can effectively detect the graph of centerlines with vehicle-mounted sensors (i.e., six cameras and one LiDAR) through iterations. Due to the use of the DETR-like transformer network, CenterLineDet can handle complicated graph topology, such as lane intersections. The proposed approach is evaluated on the large-scale public dataset NuScenes. The superiority of our CenterLineDet is demonstrated by the comparative results. Our code, supplementary materials, and video demonstrations are available at \href{https://tonyxuqaq.github.io/projects/CenterLineDet/}{https://tonyxuqaq.github.io/projects/CenterLineDet/}.


title: Enhance the Visual Representation via Discrete Adversarial Training

abstract: Adversarial Training (AT), which is commonly accepted as one of the most effective approaches defending against adversarial examples, can largely harm the standard performance, thus has limited usefulness on industrial-scale production and applications. Surprisingly, this phenomenon is totally opposite in Natural Language Processing (NLP) task, where AT can even benefit for generalization. We notice the merit of AT in NLP tasks could derive from the discrete and symbolic input space. For borrowing the advantage from NLP-style AT, we propose Discrete Adversarial Training (DAT). DAT leverages VQGAN to reform the image data to discrete text-like inputs, i.e. visual words. Then it minimizes the maximal risk on such discrete images with symbolic adversarial perturbations. We further give an explanation from the perspective of distribution to demonstrate the effectiveness of DAT. As a plug-and-play technique for enhancing the visual representation, DAT achieves significant improvement on multiple tasks including image classification, object detection and self-supervised learning. Especially, the model pre-trained with Masked Auto-Encoding (MAE) and fine-tuned by our DAT without extra data can get 31.40 mCE on ImageNet-C and 32.77% top-1 accuracy on Stylized-ImageNet, building the new state-of-the-art. The code will be available at https://github.com/alibaba/easyrobust.


title: Extrapolation and Spectral Bias of Neural Nets with Hadamard Product: a Polynomial Net Study

abstract: Neural tangent kernel (NTK) is a powerful tool to analyze training dynamics of neural networks and their generalization bounds. The study on NTK has been devoted to typical neural network architectures, but it is incomplete for neural networks with Hadamard products (NNs-Hp), e.g., StyleGAN and polynomial neural networks (PNNs). In this work, we derive the finite-width NTK formulation for a special class of NNs-Hp, i.e., polynomial neural networks. We prove their equivalence to the kernel regression predictor with the associated NTK, which expands the application scope of NTK. Based on our results, we elucidate the separation of PNNs over standard neural networks with respect to extrapolation and spectral bias. Our two key insights are that when compared to standard neural networks, PNNs can fit more complicated functions in the extrapolation regime and admit a slower eigenvalue decay of the respective NTK, leading to a faster learning towards high-frequency functions. Besides, our theoretical results can be extended to other types of NNs-Hp, which expand the scope of our work. Our empirical results validate the separations in broader classes of NNs-Hp, which provide a good justification for a deeper understanding of neural architectures.


title: Monocular Camera Mapping with Pose-Guided Optimization: Enhancing Marking-Level HD Map Accuracy

abstract: Marking-level high-definition maps (HD maps) are of great significance for autonomous vehicles (AVs), especially in large-scale, appearance-changing scenarios where AVs rely on markings for localization and lanes for safe driving. In this paper, we propose a pose-guided optimization framework for automatically building a marking-level HD map with accurate markings positions using a simple sensor setup (one or more monocular cameras). We optimize the position of the marking corners to fit the result of marking segmentation and simultaneously optimize the inverse perspective mapping (IPM) matrix of the corresponding camera to obtain an accurate transformation from the front view image to the bird's-eye view (BEV). In the quantitative evaluation, the built HD map almost attains centimeter-level accuracy. The accuracy of the optimized IPM matrix is similar to that of the manual calibration. The method can also be generalized to build HD maps in a broader sense by increasing the types of recognizable markings. The supplementary materials and videos are available at http://liuhongji.site/V2HDM-Mono/.