title: Neural Wavelet-domain Diffusion for 3D Shape Generation

abstract: This paper presents a new approach for 3D shape generation, enabling direct generative modeling on a continuous implicit representation in wavelet domain. Specifically, we propose a compact wavelet representation with a pair of coarse and detail coefficient volumes to implicitly represent 3D shapes via truncated signed distance functions and multi-scale biorthogonal wavelets, and formulate a pair of neural networks: a generator based on the diffusion model to produce diverse shapes in the form of coarse coefficient volumes; and a detail predictor to further produce compatible detail coefficient volumes for enriching the generated shapes with fine structures and details. Both quantitative and qualitative experimental results manifest the superiority of our approach in generating diverse and high-quality shapes with complex topology and structures, clean surfaces, and fine details, exceeding the 3D generation capabilities of the state-of-the-art models.


title: Axially Expanded Windows for Local-Global Interaction in Vision Transformers

abstract: Recently, Transformers have shown promising performance in various vision tasks. A challenging issue in Transformer design is that global self-attention is very expensive to compute, especially for the high-resolution vision tasks. Local self-attention performs attention computation within a local region to improve its efficiency, which leads to their receptive fields in a single attention layer are not large enough, resulting in insufficient context modeling. When observing a scene, humans usually focus on a local region while attending to non-attentional regions at coarse granularity. Based on this observation, we develop the axially expanded window self-attention mechanism that performs fine-grained self-attention within the local window and coarse-grained self-attention in the horizontal and vertical axes, and thus can effectively capturing both short- and long-range visual dependencies.


title: FV-Train: Quantum Convolutional Neural Network Training with a Finite Number of Qubits by Extracting Diverse Features

abstract: Quantum convolutional neural network (QCNN) has just become as an emerging research topic as we experience the noisy intermediate-scale quantum (NISQ) era and beyond. As convolutional filters in QCNN extract intrinsic feature using quantum-based ansatz, it should use only finite number of qubits to prevent barren plateaus, and it introduces the lack of the feature information. In this paper, we propose a novel QCNN training algorithm to optimize feature extraction while using only a finite number of qubits, which is called fidelity-variation training (FV-Training).


title: Control Barrier Functions for Stochastic Systems and Safety-critical Control Designs

abstract: In recent years, the analysis of a control barrier function has received considerable attention because it is helpful for the safety-critical control required in many control application problems. While the extension of the analysis to a stochastic system studied by many researchers, it remains a challenging issue. In this paper, we consider sufficient conditions for reciprocal and zeroing control barrier functions ensuring safety with probability one and design a control law using the functions. Then, we propose another version of a stochastic zeroing control barrier function to evaluate a probability of a sample path staying in a safe set and confirm the convergence of a specific expectation related to the attractiveness of a safe set. We also show a way of deisgning a safety-critical control law based on our stochastic zeroing control barrier function. Finally, we confirm the validity of the proposed control design and the analysis using the control barrier functions via simple examples with their numerical simulation.


title: Data-driven and machine-learning based prediction of wave propagation behavior in dam-break flood

abstract: The computational prediction of wave propagation in dam-break floods is a long-standing problem in hydrodynamics and hydrology. Until now, conventional numerical models based on Saint-Venant equations are the dominant approaches. Here we show that a machine learning model that is well-trained on a minimal amount of data, can help predict the long-term dynamic behavior of a one-dimensional dam-break flood with satisfactory accuracy. For this purpose, we solve the Saint-Venant equations for a one-dimensional dam-break flood scenario using the Lax-Wendroff numerical scheme and train the reservoir computing echo state network (RC-ESN) with the dataset by the simulation results consisting of time-sequence flow depths. We demonstrate a good prediction ability of the RC-ESN model, which ahead predicts wave propagation behavior 286 time-steps in the dam-break flood with a root mean square error (RMSE) smaller than 0.01, outperforming the conventional long short-term memory (LSTM) model which reaches a comparable RMSE of only 81 time-steps ahead. To show the performance of the RC-ESN model, we also provide a sensitivity analysis of the prediction accuracy concerning the key parameters including training set size, reservoir size, and spectral radius. Results indicate that the RC-ESN are less dependent on the training set size, a medium reservoir size K=1200~2600 is sufficient. We confirm that the spectral radius \r{ho} shows a complex influence on the prediction accuracy and suggest a smaller spectral radius \r{ho} currently. By changing the initial flow depth of the dam break, we also obtained the conclusion that the prediction horizon of RC-ESN is larger than that of LSTM.


title: Tunable valley and spin splittings in $\rm VSi_2N_4$ bilayer

abstract: The control and manipulation of the valley and spin degrees of freedom have received great interests in fundamental studies and advanced information technologies. Compared with magnetic means, it is highly desirable to realize more energy-efficient electric control of valley and spin. Using the first-principles calculations, we demonstrate tunable valley and spin degeneracy splittings in $\rm VSi_2N_4$ bilayers, with the aid of the layered structure and associated electric control. Depending on different interlayer magnetic couplings and stacking orders, the $\rm VSi_2N_4$ bilayers exhibit a variety of combinations of valley and spin degeneracies. Under the action of a vertical electric field, the degeneracy splittings become highly tunable for both the sign and magnitude. As a result, a series of anomalous Hall currents can be selectively realized with varied indices of valley and spin. These intriguing features offer a practical way for designing energy-efficient devices based on the couplings between multiple electronic degrees of freedom.


title: Translationally Invariant Constraint Optimization Problems

abstract: We study the complexity of classical constraint satisfaction problems on a 2D grid. Specifically, we consider the complexity of function versions of such problems, with the additional restriction that the constraints are translationally invariant, namely, the variables are located at the vertices of a 2D grid and the constraint between every pair of adjacent variables is the same in each dimension. The only input to the problem is thus the size of the grid. This problem is equivalent to one of the most interesting problems in classical physics, namely, computing the lowest energy of a classical system of particles on the grid. We provide a tight characterization of the complexity of this problem, and show that it is complete for the class $FP^{NEXP}$. Gottesman and Irani (FOCS 2009) also studied classical translationally-invariant constraint satisfaction problems; they show that the problem of deciding whether the cost of the optimal solution is below a given threshold is NEXP-complete. Our result is thus a strengthening of their result from the decision version to the function version of the problem. Our result can also be viewed as a generalization to the translationally invariant setting, of Krentel's famous result from 1988, showing that the function version of SAT is complete for the class $FP^{NP}$. An essential ingredient in the proof is a study of the complexity of a gapped variant of the problem. We show that it is NEXP-hard to approximate the cost of the optimal assignment to within an additive error of $\Omega(N^{1/4})$, for an $N \times N$ grid. To the best of our knowledge, no gapped result is known for CSPs on the grid, even in the non-translationally invariant case. As a byproduct of our results, we also show that a decision version of the optimization problem which asks whether the cost of the optimal assignment is odd or even is also complete for $P^{NEXP}$.


title: The relative minimal model program for excellent algebraic spaces and analytic spaces in equal characteristic zero

abstract: We establish the relative minimal model program with scaling for projective morphisms of quasi-excellent algebraic spaces admitting dualizing complexes, quasi-excellent formal schemes admitting dualizing complexes, semianalytic germs of complex analytic spaces, rigid analytic spaces, Berkovich spaces, and adic spaces locally of weakly finite type over a field, all in equal characteristic zero. To do so, we prove finite generation of relative adjoint rings associated to projective morphisms of such spaces using the strategy of Cascini and Lazi\'c and the generalization of the Kawamata-Viehweg vanishing theorem to the scheme setting recently established by the second author. To prove these results uniformly, we prove GAGA theorems for Grothendieck duality and dualizing complexes to reduce to the algebraic case. In addition, we apply our methods to establish the relative minimal model program with scaling for spaces of the form above in dimensions $\le 3$ in positive and mixed characteristic, and to show that one can run the relative minimal model program with scaling for complex analytic spaces without shrinking the base at each step.


title: On Geometrization of Spinors in a Complex Spacetime

abstract: While general relativity provides a complete geometric theory of gravity, it fails to explain the other three forces of nature, i.e., electromagnetism and weak and strong interactions. We require the quantum field theory (QFT) to explain them. Therefore, in this article, we try to geometrize the spinor fields. We define a parametric coordinate system in the tangent space of a null manifold and show that these parametric coordinates behave as spinors. By introducing a complex internal hyperspace on a tangent space of a null manifold, we show that we can get eight sets of such parametric coordinate systems that can behave as eight spinor fields. These spinor fields contain two triplets that can rotate among themselves under SU(3). Seven of these spinor fields also couple with a U(1) field with different strengths. We also show that while these spinors can be assigned a tensor weight $1/2$ or $-1/2$, in a $L^p$ space where the coordinates, instead of adding up in quadrature, add up in $p$th power, we can get a parametric space that contains similar spinors of tensor weight $1/p$.


title: Magnetic Resonance Fingerprinting with compressed sensing and distance metric learning

abstract: Magnetic Resonance Fingerprinting (MRF) is a novel technique that simultaneously estimates multiple tissue-related parameters, such as the longitudinal relaxation time T1, the transverse relaxation time T2, off resonance frequency B0 and proton density, from a scanned object in just tens of seconds. However, the MRF method suffers from aliasing artifacts because it significantly undersamples the k-space data. In this work, we propose a compressed sensing (CS) framework for simultaneously estimating multiple tissue-related parameters based on the MRF method. It is more robust to low sampling ratio and is therefore more efficient in estimating MR parameters for all voxels of an object. Furthermore, the MRF method requires identifying the nearest atoms of the query fingerprints from the MR-signal-evolution dictionary with the L2 distance. However, we observed that the L2 distance is not always a proper metric to measure the similarities between MR Fingerprints. Adaptively learning a distance metric from the undersampled training data can significantly improve the matching accuracy of the query fingerprints. Numerical results on extensive simulated cases show that our method substantially outperforms stateof-the-art methods in terms of accuracy of parameter estimation.


title: Traffic incident duration prediction via a deep learning framework for text description encoding

abstract: Predicting the traffic incident duration is a hard problem to solve due to the stochastic nature of incident occurrence in space and time, a lack of information at the beginning of a reported traffic disruption, and lack of advanced methods in transport engineering to derive insights from past accidents. This paper proposes a new fusion framework for predicting the incident duration from limited information by using an integration of machine learning with traffic flow/speed and incident description as features, encoded via several Deep Learning methods (ANN autoencoder and character-level LSTM-ANN sentiment classifier). The paper constructs a cross-disciplinary modelling approach in transport and data science. The approach improves the incident duration prediction accuracy over the top-performing ML models applied to baseline incident reports. Results show that our proposed method can improve the accuracy by $60\%$ when compared to standard linear or support vector regression models, and a further $7\%$ improvement with respect to the hybrid deep learning auto-encoded GBDT model which seems to outperform all other models. The application area is the city of San Francisco, rich in both traffic incident logs (Countrywide Traffic Accident Data set) and past historical traffic congestion information (5-minute precision measurements from Caltrans Performance Measurement System).


title: A new canonical affine BRACKET formulation of Hamiltonian Classical Field theories of first order

abstract: It has been a long standing question how to extend the canonical Poisson bracket formulation from classical mechanics to classical field theories, in a completely general, intrinsic, and canonical way. In this paper, we provide an answer to this question by presenting a new completely canonical bracket formulation of Hamiltonian Classical Field Theories of first order on an arbitrary configuration bundle. It is obtained via the construction of the appropriate field-theoretic analogues of the Hamiltonian vector field and of the space of observables, via the introduction of a suitable canonical Lie algebra structure on the space of currents (the observables in field theories). This Lie algebra structure is shown to have a representation on the affine space of Hamiltonian sections, which yields an affine analogue to the Jacobi identity for our bracket. The construction is analogous to the canonical Poisson formulation of Hamiltonian systems although the nature of our formulation is linear-affine and not bilinear as the standard Poisson bracket. This is consistent with the fact that the space of currents and Hamiltonian sections are respectively, linear and affine. Our setting is illustrated with some examples including Continuum Mechanics and Yang-Mills theory.


title: Heterogeneous Federated Learning on a Graph

abstract: Federated learning, where algorithms are trained across multiple decentralized devices without sharing local data, is increasingly popular in distributed machine learning practice. Typically, a graph structure $G$ exists behind local devices for communication. In this work, we consider parameter estimation in federated learning with data distribution and communication heterogeneity, as well as limited computational capacity of local devices. We encode the distribution heterogeneity by parametrizing distributions on local devices with a set of distinct $p$-dimensional vectors. We then propose to jointly estimate parameters of all devices under the $M$-estimation framework with the fused Lasso regularization, encouraging an equal estimate of parameters on connected devices in $G$. We provide a general result for our estimator depending on $G$, which can be further calibrated to obtain convergence rates for various specific problem setups. Surprisingly, our estimator attains the optimal rate under certain graph fidelity condition on $G$, as if we could aggregate all samples sharing the same distribution. If the graph fidelity condition is not met, we propose an edge selection procedure via multiple testing to ensure the optimality. To ease the burden of local computation, a decentralized stochastic version of ADMM is provided, with convergence rate $O(T^{-1}\log T)$ where $T$ denotes the number of iterations. We highlight that, our algorithm transmits only parameters along edges of $G$ at each iteration, without requiring a central machine, which preserves privacy. We further extend it to the case where devices are randomly inaccessible during the training process, with a similar algorithmic convergence guarantee. The computational and statistical efficiency of our method is evidenced by simulation experiments and the 2020 US presidential election data set.


title: Learning Decoupled Retrieval Representation for Nearest Neighbour Neural Machine Translation

abstract: K-Nearest Neighbor Neural Machine Translation (kNN-MT) successfully incorporates external corpus by retrieving word-level representations at test time. Generally, kNN-MT borrows the off-the-shelf context representation in the translation task, e.g., the output of the last decoder layer, as the query vector of the retrieval task. In this work, we highlight that coupling the representations of these two tasks is sub-optimal for fine-grained retrieval. To alleviate it, we leverage supervised contrastive learning to learn the distinctive retrieval representation derived from the original context representation. We also propose a fast and effective approach to constructing hard negative samples. Experimental results on five domains show that our approach improves the retrieval accuracy and BLEU score compared to vanilla kNN-MT.


title: Adaptive Multi-stage Density Ratio Estimation for Learning Latent Space Energy-based Model

abstract: This paper studies the fundamental problem of learning energy-based model (EBM) in the latent space of the generator model. Learning such prior model typically requires running costly Markov Chain Monte Carlo (MCMC). Instead, we propose to use noise contrastive estimation (NCE) to discriminatively learn the EBM through density ratio estimation between the latent prior density and latent posterior density. However, the NCE typically fails to accurately estimate such density ratio given large gap between two densities. To effectively tackle this issue and learn more expressive prior models, we develop the adaptive multi-stage density ratio estimation which breaks the estimation into multiple stages and learn different stages of density ratio sequentially and adaptively. The latent prior model can be gradually learned using ratio estimated in previous stage so that the final latent space EBM prior can be naturally formed by product of ratios in different stages. The proposed method enables informative and much sharper prior than existing baselines, and can be trained efficiently. Our experiments demonstrate strong performances in image generation and reconstruction as well as anomaly detection.


title: Distributed Execution Indexing

abstract: This work-in-progress report presents both the design and partial evaluation of distributed execution indexing, a technique for microservice applications that precisely identifies dynamic instances of inter-service remote procedure calls (RPCs). Such an indexing scheme is critical for request-level fault injection techniques, which aim to automatically find failure-handling bugs in microservice applications.Distributed execution indexes enable granular specification of request-level faults, while also establishing a correspondence between inter-service RPCs across multiple executions, as is required to perform a systematic search of the fault space.In this paper, we formally define the general concept of a distributed execution index, which can be parameterized on different ways of identifying an RPC in a single service. We identify an instantiation that maintains precision in the presence of a variety of program structure complexities such as loops, function indirection, and concurrency with scheduling nondeterminism. We demonstrate that this particular instantiation addresses gaps in the state-of-the-art in request-level fault injection and show that they are all special cases of distributed execution indexing. We discuss the implementation challenges and provide an implementation of distributed execution indexing as an extension of \Filibuster{}, a resilience testing tool for microservice applications for the Java programming language, which supports fault injection for gRPC and HTTP.


title: Bergman representative coordinate, constant holomorphic curvature and a multidimensional generalization of Carath\'eodory's theorem

abstract: By using the Bergman representative coordinate and Calabi's diastasis, we extend a theorem of Lu to bounded pseudoconvex domains whose Bergman metric is incomplete with constant holomorphic sectional curvature. We characterize such domains that are biholomorphic to a ball possibly less a relatively closed pluripolar set. We also provide a multidimensional generalization of Carath\'eodory's theorem on the continuous extension of the biholomorphisms up to the closures. In particular, sufficient conditions are given, in terms of the Bergman kernel, for the boundary of a biholomorphic ball to be a topological sphere.


title: Integrative Feature and Cost Aggregation with Transformers for Dense Correspondence

abstract: We present a novel architecture for dense correspondence. The current state-of-the-art are Transformer-based approaches that focus on either feature descriptors or cost volume aggregation. However, they generally aggregate one or the other but not both, though joint aggregation would boost each other by providing information that one has but other lacks, i.e., structural or semantic information of an image, or pixel-wise matching similarity. In this work, we propose a novel Transformer-based network that interleaves both forms of aggregations in a way that exploits their complementary information. Specifically, we design a self-attention layer that leverages the descriptor to disambiguate the noisy cost volume and that also utilizes the cost volume to aggregate features in a manner that promotes accurate matching. A subsequent cross-attention layer performs further aggregation conditioned on the descriptors of both images and aided by the aggregated outputs of earlier layers. We further boost the performance with hierarchical processing, in which coarser level aggregations guide those at finer levels. We evaluate the effectiveness of the proposed method on dense matching tasks and achieve state-of-the-art performance on all the major benchmarks. Extensive ablation studies are also provided to validate our design choices.


title: DINOMO: An Elastic, Scalable, High-Performance Key-Value Store for Disaggregated Persistent Memory (Extended Version)

abstract: We present Dinomo, a novel key-value store for disaggregated persistent memory (DPM). Dinomo is the first key-value store for DPM that simultaneously achieves high common-case performance, scalability, and lightweight online reconfiguration. We observe that previously proposed key-value stores for DPM had architectural limitations that prevent them from achieving all three goals simultaneously. Dinomo uses a novel combination of techniques such as ownership partitioning, disaggregated adaptive caching, selective replication, and lock-free and log-free indexing to achieve these goals. Compared to a state-of-the-art DPM key-value store, Dinomo achieves at least 3.8x better throughput on various workloads at scale and higher scalability, while providing fast reconfiguration.


title: AdvDO: Realistic Adversarial Attacks for Trajectory Prediction

abstract: Trajectory prediction is essential for autonomous vehicles (AVs) to plan correct and safe driving behaviors. While many prior works aim to achieve higher prediction accuracy, few study the adversarial robustness of their methods. To bridge this gap, we propose to study the adversarial robustness of data-driven trajectory prediction systems. We devise an optimization-based adversarial attack framework that leverages a carefully-designed differentiable dynamic model to generate realistic adversarial trajectories. Empirically, we benchmark the adversarial robustness of state-of-the-art prediction models and show that our attack increases the prediction error for both general metrics and planning-aware metrics by more than 50% and 37%. We also show that our attack can lead an AV to drive off road or collide into other vehicles in simulation. Finally, we demonstrate how to mitigate the adversarial attacks using an adversarial training scheme.


title: Importance Tempering: Group Robustness for Overparameterized Models

abstract: Although overparameterized models have shown their success on many machine learning tasks, the accuracy could drop on the testing distribution that is different from the training one. This accuracy drop still limits applying machine learning in the wild. At the same time, importance weighting, a traditional technique to handle distribution shifts, has been demonstrated to have less or even no effect on overparameterized models both empirically and theoretically. In this paper, we propose importance tempering to improve the decision boundary and achieve consistently better results for overparameterized models. Theoretically, we justify that the selection of group temperature can be different under label shift and spurious correlation setting. At the same time, we also prove that properly selected temperatures can extricate the minority collapse for imbalanced classification. Empirically, we achieve state-of-the-art results on worst group classification tasks using importance tempering.


title: Gaussian entanglement witness and refined Werner-Wolf criterion for continuous variables

abstract: We use matched quantum entanglement witnesses to study the separable criteria of continuous variable states. The witness can be written as an identity operator minus a Gaussian operator. The optimization of the witness then is transformed to an eigenvalue problem of a Gaussian kernel integral equation. It follows a separable criterion not only for symmetric Gaussian quantum states, but also for non-Gaussian states prepared by photon adding to or/and subtracting from symmetric Gaussian states. Based on Fock space numeric calculation, we obtain an entanglement witness for more general two-mode states. A necessary criterion of separability follows for two-mode states and it is shown to be necessary and sufficient for a two mode squeezed thermal state and the related two-mode non-Gaussian states. We also connect the witness based criterion with Werner-Wolf criterion and refine the Werner-Wolf criterion.


title: On Robust Cross-View Consistency in Self-Supervised Monocular Depth Estimation

abstract: Remarkable progress has been made in self-supervised monocular depth estimation (SS-MDE) by exploring cross-view consistency, e.g., photometric consistency and 3D point cloud consistency. However, they are very vulnerable to illumination variance, occlusions, texture-less regions, as well as moving objects, making them not robust enough to deal with various scenes. To address this challenge, we study two kinds of robust cross-view consistency in this paper. Firstly, the spatial offset field between adjacent frames is obtained by reconstructing the reference frame from its neighbors via deformable alignment, which is used to align the temporal depth features via a Depth Feature Alignment (DFA) loss. Secondly, the 3D point clouds of each reference frame and its nearby frames are calculated and transformed into voxel space, where the point density in each voxel is calculated and aligned via a Voxel Density Alignment (VDA) loss. In this way, we exploit the temporal coherence in both depth feature space and 3D voxel space for SS-MDE, shifting the "point-to-point" alignment paradigm to the "region-to-region" one. Compared with the photometric consistency loss as well as the rigid point cloud alignment loss, the proposed DFA and VDA losses are more robust owing to the strong representation power of deep features as well as the high tolerance of voxel density to the aforementioned challenges. Experimental results on several outdoor benchmarks show that our method outperforms current state-of-the-art techniques. Extensive ablation study and analysis validate the effectiveness of the proposed losses, especially in challenging scenes. The code and models are available at https://github.com/sunnyHelen/RCVC-depth.


title: Local and Covariant Flow Relations for OPE Coefficients in Lorentzian Spacetimes

abstract: For Euclidean quantum field theories, Holland and Hollands have shown operator product expansion (OPE) coefficients satisfy "flow equations": For interaction parameter $\lambda$, the partial derivative of any OPE coefficient with respect to $\lambda$ is given by an integral over Euclidean space of a sum of products of other OPE coefficients. In this paper, we generalize these results for flat Euclidean space to curved Lorentzian spacetimes in the context of the solvable "toy model" of massive Klein-Gordon scalar field theory, with $m^2$ viewed as the "self-interaction parameter". Even in Minkowski spacetime, a serious difficulty arises from the fact that all integrals must be taken over a compact spacetime region to ensure convergence but any integration cutoff necessarily breaks Lorentz covariance. We show how covariant flow relations can be obtained by adding compensating "counterterms" in a manner similar to that of the Epstein-Glaser renormalization scheme. We also show how to eliminate dependence on the "infrared-cutoff scale" $L$, thereby yielding flow relations compatible with almost homogeneous scaling of the fields. In curved spacetime, the spacetime integration will cause the OPE coefficients to depend non-locally on the spacetime metric, in violation of the requirement that quantum fields should depend locally and covariantly on the metric. We show how this potentially serious difficulty can be overcome by replacing the metric with a suitable local polynomial approximation about the OPE expansion point. We thereby obtain local and covariant flow relations for the OPE coefficients of Klein-Gordon theory in curved Lorentzian spacetimes. In an appendix, we develop an algorithm for constructing local and covariant flow relations beyond our "toy model" based on the associativity properties of OPE coefficients, and we apply our method to $\lambda\phi^4$-theory.


title: Impact of Anisotropic Birefringence on Measuring Cosmic Microwave Background Lensing

abstract: The power spectrum of cosmic microwave background lensing is a powerful tool for constraining fundamental physics such as the sum of neutrino masses and the dark energy equation of state. Current lensing measurements primarily come from distortions to the microwave background temperature field, but the polarization lensing signal will dominate upcoming experiments with greater sensitivity. Cosmic birefringence refers to the rotation of the linear polarization direction of microwave photons propagating from the last scattering surface to us, which can be induced by parity-violating physics such as axion-like dark matter or primordial magnetic fields. We find that, for an upcoming CMB-S4-like experiment, if there exists the scale-invariant anisotropic birefringence with an amplitude corresponding to the current $95\%$ upper bound, the measured lensing power spectrum could be biased by up to a factor of few at small scales, $L\gtrsim 1000$. We show that the bias scales linearly with the amplitude of the scale-invariant birefringence spectrum. The signal-to-noise of the contribution from anisotropic birefringence is larger than unity even if the birefringence amplitude decreases to $\sim 5\%$ of the current upper bound. Our results indicate that a measurement and characterization of the anisotropic birefringence is important for lensing analysis in future low-noise polarization experiments.


title: Knowledge-based Analogical Reasoning in Neuro-symbolic Latent Spaces

abstract: Analogical Reasoning problems challenge both connectionist and symbolic AI systems as these entail a combination of background knowledge, reasoning and pattern recognition. While symbolic systems ingest explicit domain knowledge and perform deductive reasoning, they are sensitive to noise and require inputs be mapped to preset symbolic features. Connectionist systems on the other hand can directly ingest rich input spaces such as images, text or speech and recognize pattern even with noisy inputs. However, connectionist models struggle to include explicit domain knowledge for deductive reasoning. In this paper, we propose a framework that combines the pattern recognition abilities of neural networks with symbolic reasoning and background knowledge for solving a class of Analogical Reasoning problems where the set of attributes and possible relations across them are known apriori. We take inspiration from the 'neural algorithmic reasoning' approach [DeepMind 2020] and use problem-specific background knowledge by (i) learning a distributed representation based on a symbolic model of the problem (ii) training neural-network transformations reflective of the relations involved in the problem and finally (iii) training a neural network encoder from images to the distributed representation in (i). These three elements enable us to perform search-based reasoning using neural networks as elementary functions manipulating distributed representations. We test this on visual analogy problems in RAVENs Progressive Matrices, and achieve accuracy competitive with human performance and, in certain cases, superior to initial end-to-end neural-network based approaches. While recent neural models trained at scale yield SOTA, our novel neuro-symbolic reasoning approach is a promising direction for this problem, and is arguably more general, especially for problems where domain knowledge is available.


title: Bias-Aware Design for Informed Decisions: Raising Awareness of Self-Selection Bias in User Ratings and Reviews

abstract: People often take user ratings and reviews into consideration when shopping for products or services online. However, such user-generated data contains self-selection bias that could affect people decisions and it is hard to resolve this issue completely by algorithms. In this work, we propose to raise the awareness of the self-selection bias by making three types of information concerning user ratings and reviews transparent. We distill these three pieces of information (reviewers experience, the extremity of emotion, and reported aspects) from the definition of self-selection bias and exploration of related literature. We further conduct an online survey to assess the perceptions of the usefulness of such information and identify the exact facets people care about in their decision process. Then, we propose a visual design to make such details behind user reviews transparent and integrate the design into an experimental website for evaluation. The results of a between-subjects study demonstrate that our bias-aware design significantly increases the awareness of bias and their satisfaction with decision-making. We further offer a series of design implications for improving information transparency and awareness of bias in user-generated content.


title: Keypoint-GraspNet: Keypoint-based 6-DoF Grasp Generation from the Monocular RGB-D input

abstract: Great success has been achieved in the 6-DoF grasp learning from the point cloud input, yet the computational cost due to the point set orderlessness remains a concern. Alternatively, we explore the grasp generation from the RGB-D input in this paper. The proposed solution, Keypoint-GraspNet, detects the projection of the gripper keypoints in the image space and then recover the SE(3) poses with a PnP algorithm. A synthetic dataset based on the primitive shape and the grasp family is constructed to examine our idea. Metric-based evaluation reveals that our method outperforms the baselines in terms of the grasp proposal accuracy, diversity, and the time cost. Finally, robot experiments show high success rate, demonstrating the potential of the idea in the real-world applications.


title: Preservation of NATP

abstract: We prove several preservation theorems for NATP and furnish several examples of NATP. First, we prove preservation of NATP for the parametrization and sum of the theories of Fra\"{i}ss\'{e} limits of Fra\"{i}ss\'{e} classes satisfying strong amalgamation property. Second, we prove preservation of NATP for two kinds of dense/co-dense expansions, that is, the theories of lovely pairs and of H-structures for geometric theories and dense/co-dense expansion on vector spaces. Third, we prove preservation of NATP for the generic predicate expansion and the pair of an algebraically closed field and its distinguished subfield; for the latter, not only NATP, but also preservations of NTP$_1$ and NTP$_2$ are considered. Fourth, we present some proper examples of NATP using the results proved in this paper. Most of all, we show that the model companion of the theory of algebraically closed fields with circular orders (ACFO) is NATP.


title: Toward Understanding Privileged Features Distillation in Learning-to-Rank

abstract: In learning-to-rank problems, a privileged feature is one that is available during model training, but not available at test time. Such features naturally arise in merchandised recommendation systems; for instance, "user clicked this item" as a feature is predictive of "user purchased this item" in the offline data, but is clearly not available during online serving. Another source of privileged features is those that are too expensive to compute online but feasible to be added offline. Privileged features distillation (PFD) refers to a natural idea: train a "teacher" model using all features (including privileged ones) and then use it to train a "student" model that does not use the privileged features. In this paper, we first study PFD empirically on three public ranking datasets and an industrial-scale ranking problem derived from Amazon's logs. We show that PFD outperforms several baselines (no-distillation, pretraining-finetuning, self-distillation, and generalized distillation) on all these datasets. Next, we analyze why and when PFD performs well via both empirical ablation studies and theoretical analysis for linear models. Both investigations uncover an interesting non-monotone behavior: as the predictive power of a privileged feature increases, the performance of the resulting student model initially increases but then decreases. We show the reason for the later decreasing performance is that a very predictive privileged teacher produces predictions with high variance, which lead to high variance student estimates and inferior testing performance.


title: Forward Modeling of Magnetic-field Measurements at the Bases of Stellar Coronae through Extreme-Ultraviolet Spectroscopy

abstract: Measurements of the stellar coronal magnetic field are of great importance in understanding the stellar magnetic activity, yet the measurements have been extremely difficult. Recent studies proposed a new method of magnetic field measurements based on the magnetic-field-induced-transition (MIT) of the Fe~{\sc{x}} ion. Here we construct a series of stellar coronal magnetohydrodynamics (MHD) models and synthesize several Fe~{\sc{x}} emission lines at extreme-ultraviolet wavelengths, and then diagnose the magnetic field strength at the bases of the coronae using the MIT technique. Our results show that the technique can be applied to some stars with magnetic fields more than three times higher than that of the Sun at solar maximum. Furthermore, we investigate the uncertainty of the derived magnetic field strength caused by photon counting error and find that a signal-noise ratio of $\sim$50 for the Fe~{\sc{x}} 175 {\AA}~line is required to achieve effective measurements of the stellar coronal magnetic field.


title: Exact mean-field solution of a spin chain with short-range and long-range interactions

abstract: We consider the transverse field Ising model with additional all-to-all interactions between the spins. We show that a mean-field treatment of this model becomes exact in the thermodynamic limit, despite the presence of 1D short-range interactions. This is established by looking for eigenstates as coherent states with an amplitude that varies through the Hilbert space. We study then the thermodynamics of the model and identify the different phases. Among its peculiar features, this 1D model possesses a second-order phase transition at finite temperature and exhibits inverse melting.

categories: cond-mat.stat-mech math-ph math.MP quant-ph


title: Parameterized Complexity of Path Set Packing

abstract: In Path Set Packing, the input is an undirected graph $G$, a collection $\calp$ of simple paths in $G$, and a positive integer $k$. The problem is to decide whether there exist $k$ edge-disjoint paths in $\calp$. We study the parameterized complexity of Path Set Packing with respect to both natural and structural parameters. We show that the problem is $W[1]$-hard with respect to vertex cover number, and $W[1]$-hard respect to pathwidth plus maximum degree plus solution size. These results answer an open question raised in COCOON 2018. On the positive side, we present an FPT algorithm parameterized by feedback vertex number plus maximum degree, and present an FPT algorithm parameterized by treewidth plus maximum degree plus maximum length of a path in $\calp$. These positive results complement the hardness of Path Set Packing with respect to any subset of the parameters used in the FPT algorithms. We also give a $4$-approximation algorithm for maximum path set packing problem which runs in FPT time when parameterized by feedback edge number.


title: Selection on treatment in the target population of generalizabillity and transportability analyses

abstract: Investigators are increasingly using novel methods for extending (generalizing or transporting) causal inferences from a trial to a target population. In many generalizability and transportability analyses, the trial and the observational data from the target population are separately sampled, following a non-nested trial design. In practical implementations of this design, non-randomized individuals from the target population are often identified by conditioning on the use of a particular treatment, while individuals who used other candidate treatments for the same indication or individuals who did not use any treatment are excluded. In this paper, we argue that conditioning on treatment in the target population changes the estimand of generalizability and transportability analyses and potentially introduces serious bias in the estimation of causal estimands in the target population or the subset of the target population using a specific treatment. Furthermore, we argue that the naive application of marginalization-based or weighting-based standardization methods does not produce estimates of any reasonable causal estimand. We use causal graphs and counterfactual arguments to characterize the identification problems induced by conditioning on treatment in the target population and illustrate the problems using simulated data. We conclude by considering the implications of our findings for applied work.


title: Tree-based Text-Vision BERT for Video Search in Baidu Video Advertising

abstract: The advancement of the communication technology and the popularity of the smart phones foster the booming of video ads. Baidu, as one of the leading search engine companies in the world, receives billions of search queries per day. How to pair the video ads with the user search is the core task of Baidu video advertising. Due to the modality gap, the query-to-video retrieval is much more challenging than traditional query-to-document retrieval and image-to-image search. Traditionally, the query-to-video retrieval is tackled by the query-to-title retrieval, which is not reliable when the quality of tiles are not high. With the rapid progress achieved in computer vision and natural language processing in recent years, content-based search methods becomes promising for the query-to-video retrieval. Benefited from pretraining on large-scale datasets, some visionBERT methods based on cross-modal attention have achieved excellent performance in many vision-language tasks not only in academia but also in industry. Nevertheless, the expensive computation cost of cross-modal attention makes it impractical for large-scale search in industrial applications. In this work, we present a tree-based combo-attention network (TCAN) which has been recently launched in Baidu's dynamic video advertising platform. It provides a practical solution to deploy the heavy cross-modal attention for the large-scale query-to-video search. After launching tree-based combo-attention network, click-through rate gets improved by 2.29\% and conversion rate get improved by 2.63\%.


title: On the range of the $X$-ray transform of symmetric tensors compactly supported in the plane

abstract: We find the necessary and sufficient conditions on the Fourier coefficients of a function $g$ on the torus to be in the range of the $X$-ray transform of a symmetric tensor of compact support in the plane.


title: Quantum network reliability with perfect nodes

abstract: We introduce the concept of quantum reliability as an extension of the concept of network reliability in the context of quantum networks. We show that this concept is intimately related to the concept of quantum reliability operator that we also introduce and show a Negami like splitting formula for it. Considering that the simple factorization formula for classical networks which is the basis of most of the calculation algorithms does not hold in the quantum context due to entanglement, a Negami like splitting for the quantum reliability operator becomes relevant.


title: Fairness on Synthetic Visual and Thermal Mask Images

abstract: In this paper, we study performance and fairness on visual and thermal images and expand the assessment to masked synthetic images. Using the SpeakingFace and Thermal-Mask dataset, we propose a process to assess fairness on real images and show how the same process can be applied to synthetic images. The resulting process shows a demographic parity difference of 1.59 for random guessing and increases to 5.0 when the recognition performance increases to a precision and recall rate of 99.99\%. We indicate that inherently biased datasets can deeply impact the fairness of any biometric system. A primary cause of a biased dataset is the class imbalance due to the data collection process. To address imbalanced datasets, the classes with fewer samples can be augmented with synthetic images to generate a more balanced dataset resulting in less bias when training a machine learning system. For biometric-enabled systems, fairness is of critical importance, while the related concept of Equity, Diversity, and Inclusion (EDI) is well suited for the generalization of fairness in biometrics, in this paper, we focus on the 3 most common demographic groups age, gender, and ethnicity.


title: Decentralized Vehicle Coordination: The Berkeley DeepDrive Drone Dataset

abstract: Decentralized multiagent planning has been an important field of research in robotics. An interesting and impactful application in the field is decentralized vehicle coordination in understructured road environments. For example, in an intersection, it is useful yet difficult to deconflict multiple vehicles of intersecting paths in absence of a central coordinator. We learn from common sense that, for a vehicle to navigate through such understructured environments, the driver must understand and conform to the implicit "social etiquette" observed by nearby drivers. To study this implicit driving protocol, we collect the Berkeley DeepDrive Drone dataset. The dataset contains 1) a set of aerial videos recording understructured driving, 2) a collection of images and annotations to train vehicle detection models, and 3) a kit of development scripts for illustrating typical usages. We believe that the dataset is of primary interest for studying decentralized multiagent planning employed by human drivers and, of secondary interest, for computer vision in remote sensing settings.


title: An Optimal Level-synchronous Shared-memory Parallel BFS Algorithm with Optimal parallel Prefix-sum Algorithm and its Implications for Energy Consumption

abstract: We present a work-efficient parallel level-synchronous Breadth First Search (BFS) algorithm for shared-memory architectures which achieves the theoretical lower bound on parallel running time. The optimality holds regardless of the shape of the graph. We also demonstrate the implication of this optimality for the energy consumption of the program empirically. The key idea is never to use more processing cores than necessary to complete the work in any computation step efficiently. We keep the rest of the cores idle to save energy and to reduce other resource contentions (e.g., bandwidth, shared caches, etc). Our BFS does not use locks and atomic instructions and is easily extendible to shared-memory coprocessors.


title: Semi-implicit Integration and Data-Driven Model Order Reduction in Structural Dynamics with Hysteresis

abstract: Structural damping is known to be approximately rate-independent in many cases. Popular models for rate-independent dissipation are hysteresis models; and a highly popular hysteresis model is the Bouc-Wen model. If such hysteretic dissipation is incorporated in a refined finite element model, then the mathematical model includes the usual structural dynamics equations along with nonlinear nonsmooth ordinary differential equations for a large number of internal hysteretic states at Gauss points, to be used within the virtual work calculation for dissipation. For such systems, numerical integration becomes difficult due to both the distributed non-analytic nonlinearity of hysteresis as well as the very high natural frequencies in the finite element model. Here we offer two contributions. First, we present a simple semi-implicit integration approach where the structural part is handled implicitly based on the work of Pich\'e, and where the hysteretic part is handled explicitly. A cantilever beam example is solved in detail using high mesh refinement. Convergence is good for lower damping and a smoother hysteresis loop. For a less smooth hysteresis loop and/or higher damping, convergence is observed to be roughly linear on average. Encouragingly, the time step needed for stability is much larger than the time period of the highest natural frequency of the structural model. Subsequently, data from several simulations conducted using the above semi-implicit method are used to construct reduced order models of the system, where the structural dynamics is projected onto a small number of modes and the number of hysteretic states is reduced significantly as well. Convergence studies of error against the number of retained hysteretic states show very good results.


title: Andreev bound states at boundaries of polarized 2D Fermi superfluids with s-wave pairing and spin-orbit coupling

abstract: A topological superfluid phase characterized by an emergent chiral-p-wave pair potential is expected to form in a two-dimensional Fermi superfluid subject to s-wave pairing, spin-orbit coupling and a large-enough Zeeman splitting. Andreev bound states appear at phase boundaries, including Majorana zero modes whose existence is assured by the bulk-boundary correspondence principle. Here we study the physical properties of these subgap-energy bound states at step-like interfaces using the spin-resolved Bogoliubov-deGennes mean-field formalism and assuming small spin-orbit coupling. Extending a recently developed spin-projection technique based on Feshbach partitioning [SciPost Phys. 5, 016 (2018)] combined with the Andreev approximation allows us to obtain remarkably simple analytical expressions for the bound-state energies as well as the majority and minority spin components of their wave functions. Besides the vacuum boundary, where a majority-spin Majorana excitation is encountered, we also consider the boundary between the topological and a nontopological superfluid phase that can appear in a coexistence scenario due to the first-order topological phase transition predicted for this system. At this superfluid-superfluid interface, we find a localized chiral Majorana mode hosted by the minority-spin sector. Our theory further predicts majority-spin subgap-energy bound states similar to those found at a Josephson junction between same-chirality p-wave superfluids. Their presence affects the Majorana mode due to a coupling of minority and majority spin sectors only in the small energy range where their spectra overlap. Our results may inform experimental efforts aimed at realizing and characterizing unconventional Majorana quasiparticles.


title: Dual-Geometric Space Embedding Model for Two-View Knowledge Graphs

abstract: Two-view knowledge graphs (KGs) jointly represent two components: an ontology view for abstract and commonsense concepts, and an instance view for specific entities that are instantiated from ontological concepts. As such, these KGs contain heterogeneous structures that are hierarchical, from the ontology-view, and cyclical, from the instance-view. Despite these various structures in KGs, most recent works on embedding KGs assume that the entire KG belongs to only one of the two views but not both simultaneously. For works that seek to put both views of the KG together, the instance and ontology views are assumed to belong to the same geometric space, such as all nodes embedded in the same Euclidean space or non-Euclidean product space, an assumption no longer reasonable for two-view KGs where different portions of the graph exhibit different structures. To address this issue, we define and construct a dual-geometric space embedding model (DGS) that models two-view KGs using a complex non-Euclidean geometric space, by embedding different portions of the KG in different geometric spaces. DGS utilizes the spherical space, hyperbolic space, and their intersecting space in a unified framework for learning embeddings. Furthermore, for the spherical space, we propose novel closed spherical space operators that directly operate in the spherical space without the need for mapping to an approximate tangent space. Experiments on public datasets show that DGS significantly outperforms previous state-of-the-art baseline models on KG completion tasks, demonstrating its ability to better model heterogeneous structures in KGs.


title: Theory of functional principal component analysis for discretely observed data

abstract: Functional data analysis is an important research field in statistics which treats data as random functions drawn from some infinite-dimensional functional space, and functional principal component analysis (FPCA) based on eigen-decomposition plays a central role for data reduction and representation. After nearly three decades of research, there remains a key problem unsolved, namely, the perturbation analysis of covariance operator for diverging number of eigencomponents obtained from noisy and discretely observed data. This is fundamental for studying models and methods based on FPCA, while there has not been substantial progress since Hall, M\"uller and Wang (2006)'s result for a fixed number of eigenfunction estimates. In this work, we aim to establish a unified theory for this problem, obtaining upper bounds for eigenfunctions with diverging indices in both the $\mathcal{L}^2$ and supremum norms, and deriving the asymptotic distributions of eigenvalues for a wide range of sampling schemes. Our results provide insight into the phenomenon when the $\mathcal{L}^{2}$ bound of eigenfunction estimates with diverging indices is minimax optimal as if the curves are fully observed, and reveal the transition of convergence rates from nonparametric to parametric regimes in connection to sparse or dense sampling. We also develop a double truncation technique to handle the uniform convergence of estimated covariance and eigenfunctions. The technical arguments in this work are useful for handling the perturbation series with noisy and discretely observed functional data and can be applied in models or those involving inverse problems based on FPCA as regularization, such as functional linear regression.


title: Walk-and-Relate: A Random-Walk-based Algorithm for Representation Learning on Sparse Knowledge Graphs

abstract: Knowledge graph (KG) embedding techniques use structured relationships between entities to learn low-dimensional representations of entities and relations. The traditional KG embedding techniques (such as TransE and DistMult) estimate these embeddings via simple models developed over observed KG triplets. These approaches differ in their triplet scoring loss functions. As these models only use the observed triplets to estimate the embeddings, they are prone to suffer through data sparsity that usually occurs in the real-world knowledge graphs, i.e., the lack of enough triplets per entity. To settle this issue, we propose an efficient method to augment the number of triplets to address the problem of data sparsity. We use random walks to create additional triplets, such that the relations carried by these introduced triplets entail the metapath induced by the random walks. We also provide approaches to accurately and efficiently filter out informative metapaths from the possible set of metapaths, induced by the random walks. The proposed approaches are model-agnostic, and the augmented training dataset can be used with any KG embedding approach out of the box. Experimental results obtained on the benchmark datasets show the advantages of the proposed approach.


title: S$^3$R: Self-supervised Spectral Regression for Hyperspectral Histopathology Image Classification

abstract: Benefited from the rich and detailed spectral information in hyperspectral images (HSI), HSI offers great potential for a wide variety of medical applications such as computational pathology. But, the lack of adequate annotated data and the high spatiospectral dimensions of HSIs usually make classification networks prone to overfit. Thus, learning a general representation which can be transferred to the downstream tasks is imperative. To our knowledge, no appropriate self-supervised pre-training method has been designed for histopathology HSIs. In this paper, we introduce an efficient and effective Self-supervised Spectral Regression (S$^3$R) method, which exploits the low rank characteristic in the spectral domain of HSI. More concretely, we propose to learn a set of linear coefficients that can be used to represent one band by the remaining bands via masking out these bands. Then, the band is restored by using the learned coefficients to reweight the remaining bands. Two pre-text tasks are designed: (1)S$^3$R-CR, which regresses the linear coefficients, so that the pre-trained model understands the inherent structures of HSIs and the pathological characteristics of different morphologies; (2)S$^3$R-BR, which regresses the missing band, making the model to learn the holistic semantics of HSIs. Compared to prior arts i.e., contrastive learning methods, which focuses on natural images, S$^3$R converges at least 3 times faster, and achieves significant improvements up to 14% in accuracy when transferring to HSI classification tasks.


title: Optimal Sparse Estimation of High Dimensional Heavy-tailed Time Series

abstract: Recently, high dimensional vector auto-regressive models (VAR), have attracted a lot of interest, due to novel applications in the health, engineering and social sciences. The presence of temporal dependence poses additional challenges to the theory of penalized estimation techniques widely used in the analysis of their iid counterparts. However, recent work (e.g., [Basu and Michailidis, 2015, Kock and Callot, 2015]) has established optimal consistency of $\ell_1$-LASSO regularized estimates applied to models involving high dimensional stable, Gaussian processes. The only price paid for temporal dependence is an extra multiplicative factor that equals 1 for independent and identically distributed (iid) data. Further, [Wong et al., 2020] extended these results to heavy tailed VARs that exhibit "$\beta$-mixing" dependence, but the rates rates are sub-optimal, while the extra factor is intractable. This paper improves these results in two important directions: (i) We establish optimal consistency rates and corresponding finite sample bounds for the underlying model parameters that match those for iid data, modulo a price for temporal dependence, that is easy to interpret and equals 1 for iid data. (ii) We incorporate more general penalties in estimation (which are not decomposable unlike the $\ell_1$ norm) to induce general sparsity patterns. The key technical tool employed is a novel, easy-to-use concentration bound for heavy tailed linear processes, that do not rely on "mixing" notions and give tighter bounds.


title: TANDEM3D: Active Tactile Exploration for 3D Object Recognition

abstract: Tactile recognition of 3D objects remains a challenging task. Compared to 2D shapes, the complex geometry of 3D surfaces requires richer tactile signals, more dexterous actions, and more advanced encoding techniques. In this work, we propose TANDEM3D, a method that applies a co-training framework for exploration and decision making to 3D object recognition with tactile signals. Starting with our previous work, which introduced a co-training paradigm for 2D recognition problems, we introduce a number of advances that enable us to scale up to 3D. TANDEM3D is based on a novel encoder that builds 3D object representation from contact positions and normals using PointNet++. Furthermore, by enabling 6DOF movement, TANDEM3D explores and collects discriminative touch information with high efficiency. Our method is trained entirely in simulation and validated with real-world experiments. Compared to state-of-the-art baselines, TANDEM3D achieves higher accuracy and a lower number of actions in recognizing 3D objects and is also shown to be more robust to different types and amounts of sensor noise. Video is available at https://jxu.ai/tandem3d.


title: CATER: Intellectual Property Protection on Text Generation APIs via Conditional Watermarks

abstract: Previous works have validated that text generation APIs can be stolen through imitation attacks, causing IP violations. In order to protect the IP of text generation APIs, a recent work has introduced a watermarking algorithm and utilized the null-hypothesis test as a post-hoc ownership verification on the imitation models. However, we find that it is possible to detect those watermarks via sufficient statistics of the frequencies of candidate watermarking words. To address this drawback, in this paper, we propose a novel Conditional wATERmarking framework (CATER) for protecting the IP of text generation APIs. An optimization method is proposed to decide the watermarking rules that can minimize the distortion of overall word distributions while maximizing the change of conditional word selections. Theoretically, we prove that it is infeasible for even the savviest attacker (they know how CATER works) to reveal the used watermarks from a large pool of potential word pairs based on statistical inspection. Empirically, we observe that high-order conditions lead to an exponential growth of suspicious (unused) watermarks, making our crafted watermarks more stealthy. In addition, \cater can effectively identify the IP infringement under architectural mismatch and cross-domain imitation attacks, with negligible impairments on the generation quality of victim APIs. We envision our work as a milestone for stealthily protecting the IP of text generation APIs.


title: Playing Technique Detection by Fusing Note Onset Information in Guzheng Performance

abstract: The Guzheng is a kind of traditional Chinese instruments with diverse playing techniques. Instrument playing techniques (IPT) play an important role in musical performance. However, most of the existing works for IPT detection show low efficiency for variable-length audio and provide no assurance in the generalization as they rely on a single sound bank for training and testing. In this study, we propose an end-to-end Guzheng playing technique detection system using Fully Convolutional Networks that can be applied to variable-length audio. Because each Guzheng playing technique is applied to a note, a dedicated onset detector is trained to divide an audio into several notes and its predictions are fused with frame-wise IPT predictions. During fusion, we add the IPT predictions frame by frame inside each note and get the IPT with the highest probability within each note as the final output of that note. We create a new dataset named GZ_IsoTech from multiple sound banks and real-world recordings for Guzheng performance analysis. Our approach achieves 87.97% in frame-level accuracy and 80.76% in note-level F1-score, outperforming existing works by a large margin, which indicates the effectiveness of our proposed method in IPT detection.


title: Operator estimates for Neumann sieve problem

abstract: Let $\Omega$ be a domain in $\mathbb{R}^n$, $\Gamma$ be a hyperplane intersecting $\Omega$, $\varepsilon>0$ be a small parameter, and $D_{k,\varepsilon}$, $k=1,2,3\dots$ be a family of small "holes" in $\Gamma\cap\Omega$; when $\varepsilon \to 0$, the number of holes tends to infinity, while their diameters tends to zero. Let $\mathscr{A}_\varepsilon$ be the Neumann Laplacian in the perforated domain $\Omega_\varepsilon=\Omega\setminus\Gamma_\varepsilon$, where $\Gamma_\varepsilon=\Gamma\setminus (\cup_k D_{k,\varepsilon})$ ("sieve"). It is well-known that if the sizes of holes are carefully chosen, $\mathscr{A}_\varepsilon$ converges in the strong resolvent sense to the Laplacian on $\Omega\setminus\Gamma$ subject to the so-called $\delta'$-conditions on $\Gamma$. In the current work we improve this result: under rather general assumptions on the shapes and locations of the holes we derive estimates on the rate of convergence in terms of $L^2\to L^2$ and $L^2\to H^1$ operator norms; in the latter case a special corrector is required.


title: NeRF-SOS: Any-View Self-supervised Object Segmentation on Complex Scenes

abstract: Neural volumetric representations have shown the potential that Multi-layer Perceptrons (MLPs) can be optimized with multi-view calibrated images to represent scene geometry and appearance, without explicit 3D supervision. Object segmentation can enrich many downstream applications based on the learned radiance field. However, introducing hand-crafted segmentation to define regions of interest in a complex real-world scene is non-trivial and expensive as it acquires per view annotation. This paper carries out the exploration of self-supervised learning for object segmentation using NeRF for complex real-world scenes. Our framework, called NeRF with Self-supervised Object Segmentation NeRF-SOS, couples object segmentation and neural radiance field to segment objects in any view within a scene. By proposing a novel collaborative contrastive loss in both appearance and geometry levels, NeRF-SOS encourages NeRF models to distill compact geometry-aware segmentation clusters from their density fields and the self-supervised pre-trained 2D visual features. The self-supervised object segmentation framework can be applied to various NeRF models that both lead to photo-realistic rendering results and convincing segmentation maps for both indoor and outdoor scenarios. Extensive results on the LLFF, Tank & Temple, and BlendedMVS datasets validate the effectiveness of NeRF-SOS. It consistently surpasses other 2D-based self-supervised baselines and predicts finer semantics masks than existing supervised counterparts. Please refer to the video on our project page for more details:https://zhiwenfan.github.io/NeRF-SOS.


title: Efficient Information Retrieval for Sensing via Continuous Measurement

abstract: Continuous monitoring of driven-dissipative quantum optical systems is a crucial element in the implementation of quantum metrology, providing essential strategies for achieving highly precise measurements beyond the classical limit. In this context, the relevant figure of merit is the quantum Fisher information of the radiation field emitted by the driven-dissipative sensor. Saturation of the corresponding precision limit as defined by the quantum Cramer-Rao bound is typically not achieved by conventional, temporally local continuous measurement schemes such as counting or homodyning. To address the outstanding open challenge of efficient retrieval of the quantum Fisher information of the emission field, we design a novel continuous measurement strategy featuring temporally quasilocal measurement bases as captured by matrix product states. Such measurement can be implemented effectively by injecting the emission field of the sensor into an auxiliary open system, a `quantum decoder' module, which `decodes' specific input matrix product states into simple product states as its output field, and performing conventional continuous measurement at the output. We devise a universal recipe for the construction of the decoder by exploiting time reversal transformation of quantum optical input-output channels, thereby establishing a universal method to achieve the quantum Cramer-Rao precision limit for generic sensors based on continuous measurement. As a by-product, we establish an effective formula for the evaluation of the quantum Fisher information of the emission field of generic driven-dissipative open sensors. We illustrate the power of our scheme with paramagnetic open sensor designs including linear force sensors, fibre-interfaced nonlinear emitters, and driven-dissipative many-body sensors, and demonstrate that it can be robustly implemented under realistic experimental imperfections.


title: Price Formation in Field Prediction Markets: the Wisdom in the Crowd

abstract: Prediction markets are a popular, prominent, and successful structure for a collective intelligence platform. However the exact mechanism by which information known to the participating traders is incorporated into the market price is unknown. Kyle (1985) detailed a model for price formation in continuous auctions with information distributed heterogeneously amongst market participants. This paper demonstrates a novel method derived from the Kyle model applied to data from a field experiment prediction market. The method is able to identify traders whose trades have price impact that adds a significant amount of information to the market price. Traders who are not identified as informed in aggregate have price impact consistent with noise trading. Results are reproduced on other prediction market datasets. Ultimately the results provide strong evidence in favor of the Kyle model in a field market setting, and highlight an under-discussed advantage of prediction markets over alternative group forecasting mechanisms: that the operator of the market does not need to have information on the distribution of information amongst participating traders.


title: Neural-Symbolic Entangled Framework for Complex Query Answering

abstract: Answering complex queries over knowledge graphs (KG) is an important yet challenging task because of the KG incompleteness issue and cascading errors during reasoning. Recent query embedding (QE) approaches to embed the entities and relations in a KG and the first-order logic (FOL) queries into a low dimensional space, answering queries by dense similarity search. However, previous works mainly concentrate on the target answers, ignoring intermediate entities' usefulness, which is essential for relieving the cascading error problem in logical query answering. In addition, these methods are usually designed with their own geometric or distributional embeddings to handle logical operators like union, intersection, and negation, with the sacrifice of the accuracy of the basic operator - projection, and they could not absorb other embedding methods to their models. In this work, we propose a Neural and Symbolic Entangled framework (ENeSy) for complex query answering, which enables the neural and symbolic reasoning to enhance each other to alleviate the cascading error and KG incompleteness. The projection operator in ENeSy could be any embedding method with the capability of link prediction, and the other FOL operators are handled without parameters. With both neural and symbolic reasoning results contained, ENeSy answers queries in ensembles. ENeSy achieves the SOTA performance on several benchmarks, especially in the setting of the training model only with the link prediction task.


title: Inverse problem for a time-dependent Convection-diffusion equation in admissible geometries

abstract: We consider a partial data inverse problem for a time-dependent convection-diffusion equation on an admissible manifold. We prove that the time-dependent convection term and time-dependent density can be recovered uniquely modulo a known gauge invariance. There have been several works on inverse problems related to the steady state convection-diffusion operator in Euclidean as well as in Riemannian geometry settings; however, inverse problems related to time-dependent convection-diffusion equation on a manifold are not studied in the prior works, which is the main aim of this paper. In fact, to the best of our knowledge, the problem studied here is the first work related to a partial data inverse problem for recovering both first and zeroth-order time-dependent perturbations of evolution equations in the Riemannian geometry setting.


title: Soliton cellular automata for the affine general linear Lie superalgebra

abstract: The box-ball system (BBS) is a cellular automaton that is an ultradiscrete analogue of the Korteweg--de Vries equation, a non-linear PDE used to model water waves. In 2001, Hikami and Inoue generalised the BBS to the general linear Lie superalgebra $\mathfrak{gl}(m|n)$. We further generalise the Hikami--Inoue BBS to column tableaux using the Kirillov--Reshetikhin crystals for $\hat{\mathfrak{gl}}{(m|n)}$ devised by Kwon and Okado (arXiv:1804.05456), where we find similar solitonic behaviour under certain conditions.


title: Vibration induced transparency: Simulating an optomechanical system via the cavity QED setup with a movable atom

abstract: We simulate an optomechanical system via a cavity QED scenario with a movable atom and investigate its application in the tiny mass sensing. We find that the steady-state solution of the system exhibits a multiple stability behavior, which is similar to that in the optomechanical system. We explain this phenomenon by the opto-mechanical interaction term in the effective Hamiltonian. Due to the dressed states formed by the effective coupling between the vibration degree of the atom and the optical mode in the cavity, we observe a narrow transparent window in the output field. We utilize this vibration induced transparency phenomenon to perform the tiny mass sensing. We hope our study will broaden the application of the cavity QED system to quantum technologies.


title: The fate of baryons in counterfactual universes

abstract: We present results from nine simulations that compare the standard $\Lambda$ Cold Dark Matter cosmology ($\Lambda$CDM) with counterfactual universes, for approximately $100\,{\rm Gyr}$ using the Enzo simulation code. We vary the value of $\Lambda$ and the fluctuation amplitude to explore the effect on the evolution of the halo mass function (HMF), the intergalactic medium (IGM) and the star formation history (SFH). The distinct peak in star formation rate density (SFRD) and its subsequent decline are both affected by the interplay between gravitational attraction and the accelerating effects of $\Lambda$. The IGM cools down more rapidly in models with a larger $\Lambda$ and also with a lower $\sigma_8$, reflecting the reduced SFRD associated with these changes -- although changing $\sigma_8$ is not degenerate with changing $\Lambda$, either regarding the thermal history of the IGM or the SFH. However, these induced changes to the IGM or ionizing background have little impact on the calculated SFRD. We provide fits for the evolution of the SFRD in these different universes, which we integrate over time to derive an asymptotic star formation efficiency. Together with Weinberg's uniform prior on $\Lambda$, the estimated probability of observers experiencing a value of $\Lambda$ no greater than the observed value is 13%, substantially larger than some alternative estimates. Within the Enzo model framework, then, observer selection within a multiverse is able to account statistically for the small value of the cosmological constant, although $\Lambda$ in our universe does appear to be at the low end of the predicted range.


title: Study of multiplicity dependence of heavy flavor production in p-p collisions using rope hadronization mechanism

abstract: The multiplicity dependence of the production of the charm mesons in p$-$p collisions at $\sqrt{s} = 7$ TeV and 13 TeV as measured by ALICE experiment has been investigated using Pythia 8 event generator by studying the effect of various processes at partonic level such as the effect of different modes of color reconnections and rope hadronization. The relative yields ($\rm Yield/\langle Yield \rangle$) of D-mesons and $J/\psi$ as a function of relative charged particle multiplicity for various transverse momentum ($p\textsubscript{T}$) ranges as measured by the ALICE experiment are in reasonable agreement with the estimations of Pythia 8 model within the framework of microscopic processes. The relative yields of B mesons for various $p\textsubscript{T}$ intervals ($1 < p_{T} < 20$ GeV/$c$) have also been predicted in p$-$p collisions at $\sqrt{s} = 7$ TeV and $\sqrt{s} = 13$ TeV.


title: A Robust Distributed Model Predictive Control Framework for Consensus of Multi-Agent Systems with Input Constraints and Varying Delays

abstract: This paper studies the consensus problem of general linear discrete-time multi-agent systems (MAS) with input constraints and bounded time-varying communication delays. We propose a robust distributed model predictive control (DMPC) consensus protocol that integrates the offline consensus design with online DMPC optimization to exploit their respective advantages. More precisely, each agent is equipped with an offline consensus protocol, which is a priori designed, depending on its immediate neighbors' estimated states. Further, the estimation errors propagated over time due to inexact neighboring information are proved bounded under mild technical assumptions, based on which a robust DMPC strategy is deliberately designed to achieve robust consensus while satisfying input constraints. Moreover, it is shown that, with the suitably designed cost function and constraints, the feasibility of the associated optimization problem can be recursively ensured. We further provide the consensus convergence result of the constrained MAS in the presence of bounded varying delays. Finally, two numerical examples are given to verify the effectiveness of the proposed distributed consensus algorithm.


title: Capacity Analysis and Sum Rate Maximization for the SCMA Cellular Network Coexisting with D2D Communications

abstract: Sparse code multiple access (SCMA) is the most concerning scheme among non-orthogonal multiple access (NOMA) technologies for 5G wireless communication new interface. Another efficient technique in 5G aimed to improve spectral efficiency for local communications is device-to-device (D2D) communications. Therefore, we utilize the SCMA cellular network coexisting with D2D communications for the connection demand of the Internet of things (IOT), and improve the system sum rate performance of the hybrid network. We first derive the information-theoretic expression of the capacity for all users and find the capacity bound of cellular users based on the mutual interference between cellular users and D2D users. Then we consider the power optimization problem for the cellular users and D2D users jointly to maximize the system sum rate. To tackle the non-convex optimization problem, we propose a geometric programming (GP) based iterative power allocation algorithm. Simulation results demonstrate that the proposed algorithm converges fast and well improves the sum rate performance.


title: Squeezing stationary distributions of stochastic chemical reaction systems

abstract: Stochastic modeling of chemical reaction systems based on master equations has been an indispensable tool in physical sciences. In the long-time limit, the properties of these systems are characterized by stationary distributions of chemical master equations. In this paper, we describe a novel method for computing stationary distributions analytically, based on a parallel formalism between stochastic chemical reaction systems and second quantization. Anderson, Craciun, and Kurtz showed that, when the rate equation for a reaction network admits a complex-balanced steady-state solution, the corresponding stochastic reaction system has a stationary distribution of a product form of Poisson distributions. In a formulation of stochastic reaction systems using the language of second quantization initiated by Doi, product-form Poisson distributions correspond to coherent states. Pursuing this analogy further, we study the counterpart of squeezed states in stochastic reaction systems. Under the action of a squeeze operator, the time-evolution operator of the chemical master equation is transformed, and the resulting system describes a different reaction network, which does not admit a complex-balanced steady state. A squeezed coherent state gives the stationary distribution of the transformed network, for which analytic expression is obtained.


title: Scale Attention for Learning Deep Face Representation: A Study Against Visual Scale Variation

abstract: Human face images usually appear with wide range of visual scales. The existing face representations pursue the bandwidth of handling scale variation via multi-scale scheme that assembles a finite series of predefined scales. Such multi-shot scheme brings inference burden, and the predefined scales inevitably have gap from real data. Instead, learning scale parameters from data, and using them for one-shot feature inference, is a decent solution. To this end, we reform the conv layer by resorting to the scale-space theory, and achieve two-fold facilities: 1) the conv layer learns a set of scales from real data distribution, each of which is fulfilled by a conv kernel; 2) the layer automatically highlights the feature at the proper channel and location corresponding to the input pattern scale and its presence. Then, we accomplish the hierarchical scale attention by stacking the reformed layers, building a novel style named SCale AttentioN Conv Neural Network (\textbf{SCAN-CNN}). We apply SCAN-CNN to the face recognition task and push the frontier of SOTA performance. The accuracy gain is more evident when the face images are blurry. Meanwhile, as a single-shot scheme, the inference is more efficient than multi-shot fusion. A set of tools are made to ensure the fast training of SCAN-CNN and zero increase of inference cost compared with the plain CNN.


title: Persistent Identification and Interlinking of FAIR Scholarly Knowledge

abstract: We leverage the Open Research Knowledge Graph - a scholarly infrastructure that supports the creation, curation, and reuse of structured, semantic scholarly knowledge - and present an approach for persistent identification of FAIR scholarly knowledge. We propose a DOI-based persistent identification of ORKG Papers, which are machine-actionable descriptions of the essential information published in scholarly articles. This enables the citability of FAIR scholarly knowledge and its discovery in global scholarly communication infrastructures (e.g., DataCite, OpenAIRE, and ORCID). While publishing, the state of the ORKG Paper is saved and cannot be further edited. To allow for updating published versions, ORKG supports creating new versions, which are linked in provenance chains. We demonstrate the linking of FAIR scholarly knowledge with digital artefacts (articles), agents (researchers) and other objects (organizations). We persistently identify FAIR scholarly knowledge (namely, ORKG Papers and ORKG Comparisons as collections of ORKG Papers) by leveraging DataCite services. Given the existing interoperability between DataCite, Crossref, OpenAIRE and ORCID, sharing metadata with DataCite ensures global findability of FAIR scholarly knowledge in scholarly communication infrastructures.


title: D&D: Learning Human Dynamics from Dynamic Camera

abstract: 3D human pose estimation from a monocular video has recently seen significant improvements. However, most state-of-the-art methods are kinematics-based, which are prone to physically implausible motions with pronounced artifacts. Current dynamics-based methods can predict physically plausible motion but are restricted to simple scenarios with static camera view. In this work, we present D&D (Learning Human Dynamics from Dynamic Camera), which leverages the laws of physics to reconstruct 3D human motion from the in-the-wild videos with a moving camera. D&D introduces inertial force control (IFC) to explain the 3D human motion in the non-inertial local frame by considering the inertial forces of the dynamic camera. To learn the ground contact with limited annotations, we develop probabilistic contact torque (PCT), which is computed by differentiable sampling from contact probabilities and used to generate motions. The contact state can be weakly supervised by encouraging the model to generate correct motions. Furthermore, we propose an attentive PD controller that adjusts target pose states using temporal information to obtain smooth and accurate pose control. Our approach is entirely neural-based and runs without offline optimization or simulation in physics engines. Experiments on large-scale 3D human motion benchmarks demonstrate the effectiveness of D&D, where we exhibit superior performance against both state-of-the-art kinematics-based and dynamics-based methods. Code is available at https://github.com/Jeffsjtu/DnD


title: DifferSketching: How Differently Do People Sketch 3D Objects?

abstract: Multiple sketch datasets have been proposed to understand how people draw 3D objects. However, such datasets are often of small scale and cover a small set of objects or categories. In addition, these datasets contain freehand sketches mostly from expert users, making it difficult to compare the drawings by expert and novice users, while such comparisons are critical in informing more effective sketch-based interfaces for either user groups. These observations motivate us to analyze how differently people with and without adequate drawing skills sketch 3D objects. We invited 70 novice users and 38 expert users to sketch 136 3D objects, which were presented as 362 images rendered from multiple views. This leads to a new dataset of 3,620 freehand multi-view sketches, which are registered with their corresponding 3D objects under certain views. Our dataset is an order of magnitude larger than the existing datasets. We analyze the collected data at three levels, i.e., sketch-level, stroke-level, and pixel-level, under both spatial and temporal characteristics, and within and across groups of creators. We found that the drawings by professionals and novices show significant differences at stroke-level, both intrinsically and extrinsically. We demonstrate the usefulness of our dataset in two applications: (i) freehand-style sketch synthesis, and (ii) posing it as a potential benchmark for sketch-based 3D reconstruction. Our dataset and code are available at https://chufengxiao.github.io/DifferSketching/.


title: In vivo whole-cell recording from morphologically identified mouse superior colliculus neurons

abstract: In vivo whole-cell recording when combined with morphological characterization after biocytin labeling is a powerful technique to study subthreshold synaptic processing in cell-type-identified neuronal populations. Here, we provide a step-by-step procedure for performing whole-cell recordings in the superior colliculus of urethane-anesthetized mice, a major visual processing region in the rodent brain. Two types of visual stimulation methods are described. While we focus on superior colliculus neurons, this protocol is applicable to other brain areas.


title: A Generalized Argmax Theorem with Applications

abstract: The argmax theorem is a useful result for deriving the limiting distribution of estimators in many applications. The conclusion of the argmax theorem states that the argmax of a sequence of stochastic processes converges in distribution to the argmax of a limiting stochastic process. This paper generalizes the argmax theorem to allow the maximization to take place over a sequence of subsets of the domain. If the sequence of subsets converges to a limiting subset, then the conclusion of the argmax theorem continues to hold. We demonstrate the usefulness of this generalization in three applications: estimating a structural break, estimating a parameter on the boundary of the parameter space, and estimating a weakly identified parameter. The generalized argmax theorem simplifies the proofs for existing results and can be used to prove new results in these literatures.


title: Gl2 Foam Functoriality and Skein Positivity

abstract: We prove full functoriality of Khovanov homology for tangled framed gl2 webs. We use this functoriality result to prove a strong positivity result for (orientable) surface skein algebras. The argument goes categorical and consists in proving that so-called linear complexes are stable under superposition.


title: AutoLV: Automatic Lecture Video Generator

abstract: We propose an end-to-end lecture video generation system that can generate realistic and complete lecture videos directly from annotated slides, instructor's reference voice and instructor's reference portrait video. Our system is primarily composed of a speech synthesis module with few-shot speaker adaptation and an adversarial learning-based talking-head generation module. It is capable of not only reducing instructors' workload but also changing the language and accent which can help the students follow the lecture more easily and enable a wider dissemination of lecture contents. Our experimental results show that the proposed model outperforms other current approaches in terms of authenticity, naturalness and accuracy. Here is a video demonstration of how our system works, and the outcomes of the evaluation and comparison: https://youtu.be/cY6TYkI0cog.


title: Flavor Structures of Quarks and Leptons from Flipped SU(5) GUT with $A_4$ Modular Flavor Symmetry

abstract: We propose to generate the flavor structures of the Standard Model plus neutrinos from flipped SU(5) GUT with $A_4$ modular flavor symmetry. Possible way to assign different moduli values for quarks and leptons in modular GUT scheme is discussed. We propose to reduce the multiple modular symmetries to a single modular symmetry in the low energy effective theory with proper boundary conditions. We classify all possible scenarios in this scheme according to the assignments of the modular $A_4$ representations for matter superfields and give the expressions of the quark and lepton mass matrices predicted by our scheme at the GUT scale. After properly selecting the modular weights for various superfields that can lead to better fitting, we can obtain the best-fit points with the corresponding $\chi^2$ values for the sample subscenarios. We find that the flavor structures of the Standard Model plus neutrinos can be fitted perfectly in such a $A_4$ modular flavor GUT scheme with single or two modulus fields. Especially, the $\chi^2_{total}$ of our fitting can be as low as $1.558$ for sample ${\bf IX^\prime}$ of scenario ${\bf III}$ even if only a single common modulus field for both quark and lepton sectors is adopted. The most predictive scenario ${\bf III}$, in which all superfields transform as triplets of $A_4$, can be fitted much better with two independent moduli fields $\tau_q,\tau_l$ for quark sector and lepton sector ($\chi^2_{total}\approx 95$) than that with the single modulus case ($\chi^2_{total}\approx 282.4$).


title: Boundedness of Fano type fibrations

abstract: In this paper, we prove various results on boundedness and singularities of Fano fibrations and of Fano type fibrations. A Fano fibration is a projective morphism $X\to Z$ of algebraic varieties with connected fibres such that $X$ is Fano over $Z$, that is, $X$ has "good" singularities and $-K_X$ is ample over $Z$. A Fano type fibration is similarly defined where $X$ is assumed to be close to being Fano over $Z$. This class includes many central ingredients of birational geometry such as Fano varieties, Mori fibre spaces, flipping and divisorial contractions, crepant models, germs of singularities, etc. We develop the theory in the more general framework of log Calabi-Yau fibrations. Dans cet article, nous prouvons divers r\'esultats sur les limites et les singularit\'es de fibrations de Fano et les fibrations de type Fano. Une fibration de Fano est un morphisme projectif $X\to Z$ de vari\'et\'es alg\'ebriques \`a fibres connexes tel que $X$ est Fano sur $Z$, c'est-\`a-dire que $X$ a de "bonnes" singularit\'es et $-K_X$ est ample sur $Z$. Une fibration de type Fano est d\'efinie de fa\c{c}on similaire quand $X$ est suppos\'e \^etre proche d'\^etre Fano sur $Z$. Cette classe comprend de nombreux ingr\'edients centraux de g\'eom\'etrie birationnelle tels que les vari\'et\'es de fano, les espaces de fibres Mori, le flip et les contractions divisorielles, les mod\`eles r\'ep\'etiteurs, les germes de singularit\'es, etc. Nous d\'eveloppons la th\'eorie dans le cadre plus g\'en\'eral des log-fibrations de Calabi-Yau.


title: Height Zero Conjecture with Galois Automorphisms

abstract: We prove a strengthening of Brauer's height zero conjecture for principal 2-blocks with Galois automorphisms. This requires a new extension of the It\^o--Michler theorem for the prime~2, again with Galois automorphisms. We close, this time for odd primes $p$, with a new characterisation of $p$-closed groups via the decomposition numbers of certain characters.


title: Probing Spurious Correlations in Popular Event-Based Rumor Detection Benchmarks

abstract: As social media becomes a hotbed for the spread of misinformation, the crucial task of rumor detection has witnessed promising advances fostered by open-source benchmark datasets. Despite being widely used, we find that these datasets suffer from spurious correlations, which are ignored by existing studies and lead to severe overestimation of existing rumor detection performance. The spurious correlations stem from three causes: (1) event-based data collection and labeling schemes assign the same veracity label to multiple highly similar posts from the same underlying event; (2) merging multiple data sources spuriously relates source identities to veracity labels; and (3) labeling bias. In this paper, we closely investigate three of the most popular rumor detection benchmark datasets (i.e., Twitter15, Twitter16 and PHEME), and propose event-separated rumor detection as a solution to eliminate spurious cues. Under the event-separated setting, we observe that the accuracy of existing state-of-the-art models drops significantly by over 40%, becoming only comparable to a simple neural classifier. To better address this task, we propose Publisher Style Aggregation (PSA), a generalizable approach that aggregates publisher posting records to learn writing style and veracity stance. Extensive experiments demonstrate that our method outperforms existing baselines in terms of effectiveness, efficiency and generalizability.


title: A Realistic 3D Non-Stationary Channel Model for UAV-to-Vehicle Communications Incorporating Fuselage Posture

abstract: Considering the unmanned aerial vehicle (UAV) three-dimensional (3D) posture, a novel 3D non-stationary geometry-based stochastic model (GBSM) is proposed for multiple-input multiple-output (MIMO) UAV-to-vehicle (U2V) channels. It consists of a line-of-sight (LoS) and non-line-of-sight (NLoS) components. The factor of fuselage posture is considered by introducing a time-variant 3D posture matrix. Some important statistical properties, i.e. the temporal autocorrelation function (ACF) and spatial cross correlation function (CCF), are derived and investigated. Simulation results show that the fuselage posture has significant impact on the U2V channel characteristic and aggravate the non-stationarity. The agreements between analytical, simulated, and measured results verify the correctness of proposed model and derivations. Moreover, it is demonstrated that the proposed model is also compatible to the existing GBSM without considering fuselage posture.