title: Parallel Network with Channel Attention and Post-Processing for Carotid Arteries Vulnerable Plaque Segmentation in Ultrasound Images

abstract: Carotid arteries vulnerable plaques are a crucial factor in the screening of atherosclerosis by ultrasound technique. However, the plaques are contaminated by various noises such as artifact, speckle noise, and manual segmentation may be time-consuming. This paper proposes an automatic convolutional neural network (CNN) method for plaque segmentation in carotid ultrasound images using a small dataset. First, a parallel network with three independent scale decoders is utilized as our base segmentation network, pyramid dilation convolutions are used to enlarge receptive fields in the three segmentation sub-networks. Subsequently, the three decoders are merged to be rectified in channels by SENet. Thirdly, in test stage, the initially segmented plaque is refined by the max contour morphology post-processing to obtain the final plaque. Moreover, three loss function Dice loss, SSIM loss and cross-entropy loss are compared to segment plaques. Test results show that the proposed method with dice loss function yields a Dice value of 0.820, an IoU of 0.701, Acc of 0.969, and modified Hausdorff distance (MHD) of 1.43 for 30 vulnerable cases of plaques, it outperforms some of the conventional CNN-based methods on these metrics. Additionally, we apply an ablation experiment to show the validity of each proposed module. Our study provides some reference for similar researches and may be useful in actual applications for plaque segmentation of ultrasound carotid arteries.


title: Less is More: Learning to Refine Dialogue History for Personalized Dialogue Generation

abstract: Personalized dialogue systems explore the problem of generating responses that are consistent with the user's personality, which has raised much attention in recent years. Existing personalized dialogue systems have tried to extract user profiles from dialogue history to guide personalized response generation. Since the dialogue history is usually long and noisy, most existing methods truncate the dialogue history to model the user's personality. Such methods can generate some personalized responses, but a large part of dialogue history is wasted, leading to sub-optimal performance of personalized response generation. In this work, we propose to refine the user dialogue history on a large scale, based on which we can handle more dialogue history and obtain more abundant and accurate persona information. Specifically, we design an MSP model which consists of three personal information refiners and a personalized response generator. With these multi-level refiners, we can sparsely extract the most valuable information (tokens) from the dialogue history and leverage other similar users' data to enhance personalization. Experimental results on two real-world datasets demonstrate the superiority of our model in generating more informative and personalized responses.


title: Animal Kingdom: A Large and Diverse Dataset for Animal Behavior Understanding

abstract: Understanding animals' behaviors is significant for a wide range of applications. However, existing animal behavior datasets have limitations in multiple aspects, including limited numbers of animal classes, data samples and provided tasks, and also limited variations in environmental conditions and viewpoints. To address these limitations, we create a large and diverse dataset, Animal Kingdom, that provides multiple annotated tasks to enable a more thorough understanding of natural animal behaviors. The wild animal footages used in our dataset record different times of the day in extensive range of environments containing variations in backgrounds, viewpoints, illumination and weather conditions. More specifically, our dataset contains 50 hours of annotated videos to localize relevant animal behavior segments in long videos for the video grounding task, 30K video sequences for the fine-grained multi-label action recognition task, and 33K frames for the pose estimation task, which correspond to a diverse range of animals with 850 species across 6 major animal classes. Such a challenging and comprehensive dataset shall be able to facilitate the community to develop, adapt, and evaluate various types of advanced methods for animal behavior analysis. Moreover, we propose a Collaborative Action Recognition (CARe) model that learns general and specific features for action recognition with unseen new animals. This method achieves promising performance in our experiments. Our dataset can be found at https://sutdcv.github.io/Animal-Kingdom.


title: Almost global smooth solutions of the 3D quasilinear Klein-Gordon equations on the product space $\mathbb{R}^{2}\times \mathbb{T}$

abstract: In the paper, for the 3D quasilinear Klein-Gordon equation with the small initial data posed on the product space $\mathbb{R}^{2}\times \mathbb{T}$, we focus on the lower bound of the lifespan of the smooth solution. When the size of initial data is bounded by $\varepsilon_0>0$, by the space-time resonance method, it is shown that smooth solution exists up to the time $e^{c_{0}/\varepsilon_{0}^2}$ with $\varepsilon_0$ being sufficiently small and $c_0>0$ being some suitable constant.


title: Positioning Using Visible Light Communications: A Perspective Arcs Approach

abstract: Visible light positioning (VLP) is an accurate indoor positioning technology that uses luminaires as transmitters. In particular, circular luminaires are a common source type for VLP, that are typically treated only as point sources for positioning, while ignoring their geometry characteristics. In this paper, the arc feature of the circular luminaire and the coordinate information obtained via visible light communication (VLC) are jointly used for VLC-enabled indoor positioning, and a novel perspective arcs approach is proposed. The proposed approach does not rely on any inertial measurement unit, and has no tilted angle limitations at the user. First, a VLC assisted perspective circle and arc algorithm (V-PCA) is proposed for a scenario in which a complete luminaire and an incomplete one can be captured by the user. Considering the cases in which parts of VLC links are blocked, an anti-occlusion VLC assisted perspective arcs algorithm (OA-V-PA) is proposed. Simulation results show that the proposed indoor positioning algorithm can achieve a 95th percentile positioning accuracy of around 10 cm. Moreover, an experimental prototype based on mobile phone is implemented, in which, a fused image processing method is proposed. Experimental results show that the average positioning accuracy is less than 5 cm.


title: Intermittency of turbulent velocity and scalar fields using 3D local averaging

abstract: An efficient approach for extracting 3D local averages in spherical subdomains is proposed and applied to study the intermittency of small-scale velocity and scalar fields in direct numerical simulations of isotropic turbulence. We focus on the inertial-range scaling exponents of locally averaged energy dissipation rate, enstrophy and scalar dissipation rate corresponding to the mixing of a passive scalar $\theta$ in the presence of a uniform mean gradient. The Taylor-scale Reynolds number $R_\lambda$ goes up to $1300$, and the Schmidt number $Sc$ up to $512$ (albeit at smaller $R_\lambda$). The intermittency exponent of the energy dissipation rate is $\mu \approx 0.23$, whereas that of enstrophy is slightly larger; trends with $R_\lambda$ suggest that this will be the case even at extremely large $R_\lambda$. The intermittency exponent of the scalar dissipation rate is $\mu_\theta \approx 0.35$ for $Sc=1$. These findings are in essential agreement with previously reported results in the literature. We further show that $\mu_\theta$ decreases monotonically with increasing $Sc$, either as $1/\log Sc$ or a weak power law, suggesting that $\mu_\theta \to 0$ as $Sc \to \infty$, reaffirming recent results on the breakdown of scalar dissipation anomaly in this limit.


title: Proximate deconfined quantum critical point in SrCu2(BO3)2

abstract: The deconfined quantum critical point (DQCP) represents a paradigm shift in quantum matter studies, presenting a "beyond Landau" scenario for order--order transitions. Its experimental realization, however, has remained elusive. Using high-pressure $^{11}$B NMR measurements on the quantum magnet SrCu$_2$(BO$_3$)$_2$, we here demonstrate a magnetic-field induced plaquette-singlet to antiferromagnetic transition above 1.8 GPa at a remarkably low temperature, $T_{\rm c}\simeq 0.07$ K. First-order signatures of the transition weaken with increasing pressure, and we observe quantum critical scaling at the highest pressure, 2.4 GPa. Supported by model calculations, we suggest that these observations can be explained by a proximate DQCP inducing critical quantum fluctuations and emergent O(3) symmetry of the order parameters. Our findings take the DQCP from a theoretical concept to a concrete experimental platform.


title: A Practical Cross-Device Federated Learning Framework over 5G Networks

abstract: The concept of federated learning (FL) was first proposed by Google in 2016. Thereafter, FL has been widely studied for the feasibility of application in various fields due to its potential to make full use of data without compromising the privacy. However, limited by the capacity of wireless data transmission, the employment of federated learning on mobile devices has been making slow progress in practical. The development and commercialization of the 5th generation (5G) mobile networks has shed some light on this. In this paper, we analyze the challenges of existing federated learning schemes for mobile devices and propose a novel cross-device federated learning framework, which utilizes the anonymous communication technology and ring signature to protect the privacy of participants while reducing the computation overhead of mobile devices participating in FL. In addition, our scheme implements a contribution-based incentive mechanism to encourage mobile users to participate in FL. We also give a case study of autonomous driving. Finally, we present the performance evaluation of the proposed scheme and discuss some open issues in federated learning.


title: On Secure NOMA-Aided Semi-Grant-Free Systems

abstract: Semi-grant-free (SGF) transmission scheme enables grant-free (GF) users to utilize resource blocks allocated for grant-based (GB) users while maintaining the quality of service of GB users. This work investigates the secrecy performance of non-orthogonal multiple access (NOMA)-aided SGF systems. First, analytical expressions for the exact and asymptotic secrecy outage probability (SOP) of NOMA-aided SGF systems with a single GF user are derived. Then, the SGF systems with multiple GF users and the best-user scheduling scheme is considered. Analytical expressions for the exact and asymptotic SOP are derived by utilizing order statistics theory. Monte Carlo simulation results are provided and compared with two benchmark schemes. The effects of system parameters on the SOP of the considered system are demonstrated and the accuracy of the developed analytical results is verified. The results indicate that both the outage target rate for GB and the secure target rate for GF are the main factors of the secrecy performance of SGF systems.


title: Trinary Tools for Continuously Valued Binary Classifiers

abstract: Classification methods for binary (yes/no) tasks often produce a continuously valued score. Machine learning practitioners must perform model selection, calibration, discretization, performance assessment, tuning, and fairness assessment. Such tasks involve examining classifier results, typically using summary statistics and manual examination of details. In this paper, we provide an interactive visualization approach to support such continuously-valued classifier examination tasks. Our approach addresses the three phases of these tasks: calibration, operating point selection, and examination. We enhance standard views and introduce task-specific views so that they can be integrated into a multi-view coordination (MVC) system. We build on an existing comparison-based approach, extending it to continuous classifiers by treating the continuous values as trinary (positive, unsure, negative) even if the classifier will not ultimately use the 3-way classification. We provide use cases that demonstrate how our approach enables machine learning practitioners to accomplish key tasks.


title: Ingredient Extraction from Text in the Recipe Domain

abstract: In recent years, there has been an increase in the number of devices with virtual assistants (e.g: Siri, Google Home, Alexa) in our living rooms and kitchens. As a result of this, these devices receive several queries about recipes. All these queries will contain terms relating to a "recipe-domain" i.e: they will contain dish-names, ingredients, cooking times, dietary preferences etc. Extracting these recipe-relevant aspects from the query thus becomes important when it comes to addressing the user's information need. Our project focuses on extracting ingredients from such plain-text user utterances. Our best performing model was a fine-tuned BERT which achieved an F1-score of $95.01$. We have released all our code in a GitHub repository.


title: Walking to Infinity on the Fibonacci Sequence

abstract: An interesting open problem in number theory asks whether it is possible to walk to infinity on primes, where each term in the sequence has one more digit than the previous. In this paper, we study its variation where we walk on the Fibonacci sequence. We prove that all walks starting with a Fibonacci number and the following terms are Fibonacci numbers obtained by appending exactly one digit at a time to the right have a length of at most two. In the more general case where we append at most a bounded number of digits each time, we give a formula for the length of the longest walk.


title: A Deep Learning Galerkin Method for the Closed-Loop Geothermal System

abstract: There has been an arising trend of adopting deep learning methods to study partial differential equations (PDEs). This article is to propose a Deep Learning Galerkin Method (DGM) for the closed-loop geothermal system, which is a new coupled multi-physics PDEs and mainly consists of a framework of underground heat exchange pipelines to extract the geothermal heat from the geothermal reservoir. This method is a natural combination of Galerkin Method and machine learning with the solution approximated by a neural network instead of a linear combination of basis functions. We train the neural network by randomly sampling the spatiotemporal points and minimize loss function to satisfy the differential operators, initial condition, boundary and interface conditions. Moreover, the approximate ability of the neural network is proved by the convergence of the loss function and the convergence of the neural network to the exact solution in L^2 norm under certain conditions. Finally, some numerical examples are carried out to demonstrate the approximation ability of the neural networks intuitively.


title: Pricing Real-time Stochastic Storage Operations

abstract: Pricing storage operation in the real-time market under demand and generation stochasticities is considered. A scenario-based stochastic rolling-window dispatch model is formulated for the real-time market, consisting of conventional generators, utility-scale storage, and distributed energy resource aggregators. We show that uniform pricing mechanisms require discriminative out-of-the-market uplifts, making settlements under locational marginal pricing (LMP) discriminative. It is shown that the temporal locational marginal pricing (TLMP) that adds nonuniform shadow prices of ramping and state-of-charge to LMP removes the need for out-of-the-market uplifts. Truthful bidding incentives are also established for price-taking participants under TLMP. Revenue adequacy and uplifts are evaluated in numerical simulations.


title: On Riedtmann's Lie algebra of the gentle one-cycle algebra $\Lambda(n-1,1,1)$

abstract: An extended version of Riedtmann's Lie algebra of the gentle one-cycle algebra $\Lambda(n-1,1,1)$ is computed and is shown to admit a Cartan decomposition by the positive roots of the root system of type $\mathbf{BC}_n$.


title: Dynamic Position Encoding for Transformers

abstract: Recurrent models have been dominating the field of neural machine translation (NMT) for the past few years. Transformers \citep{vaswani2017attention}, have radically changed it by proposing a novel architecture that relies on a feed-forward backbone and self-attention mechanism. Although Transformers are powerful, they could fail to properly encode sequential/positional information due to their non-recurrent nature. To solve this problem, position embeddings are defined exclusively for each time step to enrich word information. However, such embeddings are fixed after training regardless of the task and the word ordering system of the source or target language. In this paper, we propose a novel architecture with new position embeddings depending on the input text to address this shortcoming by taking the order of target words into consideration. Instead of using predefined position embeddings, our solution generates new embeddings to refine each word's position information. Since we do not dictate the position of source tokens and learn them in an end-to-end fashion, we refer to our method as dynamic position encoding (DPE). We evaluated the impact of our model on multiple datasets to translate from English into German, French, and Italian and observed meaningful improvements in comparison to the original Transformer.


title: Detect Rumors in Microblog Posts for Low-Resource Domains via Adversarial Contrastive Learning

abstract: Massive false rumors emerging along with breaking news or trending topics severely hinder the truth. Existing rumor detection approaches achieve promising performance on the yesterday's news, since there is enough corpus collected from the same domain for model training. However, they are poor at detecting rumors about unforeseen events especially those propagated in different languages due to the lack of training data and prior knowledge (i.e., low-resource regimes). In this paper, we propose an adversarial contrastive learning framework to detect rumors by adapting the features learned from well-resourced rumor data to that of the low-resourced. Our model explicitly overcomes the restriction of domain and/or language usage via language alignment and a novel supervised contrastive training paradigm. Moreover, we develop an adversarial augmentation mechanism to further enhance the robustness of low-resource rumor representation. Extensive experiments conducted on two low-resource datasets collected from real-world microblog platforms demonstrate that our framework achieves much better performance than state-of-the-art methods and exhibits a superior capacity for detecting rumors at early stages.


title: Hawking Temperature for 4D-Einstein-Gauss-Bonnet Black Holes from uncertainty principle

abstract: Inspired by string theory, Heisenberg's uncertainty principle can be generalized to include the photon-electron gravitational interaction, which leads to the Generalized Uncertainty Principle (GUP). Although GUP considers gravitational uncertainty at the minimum fundamental length scale in physics, it does not consider the effects of spacetime curvature on quantum mechanical uncertainty relations. The Extended Uncertainty Principle (EUP) is a generalization of Heisenberg's Uncertainty Principle that, unlike the GUP, applies to large length scales. GEUP is also a linear combination of EUP and GUP that creates minimal uncertainty on large length scales. The Einstein-Gauss-Bonnet theory (EGB) can be considered as one of the most promising candidates for modified gravity. In this paper, by using GUP, EUP, and GEUP, we intend to obtain the Hawking temperature of a four-dimensional EGB black hole in the asymptotically flat and (Anti)-de Sitter spacetime. We show that coupling constant, cosmological constant, mass, and radius significantly affect Hawking temperature and decrease or increase Hawking temperature depending on the chosen horizons.


title: The Convergence of Circle Packings on Tori

abstract: The notion of circle packings has been explored intensively since Thurston proposed it as an approximation to conformal maps. One of the fundamental questions about circle packings is whether it converges to the Riemann mapping if the radius of the circles tends to zero. In this paper, we prove the convergence of circle packings to the maps induced by the uniformization theorem in a different sense proposed by Gu-Luo-Wu for surfaces of genus one. This is the first result of the convergence of circle packings on surfaces with nontrivial topology.


title: PrivateRec: Differentially Private Training and Serving for Federated News Recommendation

abstract: Collecting and training over sensitive personal data raise severe privacy concerns in personalized recommendation systems, and federated learning can potentially alleviate the problem by training models over decentralized user data.However, a theoretically private solution in both the training and serving stages of federated recommendation is essential but still lacking.Furthermore, naively applying differential privacy (DP) to the two stages in federated recommendation would fail to achieve a satisfactory trade-off between privacy and utility due to the high-dimensional characteristics of model gradients and hidden representations.In this work, we propose a federated news recommendation method for achieving a better utility in model training and online serving under a DP guarantee.We first clarify the DP definition over behavior data for each round in the life-circle of federated recommendation systems.Next, we propose a privacy-preserving online serving mechanism under this definition based on the idea of decomposing user embeddings with public basic vectors and perturbing the lower-dimensional combination coefficients. We apply a random behavior padding mechanism to reduce the required noise intensity for better utility. Besides, we design a federated recommendation model training method, which can generate effective and public basic vectors for serving while providing DP for training participants. We avoid the dimension-dependent noise for large models via label permutation and differentially private attention modules. Experiments on real-world news recommendation datasets validate that our method achieves superior utility under a DP guarantee in both training and serving of federated news recommendations.


title: Numerical computation of the equilibrium-reduced density matrix for strongly coupled open quantum systems

abstract: We describe a numerical algorithm for approximating the equilibrium-reduced density matrix and the effective (mean force) Hamiltonian for a set of system spins coupled strongly to a set of bath spins when the total system (system+bath) is held in canonical thermal equilibrium by weak coupling with a "super-bath". Our approach is a generalization of now standard typicality algorithms for computing the quantum expectation value of observables of bare quantum systems via trace estimators and Krylov subspace methods. In particular, our algorithm makes use of the fact that the reduced system density, when the bath is measured in a given random state, tends to concentrate about the corresponding thermodynamic averaged reduced system density. Theoretical error analysis and numerical experiments are given to validate the accuracy of our algorithm. Further numerical experiments demonstrate the potential of our approach for applications including the study of quantum phase transitions and entanglement entropy for long-range interaction systems.


title: Frustrated magnetic interactions in a Wigner-Mott insulator

abstract: Two-dimensional semiconductor moir\'e materials have emerged as a highly controllable platform to simulate and explore quantum condensed matter. Compared to real solids, electrons in semiconductor moir\'e materials are less strongly attracted to the moir\'e lattice sites, making the nonlocal contributions to the magnetic interactions as important as the Anderson super-exchange. It provides a unique platform to study the effects of competing magnetic interactions. Here, we report the observation of strongly frustrated magnetic interactions in a Wigner-Mott insulating state at 2/3 filling of the moir\'e lattice in angle-aligned WSe2/WS2 heterobilayers. Magneto-optical measurements show that the net exchange interaction is antiferromagnetic for filling factors below 1 with a strong suppression at 2/3 filling. The suppression is lifted upon screening of the long-range Coulomb interactions and melting of the Wigner-Mott insulator by a nearby metallic gate. The results can be qualitatively captured by a honeycomb-lattice spin model with an antiferromagnetic nearest-neighbor coupling and a ferromagnetic second-neighbor coupling. Our study establishes semiconductor moir\'e materials as a model system for the lattice-spin physics and frustrated magnetism.


title: Phase covariant channel: Quantum speed limit of evolution

abstract: The quantum speed of evolution for the phase covariant map is investigated. This involves absorption, emission and dephasing processes. We consider the maps under various combinations of the above processes to investigate the effect of phase covariant maps on quantum speed limit time. For absorption-free phase covariant maps, combinations of dissipative and CP-(in)divisible (non)-Markovian dephasing noises are considered. The role of coherence-mixedness balance on the speed limit time is checked in the presence of both vacuum and finite temperature effects. We also investigate the rate at which Holevo's information changes and the action quantum speed of evolution for specific cases of the phase covariant map.


title: Characterizing and Understanding Distributed GNN Training on GPUs

abstract: Graph neural network (GNN) has been demonstrated to be a powerful model in many domains for its effectiveness in learning over graphs. To scale GNN training for large graphs, a widely adopted approach is distributed training which accelerates training using multiple computing nodes. Maximizing the performance is essential, but the execution of distributed GNN training remains preliminarily understood. In this work, we provide an in-depth analysis of distributed GNN training on GPUs, revealing several significant observations and providing useful guidelines for both software optimization and hardware optimization.


title: Machine-learning rationalization and prediction of solid-state synthesis conditions

abstract: There currently exist no quantitative methods to determine the appropriate conditions for solid-state synthesis. This not only hinders the experimental realization of novel materials but also complicates the interpretation and understanding of solid-state reaction mechanisms. Here, we demonstrate a machine-learning approach that predicts synthesis conditions using large solid-state synthesis datasets text-mined from scientific journal articles. Using feature importance ranking analysis, we discovered that optimal heating temperatures have strong correlations with the stability of precursor materials quantified using melting points and formation energies ($\Delta G_f$, $\Delta H_f$). In contrast, features derived from the thermodynamics of synthesis-related reactions did not directly correlate to the chosen heating temperatures. This correlation between optimal solid-state heating temperature and precursor stability extends Tamman's rule from intermetallics to oxide systems, suggesting the importance of reaction kinetics in determining synthesis conditions. Heating times are shown to be strongly correlated with the chosen experimental procedures and instrument setups, which may be indicative of human bias in the dataset. Using these predictive features, we constructed machine-learning models with good performance and general applicability to predict the conditions required to synthesize diverse chemical systems. Codes and data used in this work can be found at: https://github.com/CederGroupHub/s4.


title: Back to the Future: Bidirectional Information Decoupling Network for Multi-turn Dialogue Modeling

abstract: Multi-turn dialogue modeling as a challenging branch of natural language understanding (NLU), aims to build representations for machines to understand human dialogues, which provides a solid foundation for multiple downstream tasks. Recent studies of dialogue modeling commonly employ pre-trained language models (PrLMs) to encode the dialogue history as successive tokens, which is insufficient in capturing the temporal characteristics of dialogues. Therefore, we propose Bidirectional Information Decoupling Network (BiDeN) as a universal dialogue encoder, which explicitly incorporates both the past and future contexts and can be generalized to a wide range of dialogue-related tasks. Experimental results on datasets of different downstream tasks demonstrate the universality and effectiveness of our BiDeN.


title: Sparsity-Exploiting Distributed Projections onto a Simplex

abstract: Projecting a vector onto a simplex is a well-studied problem that arises in a wide range of optimization problems. Numerous algorithms have been proposed for determining the projection; however, the primary focus of the literature has been on serial algorithms. We present a parallel method that decomposes the input vector and distributes it across multiple processors for local projection. Our method is especially effective when the resulting projection is highly sparse; which is the case, for instance, in large-scale problems with i.i.d. entries. Moreover, the method can be adapted to parallelize a broad range of serial algorithms from the literature. We fill in theoretical gaps in serial algorithm analysis, and develop similar results for our parallel analogues. Numerical experiments conducted on a wide range of large-scale instances, both real-world and simulated, demonstrate the practical effectiveness of the method.


title: End-to-end Weakly-supervised Single-stage Multiple 3D Hand Mesh Reconstruction from a Single RGB Image

abstract: In this paper, we consider the challenging task of simultaneously locating and recovering multiple hands from a single 2D image. Previous studies either focus on single hand reconstruction or solve this problem in a multi-stage way. Moreover, the conventional two-stage pipeline firstly detects hand areas, and then estimates 3D hand pose from each cropped patch. To reduce the computational redundancy in preprocessing and feature extraction, for the first time, we propose a concise but efficient single-stage pipeline for multi-hand reconstruction. Specifically, we design a multi-head auto-encoder structure, where each head network shares the same feature map and outputs the hand center, pose and texture, respectively. Besides, we adopt a weakly-supervised scheme to alleviate the burden of expensive 3D real-world data annotations. To this end, we propose a series of losses optimized by a stage-wise training scheme, where a multi-hand dataset with 2D annotations is generated based on the publicly available single hand datasets. In order to further improve the accuracy of the weakly supervised model, we adopt several feature consistency constraints in both single and multiple hand settings. Specifically, the keypoints of each hand estimated from local features should be consistent with the re-projected points predicted from global features. Extensive experiments on public benchmarks including FreiHAND, HO3D, InterHand2.6M and RHD demonstrate that our method outperforms the state-of-the-art model-based methods in both weakly-supervised and fully-supervised manners. The code and models are available at {https://github.com/zijinxuxu/SMHR}.


title: A dynamical systems based framework for dimension reduction

abstract: We propose a novel framework for learning a low-dimensional representation of data based on nonlinear dynamical systems, which we call dynamical dimension reduction (DDR). In the DDR model, each point is evolved via a nonlinear flow towards a lower-dimensional subspace; the projection onto the subspace gives the low-dimensional embedding. Training the model involves identifying the nonlinear flow and the subspace. Following the equation discovery method, we represent the vector field that defines the flow using a linear combination of dictionary elements, where each element is a pre-specified linear/nonlinear candidate function. A regularization term for the average total kinetic energy is also introduced and motivated by optimal transport theory. We prove that the resulting optimization problem is well-posed and establish several properties of the DDR method. We also show how the DDR method can be trained using a gradient-based optimization method, where the gradients are computed using the adjoint method from optimal control theory. The DDR method is implemented and compared on synthetic and example datasets to other dimension reductions methods, including PCA, t-SNE, and Umap.


title: Interaction Design of Dwell Selection Toward Gaze-based AR/VR Interaction

abstract: In this paper, we first position the current dwell selection among gaze-based interactions and its advantages against head-gaze selection, which is the mainstream interface for HMDs. Next, we show how dwell selection and head-gaze selection are used in an actual interaction situation. By comparing these two selection methods, we describe the potential of dwell selection as an essential AR/VR interaction.


title: Deep Learning Coherent Diffractive Imaging

abstract: We report the development of deep learning coherent electron diffractive imaging at sub-angstrom resolution using convolutional neural networks (CNNs) trained with only simulated data. We experimentally demonstrate this method by applying the trained CNNs to directly recover the phase images from electron diffraction patterns of twisted hexagonal boron nitride, monolayer graphene and a Au nanoparticle with comparable quality to those reconstructed by a conventional ptychographic method. Fourier ring correlation between the CNN and ptychographic images indicates the achievement of a spatial resolution in the range of 0.70 and 0.55 angstrom (depending on different resolution criteria). The ability to replace iterative algorithms with CNNs and perform real-time imaging from coherent diffraction patterns is expected to find broad applications in the physical and biological sciences.


title: Forecasts on CMB lensing observations with AliCPT-1

abstract: AliCPT-1 is the first Chinese CMB experiment aiming for high precision measurement of Cosmic Microwave Background B-mode polarization. The telescope, currently under deployment in Tibet, will observe in two frequency bands centered at 90 and 150 GHz. We forecast the CMB lensing reconstruction, lensing-galaxy as well as lensing-CIB (Cosmic Infrared Background) cross correlation signal-to-noise ratio (SNR) for AliCPT-1. We consider two stages with different integrated observation time, namely "4 module*yr" (first stage) and "48 module*yr" (final stage). For lensing reconstruction, we use three different quadratic estimators, namely temperature-only, polarization-only and minimum-variance estimators, using curved sky geometry. We take into account the impact of inhomogeneous hit counts as well as of the mean-field bias due to incomplete sky coverage. In the first stage, our results show that the 150 GHz channel is able to measure the lensing signal at $15\sigma$ significance with the minimum-variance estimator. In the final stage, the measurement significance will increase to $31\sigma$. We also combine the two frequency data in the harmonic domain to optimize the SNR. Our result show that the coadding procedure can significantly reduce the reconstruction bias in the multiple range l>800. Thanks to the high quality of the polarization data in the final stage of AliCPT-1, the EB estimator will dominate the lensing reconstruction in this stage. We also estimate the SNR of cross-correlations between AliCPT-1 CMB lensing and other tracers of the large scale structure of the universe. For its cross-correlation with DESI galaxies/quasars, we report the cross-correlation SNR = 10-20 for the 4 redshift bins at 0.05<z<2.1. In the first stage, the total SNR is about $32$. In the final stage, the lensing-galaxy cross-correlation can reach SNR=52.


title: Multi-scale Anomaly Detection for Big Time Series of Industrial Sensors

abstract: Given a multivariate big time series, can we detect anomalies as soon as they occur? Many existing works detect anomalies by learning how much a time series deviates away from what it should be in the reconstruction framework. However, most models have to cut the big time series into small pieces empirically since optimization algorithms cannot afford such a long series. The question is raised: do such cuts pollute the inherent semantic segments, like incorrect punctuation in sentences? Therefore, we propose a reconstruction-based anomaly detection method, MissGAN, iteratively learning to decode and encode naturally smooth time series in coarse segments, and finding out a finer segment from low-dimensional representations based on HMM. As a result, learning from multi-scale segments, MissGAN can reconstruct a meaningful and robust time series, with the help of adversarial regularization and extra conditional states. MissGAN does not need labels or only needs labels of normal instances, making it widely applicable. Experiments on industrial datasets of real water network sensors show our MissGAN outperforms the baselines with scalability. Besides, we use a case study on the CMU Motion dataset to demonstrate that our model can well distinguish unexpected gestures from a given conditional motion.


title: On Arbitrary Compression for Decentralized Consensus and Stochastic Optimization over Directed Networks

abstract: We study the decentralized consensus and stochastic optimization problems with compressed communications over static directed graphs. We propose an iterative gradient-based algorithm that compresses messages according to a desired compression ratio. The proposed method provably reduces the communication overhead on the network at every communication round. Contrary to existing literature, we allow for arbitrary compression ratios in the communicated messages. We show a linear convergence rate for the proposed method on the consensus problem. Moreover, we provide explicit convergence rates for decentralized stochastic optimization problems on smooth functions that are either (i) strongly convex, (ii) convex, or (iii) non-convex. Finally, we provide numerical experiments to illustrate convergence under arbitrary compression ratios and the communication efficiency of our algorithm.


title: Decompositions of graphs of nonnegative characteristic with some forbidden subgraphs

abstract: A {\em $(d,h)$-decomposition} of a graph $G$ is an order pair $(D,H)$ such that $H$ is a subgraph of $G$ where $H$ has the maximum degree at most $h$ and $D$ is an acyclic orientation of $G-E(H)$ of maximum out-degree at most $d$. A graph $G$ is {\em $(d, h)$-decomposable} if $G$ has a $(d,h)$-decomposition. Let $G$ be a graph embeddable in a surface of nonnegative characteristic. In this paper, we prove the following results. (1) If $G$ has no chord $5$-cycles or no chord $6$-cycles or no chord $7$-cycles and no adjacent $4$-cycles, then $G$ is $(3,1)$-decomposable, which generalizes the results of Chen, Zhu and Wang [Comput. Math. Appl, 56 (2008) 2073--2078] and the results of Zhang [Comment. Math. Univ. Carolin, 54(3) (2013) 339--344]. (2) If $G$ has no $i$-cycles nor $j$-cycles for any subset $\{i,j\}\subseteq \{3,4,6\}$ is $(2,1)$-decomposable, which generalizes the results of Dong and Xu [Discrete Math. Alg. and Appl., 1(2) (2009), 291--297].


title: Gaussian quantum information over general quantum kinematical systems I: Gaussian states

abstract: We develop a theory of Gaussian states over general quantum kinematical systems with finitely many degrees of freedom. The underlying phase space is described by a locally compact abelian (LCA) group $G$ with a symplectic structure determined by a 2-cocycle on $G$. We use the concept of Gaussian distributions on LCA groups in the sense of Bernstein to define Gaussian states and completely characterize Gaussian states over 2-regular LCA groups of the form $G= F\times\hat{F}$ endowed with a canonical normalized 2-cocycle. This covers, in particular, the case of $n$-bosonic modes, $n$-qudit systems with odd $d\ge 3$, and $p$-adic quantum systems. Our characterization reveals a topological obstruction to Gaussian state entanglement when we decompose the quantum kinematical system into the Euclidean part and the remaining part (whose phase space admits a compact open subgroup). We then generalize the discrete Hudson theorem \cite{Gro} to the case of totally disconnected 2-regular LCA groups. We also examine angle-number systems with phase space $\mathbb{T}^n\times\mathbb{Z}^n$ and fermionic/hard-core bosonic systems with phase space $\mathbb{Z}^{2n}_2$ (which are not 2-regular), and completely characterize their Gaussian states.


title: Mapping While Following: 2D LiDAR SLAM in Indoor Dynamic Environments with a Person Tracker

abstract: 2D LiDAR SLAM (Simultaneous Localization and Mapping) is widely used in indoor environments due to its stability and flexibility. However, its mapping procedure is usually operated by a joystick in static environments, while indoor environments often are dynamic with moving objects such as people. The generated map with noisy points due to the dynamic objects is usually incomplete and distorted. To address this problem, we propose a framework of 2D-LiDAR-based SLAM without manual control that effectively excludes dynamic objects (people) and simplify the process for a robot to map an environment. The framework, which includes three parts: people tracking, filtering and following. We verify our proposed framework in experiments with two classic 2D-LiDAR-based SLAM algorithms in indoor environments. The results show that this framework is effective in handling dynamic objects and reducing the mapping error.


title: Robust End-to-end Speaker Diarization with Generic Neural Clustering

abstract: End-to-end speaker diarization approaches have shown exceptional performance over the traditional modular approaches. To further improve the performance of the end-to-end speaker diarization for real speech recordings, recently works have been proposed which integrate unsupervised clustering algorithms with the end-to-end neural diarization models. However, these methods have a number of drawbacks: 1) The unsupervised clustering algorithms cannot leverage the supervision from the available datasets; 2) The K-means-based unsupervised algorithms that are explored often suffer from the constraint violation problem; 3) There is unavoidable mismatch between the supervised training and the unsupervised inference. In this paper, a robust generic neural clustering approach is proposed that can be integrated with any chunk-level predictor to accomplish a fully supervised end-to-end speaker diarization model. Also, by leveraging the sequence modelling ability of a recurrent neural network, the proposed neural clustering approach can dynamically estimate the number of speakers during inference. Experimental show that when integrating an attractor-based chunk-level predictor, the proposed neural clustering approach can yield better Diarization Error Rate (DER) than the constrained K-means-based clustering approaches under the mismatched conditions.


title: Effect of anharmonicity on the thermal conductivity of amorphous silica

abstract: Proper consideration of anharmonicity is important for the calculation of the thermal conductivity. However, how the anharmonicity influences the thermal conduction in amorphous materials is still an open question. In this work, we uncover the role of anharmonicity on the thermal conductivity of amorphous silica (a-SiO2) by comparing the thermal conductivity predicted from the harmonic theory and the anharmonic theory. Moreover, we explore the effect of anharmonicity-induced frequency shift on the prediction of the thermal conductivity. It is found that the thermal conductivity calculated by the recently developed anharmonic theory (quasi-harmonic Green-Kubo approximation, QHGK) is higher than that by the harmonic theory developed by Allen and Feldman. The use of anharmonic vibrational frequencies also leads to a higher thermal conductivity compared with that calculated using harmonic vibrational frequencies. The anharmonicity induced frequency shifts is a mechanism for the positive temperature dependence of the thermal conductivity of a-SiO2 at higher temperatures. Further investigation on mode diffusivity suggests that although anharmonicity has larger influence on locons than diffusons, the increase of the thermal conductivity due to the anharmonicity is mainly contributed by the anharmonicity induced increase of the diffusivity of diffusons. Finally, it is found that the cross-correlations between diffusons and diffusons contribute most to the thermal conductivity of a-SiO2, and the locons contribute to the thermal conductivity mainly through collaboration with diffusons. These results offer new insights into the nature of the thermal conduction in a-SiO2.


title: TOD-CNN: An Effective Convolutional Neural Network for Tiny Object Detection in Sperm Videos

abstract: The detection of tiny objects in microscopic videos is a problematic point, especially in large-scale experiments. For tiny objects (such as sperms) in microscopic videos, current detection methods face challenges in fuzzy, irregular, and precise positioning of objects. In contrast, we present a convolutional neural network for tiny object detection (TOD-CNN) with an underlying data set of high-quality sperm microscopic videos (111 videos, $>$ 278,000 annotated objects), and a graphical user interface (GUI) is designed to employ and test the proposed model effectively. TOD-CNN is highly accurate, achieving $85.60\%$ AP$_{50}$ in the task of real-time sperm detection in microscopic videos. To demonstrate the importance of sperm detection technology in sperm quality analysis, we carry out relevant sperm quality evaluation metrics and compare them with the diagnosis results from medical doctors.


title: A Study on Prompt-based Few-Shot Learning Methods for Belief State Tracking in Task-oriented Dialog Systems

abstract: We tackle the Dialogue Belief State Tracking(DST) problem of task-oriented conversational systems. Recent approaches to this problem leveraging Transformer-based models have yielded great results. However, training these models is expensive, both in terms of computational resources and time. Additionally, collecting high quality annotated dialogue datasets remains a challenge for researchers because of the extensive annotation required for training these models. Driven by the recent success of pre-trained language models and prompt-based learning, we explore prompt-based few-shot learning for Dialogue Belief State Tracking. We formulate the DST problem as a 2-stage prompt-based language modelling task and train language models for both tasks and present a comprehensive empirical analysis of their separate and joint performance. We demonstrate the potential of prompt-based methods in few-shot learning for DST and provide directions for future improvement.


title: Nonlinear and Nonseparable Structural Functions in Fuzzy Regression Discontinuity Designs

abstract: Many empirical examples of regression discontinuity (RD) designs concern a continuous treatment variable, but the theoretical aspects of such models are less studied. This study examines the identification and estimation of the structural function in fuzzy RD designs with a continuous treatment variable. The structural function fully describes the causal impact of the treatment on the outcome. We show that the nonlinear and nonseparable structural function can be nonparametrically identified at the RD cutoff under shape restrictions, including monotonicity and smoothness conditions. Based on the nonparametric identification equation, we propose a three-step semiparametric estimation procedure and establish the asymptotic normality of the estimator. The semiparametric estimator achieves the same convergence rate as in the case of a binary treatment variable. As an application of the method, we estimate the causal effect of sleep time on health status by using the discontinuity in natural light timing at time zone boundaries.


title: Actions at the Edge: Jointly Optimizing the Resources in Multi-access Edge Computing

abstract: Multi-access edge computing (MEC) is an emerging paradigm that pushes resources for sensing, communications, computing, storage and intelligence (SCCSI) to the premises closer to the end users, i.e., the edge, so that they could leverage the nearby rich resources to improve their quality of experience (QoE). Due to the growing emerging applications targeting at intelligentizing life-sustaining cyber-physical systems, this paradigm has become a hot research topic, particularly when MEC is utilized to provide edge intelligence and real-time processing and control. This article is to elaborate the research issues along this line, including basic concepts and performance metrics, killer applications, architectural design, modeling approaches and solutions, and future research directions. It is hoped that this article provides a quick introduction to this fruitful research area particularly for beginning researchers.


title: Hermitian manifolds with flat Gauduchon connections

abstract: We complete the classification of compact Hermitian manifolds admitting a flat Gauduchon connection. In particular, we establish a conjecture of Yang and Zheng, showing that apart from the cases of a flat Chern or Bismut connection, such manifolds are K\"ahler. More generally, we prove the same result holds when the flatness assumption is replaced by the so-called K\"ahler-like condition, proving a conjecture of Angella, Otal, Ugarte and Villacampa. We also treat the non-compact case.


title: Distributed Neural Precoding for Hybrid mmWave MIMO Communications with Limited Feedback

abstract: Hybrid precoding is a cost-efficient technique for millimeter wave (mmWave) massive multiple-input multiple-output (MIMO) communications. This paper proposes a deep learning approach by using a distributed neural network for hybrid analog-and-digital precoding design with limited feedback. The proposed distributed neural precoding network, called DNet, is committed to achieving two objectives. First, the DNet realizes channel state information (CSI) compression with a distributed architecture of neural networks, which enables practical deployment on multiple users. Specifically, this neural network is composed of multiple independent sub-networks with the same structure and parameters, which reduces both the number of training parameters and network complexity. Secondly, DNet learns the calculation of hybrid precoding from reconstructed CSI from limited feedback. Different from existing black-box neural network design, the DNet is specifically designed according to the data form of the matrix calculation of hybrid precoding. Simulation results show that the proposed DNet significantly improves the performance up to nearly 50% compared to traditional limited feedback precoding methods under the tests with various CSI compression ratios.


title: A new proof for global rigidity of vertex scaling on polyhedral surfaces

abstract: The vertex scaling for piecewise linear metrics on polyhedral surfaces was introduced by Luo, who proved the local rigidity by establishing a variational principle and conjectured the global rigidity. Luo's conjecture was solved by Bobenko-Pinkall-Springborn, who also introduced the vertex scaling for piecewise hyperbolic metrics and proved its global rigidity. Bobenko-Pinkall-Spingborn's proof is based on their observation of the connection of vertex scaling and the geometry of polyhedra in $3$-dimensional hyperbolic space and the concavity of the volume of ideal and hyper-ideal tetrahedra. In this paper, we give an elementary and short variational proof of the global rigidity of vertex scaling without involving $3$-dimensional hyperbolic geometry. The method is based on continuity of eigenvalues of matrices and the extension of convex functions.


title: TABi: Type-Aware Bi-Encoders for Open-Domain Entity Retrieval

abstract: Entity retrieval--retrieving information about entity mentions in a query--is a key step in open-domain tasks, such as question answering or fact checking. However, state-of-the-art entity retrievers struggle to retrieve rare entities for ambiguous mentions due to biases towards popular entities. Incorporating knowledge graph types during training could help overcome popularity biases, but there are several challenges: (1) existing type-based retrieval methods require mention boundaries as input, but open-domain tasks run on unstructured text, (2) type-based methods should not compromise overall performance, and (3) type-based methods should be robust to noisy and missing types. In this work, we introduce TABi, a method to jointly train bi-encoders on knowledge graph types and unstructured text for entity retrieval for open-domain tasks. TABi leverages a type-enforced contrastive loss to encourage entities and queries of similar types to be close in the embedding space. TABi improves retrieval of rare entities on the Ambiguous Entity Retrieval (AmbER) sets, while maintaining strong overall retrieval performance on open-domain tasks in the KILT benchmark compared to state-of-the-art retrievers. TABi is also robust to incomplete type systems, improving rare entity retrieval over baselines with only 5% type coverage of the training dataset. We make our code publicly available at https://github.com/HazyResearch/tabi.


title: Linear level repulsions near exceptional points of non-Hermitian systems

abstract: The nearest-neighbor level-spacing distributions are a fundamental quantity of disordered systems and universal. It is well-known that extended and localized states of random Hermitian systems follow the Wigner-Dyson and the Poison distributions, respectively, while the Ginibre distributions describe random non-Hermitian systems with complex eigenvalues. However, the level distribution of systems of neither Hermitian nor non-Hermitian with full complex eigenvalues is still unknown. Here we show a new class of universal level distributions in the vicinity of exceptional points of non-Hermitian Hamiltonians. Two universal distribution functions, $P_{\text{SP}}(s)$ for the symmetry-preserved phase and $P_{\text{SB}}(s)$ for the symmetry-broken phase, are needed to describe the nearest-neighbor level-spacing distributions near exceptional points. Surprisingly, both $P_{\text{SP}}(s)$ and $P_{\text{SB}}(s)$ are proportional to $s$ for small $s$, or a linear level repulsion, in contrast to the cubic level repulsions of the Ginibre ensembles. For non-Hermitian disordered tight-binding Hamiltonians, $P_{\text{SP}}(s)$ and $P_{\text{SB}}(s)$ can be well described by $P_{\text{SP(SB)}}(s)=\tilde{c}_1s\exp[-\tilde{c}_2s^{\tilde{\alpha}}]$ in the thermodynamic limit (of infinite systems) with a constant $\tilde{\alpha}$ that depends on the localization nature of states at exceptional points.


title: Usage of specific attention improves change point detection

abstract: The change point is a moment of an abrupt alteration in the data distribution. Current methods for change point detection are based on recurrent neural methods suitable for sequential data. However, recent works show that transformers based on attention mechanisms perform better than standard recurrent models for many tasks. The most benefit is noticeable in the case of longer sequences. In this paper, we investigate different attentions for the change point detection task and proposed specific form of attention related to the task at hand. We show that using a special form of attention outperforms state-of-the-art results.


title: HRCF: Enhancing Collaborative Filtering via Hyperbolic Geometric Regularization

abstract: In large-scale recommender systems, the user-item networks are generally scale-free or expand exponentially. The latent features (also known as embeddings) used to describe the user and item are determined by how well the embedding space fits the data distribution. Hyperbolic space offers a spacious room to learn embeddings with its negative curvature and metric properties, which can well fit data with tree-like structures. Recently, several hyperbolic approaches have been proposed to learn high-quality representations for the users and items. However, most of them concentrate on developing the hyperbolic similitude by designing appropriate projection operations, whereas many advantageous and exciting geometric properties of hyperbolic space have not been explicitly explored. For example, one of the most notable properties of hyperbolic space is that its capacity space increases exponentially with the radius, which indicates the area far away from the hyperbolic origin is much more embeddable. Regarding the geometric properties of hyperbolic space, we bring up a Hyperbolic Regularization powered Collaborative Filtering(HRCF) and design a geometric-aware hyperbolic regularizer. Specifically, the proposal boosts optimization procedure via the root alignment and origin-aware penalty, which is simple yet impressively effective. Through theoretical analysis, we further show that our proposal is able to tackle the over-smoothing problem caused by hyperbolic aggregation and also brings the models a better discriminative ability. We conduct extensive empirical analysis, comparing our proposal against a large set of baselines on several public benchmarks. The empirical results show that our approach achieves highly competitive performance and surpasses both the leading Euclidean and hyperbolic baselines by considerable margins.


title: Cosmic microwave background spectral distortions from Rayleigh scattering at second order

abstract: Cosmic microwave background (CMB) spectral distortion from Rayleigh scattering is calculated for the first time in rigorous second-order cosmological perturbation theory. The new spectral distortion is sensitive to acoustic dissipation at $10^{-2}<k{\rm Mpc}/h<1$, which slightly extends the scale constrained by the CMB anisotropies. The spectral shape is different from either temperature perturbations or any other traditional spectral distortions from Compton scattering, such as $y$ and $\mu$. The new spectral distortion is not formed in the late Universe, unlike the thermal Sunyaev-Zel'dovich effect degenerated with the primordial $y$ distortions since photons must be hot for Rayleigh scattering. Therefore, ideal measurements can distinguish the signal from the other effects and extract new information during recombination. Assuming cosmological parameters consistent with the recent CMB anisotropy measurements, we find the new spectral distortion is $6.5\times 10^{-3}$Jy/str, which is one order of magnitude smaller than the currently proposed target sensitivity range of voyage 2050.


title: Self-Supporting Wormholes in Four Dimensions with Scalar Field

abstract: In this paper, we investigated the space-time obtained by quotients of the $AdS_4$ space-time. Further quotient with specific $\mathbb{Z}_2$ is considered. Taking up to the first-order perturbation in metric, we estimated the backreaction of the matter field on space-time geometry. We can calculate the stress-energy tensor's expected value by pulling it back onto the covering space. The average null energy becomes negative when the suitable boundary condition is chosen, resulting in a traversable wormhole.


title: Real-World Deep Local Motion Deblurring

abstract: Most existing deblurring methods focus on removing global blur caused by camera shake, while they cannot well handle local blur caused by object movements. To fill the vacancy of local deblurring in real scenes, we establish the first real local motion blur dataset (ReLoBlur), which is captured by a synchronized beam-splitting photographing system and corrected by a post-progressing pipeline. Based on ReLoBlur, we propose a Local Blur-Aware Gated network (LBAG) and several local blur-aware techniques to bridge the gap between global and local deblurring: 1) a blur detection approach based on background subtraction to localize blurred regions; 2) a gate mechanism to guide our network to focus on blurred regions; and 3) a blur-aware patch cropping strategy to address data imbalance problem. Extensive experiments prove the reliability of ReLoBlur dataset, and demonstrate that LBAG achieves better performance than state-of-the-art global deblurring methods without our proposed local blur-aware techniques.


title: A Taxonomy of Error Sources in HPC I/O Machine Learning Models

abstract: I/O efficiency is crucial to productivity in scientific computing, but the increasing complexity of the system and the applications makes it difficult for practitioners to understand and optimize I/O behavior at scale. Data-driven machine learning-based I/O throughput models offer a solution: they can be used to identify bottlenecks, automate I/O tuning, or optimize job scheduling with minimal human intervention. Unfortunately, current state-of-the-art I/O models are not robust enough for production use and underperform after being deployed. We analyze multiple years of application, scheduler, and storage system logs on two leadership-class HPC platforms to understand why I/O models underperform in practice. We propose a taxonomy consisting of five categories of I/O modeling errors: poor application and system modeling, inadequate dataset coverage, I/O contention, and I/O noise. We develop litmus tests to quantify each category, allowing researchers to narrow down failure modes, enhance I/O throughput models, and improve future generations of HPC logging and analysis tools.


title: On the blowup mechanism of smooth solutions to 1D quasilinear strictly hyperbolic systems with large initial data

abstract: For the first order 1D $n\times n$ quasilinear strictly hyperbolic system $\partial_tu+F(u)\partial_xu=0$ with $u(x, 0)=\varepsilon u_0(x)$, where $\varepsilon>0$ is small, $u_0(x)\not\equiv 0$ and $u_0(x)\in C_0^2(\mathbb R)$, when at least one eigenvalue of $F(u)$ is genuinely nonlinear, it is well-known that on the finite blowup time $T_{\varepsilon}$, the derivatives $\partial_{t,x}u$ blow up while the solution $u$ keeps to be small. For the 1D scalar equation or $2\times 2$ strictly hyperbolic system (corresponding to $n=1, 2$), if the smooth solution $u$ blows up in finite time, then the blowup mechanism can be well understood (i.e., only the blowup of $\partial_{t,x}u$ happens). In the present paper, for the $n\times n$ ($n\geq 3$) strictly hyperbolic system with a class of large initial data, we are concerned with the blowup mechanism of smooth solution $u$ on the finite blowup time and the detailed singularity behaviours of $\partial_{t,x}u$ near the blowup point. Our results are based on the efficient decomposition of $u$ along the different characteristic directions, the suitable introduction of the modulated coordinates and the global weighted energy estimates.


title: Modality-Balanced Embedding for Video Retrieval

abstract: Video search has become the main routine for users to discover videos relevant to a text query on large short-video sharing platforms. During training a query-video bi-encoder model using online search logs, we identify a modality bias phenomenon that the video encoder almost entirely relies on text matching, neglecting other modalities of the videos such as vision, audio. This modality imbalanceresults from a) modality gap: the relevance between a query and a video text is much easier to learn as the query is also a piece of text, with the same modality as the video text; b) data bias: most training samples can be solved solely by text matching. Here we share our practices to improve the first retrieval stage including our solution for the modality imbalance issue. We propose MBVR (short for Modality Balanced Video Retrieval) with two key components: manually generated modality-shuffled (MS) samples and a dynamic margin (DM) based on visual relevance. They can encourage the video encoder to pay balanced attentions to each modality. Through extensive experiments on a real world dataset, we show empirically that our method is both effective and efficient in solving modality bias problem. We have also deployed our MBVR in a large video platform and observed statistically significant boost over a highly optimized baseline in an A/B test and manual GSB evaluations.


title: Massive Parallelization of Massive Sample-size Survival Analysis

abstract: Large-scale observational health databases are increasingly popular for conducting comparative effectiveness and safety studies of medical products. However, increasing number of patients poses computational challenges when fitting survival regression models in such studies. In this paper, we use graphics processing units (GPUs) to parallelize the computational bottlenecks of massive sample-size survival analyses. Specifically, we develop and apply time- and memory-efficient single-pass parallel scan algorithms for Cox proportional hazards models and forward-backward parallel scan algorithms for Fine-Gray models for analysis with and without a competing risk using a cyclic coordinate descent optimization approach. We demonstrate that GPUs accelerate the computation of fitting these complex models in large databases by orders of magnitude as compared to traditional multi-core CPU parallelism. Our implementation enables efficient large-scale observational studies involving millions of patients and thousands of patient characteristics. The above implementation is available in the open-source R package Cyclops (Suchard et al., 2013).


title: On The Diameter of Pancake Graphs

abstract: The Pancake graph($P_n$) represents the group of all permutations on n elements, namely $S_n$, with respect to the generating set containing all prefix reversals. The diameter of a graph is the maximum of all distances on the graph, where the distance between two vertices is the shortest path between them. In the case of the $P_n$, it is the maximum of the shortest generating sequence of each permutation in $S_n$. Here we propose a method to realise better upper bounds to the diameter of $P_n$ that has its focus on Graph Theoretical concepts rather than Algebra.


title: Completion Delay of Random Linear Network Coding in Full-Duplex Relay Networks

abstract: As the next-generation wireless networks thrive, full-duplex and relay techniques are combined to improve the network performance. Random linear network coding (RLNC) is another popular technique to enhance the efficiency and reliability of wireless communications. In this paper, in order to explore the potential of RLNC in full-duplex relay networks, we investigate two fundamental perfect RLNC schemes and theoretically analyze their completion delay performance. The first scheme is a straightforward application of conventional perfect RLNC studied in wireless broadcast, so it involves no additional process at the relay. Its performance serves as an upper bound for all perfect RLNC schemes. The other scheme allows sufficiently large buffer and unconstrained linear coding at the relay. It attains the optimal performance and serves as a lower bound for all RLNC schemes. For both schemes, closed-form formulae to characterize the expected completion delay at a single receiver as well as for the whole system are derived. Numerical results are also demonstrated to validate the theoretical characterizations, and compare the two fundamental schemes with the existing one.


title: On invariant properties of natural differential operators associated to geometric structures on $\mathbb{R}^n$

abstract: We provide a general framework to study invariant properties of various gradient-like and Laplace-like differential operators naturally associated to geometric structures on $\mathbb{R}^n$, which encompass Euclidean, Minkowski, pseudo-Euclidean and symplectic structures.


title: Securing Signal-free Intersections against Strategic Jamming Attacks: A Macroscopic Approach

abstract: We consider the security-by-design of a signal-free intersection for connected and autonomous vehicles in the face of strategic jamming attacks. We use a fluid model to characterize macroscopic traffic flow through the intersection, where the saturation rate is derived from a vehicle coordination algorithm. We model jamming attacks as sudden increase in communication latency induced on vehicle-to-infrastructure connectivity; such latency triggers the safety mode for vehicle coordination and thus reduces the intersection saturation rate. A strategic attacker selects the attacking rate, while a system operator selects key design parameters, either the saturation rate or the recovery rate. Both players' actions induce technological costs and jointly determine the mean travel delay. By analyzing the equilibrium of the security game, we study the preferable level of investment in the intersection's nominal discharging capability or recovery capability.


title: Local wild mapping class groups and cabled braids

abstract: We will define and study some generalisations of pure $\mathfrak{g}$-braid groups that occur in the theory of connections on curves, for any complex reductive Lie algebra $\mathfrak{g}$. They make up local pieces of the wild mapping class groups, which are fundamental groups of (universal) deformations of wild Riemann surfaces, underlying the braiding of Stokes data and generalising the usual mapping class groups. We will establish a general product decomposition for the local wild mapping class groups, and in many cases define a fission tree controlling this decomposition. Further in type A we will show one obtains cabled versions of braid groups, related to braid operads.


title: Sardino: Ultra-Fast Dynamic Ensemble for Secure Visual Sensing at Mobile Edge

abstract: Adversarial example attack endangers the mobile edge systems such as vehicles and drones that adopt deep neural networks for visual sensing. This paper presents {\em Sardino}, an active and dynamic defense approach that renews the inference ensemble at run time to develop security against the adaptive adversary who tries to exfiltrate the ensemble and construct the corresponding effective adversarial examples. By applying consistency check and data fusion on the ensemble's predictions, Sardino can detect and thwart adversarial inputs. Compared with the training-based ensemble renewal, we use HyperNet to achieve {\em one million times} acceleration and per-frame ensemble renewal that presents the highest level of difficulty to the prerequisite exfiltration attacks. We design a run-time planner that maximizes the ensemble size in favor of security while maintaining the processing frame rate. Beyond adversarial examples, Sardino can also address the issue of out-of-distribution inputs effectively. This paper presents extensive evaluation of Sardino's performance in counteracting adversarial examples and applies it to build a real-time car-borne traffic sign recognition system. Live on-road tests show the built system's effectiveness in maintaining frame rate and detecting out-of-distribution inputs due to the false positives of a preceding YOLO-based traffic sign detector.


title: What "quenches" ${g_A}$ in nuclei ?

abstract: The answer is found in the way the hidden scale symmetry involving a dilaton emerges in strong nuclear correlations in nuclear matter. It is suggested that the same mechanism is at the origin at higher densities of the sound speed converging in the core of massive compact stars to what could be called ``pseudo-conformal sound speed" $v_s^2/c^2\approx 1/3$. A precision measurement of the superallowed Gamow-Teller transitions in the doubly magic nucleus $^{100}$Sn is suggested to confirm or falsify this prediction. It could also lead to the possible determination of genuine ``fundamental renormalization" of $g_A$ in nuclear medium.


title: Combinatorial Yamabe flow on hyperbolic bordered surfaces

abstract: This paper studies the combinatorial Yamabe flow on hyperbolic bordered surfaces. We show that the flow exists for all time and converges exponentially fast to conformal factor which produces a hyperbolic surface whose lengths of boundary components are equal to prescribed positive numbers. This provides an algorithm to such problems.


title: Semi-Supervised Super-Resolution

abstract: Super-Resolution is the technique to improve the quality of a low-resolution photo by boosting its plausible resolution. The computer vision community has extensively explored the area of Super-Resolution. However, previous Super-Resolution methods require vast amounts of data for training which becomes problematic in domains where very few low-resolution, high-resolution pairs might be available. One such area is statistical downscaling, where super-resolution is increasingly being used to obtain high-resolution climate information from low-resolution data. Acquiring high-resolution climate data is extremely expensive and challenging. To reduce the cost of generating high-resolution climate information, Super-Resolution algorithms should be able to train with a limited number of low-resolution, high-resolution pairs. This paper tries to solve the aforementioned problem by introducing a semi-supervised way to perform super-resolution that can generate sharp, high-resolution images with as few as 500 paired examples. The proposed semi-supervised technique can be used as a plug-and-play module with any supervised GAN-based Super-Resolution method to enhance its performance. We quantitatively and qualitatively analyze the performance of the proposed model and compare it with completely supervised methods as well as other unsupervised techniques. Comprehensive evaluations show the superiority of our method over other methods on different metrics. We also offer the applicability of our approach in statistical downscaling to obtain high-resolution climate images.


title: I Cannot See Students Focusing on My Presentation; Are They Following Me? Continuous Monitoring of Student Engagement through "Stungage"

abstract: Monitoring students' engagement and understanding their learning pace in a virtual classroom becomes challenging in the absence of direct eye contact between the students and the instructor. Continuous monitoring of eye gaze and gaze gestures may produce inaccurate outcomes when the students are allowed to do productive multitasking, such as taking notes or browsing relevant content. This paper proposes Stungage - a software wrapper over existing online meeting platforms to monitor students' engagement in real-time by utilizing the facial video feeds from the students and the instructor coupled with a local on-device analysis of the presentation content. The crux of Stungage is to identify a few opportunistic moments when the students should visually focus on the presentation content if they can follow the lecture. We investigate these instances and analyze the students' visual, contextual, and cognitive presence to assess their engagement during the virtual classroom while not directly sharing the video captures of the participants and their screens over the web. Our system achieves an overall F2-score of 0.88 for detecting student engagement. Besides, we obtain 92 responses from the usability study with an average SU score of 74.18.


title: Phishing Fraud Detection on Ethereum using Graph Neural Network

abstract: Blockchain has widespread applications in the financial field but has also attracted increasing cybercrimes. Recently, phishing fraud has emerged as a major threat to blockchain security, calling for the development of effective regulatory strategies. Nowadays network science has been widely used in modeling Ethereum transaction data, further introducing the network representation learning technology to analyze the transaction patterns. In this paper, we consider phishing detection as a graph classification task and propose an end-to-end Phishing Detection Graph Neural Network framework (PDGNN). Specifically, we first construct a lightweight Ethereum transaction network and extract transaction subgraphs of collected phishing accounts. Then we propose an end-to-end detection model based on Chebyshev-GCN to precisely distinguish between normal and phishing accounts. Extensive experiments on five Ethereum datasets demonstrate that our PDGNN significantly outperforms general phishing detection methods and scales well in large transaction networks.


title: Tri-photon at muon collider: a new process to probe the anomalous quartic gauge couplings

abstract: The muon collider has recently received a great deal of attention because of its ability to achieve both high energy and high luminosity. It plays as a gauge boson collider because the vector boson scattering (VBS) becomes the dominant production topology for Standard Model processes starting from a few TeV of collision energy. In this paper, we propose that the process of $\mu^+\mu^-$ annihilation into tri-photon is also very sensitive to the search of anomalous quartic gauge couplings (aQGCs). We investigate the projected constraints on the transverse operators contributing to aQGCs through $\mu^+\mu^-\to Z^\ast/\gamma^\ast\to \gamma\gamma\gamma$ at muon colliders. For the muon collider with $\sqrt{s}=3$ TeV and $\mathcal{L}=1\;{\rm ab}^{-1}$, the expected constraints are about two orders of magnitude stronger than those at the 13 TeV LHC.


title: Self-Supervised Arbitrary-Scale Point Clouds Upsampling via Implicit Neural Representation

abstract: Point clouds upsampling is a challenging issue to generate dense and uniform point clouds from the given sparse input. Most existing methods either take the end-to-end supervised learning based manner, where large amounts of pairs of sparse input and dense ground-truth are exploited as supervision information; or treat up-scaling of different scale factors as independent tasks, and have to build multiple networks to handle upsampling with varying factors. In this paper, we propose a novel approach that achieves self-supervised and magnification-flexible point clouds upsampling simultaneously. We formulate point clouds upsampling as the task of seeking nearest projection points on the implicit surface for seed points. To this end, we define two implicit neural functions to estimate projection direction and distance respectively, which can be trained by two pretext learning tasks. Experimental results demonstrate that our self-supervised learning based scheme achieves competitive or even better performance than supervised learning based state-of-the-art methods. The source code is publicly available at https://github.com/xnowbzhao/sapcu.


title: Groups, drift and harmonic measures

abstract: In this short note we will describe an old problem and a new approach which casts light upon it. The old problem is to understand the nature of harmonic measures for cocompact Fuchsian groups. The new approach is to compute numerically the value of the drift and, in particular, get new results on the dimension of the measure in some new examples.


title: UTNLP at SemEval-2022 Task 6: A Comparative Analysis of Sarcasm Detection Using Generative-based and Mutation-based Data Augmentation

abstract: Sarcasm is a term that refers to the use of words to mock, irritate, or amuse someone. It is commonly used on social media. The metaphorical and creative nature of sarcasm presents a significant difficulty for sentiment analysis systems based on affective computing. The methodology and results of our team, UTNLP, in the SemEval-2022 shared task 6 on sarcasm detection are presented in this paper. We put different models, and data augmentation approaches to the test and report on which one works best. The tests begin with traditional machine learning models and progress to transformer-based and attention-based models. We employed data augmentation based on data mutation and data generation. Using RoBERTa and mutation-based data augmentation, our best approach achieved an F1-sarcastic of 0.38 in the competition's evaluation phase. After the competition, we fixed our model's flaws and achieved an F1-sarcastic of 0.414.


title: Microbulk Micromegas in non-flammable mixtures of argon and neon at high pressure

abstract: We report on a systematic characterization of microbulk Micromegas readouts in high-pressure Ar+1%iC4H10 and Ne+2%iC4H10 mixtures. Experimental data on gain, electron transmission and energy resolution are presented for a wide range of drift and amplification voltages and pressures from 1 bar to 10 bar for argon and from 5 bar to 10 bar in neon, in steps of 1 bar. Maximum gains higher than 1.7e3 (1.7e4) in argon (neon) are measured for all pressures, remarkably without the significant decrease with pressure typically observed in other amplification structures. A competitive energy resolution at 22.1 keV, but with a slight degradation with pressure, is observed:from 10.8% at 1 bar to 15.6% FWHM at 10 bar in argon and from 8.3% at 5 bar to 15.0% FWHM at1 10 bar in neon. The experimental setup, procedure and the results will be presented and discussed in detail. The work is motivated by the TREX-DM experiment, that is operating in the Laboratorio Subterr\'aneo de Canfranc with the mentioned mixtures, although the results may be of interest for other applications of time projection chambers at high pressures.


title: Understanding Gradual Domain Adaptation: Improved Analysis, Optimal Path and Beyond

abstract: The vast majority of existing algorithms for unsupervised domain adaptation (UDA) focus on adapting from a labeled source domain to an unlabeled target domain directly in a one-off way. Gradual domain adaptation (GDA), on the other hand, assumes a path of $(T-1)$ unlabeled intermediate domains bridging the source and target, and aims to provide better generalization in the target domain by leveraging the intermediate ones. Under certain assumptions, Kumar et al. (2020) proposed a simple algorithm, Gradual Self-Training, along with a generalization bound in the order of $e^{O(T)} \left(\varepsilon_0+O\left(\sqrt{log(T)/n}\right)\right)$ for the target domain error, where $\varepsilon_0$ is the source domain error and $n$ is the data size of each domain. Due to the exponential factor, this upper bound becomes vacuous when $T$ is only moderately large. In this work, we analyze gradual self-training under more general and relaxed assumptions, and prove a significantly improved generalization bound as $\varepsilon_0+ O \left(T\Delta + T/\sqrt{n}\right) + \widetilde{O}\left(1/\sqrt{nT}\right)$, where $\Delta$ is the average distributional distance between consecutive domains. Compared with the existing bound with an exponential dependency on $T$ as a multiplicative factor, our bound only depends on $T$ linearly and additively. Perhaps more interestingly, our result implies the existence of an optimal choice of $T$ that minimizes the generalization error, and it also naturally suggests an optimal way to construct the path of intermediate domains so as to minimize the accumulative path length $T\Delta$ between the source and target. To corroborate the implications of our theory, we examine gradual self-training on multiple semi-synthetic and real datasets, which confirms our findings. We believe our insights provide a path forward toward the design of future GDA algorithms.


title: On an inhomogeneous slip-inflow boundary value problems for a steady viscous compressible channel flows

abstract: We prove the existence and uniqueness of strong solutions to the steady isentropic compressible Navier-Stokes equations with inflow boundary conditions for density and mixed boundary conditions for the velocity around a shear flow. In particular, the Dirichlet boundary condition on inflow and outflow part of the boundary while the full Navier boundary conditions on the wall $\Gamma_{0}$ for the velocity filed are considered. For our result, there are no restrictions on the amplitude of friction coefficients $\alpha$, and the appropriately large hypothesis for the viscous coefficients $\mu$ is enough. One of the substantial ingredients of our proof is an elegant transformation induced by the flow field. With the help of this transformation, we can overcome the difficulties caused by the hyperbolicity of continuity equation, establish the a priori estimates for a linearized system and apply the fixed point arguments.


title: Type II Seesaw Leptogenesis

abstract: The Type II Seesaw Mechanism provides a minimal framework to explain the neutrino masses involving the introduction of a single triplet Higgs to the Standard Model. However, this simple extension was believed to be unable to successfully explain the observed baryon asymmetry of the universe through Leptogenesis. In our previous work (Phys. Rev. Lett. 128, 141801), we demonstrated that the triplet Higgs of the Type II Seesaw Mechanism alone can simultaneously generate the observed baryon asymmetry of the universe and the neutrino masses while playing a role in setting up Inflation. This is achievable with a triplet Higgs mass as low as 1 TeV, and predicts that the neutral component obtains a small vacuum expectation value $v_\Delta < 10 $ keV. We find that our model has very rich phenomenology and can be tested by various terrestrial experiments as well as by astronomical observations. Particularly, we show that the successful parameter region may be probed at a future 100 TeV collider, upcoming lepton flavor violation experiments such as Mu3e, and neutrinoless double beta decay experiments. Additionally, the tensor-to-scalar ratio from the inflationary scenario will be probed by the LiteBIRD telescope, and observable isocurvature perturbations may be produced for some parameter choices. In this article, we present all the technical details of our calculations and further discussion of its phenomenological implications.


title: The Bowen$\unicode{x2013}$Series coding and zeros of zeta functions

abstract: We give a discussion of the classical Bowen$\unicode{x2013}$Series coding and, in particular, its application to the study of zeta functions and their zeros. In the case of compact surfaces of constant negative curvature $-1$ the analytic extension of the Selberg zeta function to the entire complex plane is classical, and can be achieved using the Selberg trace formula. However, an alternative dynamical approach is to use the Bowen$\unicode{x2013}$Series coding on the boundary at infinity to obtain a piecewise analytic expanding map from which the extension of the zeta function can be obtained using properties of the associated transfer operator. This latter method has the advantage that it also applies in the case of infinite area surfaces provided they do not have cusps. For such examples the location of the zeros is somewhat more mysterious. However, in particularly simple examples there is a striking structure to the zeros when we take appropriate limits. We will try to give some insight into this phenomenon. The survey is based on lectures given by the first author during the Workshop on Statistical Properties of Nonequilibrium Dynamical Systems which took place in July 2016 at South University of Science and Technology of China in ShenZhen.


title: Stochastic subgradient for composite optimization with functional constraints

abstract: In this paper we consider convex optimization problems with stochastic composite objective function subject to (possibly) infinite intersection of constraints. The objective function is expressed in terms of expectation operator over a sum of two terms satisfying a stochastic bounded gradient condition, with or without strong convexity type properties. In contrast to the classical approach, where the constraints are usually represented as intersection of simple sets, in this paper we consider that each constraint set is given as the level set of a convex but not necessarily differentiable function. Based on the flexibility offered by our general optimization model we consider a stochastic subgradient method with random feasibility updates. At each iteration, our algorithm takes a stochastic proximal (sub)gradient step aimed at minimizing the objective function and then a subsequent subgradient step minimizing the feasibility violation of the observed random constraint. We analyze the convergence behavior of the proposed algorithm for diminishing stepsizes and for the case when the objective function is convex or strongly convex, unifying the nonsmooth and smooth cases. We prove sublinear convergence rates for this stochastic subgradient algorithm, which are known to be optimal for subgradient methods on this class of problems. When the objective function has a linear least-square form and the constraints are polyhedral, it is shown that the algorithm converges linearly. Numerical evidence supports the effectiveness of our method in real problems.


title: A Greedy and Optimistic Approach to Clustering with a Specified Uncertainty of Covariates

abstract: In this study, we examine a clustering problem in which the covariates of each individual element in a dataset are associated with an uncertainty specific to that element. More specifically, we consider a clustering approach in which a pre-processing applying a non-linear transformation to the covariates is used to capture the hidden data structure. To this end, we approximate the sets representing the propagated uncertainty for the pre-processed features empirically. To exploit the empirical uncertainty sets, we propose a greedy and optimistic clustering (GOC) algorithm that finds better feature candidates over such sets, yielding more condensed clusters. As an important application, we apply the GOC algorithm to synthetic datasets of the orbital properties of stars generated through our numerical simulation mimicking the formation process of the Milky Way. The GOC algorithm demonstrates an improved performance in finding sibling stars originating from the same dwarf galaxy. These realistic datasets have also been made publicly available.


title: TigerLily: Finding drug interactions in silico with the Graph

abstract: Tigerlily is a TigerGraph based system designed to solve the drug interaction prediction task. In this machine learning task, we want to predict whether two drugs have an adverse interaction. Our framework allows us to solve this highly relevant real-world problem using graph mining techniques in these steps: (a) Using PyTigergraph we create a heterogeneous biological graph of drugs and proteins. (b) We calculate the personalized PageRank scores of drug nodes in the TigerGraph Cloud. (c) We embed the nodes using sparse non-negative matrix factorization of the personalized PageRank matrix. (d) Using the node embeddings we train a gradient boosting based drug interaction predictor.


title: Searching $B_c^\ast$ via conservation laws

abstract: To distinguish $B_c^{\ast +}(1^3S_1)$ and $B_c^+(1^1S_0)$ in the experiments, we propose two methods based on the conservation laws. I. From the angular momentum conservation, a nonzero helicity of $J/\psi$ of $B_c^{(\ast)+ } \to J/\psi \pi^+$ would be an evidence of $B_c^{\ast +}$. II. Since $B_c^+ \to B^+ \phi$ is kinematically forbidden, $ B_c^{\ast +} \to B^+ \phi$ provides a clean channel to probe $B_c^{\ast +}$\,. Particularly, our results show that $B_c^{\ast +}$ is promising to be observed at LHC via $B_c^{(\ast)+} \to J/\psi \pi^+$. On the other hand, we find that ${\cal B} ( B_c^{\ast+} \to B^+ \phi) = ( 7.0 \pm 3.0 ) \times 10 ^{-9} $, which is also feasible to be measured at the forthcoming experiments at HL-LHC and FCC-hh.


title: Time dependent numerical model for the very high energy emissions of distant gamma-ray busrt GRB 201216C

abstract: Recently, the MAGIC Collaboration reported a $\sim 5\sigma$ statistical significance of the very-high-energy (VHE) emission from a distant GRB, GRB 201216C. Such distant GRB may be effectively absorbed by the extragalactic background light (EBL). The origin of the VHE emission from such distant objects is still unknown. Here, we propose a numerical model for studying the afterglow emission of this distant GRB. The model solves the continuity equation governing the temporal evolution of electron distribution, and the broad-band observed data can be explained by the synchrotron plus synchrotron self-Compton (SSC) radiation of the forward shock. The predicted observed 0.1 TeV flux can reach $\sim 10^{-9} -10^{-10}\rm erg ~ cm^{-2} ~ s^{-1}$ at $t \sim 10^3 -10^4 \rm s$, even with strong EBL absorption, such strong Sub-TeV emissions still can be observed by MAGIC telescope. Using this numerical model, the shock parameters in the modeling are similar with two other Sub-TeV GRBs (i.e., GRB 190114C and GRB 180720B), implying that the Sub-TeV GRBs have some commonalities: they have energetic burst energy, low circum-burst medium density and low magnetic equipartition factor. We regard GRB 201216C as a typical GRB, and estimate the maximum redshift of GRB that can be detected by MAGIC telescope, i.e., $z \sim 1.6$. We also find that the VHE photon energy of such distant GRB can only reach $\sim 0.1 ~\rm TeV$. Improving the low energy sensitivity of the VHE telescope is very important to detect the Sub-TeV emissions of these distant GRBs.


title: OMG: Observe Multiple Granularities for Natural Language-Based Vehicle Retrieval

abstract: Retrieving tracked-vehicles by natural language descriptions plays a critical role in smart city construction. It aims to find the best match for the given texts from a set of tracked vehicles in surveillance videos. Existing works generally solve it by a dual-stream framework, which consists of a text encoder, a visual encoder and a cross-modal loss function. Although some progress has been made, they failed to fully exploit the information at various levels of granularity. To tackle this issue, we propose a novel framework for the natural language-based vehicle retrieval task, OMG, which Observes Multiple Granularities with respect to visual representation, textual representation and objective functions. For the visual representation, target features, context features and motion features are encoded separately. For the textual representation, one global embedding, three local embeddings and a color-type prompt embedding are extracted to represent various granularities of semantic features. Finally, the overall framework is optimized by a cross-modal multi-granularity contrastive loss function. Experiments demonstrate the effectiveness of our method. Our OMG significantly outperforms all previous methods and ranks the 9th on the 6th AI City Challenge Track2. The codes are available at https://github.com/dyhBUPT/OMG.


title: Long wave interaction with a partially immersed body. Part II: Numerical results

abstract: In this manuscript we perform an extensive numerical study of the long wave interaction problem with a fixed partially immersed body into a fluid layer. The incident wave is assumed to be an isolated solitary wave. The body in this study is assumed to be fixed with a rectangular section which is not touching the bottom of the channel. The mathematical modelling of this problem is based on Part I (Khakimzyanov and Dutykh 2020) of this series and considered models include the Nonlinear Shallow Water Equations (NSWE), fully nonlinear weakly dispersive Serre-Green-Naghdi Equations (SGN equations) (completed with appropriate compatibility conditions on solid/fluid boundaries) and the free surface irrotational full Euler equations (FEE). We study the influence of the floating body elongation, immersion depth and incident wave amplitude on the wave field before and after the obstacle. The comparison of all three models predictions and the data of small-scale laboratory experiments is performed. Moreover, in the framework of the FEE model we investigate the anomalous wave run-up behind the floating body in the close presence of a vertical wall. We demonstrate the cases where the vertical wall creates extreme wave amplitudes behind the body, but also we show the cases where the wall attenuates wave amplitudes comparing to the wave field without a wall.


title: How to Attain Communication-Efficient DNN Training? Convert, Compress, Correct

abstract: This paper introduces CO3 -- an algorithm for communication-efficient federated Deep Neural Network (DNN) training. CO3 takes its name from three processing applied which reduce the communication load when transmitting the local DNN gradients from the remote users to the Parameter Server. Namely: (i) gradient quantization through floating-point conversion, (ii) lossless compression of the quantized gradient, and (iii) quantization error correction. We carefully design each of the steps above to assure good training performance under a constraint on the communication rate. In particular, in steps (i) and (ii), we adopt the assumption that DNN gradients are distributed according to a generalized normal distribution, which is validated numerically in the paper. For step (iii), we utilize an error feedback with memory decay mechanism to correct the quantization error introduced in step (i). We argue that the memory decay coefficient, similarly to the learning rate, can be optimally tuned to improve convergence. A rigorous convergence analysis of the proposed CO3 with SGD is provided. Moreover, with extensive simulations, we show that CO3 offers improved performance when compared with existing gradient compression schemes in the literature which employ sketching and non-uniform quantization of the local gradients.