title: The zero-adjusted log-symmetric quantile regression model applied to extramarital affairs data

abstract: In this work, we propose a zero-adjusted log-symmetric quantile regression model. Initially, we introduce zero-adjusted log-symmetric distributions, which allow for the accommodation of zeros. The estimation of the parameters is approached by the maximum likelihood method and a Monte Carlo simulation is performed to evaluate the estimates. Finally, we illustrate the proposed methodology with the use of a real extramarital affairs data set.


title: Estimation of 3D Human Pose Using Prior Knowledge

abstract: Estimating three-dimensional human poses from the positions of two-dimensional joints has shown promising results.However, using two-dimensional joint coordinates as input loses more information than image-based approaches and results in ambiguity.In order to overcome this problem, we combine bone length and camera parameters with two-dimensional joint coordinates for input.This combination is more discriminative than the two-dimensional joint coordinates in that it can improve the accuracy of the model's prediction depth and alleviate the ambiguity that comes from projecting three-dimensional coordinates into two-dimensional space. Furthermore, we introduce direction constraints which can better measure the difference between the ground truth and the output of the proposed model. The experimental results on the H36M show that the method performed better than other state-of-the-art three-dimensional human pose estimation approaches.


title: On homological mirror symmetry for chain type polynomials

abstract: We consider Takahashi's categorical interpretation of the Berglund-Hubsch mirror symmetry conjecture for invertible polynomials in the case of chain polynomials. Our strategy is based on a stronger claim that the relevant categories satisfy a recursion of directed $A_{\infty}$-categories, which may be of independent interest. We give a full proof of this claim on the B-side. On the A-side we give a detailed sketch of an argument, which falls short of a full proof because of certain missing foundational results in Fukaya-Seidel categories, most notably a generation statement.


title: Superresolution photoacoustic tomography using random speckle illumination and second order moments

abstract: Idier et al. [IEEE Trans. Comput. Imaging 4(1), 2018] propose a method which achieves superresolution in the microscopy setting by leveraging random speckle illumination and knowledge about statistical second order moments for the illumination patterns and model noise. This is achieved without any assumptions on the sparsity of the imaged object. In this paper, we show that their technique can be extended to photoacoustic tomography. We propose a simple algorithm for doing the reconstruction which only requires a small number of linear algebra steps. It is therefore much faster than the iterative method used by Idier et al. We also propose a new representation of the imaged object based on Dirac delta expansion functions.


title: The Local Approach to Causal Inference under Network Interference

abstract: We propose a new nonparametric modeling framework for causal inference when outcomes depend on how agents are linked in a social or economic network. Such network interference describes a large literature on treatment spillovers, social interactions, social learning, information diffusion, disease and financial contagion, social capital formation, and more. Our approach works by first characterizing how an agent is linked in the network using the configuration of other agents and connections nearby as measured by path distance. The impact of a policy or treatment assignment is then learned by pooling outcome data across similarly configured agents. We demonstrate the approach by proposing an asymptotically valid test for the hypothesis of policy irrelevance/no treatment effects and bounding the mean-squared error of a k-nearest-neighbor estimator for the average or distributional policy effect/treatment response.


title: Click-Through Rate Prediction Using Graph Neural Networks and Online Learning

abstract: Recommendation systems have been extensively studied by many literature in the past and are ubiquitous in online advertisement, shopping industry/e-commerce, query suggestions in search engines, and friend recommendation in social networks. Moreover, restaurant/music/product/movie/news/app recommendations are only a few of the applications of a recommender system. A small percent improvement on the CTR prediction accuracy has been mentioned to add millions of dollars of revenue to the advertisement industry. Click-Through-Rate (CTR) prediction is a special version of recommender system in which the goal is predicting whether or not a user is going to click on a recommended item. A content-based recommendation approach takes into account the past history of the user's behavior, i.e. the recommended products and the users reaction to them. So, a personalized model that recommends the right item to the right user at the right time is the key to building such a model. On the other hand, the so-called collaborative filtering approach incorporates the click history of the users who are very similar to a particular user, thereby helping the recommender to come up with a more confident prediction for that particular user by leveraging the wider knowledge of users who share their taste in a connected network of users. In this project, we are interested in building a CTR predictor using Graph Neural Networks complemented by an online learning algorithm that models such dynamic interactions. By framing the problem as a binary classification task, we have evaluated this system both on the offline models (GNN, Deep Factorization Machines) with test-AUC of 0.7417 and on the online learning model with test-AUC of 0.7585 using a sub-sampled version of Criteo public dataset consisting of 10,000 data points.


title: Analysis and Mitigations of Reverse Engineering Attacks on Local Feature Descriptors

abstract: As autonomous driving and augmented reality evolve, a practical concern is data privacy. In particular, these applications rely on localization based on user images. The widely adopted technology uses local feature descriptors, which are derived from the images and it was long thought that they could not be reverted back. However, recent work has demonstrated that under certain conditions reverse engineering attacks are possible and allow an adversary to reconstruct RGB images. This poses a potential risk to user privacy. We take this a step further and model potential adversaries using a privacy threat model. Subsequently, we show under controlled conditions a reverse engineering attack on sparse feature maps and analyze the vulnerability of popular descriptors including FREAK, SIFT and SOSNet. Finally, we evaluate potential mitigation techniques that select a subset of descriptors to carefully balance privacy reconstruction risk while preserving image matching accuracy; our results show that similar accuracy can be obtained when revealing less information.


title: Adaptive and Risk-Aware Target Tracking with Heterogeneous Robot Teams

abstract: We consider a scenario where a team of robots with heterogeneous sensors must track a set of hostile targets which induce sensory failures on the robots. In particular, the likelihood of failures depends on the proximity between the targets and the robots. We propose a control framework that implicitly addresses the competing objectives of performance maximization and sensor preservation (which impacts the future performance of the team). Our framework consists of a predictive component -- which accounts for the risk of being detected by the target, and a reactive component -- which maximizes the performance of the team regardless of the failures that have already occurred. Based on a measure of the abundance of sensors in the team, our framework can generate aggressive and risk-averse robot configurations to track the targets. Crucially, the heterogeneous sensing capabilities of the robots are explicitly considered in each step, allowing for a more expressive risk-performance trade-off. Simulated experiments with induced sensor failures demonstrate the efficacy of the proposed approach.


title: Benchmarking a New Paradigm: An Experimental Analysis of a Real Processing-in-Memory Architecture

abstract: Many modern workloads, such as neural networks, databases, and graph processing, are fundamentally memory-bound. For such workloads, the data movement between main memory and CPU cores imposes a significant overhead in terms of both latency and energy. A major reason is that this communication happens through a narrow bus with high latency and limited bandwidth, and the low data reuse in memory-bound workloads is insufficient to amortize the cost of main memory access. Fundamentally addressing this data movement bottleneck requires a paradigm where the memory system assumes an active role in computing by integrating processing capabilities. This paradigm is known as processing-in-memory (PIM). Recent research explores different forms of PIM architectures, motivated by the emergence of new 3D-stacked memory technologies that integrate memory with a logic layer where processing elements can be easily placed. Past works evaluate these architectures in simulation or, at best, with simplified hardware prototypes. In contrast, the UPMEM company has designed and manufactured the first publicly-available real-world PIM architecture. This paper provides the first comprehensive analysis of the first publicly-available real-world PIM architecture. We make two key contributions. First, we conduct an experimental characterization of the UPMEM-based PIM system using microbenchmarks to assess various architecture limits such as compute throughput and memory bandwidth, yielding new insights. Second, we present PrIM, a benchmark suite of 16 workloads from different application domains (e.g., linear algebra, databases, graph processing, neural networks, bioinformatics).


title: Knowledge-based Review Generation by Coherence Enhanced Text Planning

abstract: As a natural language generation task, it is challenging to generate informative and coherent review text. In order to enhance the informativeness of the generated text, existing solutions typically learn to copy entities or triples from knowledge graphs (KGs). However, they lack overall consideration to select and arrange the incorporated knowledge, which tends to cause text incoherence. To address the above issue, we focus on improving entity-centric coherence of the generated reviews by leveraging the semantic structure of KGs. In this paper, we propose a novel Coherence Enhanced Text Planning model (CETP) based on knowledge graphs (KGs) to improve both global and local coherence for review generation. The proposed model learns a two-level text plan for generating a document: (1) the document plan is modeled as a sequence of sentence plans in order, and (2) the sentence plan is modeled as an entity-based subgraph from KG. Local coherence can be naturally enforced by KG subgraphs through intra-sentence correlations between entities. For global coherence, we design a hierarchical self-attentive architecture with both subgraph- and node-level attention to enhance the correlations between subgraphs. To our knowledge, we are the first to utilize a KG-based text planning model to enhance text coherence for review generation. Extensive experiments on three datasets confirm the effectiveness of our model on improving the content coherence of generated texts.


title: Some diophantine problems concerning a pair of rational triangles with a common circumradius

abstract: A triangle with rational sides and rational area is called a rational triangle. In this paper we consider three problems of finding pairs of rational triangles which have a common circumradius as well as either a common perimeter or a common inradius or a common area. While several similar problems concerning pairs of rational triangles have been considered in the existing literature, these three problems have not been studied till now. For each of these problems, we give a parametric solution and we also indicate how additional parametric solutions of these problems may be obtained.


title: TrTr: Visual Tracking with Transformer

abstract: Template-based discriminative trackers are currently the dominant tracking methods due to their robustness and accuracy, and the Siamese-network-based methods that depend on cross-correlation operation between features extracted from template and search images show the state-of-the-art tracking performance. However, general cross-correlation operation can only obtain relationship between local patches in two feature maps. In this paper, we propose a novel tracker network based on a powerful attention mechanism called Transformer encoder-decoder architecture to gain global and rich contextual interdependencies. In this new architecture, features of the template image is processed by a self-attention module in the encoder part to learn strong context information, which is then sent to the decoder part to compute cross-attention with the search image features processed by another self-attention module. In addition, we design the classification and regression heads using the output of Transformer to localize target based on shape-agnostic anchor. We extensively evaluate our tracker TrTr, on VOT2018, VOT2019, OTB-100, UAV, NfS, TrackingNet, and LaSOT benchmarks and our method performs favorably against state-of-the-art algorithms. Training code and pretrained models are available at https://github.com/tongtybj/TrTr.


title: Heterogeneous Risk Minimization

abstract: Machine learning algorithms with empirical risk minimization usually suffer from poor generalization performance due to the greedy exploitation of correlations among the training data, which are not stable under distributional shifts. Recently, some invariant learning methods for out-of-distribution (OOD) generalization have been proposed by leveraging multiple training environments to find invariant relationships. However, modern datasets are frequently assembled by merging data from multiple sources without explicit source labels. The resultant unobserved heterogeneity renders many invariant learning methods inapplicable. In this paper, we propose Heterogeneous Risk Minimization (HRM) framework to achieve joint learning of latent heterogeneity among the data and invariant relationship, which leads to stable prediction despite distributional shifts. We theoretically characterize the roles of the environment labels in invariant learning and justify our newly proposed HRM framework. Extensive experimental results validate the effectiveness of our HRM framework.


title: Evaluating Deep Neural Network Ensembles by Majority Voting cum Meta-Learning scheme

abstract: Deep Neural Networks (DNNs) are prone to overfitting and hence have high variance. Overfitted networks do not perform well for a new data instance. So instead of using a single DNN as classifier we propose an ensemble of seven independent DNN learners by varying only the input to these DNNs keeping their architecture and intrinsic properties same. To induce variety in the training input, for each of the seven DNNs, one-seventh of the data is deleted and replenished by bootstrap sampling from the remaining samples. We have proposed a novel technique for combining the prediction of the DNN learners in the ensemble. Our method is called pre-filtering by majority voting coupled with stacked meta-learner which performs a two-step confi-dence check for the predictions before assigning the final class labels. All the algorithms in this paper have been tested on five benchmark datasets name-ly, Human Activity Recognition (HAR), Gas sensor array drift, Isolet, Spam-base and Internet advertisements. Our ensemble approach achieves higher accuracy than a single DNN and the average individual accuracies of DNNs in the ensemble, as well as the baseline approaches of plurality voting and meta-learning.


title: Quantum-enhanced SU(1,1) interferometry via a Fock state

abstract: In this paper, we derive a general expression of the quantum Fisher information of an SU(1,1) interferometer with an arbitrary state and a Fock state as inputs by the phase-averaging method. Our results show that the same quantum Fisher information can be obtained regardless of the specific form of the arbitrary state. Then, we analytically prove that the parity measurement can saturate the quantum Cramer-Rao bound when the estimated phase sits at the optimal working point. For practical reasons, we investigate the phase sensitivity when the arbitrary state is a coherent or thermal state. We further show that a Fock state can indeed enhance the phase sensitivity within a constraint on the total mean photon number inside the interferometer.


title: Graph Inference Representation: Learning Graph Positional Embeddings with Anchor Path Encoding

abstract: Learning node representations that incorporate information from graph structure benefits wide range of tasks on graph. The majority of existing graph neural networks (GNNs) have limited power in capturing position information for a given node. The idea of positioning nodes with selected anchors has been exploited, yet mainly relying on explicit labeling of distance information. Here we propose Graph Inference Representation (GIR), an anchor based GNN model encoding path information related to pre-selected anchors for each node. Abilities to get position-aware embeddings are theoretically and experimentally investigated on GIR and its core variants. Further, the complementarity between GIRs and typical GNNs is demonstrated. We show that GIRs get outperformed results in position-aware scenarios, and performances on typical GNNs could be improved by fusing GIR embeddings.


title: RBNN: Memory-Efficient Reconfigurable Deep Binary Neural Network with IP Protection for Internet of Things

abstract: Though deep neural network models exhibit outstanding performance for various applications, their large model size and extensive floating-point operations render deployment on mobile computing platforms a major challenge, and, in particular, on Internet of Things devices. One appealing solution is model quantization that reduces the model size and uses integer operations commonly supported by microcontrollers . To this end, a 1-bit quantized DNN model or deep binary neural network maximizes the memory efficiency, where each parameter in a BNN model has only 1-bit. In this paper, we propose a reconfigurable BNN (RBNN) to further amplify the memory efficiency for resource-constrained IoT devices. Generally, the RBNN can be reconfigured on demand to achieve any one of M (M>1) distinct tasks with the same parameter set, thus only a single task determines the memory requirements. In other words, the memory utilization is improved by times M. Our extensive experiments corroborate that up to seven commonly used tasks can co-exist (the value of M can be larger). These tasks with a varying number of classes have no or negligible accuracy drop-off on three binarized popular DNN architectures including VGG, ResNet, and ReActNet. The tasks span across different domains, e.g., computer vision and audio domains validated herein, with the prerequisite that the model architecture can serve those cross-domain tasks. To protect the intellectual property of an RBNN model, the reconfiguration can be controlled by both a user key and a device-unique root key generated by the intrinsic hardware fingerprint. By doing so, an RBNN model can only be used per paid user per authorized device, thus benefiting both the user and the model provider.


title: Complementary inequalities to Davis-Choi-Jensen's inequality and operator power means

abstract: Let $f$ be an operator convex function on $(0,\infty)$, and $\Phi$ be a unital positive linear maps on $B(H)$. we give a complementary inequality to Davis-Choi-Jensen's inequality as follows \begin{equation*} f(\Phi(A))\geq \frac{4R(A,B)}{(1+R(A,B))^2}\Phi(f(A)), \end{equation*} where $R(A, B)=\max\{r(A^{-1}B) ,r(B^{-1}A)\}$ and $r(A)$ is the spectral radius of $A$. We investigate the complementary inequalities related to the operator power means and the Karcher means via unital positive linear maps, and obtain the following result: If $A_{1}$, $A_{2}$,\dots, $A_{n}$, are positive definite operators in $B(H)$, and $0<m_i\leq A_i\leq M_i$, then \begin{equation*} \Lambda( \omega;\Phi(\mathbb{A}))\geq\Phi(\Lambda( \omega; \mathbb{A}))\geq \frac{4\hbar}{(1+\hbar)^2}~\Lambda( \omega;\Phi(\mathbb{A})), \end{equation*} where $\hbar= \max\limits_{1\leq i\leq n} \frac{M_i}{m_i}$. Finally, we prove that if $G(A_1,\dots,A_n)$ is the generalized geometric mean defined by Ando-Li-Mathias for $n$ positive definite operators, then \begin{align*} \Phi(G(A_1,\dots,A_n))\geq\left(\frac{2h^\frac{1}{2}}{1+h}\right)^{n-1}G(\Phi(A_1),\dots,\Phi(A_n)), \end{align*} where $h=\max\limits_{1\leq i,j\leq n} R(A_i, A_j)$.


title: FNet: Mixing Tokens with Fourier Transforms

abstract: We show that Transformer encoder architectures can be sped up, with limited accuracy costs, by replacing the self-attention sublayers with simple linear transformations that "mix" input tokens. These linear mixers, along with standard nonlinearities in feed-forward layers, prove competent at modeling semantic relationships in several text classification tasks. Most surprisingly, we find that replacing the self-attention sublayer in a Transformer encoder with a standard, unparameterized Fourier Transform achieves 92-97% of the accuracy of BERT counterparts on the GLUE benchmark, but trains 80% faster on GPUs and 70% faster on TPUs at standard 512 input lengths. At longer input lengths, our FNet model is significantly faster: when compared to the "efficient" Transformers on the Long Range Arena benchmark, FNet matches the accuracy of the most accurate models, while outpacing the fastest models across all sequence lengths on GPUs (and across relatively shorter lengths on TPUs). Finally, FNet has a light memory footprint and is particularly efficient at smaller model sizes; for a fixed speed and accuracy budget, small FNet models outperform Transformer counterparts.


title: Norm inequalities related to Heinz and Heron operator means

abstract: In this article we present some new comparisons between the Heinz and Heron operator means, which improve some recent results known from the literature. We derive some refinements of these inequalities for unitarily invariant norms with the help of the contractive maps.


title: A Hybrid Model for Combining Neural Image Caption and k-Nearest Neighbor Approach for Image Captioning

abstract: A hybrid model is proposed that integrates two popular image captioning methods to generate a text-based summary describing the contents of the image. The two image captioning models are the Neural Image Caption (NIC) and the k-nearest neighbor approach. These are trained individually on the training set. We extract a set of five features, from the validation set, for evaluating the results of the two models that in turn is used to train a logistic regression classifier. The BLEU-4 scores of the two models are compared for generating the binary-value ground truth for the logistic regression classifier. For the test set, the input images are first passed separately through the two models to generate the individual captions. The five-dimensional feature set extracted from the two models is passed to the logistic regression classifier to take a decision regarding the final caption generated which is the best of two captions generated by the models. Our implementation of the k-nearest neighbor model achieves a BLEU-4 score of 15.95 and the NIC model achieves a BLEU-4 score of 16.01, on the benchmark Flickr8k dataset. The proposed hybrid model is able to achieve a BLEU-4 score of 18.20 proving the validity of our approach.


title: Good Practices and A Strong Baseline for Traffic Anomaly Detection

abstract: The detection of traffic anomalies is a critical component of the intelligent city transportation management system. Previous works have proposed a variety of notable insights and taken a step forward in this field, however, dealing with the complex traffic environment remains a challenge. Moreover, the lack of high-quality data and the complexity of the traffic scene, motivate us to study this problem from a hand-crafted perspective. In this paper, we propose a straightforward and efficient framework that includes pre-processing, a dynamic track module, and post-processing. With video stabilization, background modeling, and vehicle detection, the pro-processing phase aims to generate candidate anomalies. The dynamic tracking module seeks and locates the start time of anomalies by utilizing vehicle motion patterns and spatiotemporal status. Finally, we use post-processing to fine-tune the temporal boundary of anomalies. Not surprisingly, our proposed framework was ranked $1^{st}$ in the NVIDIA AI CITY 2021 leaderboard for traffic anomaly detection. The code is available at: https://github.com/Endeavour10020/AICity2021-Anomaly-Detection .


title: Impacts of Privately Owned Electric Vehicles on Distribution System Resilience: A Multi-agent Optimization Approach

abstract: We investigate the effects of private electric vehicles (EVs) on the resilience of distribution systems after disruptions. We propose a framework of network-based multi-agent optimization problems with equilibrium constraints (N-MOPEC) to consider the decentralized decision making of stakeholders in transportation and energy systems. To solve the high-dimensional non-convex problem, we develop an efficient computational algorithm based on exact convex reformulation. Numerical studies are conducted to illustrate the effectiveness of our modeling and computational approach and to draw policy insights. The proposed modeling and computational strategies could provide a solid foundation for the future study of power system resilience with private EVs in coupled transportation and power networks.


title: The peculiar short-duration GRB 200826A and its supernova

abstract: Gamma-ray bursts (GRBs) are classified as long and short events. Long GRBs (LGRBs) are associated with the end states of very massive stars, while short GRBs (SGRBs) are linked to the merger of compact objects. GRB 200826A was a peculiar event, because by definition it was a SGRB, with a rest-frame duration of ~ 0.5 s. However, this event was energetic and soft, which is consistent with LGRBs. The relatively low redshift (z = 0.7486) motivated a comprehensive, multi-wavelength follow-up campaign to characterize its host, search for a possible associated supernova (SN), and thus understand the origin of this burst. To this aim we obtained a combination of deep near-infrared (NIR) and optical imaging together with spectroscopy. Our analysis reveals an optical and NIR bump in the light curve whose luminosity and evolution is in agreement with several LGRB-SNe. Analysis of the prompt GRB shows that this event follows the $E_{\rm p,i}-E_{\rm iso}$ relation found for LGRBs. The host galaxy is a low-mass star-forming galaxy, typical for LGRBs, but with one of the highest star-formation rates (SFR), especially with respect to its mass ($\log M_\ast/M_\odot = 8.6$, SFR $\sim 4.0 \,M_\odot$/yr). We conclude that GRB 200826A is a typical collapsar event in the low tail of the duration distribution of LGRBs. These findings support theoretical predictions that events produced by collapsars can be as short as 0.5 s in the host frame and further confirm that duration alone is not an efficient discriminator for the progenitor class of a GRB.


title: Beyond Monocular Deraining: Parallel Stereo Deraining Network Via Semantic Prior

abstract: Rain is a common natural phenomenon. Taking images in the rain however often results in degraded quality of images, thus compromises the performance of many computer vision systems. Most existing de-rain algorithms use only one single input image and aim to recover a clean image. Few work has exploited stereo images. Moreover, even for single image based monocular deraining, many current methods fail to complete the task satisfactorily because they mostly rely on per pixel loss functions and ignore semantic information. In this paper, we present a Paired Rain Removal Network (PRRNet), which exploits both stereo images and semantic information. Specifically, we develop a Semantic-Aware Deraining Module (SADM) which solves both tasks of semantic segmentation and deraining of scenes, and a Semantic-Fusion Network (SFNet) and a View-Fusion Network (VFNet) which fuse semantic information and multi-view information respectively. In addition, we also introduce an Enhanced Paired Rain Removal Network (EPRRNet) which exploits semantic prior to remove rain streaks from stereo images. We first use a coarse deraining network to reduce the rain streaks on the input images, and then adopt a pre-trained semantic segmentation network to extract semantic features from the coarse derained image. Finally, a parallel stereo deraining network fuses semantic and multi-view information to restore finer results. We also propose new stereo based rainy datasets for benchmarking. Experiments on both monocular and the newly proposed stereo rainy datasets demonstrate that the proposed method achieves the state-of-the-art performance.


title: Super Solutions of the Model RB

abstract: The concept of super solution is a special type of generalized solutions with certain degree of robustness and stability. In this paper we consider the $(1,1)$-super solutions of the model RB. Using the first moment method, we establish a "threshold" such that as the constraint density crosses this value, the expected number of $(1,1)$-super solutions goes from $0$ to infinity.


title: Dataset and Performance Comparison of Deep Learning Architectures for Plum Detection and Robotic Harvesting

abstract: Many automated operations in agriculture, such as weeding and plant counting, require robust and accurate object detectors. Robotic fruit harvesting is one of these, and is an important technology to address the increasing labour shortages and uncertainty suffered by tree crop growers. An eye-in-hand sensing setup is commonly used in harvesting systems and provides benefits to sensing accuracy and flexibility. However, as the hand and camera move from viewing the entire trellis to picking a specific fruit, large changes in lighting, colour, obscuration and exposure occur. Object detection algorithms used in harvesting should be robust to these challenges, but few datasets for assessing this currently exist. In this work, two new datasets are gathered during day and night operation of an actual robotic plum harvesting system. A range of current generation deep learning object detectors are benchmarked against these. Additionally, two methods for fusing depth and image information are tested for their impact on detector performance. Significant differences between day and night accuracy of different detectors is found, transfer learning is identified as essential in all cases, and depth information fusion is assessed as only marginally effective. The dataset and benchmark models are made available online.


title: Euclidean Distance-Optimal Post-Processing of Grid-Based Paths

abstract: Paths planned over grids can often be suboptimal in an Euclidean space and contain a large number of unnecessary turns. Consequently, researchers have looked into post-processing techniques to improve the paths after they are planned. In this paper, we propose a novel post-processing technique, called Homotopic Visibility Graph Planning (HVG) which differentiates itself from existing post-processing methods in that it is guaranteed to shorten the path such that it is at least as short as the provably shortest path that lies within the same topological class as the initially computed path. We propose the algorithm, provide proofs and compare it experimentally against other post-processing methods and any-angle planning algorithms.


title: Learning Image Attacks toward Vision Guided Autonomous Vehicles

abstract: While adversarial neural networks have been shown successful for static image attacks, very few approaches have been developed for attacking online image streams while taking into account the underlying physical dynamics of autonomous vehicles, their mission, and environment. This paper presents an online adversarial machine learning framework that can effectively misguide autonomous vehicles' missions. In the existing image attack methods devised toward autonomous vehicles, optimization steps are repeated for every image frame. This framework removes the need for fully converged optimization at every frame to realize image attacks in real-time. Using reinforcement learning, a generative neural network is trained over a set of image frames to obtain an attack policy that is more robust to dynamic and uncertain environments. A state estimator is introduced for processing image streams to reduce the attack policy's sensitivity to physical variables such as unknown position and velocity. A simulation study is provided to validate the results.


title: Segmenting Hybrid Trajectories using Latent ODEs

abstract: Smooth dynamics interrupted by discontinuities are known as hybrid systems and arise commonly in nature. Latent ODEs allow for powerful representation of irregularly sampled time series but are not designed to capture trajectories arising from hybrid systems. Here, we propose the Latent Segmented ODE (LatSegODE), which uses Latent ODEs to perform reconstruction and changepoint detection within hybrid trajectories featuring jump discontinuities and switching dynamical modes. Where it is possible to train a Latent ODE on the smooth dynamical flows between discontinuities, we apply the pruned exact linear time (PELT) algorithm to detect changepoints where latent dynamics restart, thereby maximizing the joint probability of a piece-wise continuous latent dynamical representation. We propose usage of the marginal likelihood as a score function for PELT, circumventing the need for model complexity-based penalization. The LatSegODE outperforms baselines in reconstructive and segmentation tasks including synthetic data sets of sine waves, Lotka Volterra dynamics, and UCI Character Trajectories.


title: Optimized Low-Depth Quantum Circuits for Molecular Electronic Structure using a Separable Pair Approximation

abstract: We present a classically solvable model that leads to optimized low-depth quantum circuits leveraging separable pair approximations. The obtained circuits are well suited as a baseline circuit for emerging quantum hardware and can, in the long term, provide significantly improved initial states for quantum algorithms. The associated wavefunctions can be represented with linear memory requirement which allows classical optimization of the circuits and naturally defines a minimum benchmark for quantum algorithms. In this work, we employ directly determined pair-natural orbitals within a basis-set-free approach. This leads to an accurate representation of the one- and many-body parts for weakly correlated systems and we explicitly illustrate how the model can be integrated into variational and projective quantum algorithms for stronger correlated systems.


title: Exploring Bell nonlocality of quantum networks with stabilizing and logical operators

abstract: In practical quantum networks, a variety of multi-qubit stabilized states emitted from independent sources are distributed among the agents, and the correlations across the entire network can be derived from each agent's local measurements on the shared composite quantum systems. To reveal the Bell non-locality in such cases as a quantum feature, minimal knowledge of the emitted stabilizer state is required. Here, we demonstrate that knowing the stabilizing and logical operators indeed provides a new way of exploring Bell non-locality in quantum networks. For the qubit distribution in quantum networks, the associated nonlinear Bell inequalities are derived. On the other hand, to violate these inequalities, one can design local incompatible observables using minimal knowledge of the emitted states. The tilted nonlinear Bell inequalities tailored for specific non-maximal entangled stabilizer states and a way of achieving the maximal violation are also explored.


title: HyperHyperNetworks for the Design of Antenna Arrays

abstract: We present deep learning methods for the design of arrays and single instances of small antennas. Each design instance is conditioned on a target radiation pattern and is required to conform to specific spatial dimensions and to include, as part of its metallic structure, a set of predetermined locations. The solution, in the case of a single antenna, is based on a composite neural network that combines a simulation network, a hypernetwork, and a refinement network. In the design of the antenna array, we add an additional design level and employ a hypernetwork within a hypernetwork. The learning objective is based on measuring the similarity of the obtained radiation pattern to the desired one. Our experiments demonstrate that our approach is able to design novel antennas and antenna arrays that are compliant with the design requirements, considerably better than the baseline methods. We compare the solutions obtained by our method to existing designs and demonstrate a high level of overlap. When designing the antenna array of a cellular phone, the obtained solution displays improved properties over the existing one.


title: News Kaleidoscope: Visual Investigation of Coverage Diversity in News Event Reporting

abstract: We develop a visual analytics system, NewsKaleidoscope, to investigate the how news reporting of events varies. NewsKaleidoscope combines several backend text language processing techniques with a coordinated visualization interface tailored for visualization non-expert users. To robustly evaluate NewsKaleidoscope, we conduct a trio of user studies. (1) A usability study with news novices assesses the overall system and the specific insights promoted for journalism-agnostic users. (2) A follow-up study with news experts assesses the insights promoted for journalism-savvy users. (3) Based on identified system limitations in these two studies, we amend NewsKaleidoscope design and conduct a third study to validate these improvements. Results indicate that, for both news novice and experts, NewsKaleidoscope supports an effective, task-driven workflow for analyzing the diversity of news coverage about events, though journalism expertise has a significant influence on the user insights and takeaways. Our insights while developing and evaluating NewsKaleidoscope can aid future interface designs that combine visualization with natural language processing to analyze coverage diversity in news event reporting.


title: The geodesic total curvature of spherical curves

abstract: The geodesic total curvature of rectifiable spherical curves is analyzed. We extend to the case of high dimension spheres the explicit formula that holds true for curves supported into the 2-sphere. For this purpose, we take advantage of some new integral-geometric formulas concerning both the Euclidean and geodesic total curvature of spherical curves.


title: The Temporal Dictionary Ensemble (TDE) Classifier for Time Series Classification

abstract: Using bag of words representations of time series is a popular approach to time series classification. These algorithms involve approximating and discretising windows over a series to form words, then forming a count of words over a given dictionary. Classifiers are constructed on the resulting histograms of word counts. A 2017 evaluation of a range of time series classifiers found the bag of symbolic-fourier approximation symbols (BOSS) ensemble the best of the dictionary based classifiers. It forms one of the components of hierarchical vote collective of transformation-based ensembles (HIVE-COTE), which represents the current state of the art. Since then, several new dictionary based algorithms have been proposed that are more accurate or more scalable (or both) than BOSS. We propose a further extension of these dictionary based classifiers that combines the best elements of the others combined with a novel approach to constructing ensemble members based on an adaptive Gaussian process model of the parameter space. We demonstrate that the temporal dictionary ensemble (TDE) is more accurate than other dictionary based approaches. Furthermore, unlike the other classifiers, if we replace BOSS in HIVE-COTE with TDE, HIVE-COTE is significantly more accurate. We also show this new version of HIVE-COTE is significantly more accurate than the current best deep learning approach, a recently proposed hybrid tree ensemble and a recently introduced competitive classifier making use of highly randomised convolutional kernels. This advance represents a new state of the art for time series classification.


title: FastCorrect: Fast Error Correction with Edit Alignment for Automatic Speech Recognition

abstract: Error correction techniques have been used to refine the output sentences from automatic speech recognition (ASR) models and achieve a lower word error rate (WER) than original ASR outputs. Previous works usually use a sequence-to-sequence model to correct an ASR output sentence autoregressively, which causes large latency and cannot be deployed in online ASR services. A straightforward solution to reduce latency, inspired by non-autoregressive (NAR) neural machine translation, is to use an NAR sequence generation model for ASR error correction, which, however, comes at the cost of significantly increased ASR error rate. In this paper, observing distinctive error patterns and correction operations (i.e., insertion, deletion, and substitution) in ASR, we propose FastCorrect, a novel NAR error correction model based on edit alignment. In training, FastCorrect aligns each source token from an ASR output sentence to the target tokens from the corresponding ground-truth sentence based on the edit distance between the source and target sentences, and extracts the number of target tokens corresponding to each source token during edition/correction, which is then used to train a length predictor and to adjust the source tokens to match the length of the target sentence for parallel generation. In inference, the token number predicted by the length predictor is used to adjust the source tokens for target sequence generation. Experiments on the public AISHELL-1 dataset and an internal industrial-scale ASR dataset show the effectiveness of FastCorrect for ASR error correction: 1) it speeds up the inference by 6-9 times and maintains the accuracy (8-14% WER reduction) compared with the autoregressive correction model; and 2) it outperforms the popular NAR models adopted in neural machine translation and text edition by a large margin.


title: Is math useful?

abstract: "Is math useful?" might sound as a trick question. And it is. Of course math is useful, we live in a data-filled world and every aspect of life is totally entwined with math applications, both trivial and subtle applications, of both basic and advanced math. But we need to ask once again that question, in order to truly understand what is math useful for and what being useful means. Moreover, is it knowledge of math useful for a class of specialists, or for political leaders or for all people at large? Being more on a concrete level, why does math need to have a central role in education? Each section will be titled by a question. And each section will not give an answer, but -- at least I hope -- provide some food for tought to the reader, in order to try to come up with his or her own answers. I feel that these kind of questions are at home in a book devoted to the interplays between mathematics and culture: what is the space we should give to math in culture and what is math's role in becoming a complete citizen?


title: Reinforcement Learning with Expert Trajectory For Quantitative Trading

abstract: In recent years, quantitative investment methods combined with artificial intelligence have attracted more and more attention from investors and researchers. Existing related methods based on the supervised learning are not very suitable for learning problems with long-term goals and delayed rewards in real futures trading. In this paper, therefore, we model the price prediction problem as a Markov decision process (MDP), and optimize it by reinforcement learning with expert trajectory. In the proposed method, we employ more than 100 short-term alpha factors instead of price, volume and several technical factors in used existing methods to describe the states of MDP. Furthermore, unlike DQN (deep Q-learning) and BC (behavior cloning) in related methods, we introduce expert experience in training stage, and consider both the expert-environment interaction and the agent-environment interaction to design the temporal difference error so that the agents are more adaptable for inevitable noise in financial data. Experimental results evaluated on share price index futures in China, including IF (CSI 300) and IC (CSI 500), show that the advantages of the proposed method compared with three typical technical analysis and two deep leaning based methods.


title: Measurement of surface deformation and cohesion of a granular pile under the effect of centrifugal force

abstract: An experimental apparatus measuring free-surface deformation of a centrifuged granular pile is developed. By horizontally rotating a quasi two-dimensional granular pile whose apex is located at the vertical rotation axis, the resultant force of gravity and centrifuge yields the deformation of the granular pile. In this setup, centrifugal force depends on distance from the rotation axis whilst gravitational force is constant everywhere. Therefore, free-surface deformation by various centrifuge degrees can be systematically examined using this apparatus. In the system, a small unit consisting of a camera and computer is rotated with the granular sample to record the rotation-induced deformation. To evaluate the validity of the system, deformation of a rotated water surface is first measured and analyzed. The obtained data are properly explained by the theoretical parabolas without any fitting parameter. Next, we measure the deformation of non-cohesive and cohesive granular piles using the developed apparatus. Both granular samples show the significant deformation of granular pile and finally develop steep granular slopes on the side walls. However, details of the deformation processes depend on the cohesion strength. To quantitatively characterize the difference, the effective strength by cohesion and granular local-slope variations are analyzed based on the experimental results.


title: Sensing Strain-induced Symmetry Breaking by Reflectance Anisotropy Spectroscopy

abstract: Intentional breaking of the lattice symmetry in solids is a key concept to alter the properties of materials by modifying their electronic band structure. However, the correlation of strain-induced effects and breaking of the lattice symmetry is often indirect, resorting to vibrational spectroscopic techniques such as Raman scattering. Here, we demonstrate that reflectance anisotropy spectroscopy (RAS), which directly depends on the complex dielectric function, enables the direct observation of electronic band structure modulation. Studying the strain-induced symmetry breaking in copper, we show how uniaxial strain lifts the degeneracy of states in the proximity of the both L and X symmetry points, thus altering the matrix element for interband optical transitions, directly observable in RAS. We corroborate our experimental results by analysing the strain-induced changes in the electronic structure based on ab-initio density functional theory calculations. The versatility to study breaking of the lattice symmetry by simple reflectance measurements opens up the possibility to gain a direct insight on the band-structure of other strain-engineered materials, such as graphene and two-dimensional (2D) transition metal dichalcogenides (TMDCs).


title: Automatic segmentation of vertebral features on ultrasound spine images using Stacked Hourglass Network

abstract: Objective: The spinous process angle (SPA) is one of the essential parameters to denote three-dimensional (3-D) deformity of spine. We propose an automatic segmentation method based on Stacked Hourglass Network (SHN) to detect the spinous processes (SP) on ultrasound (US) spine images and to measure the SPAs of clinical scoliotic subjects. Methods: The network was trained to detect vertebral SP and laminae as five landmarks on 1200 ultrasound transverse images and validated on 100 images. All the processed transverse images with highlighted SP and laminae were reconstructed into a 3D image volume, and the SPAs were measured on the projected coronal images. The trained network was tested on 400 images by calculating the percentage of correct keypoints (PCK); and the SPA measurements were evaluated on 50 scoliotic subjects by comparing the results from US images and radiographs. Results: The trained network achieved a high average PCK (86.8%) on the test datasets, particularly the PCK of SP detection was 90.3%. The SPAs measured from US and radiographic methods showed good correlation (r>0.85), and the mean absolute differences (MAD) between two modalities were 3.3{\deg}, which was less than the clinical acceptance error (5{\deg}). Conclusion: The vertebral features can be accurately segmented on US spine images using SHN, and the measurement results of SPA from US data was comparable to the gold standard from radiography.


title: Seasonal Variation of Multiple-Muon Cosmic Ray Air Showers Observed in the NOvA Detector on the Surface

abstract: We report the rate of cosmic ray air showers with multiplicities exceeding 15 muon tracks recorded in the NOvA Far Detector between May 2016 and May 2018. The detector is located on the surface under an overburden of 3.6 meters water equivalent. We observe a seasonal dependence in the rate of multiple-muon showers, which varies in magnitude with multiplicity and zenith angle. During this period, the effective atmospheric temperature and surface pressure ranged between 210 K to 230 K and 940mbar to 990mbar, respectively; the shower rates are anti-correlated with the variation in the effective temperature. The variations are about 30% larger for the highest multiplicities than the lowest multiplicities and 20% larger for showers near the horizon than vertical showers.


title: Higher-Dimensional Minimal Theory of Mass-Varying Massive Gravity And Its Cosmological Consequences

abstract: In this paper we construct higher-dimensional minimal theory of mass-varying massive gravity (MTMVMG) where the masslike scalar potential is coupled to a vielbein potential, unlike in the previous literature where it is coupled to metric, such that the number of graviton degrees of freedom in the theory is the same as in general relativity. We then study the cosmological aspects of this theory and show that it has eight critical points: five in the massless sector and three in the massive sector. In contrast to the standard theory of mass-varying massive gravity where the graviton mass asymptotically approaches zero at late times, hence making the contribution of massive gravity to the late-time cosmic expansion minimum, the MTMVMG can provide good descriptions both in the massless and massive sectors. Especially, there are at least two interesting possible scenarios for the late-time cosmology in the theory: the dark energy is either due to the constant graviton mass which comes from the scalar field that becomes frozen after the reheating era, or due to the quintessence paradigm where the scalar field is dynamic. Therefore, if the accelerating expansion of the universe in the massless sector can be explained by standard quintessence paradigm, in the massive sector it has to be explained by the nontrivial interplay between quintessence and massive gravity.


title: Proposal of Bragg Diffraction Imaging on Protein Crystals with Precession-Electron Annular-Bright-Field Microscopy

abstract: In this theoretical study, the author firstly discusses the wave interference of Bragg diffraction inside 3D crystal, followed by quantum mechanical interpretation on the diffraction process, and proves that the interference fringe between Bragg diffraction and the incident beam is identical to the lattice plane. By introducing the beam expander concept, we may explain the image projection mechanism of Bragg diffractions propagating through TEM: Transmission Electron Microscope. In practice, we will take projection images at zone axes, because of its symmetric high-density diffractions associated with flat Ewald sphere and minimum overlap with the neighboring molecules. By precessing the illuminating beam around the zone axis, and introducing annular objective aperture, we select only the kinematic Bragg diffractions which correctly contribute to the real image reconstruction on the 2D electron detector. The outcome should be a positive contrast, clean image with no dynamical diffractions nor Moir\'e patterns. Importantly, the image should be insensitive to the defocus, and the spatial resolution may not be limited by the spherical and the chromatic aberrations of objective lens. Therefore, the imaging of small molecules, such as, the drug structure will be straightforward. By taking multiple projection images at the different zone axes from many micro-crystals, or from surrounding thin edges of a large crystal, we may reconstruct 3D structure of the larger protein complex in atomic resolution.


title: Employing Agent Beliefs during Fault Diagnosis for IEC 61499 Industrial Cyber-Physical Systems

abstract: We have come to rely on industrial-scale cyber-physical systems more and more to manage tasks and machinery in safety-critical situations. Efficient, reliable fault identification and management has become a critical factor in the design of these increasingly sophisticated and complex devices. Teams of co-operating software agents are one way to coordinate the flow of diagnostic information gathered during fault-finding. By wielding domain knowledge of the software architecture used to construct the system, agents build and refine their beliefs about the location and root cause of faults. This paper examines how agents constructed within the GORITE Multi-Agent Framework create and refine their beliefs. We demonstrate three different belief structures implemented within our Fault Diagnostic Engine, showing how each supports a distinct aspect of the agent's reasoning. Using domain knowledge of the IEC 61499 Function Block architecture, agents are able to examine and rigorously evaluate both individual components and entire subsystems.


title: Towards Dynamic Feature Selection with Attention to Assist Banking Customers in Establishing a New Business

abstract: Establishing a new business may involve Knowledge acquisition in various areas, from personal to business and marketing sources. This task is challenging as it requires examining various data islands to uncover hidden patterns and unknown correlations such as purchasing behavior, consumer buying signals, and demographic and socioeconomic attributes of different locations. This paper introduces a novel framework for extracting and identifying important features from banking and non-banking data sources to address this challenge. We present an attention-based supervised feature selection approach to select important and relevant features which contribute most to the customer's query regarding establishing a new business. We report on the experiment conducted on an openly available dataset created from Kaggle and the UCI machine learning repositories.


title: Static Black Holes of Higher Dimensional Einstein-Skyrme System with General Couplings

abstract: We construct hairy static black holes of higher dimensional general coupling Einstein-Skyrme theories with the scalar potential turned on and the cosmological constant is non-positive in which the scalar multiplets satisfy $O(d+1)$ model constraint where $d$ is the spatial dimension of the spacetime and $d \ge 3$. Some physical properties of solutions near the boundaries, namely, near the (event) horizon and in the asymptotic region are discussed. Then, we prove that these black hole solutions exist globally which may have finite energy for non-positive cosmological constant. Finally, we use perturbative method to perform a linear dynamical stability analysis and then, show the existence of stable and unstable solutions in the model.


title: Surrogate Modeling of Fluid Dynamics with a Multigrid Inspired Neural Network Architecture

abstract: Algebraic or geometric multigrid methods are commonly used in numerical solvers as they are a multi-resolution method able to handle problems with multiple scales. In this work, we propose a modification to the commonly-used U-Net neural network architecture that is inspired by the principles of multigrid methods, referred to here as U-Net-MG. We then demonstrate that this proposed U-Net-MG architecture can successfully reduce the test prediction errors relative to the conventional U-Net architecture when modeling a set of fluid dynamic problems. In total, we demonstrate an improvement in the prediction of velocity and pressure fields for the canonical fluid dynamics cases of flow past a stationary cylinder, flow past 2 cylinders in out-of-phase motion, and flow past an oscillating airfoil in both the propulsion and energy harvesting modes. In general, while both the U-Net and U-Net-MG models can model the systems well with test RMSEs of less than 1%, the use of the U-Net-MG architecture can further reduce RMSEs by between 20% and 70%.


title: GMOTE: Gaussian based minority oversampling technique for imbalanced classification adapting tail probability of outliers

abstract: Classification of imbalanced data is one of the common problems in the recent field of data mining. Imbalanced data substantially affects the performance of standard classification models. Data-level approaches mainly use the oversampling methods to solve the problem, such as synthetic minority oversampling Technique (SMOTE). However, since the methods such as SMOTE generate instances by linear interpolation, synthetic data space may look like a polygonal. Also, the oversampling methods generate outliers of the minority class. In this paper, we proposed Gaussian based minority oversampling technique (GMOTE) with a statistical perspective for imbalanced datasets. To avoid linear interpolation and to consider outliers, this proposed method generates instances by the Gaussian Mixture Model. Motivated by clustering-based multivariate Gaussian outlier score (CMGOS), we propose to adapt tail probability of instances through the Mahalanobis distance to consider local outliers. The experiment was carried out on a representative set of benchmark datasets. The performance of the GMOTE is compared with other methods such as SMOTE. When the GMOTE is combined with classification and regression tree (CART) or support vector machine (SVM), it shows better accuracy and F1-Score. Experimental results demonstrate the robust performance.


title: The D-plus Discriminant and Complexity of Root Clustering

abstract: Let $p(x)$ be an integer polynomial with $m\ge 2$ distinct roots $\rho_1,\ldots,\rho_m$ whose multiplicities are $\boldsymbol{\mu}=(\mu_1,\ldots,\mu_m)$. We define the D-plus discriminant of $p(x)$ to be $D^+(p):= \prod_{1\le i<j\le m}(\rho_i-\rho_j)^{\mu_i+\mu_j}$. We first prove a conjecture that $D^+(p)$ is a $\boldsymbol{\mu}$-symmetric function of its roots $\rho_1,\ldots,\rho_m$. Our main result gives an explicit formula for $D^+(p)$, as a rational function of its coefficients. Our proof is ideal-theoretic, based on re-casting the classic Poisson resultant as the "symbolic Poisson formula". The D-plus discriminant first arose in the complexity analysis of a root clustering algorithm from Becker et al. (ISSAC 2016). The bit-complexity of this algorithm is proportional to a quantity $\log(|D^+(p)|^{-1})$. As an application of our main result, we give an explicit upper bound on this quantity in terms of the degree of $p$ and its leading coefficient.


title: Attention-Based 3D Seismic Fault Segmentation Training by a Few 2D Slice Labels

abstract: Detection faults in seismic data is a crucial step for seismic structural interpretation, reservoir characterization and well placement. Some recent works regard it as an image segmentation task. The task of image segmentation requires huge labels, especially 3D seismic data, which has a complex structure and lots of noise. Therefore, its annotation requires expert experience and a huge workload. In this study, we present lambda-BCE and lambda-smooth L1loss to effectively train 3D-CNN by some slices from 3D seismic data, so that the model can learn the segmentation of 3D seismic data from a few 2D slices. In order to fully extract information from limited data and suppress seismic noise, we propose an attention module that can be used for active supervision training and embedded in the network. The attention heatmap label is generated by the original label, and letting it supervise the attention module using the lambda-smooth L1loss. The experiment demonstrates the effectiveness of our loss function, the method can extract 3D seismic features from a few 2D slice labels. And it also shows the advanced performance of the attention module, which can significantly suppress the noise in the seismic data while increasing the model's sensitivity to the foreground. Finally, on the public test set, we only use the 2D slice labels training that accounts for 3.3% of the 3D volume label, and achieve similar performance to the 3D volume label training.


title: Location-Based Timing Advance Estimation for 5G Integrated LEO Satellite Communications

abstract: Integrated satellite-terrestrial communications networks aim to exploit both the satellite and the ground mobile communications, thus providing genuine ubiquitous coverage. For 5G integrated low earth orbit (LEO) satellite communication systems, the timing advance (TA) is required to be estimated in the initial random access procedure in order to facilitate the uplink frame alignment among different users. However, due to the inherent characteristics of LEO satellite communication systems, e.g., wide beam coverage and long propagation delays, the existing 5G terrestrial uplink TA scheme is not applicable in the satellite networks. In this paper, we investigate location-based TA estimation for 5G integrated LEO satellite communication systems. We obtain the time difference of arrival (TDOA) and frequency difference of arrival (FDOA) measurements in the downlink timing and frequency synchronization phase, which are made from the satellite at different time instants. We propose to take these measurements for either UE geolocation or ephemeris estimation, thus calculating the TA value. The estimation is then formulated as a quadratic optimization problem whose globally optimal solution can be obtained by a quadratic penalty algorithm. To reduce the computational complexity, we further propose an alternative approximation method based on iteratively performing a linearization procedure on the quadratic equality constraints. Numerical results show that the proposed methods can approach the constrained Cramer-Rao lower bound (CRLB) of the TA estimation and thus assure uplink frame alignment for different users.


title: RRCD: Redirecci\'on de Registros Basada en Compresi\'on de Datos para Tolerar FallosPermanentes en una GPU

abstract: The ever-increasing parallelism demand of General-Purpose Graphics Processing Unit (GPGPU) applications pushes toward larger and more energy-hungry register files in successive GPU generations. Reducing the supply voltage beyond its safe limit is an effective way to improve the energy efficiency of register files. However, at these operating voltages, the reliability of the circuit is compromised. This work aims to tolerate permanent faults from process variations in large GPU register files operating below the safe supply voltage limit. To do so, this paper proposes a microarchitectural patching technique, DC-Patch, exploiting the inherent data redundancy of applications to compress registers at run-time with neither compiler assistance nor instruction set modifications. Instead of disabling an entire faulty register file entry, DC-Patch leverages the reliable cells within a faulty entry to store compressed register values. Experimental results show that, with more than a third of faulty register entries, DC-Patch ensures a reliable operation of the register file and reduces the energy consumption by 47% with respect to a conventional register file working at nominal supply voltage. The energy savings are 21% compared to a voltage noise smoothing scheme operating at the safe supply voltage limit. These benefits are obtained with less than 2 and 6% impact on the system performance and area, respectively.


title: Phase-field model of ion transport and intercalation in lithium-ion battery

abstract: The unified 3D phase-field model for the description of the lithium-ion cell as a whole is developed. The model takes into account the realistic distribution of particles in porous electrodes, percolative transport of ions, and the difference in size of solute and solvent molecules. We use spatially dependent interaction and dynamic parameters that are considered as a function of the order parameter determining the space and size distribution of particles in nanostructured porous electrodes. The model describes the dynamics of ions in a battery at the constant value of overpotential across the electrode/electrolyte interface. The electrochemical reaction is naturally determined by the chemical potential difference at the interface. The proposed model is applied to simulate charging and discharging process in 3D lithium-ion cell with porous cathode and anode characterized by the realistic size distribution of electrode particles. We demonstrate that the condition of constant overpotential provides nearly constant current density in the battery. The obtained results indicate non-diffusive motion of the concentration front during charging or discharging, nonuniform intercalation flux over the surface of electrode particles, and violation of the equipartition of electric current density over the electrode surface. All these facts are not taken into account by the most commonly used models.


title: Universally irreducible subvarieties of Siegel moduli spaces

abstract: A subvariety of a quasi-projective complex variety $X$ is called ``universally irreducible'' if its preimage inside the universal cover of $X$ is irreducible. In this paper we investigate sufficient conditions for universal irreducibility. We consider in detail complete intersection subvarieties of small codimension inside Siegel moduli spaces of any finite level. Moreover we show that, for $g\geq 3$, every Siegel modular form is the product of finitely many irreducible analytic functions on the Siegel upper half-space $\mathbb{H}_g$. We also discuss the special case of singular theta series of weight $\frac{1}{2}$ and of Schottky forms.


title: Asymptotic stability for a class of viscoelastic equations with general relaxation functions and the time delay

abstract: The goal of the present paper is to study the viscoelastic wave equation with the time delay \[ |u_t|^\rho u_{tt}-\Delta u-\Delta u_{tt}+\int_0^tg(t-s)\Delta u(s)ds+\mu_1u_t(x,t)+\mu_2 u_t(x,t-\tau)=b|u|^{p-2}u\] under initial boundary value conditions, where $\rho,~b,~\mu_1$ are positive constants, $\mu_2$ is a real number, $\tau>0$ represents the time delay. By using the multiplier method together with some properties of the convex functions, the explicit and general stability results of energy are proved under the general assumption on the relaxation function $g$. This work generalizes and improves earlier results on the stability of the viscoelastic equations with the time delay in the literature.


title: Towards Theoretical Understandings of Robust Markov Decision Processes: Sample Complexity and Asymptotics

abstract: In this paper, we study the non-asymptotic and asymptotic performances of the optimal robust policy and value function of robust Markov Decision Processes(MDPs), where the optimal robust policy and value function are solved only from a generative model. While prior work focusing on non-asymptotic performances of robust MDPs is restricted in the setting of the KL uncertainty set and $(s,a)$-rectangular assumption, we improve their results and also consider other uncertainty sets, including $L_1$ and $\chi^2$ balls. Our results show that when we assume $(s,a)$-rectangular on uncertainty sets, the sample complexity is about $\widetilde{O}\left(\frac{|\mathcal{S}|^2|\mathcal{A}|}{\varepsilon^2\rho^2(1-\gamma)^4}\right)$. In addition, we extend our results from $(s,a)$-rectangular assumption to $s$-rectangular assumption. In this scenario, the sample complexity varies with the choice of uncertainty sets and is generally larger than the case under $(s,a)$-rectangular assumption. Moreover, we also show that the optimal robust value function is asymptotic normal with a typical rate $\sqrt{n}$ under $(s,a)$ and $s$-rectangular assumptions from both theoretical and empirical perspectives.


title: Quick NAT: High performance NAT system on commodity platforms

abstract: NAT gateway is an important network system in today's IPv4 network when translating a private IPv4 address to a public address. However, traditional NAT system based on Linux Netfilter cannot achieve high network throughput to meet modern requirements such as data centers. To address this challenge, we improve the network performance of NAT system by three ways. First, we leverage DPDK to enable polling and zero-copy delivery, so as to reduce the cost of interrupt and packet copies. Second, we enable multiple CPU cores to process in parallel and use lock-free hash table to minimize the contention between CPU cores. Third, we use hash search instead of sequential search when looking up the NAT rule table. Evaluation shows that our Quick NAT system significantly improves the performance of NAT on commodity platforms.


title: Semiparametric Volatility Model with Varying Frequencies

abstract: In extracting time series data from various sources, it is inevitable to compile variables measured at varying frequencies as this is often dependent on the source. Modeling from these data can be facilitated by aggregating high frequency data to match the relatively lower frequencies of the rest of the variables. This however, can easily loss vital information that characterizes the system ought to be modelled. Two semiparametric volatility models are postulated to account for covariates of varying frequencies without aggregation of the data to lower frequencies. First is an extension of the autoregressive integrated moving average with explanatory variable (ARMAX) model, it integrates high frequency data into the mean equation (VF-ARMA). Second is an extension of the Glosten, Jagannathan and Rankle (GJR) model that incorporates the high frequency data into the variance equation (VF-GARCH). In both models, high frequency data was introduced as a nonparametric function in the model. Both models are estimated using a hybrid estimation procedure that benefits from the additive nature of the models. Simulation studies illustrate the advantages of postulated models in terms of predictive ability compared to generalized autoregressive conditionally heteroscedastic (GARCH) and GJR models that simply aggregates high frequency covariates to the same frequency as the output variable. Furthermore, VF-ARMA is superior to VF-GARCH since it exhibits some degree of robustness in a wide range of scenarios.


title: Detection of acoustic events in Lavender for measuring the xylem vulnerability to embolism and cellular damages

abstract: Acoustic emission analysis is a promising technique to investigate the physiological events leading to drought-induced injuries and mortality. However, the nature and the source of the acoustic emissions are not fully understood and make the use of this technique difficult as a direct measure of the loss of xylem hydraulic conductance. In this study, acoustic emissions were recorded during severe dehydration in lavender plants and compared to the dynamics of embolism development and cell lysis. The timing and characteristics of acoustic signals from two independent recording systems were compared by principal component analysis. In parallel, changes in water potential, branch diameter, loss of hydraulic conductance and electrolyte leakage were measured to quantify drought-induced damages. Two distinct phases of acoustic emissions were observed during dehydration: the first one associated with a rapid loss of diameter and a significant increase in loss of xylem conductance (90%) and the second one with a significant increase in electrolyte leakage and slower diameter changes. This second phase corresponds to a complete loss of recovery capacity. The acoustic signals of both phases were discriminated by the third and fourth principal components. The loss of hydraulic conductance during the first acoustic phase suggests the hydraulic origin of these signals (i.e. cavitation events). For the second phase, the signals showed much higher variability between plants and acoustic systems suggesting that the sources of these signals may be plural, although likely including cellular damage. A simple algorithm was developed to discriminate hydraulic-related acoustic signals from other sources, allowing the reconstruction of dynamic hydraulic vulnerability curves. However, hydraulic failure precedes cellular damage and lack of whole plant recovery is associated to these latter.


title: Improving Cost Learning for JPEG Steganography by Exploiting JPEG Domain Knowledge

abstract: Although significant progress in automatic learning of steganographic cost has been achieved recently, existing methods designed for spatial images are not well applicable to JPEG images which are more common media in daily life. The difficulties of migration mostly lie in the unique and complicated JPEG characteristics caused by 8x8 DCT mode structure. To address the issue, in this paper we extend an existing automatic cost learning scheme to JPEG, where the proposed scheme called JEC-RL (JPEG Embedding Cost with Reinforcement Learning) is explicitly designed to tailor the JPEG DCT structure. It works with the embedding action sampling mechanism under reinforcement learning, where a policy network learns the optimal embedding policies via maximizing the rewards provided by an environment network. The policy network is constructed following a domain-transition design paradigm, where three modules including pixel-level texture complexity evaluation, DCT feature extraction, and mode-wise rearrangement, are proposed. These modules operate in serial, gradually extracting useful features from a decompressed JPEG image and converting them into embedding policies for DCT elements, while considering JPEG characteristics including inter-block and intra-block correlations simultaneously. The environment network is designed in a gradient-oriented way to provide stable reward values by using a wide architecture equipped with a fixed preprocessing layer with 8x8 DCT basis filters. Extensive experiments and ablation studies demonstrate that the proposed method can achieve good security performance for JPEG images against both advanced feature based and modern CNN based steganalyzers.


title: Non-Recursive Graph Convolutional Networks

abstract: Graph Convolutional Networks (GCNs) are powerful models for node representation learning tasks. However, the node representation in existing GCN models is usually generated by performing recursive neighborhood aggregation across multiple graph convolutional layers with certain sampling methods, which may lead to redundant feature mixing, needless information loss, and extensive computations. Therefore, in this paper, we propose a novel architecture named Non-Recursive Graph Convolutional Network (NRGCN) to improve both the training efficiency and the learning performance of GCNs in the context of node classification. Specifically, NRGCN proposes to represent different hops of neighbors for each node based on inner-layer aggregation and layer-independent sampling. In this way, each node can be directly represented by concatenating the information extracted independently from each hop of its neighbors thereby avoiding the recursive neighborhood expansion across layers. Moreover, the layer-independent sampling and aggregation can be precomputed before the model training, thus the training process can be accelerated considerably. Extensive experiments on benchmark datasets verify that our NRGCN outperforms the state-of-the-art GCN models, in terms of the node classification performance and reliability.


title: Trajectory Prediction for Autonomous Driving with Topometric Map

abstract: State-of-the-art autonomous driving systems rely on high definition (HD) maps for localization and navigation. However, building and maintaining HD maps is time-consuming and expensive. Furthermore, the HD maps assume structured environment such as the existence of major road and lanes, which are not present in rural areas. In this work, we propose an end-to-end transformer networks based approach for map-less autonomous driving. The proposed model takes raw LiDAR data and noisy topometric map as input and produces precise local trajectory for navigation. We demonstrate the effectiveness of our method in real-world driving data, including both urban and rural areas. The experimental results show that the proposed method outperforms state-of-the-art multimodal methods and is robust to the perturbations of the topometric map. The code of the proposed method is publicly available at \url{https://github.com/Jiaolong/trajectory-prediction}.


title: Deep learning of topological phase transitions from entanglement aspects: An unsupervised way

abstract: Machine learning techniques have been shown to be effective to recognize different phases of matter and produce phase diagrams in the parameter space interested, while they usually require prior labeled data to perform well. Here, we propose a machine learning procedure, mainly in an unsupervised manner, which can first identify topological/non-topological phases and then refine the locations of phase boundaries. By following this proposed procedure, we expand our previous work on the one-dimensional $p$-wave superconductor [Phys. Rev. B 102, 054512 (2020)] and further on the Su-Schrieffer-Heeger model, with an emphasis on using the quantum entanglement-based quantities as the input features. We find that our method not only reproduces similar results to the previous work with sharp phase boundaries but importantly it also does not rely on prior knowledge of the phase space, e.g., the number of phases present. We conclude with a few remarks about its potential, limitations, and explainabilities.


title: The extremal length systole of the Bolza surface

abstract: We prove that the extremal length systole of genus two surfaces attains a strict local maximum at the Bolza surface, where it takes the value $\sqrt{2}$.


title: Gluing determinantal Cremona maps

abstract: We study determinantal Cremona maps, i.e. birational maps whose base ideal is the maximal minors ideal of a given matrix $\Phi$, via the resolution of the polynomials systems defined by $\Phi$. Using convex geometry, this approach leads in particular to describe the projective degrees of some almost linear determinantal maps.


title: Minimizing the energy supply of infinite-dimensional linear port-Hamiltonian systems

abstract: We consider the problem of minimizing the supplied energy of infinite-dimensional linear port-Hamiltonian systems and prove that optimal trajectories exhibit the turnpike phenomenon towards certain subspaces induced by the dissipation of the dynamics.


title: Sparse power methods for large-scale higher-order PageRank problems

abstract: A commonly used technique for the higher-order PageRank problem is the power method that is computationally intractable for large-scale problems. The truncated power method proposed recently provides us with another idea to solve this problem, however, its accuracy and efficiency can be poor in practical computations. In this work, we revisit the higher-order PageRank problem and consider how to solve it efficiently. The contribution of this work is as follows. First, we accelerate the truncated power method for high-order PageRank. In the improved version, it is neither to form and store the vectors arising from the dangling states, nor to store an auxiliary matrix. Second, we propose a truncated power method with partial updating to further release the overhead, in which one only needs to update some important columns of the approximation in each iteration. On the other hand, the truncated power method solves a modified high-order PageRank model for convenience, which is not mathematically equivalent to the original one. Thus, the third contribution of this work is to propose a sparse power method with partial updating for the original higher-order PageRank problem. The convergence of all the proposed methods are discussed. Numerical experiments on large and sparse real-world and synthetic data sets are performed. The numerical results show the superiority of our new algorithms over some state-of-the-art ones for large and sparse higher-order PageRank problems.


title: Bounding Information Leakage in Machine Learning

abstract: Recently, it has been shown that Machine Learning models can leak sensitive information about their training data. This information leakage is exposed through membership and attribute inference attacks. Although many attack strategies have been proposed, little effort has been made to formalize these problems. We present a novel formalism, generalizing membership and attribute inference attack setups previously studied in the literature and connecting them to memorization and generalization. First, we derive a universal bound on the success rate of inference attacks and connect it to the generalization gap of the target model. Second, we study the question of how much sensitive information is stored by the algorithm about its training set and we derive bounds on the mutual information between the sensitive attributes and model parameters. Experimentally, we illustrate the potential of our approach by applying it to both synthetic data and classification tasks on natural images. Finally, we apply our formalism to different attribute inference strategies, with which an adversary is able to recover the identity of writers in the PenDigits dataset.


title: Selective Probabilistic Classifier Based on Hypothesis Testing

abstract: In this paper, we propose a simple yet effective method to deal with the violation of the Closed-World Assumption for a classifier. Previous works tend to apply a threshold either on the classification scores or the loss function to reject the inputs that violate the assumption. However, these methods cannot achieve the low False Positive Ratio (FPR) required in safety applications. The proposed method is a rejection option based on hypothesis testing with probabilistic networks. With probabilistic networks, it is possible to estimate the distribution of outcomes instead of a single output. By utilizing Z-test over the mean and standard deviation for each class, the proposed method can estimate the statistical significance of the network certainty and reject uncertain outputs. The proposed method was experimented on with different configurations of the COCO and CIFAR datasets. The performance of the proposed method is compared with the Softmax Response, which is a known top-performing method. It is shown that the proposed method can achieve a broader range of operation and cover a lower FPR than the alternative.


title: Non-iterative Optimization Algorithm for Active Distribution Grids Considering Uncertainty of Feeder Parameters

abstract: To cope with fast-fluctuating distributed energy resources (DERs) and uncontrolled loads, this paper formulates a time-varying optimization problem for distribution grids with DERs and develops a novel non-iterative algorithm to track the optimal solutions. Different from existing methods, the proposed approach does not require iterations during the sampling interval. It only needs to perform a single one-step calculation at each interval to obtain the evolution of the optimal trajectory, which demonstrates fast calculation and online-tracking capability with an asymptotically vanishing error. Specifically, the designed approach contains two terms: a prediction term tracking the change in the optimal solution based on the time-varying nature of system power, and a correction term pushing the solution toward the optimum based on Newton's method. Moreover, the proposed algorithm can be applied in the absence of an accurate network model by leveraging voltage measurements to identify the true voltage sensitivity parameters. Simulations for an illustrative distribution network are provided to validate the approach.


title: Mirror-extended standard model with spontaneously broken left-right symmetry and its implementation in the course of cosmological evolution

abstract: A mirror-extended standard model (MESM) is offered, where in the left-right symmetric underlying action the sector of the standard model (SM) and its mirror copy have the same SU(2)\times U(1) gauge structure and parameters; the mirror fermion counter-partners have opposite chiralities. A theory is used that allows one to obtain MESM in Minkowski space only if we start with an accurate account of gravity and only at the end go to the limit of Minkowski space. Spontaneous breaking of left-right symmetry and the "wrong" sign in the mass terms of the Higgs fields potentials arise due to the initial conditions imposed on the T-model inflation. MESM allows choosing the universal Yukawa coupling constant $y$ in the underlying Lagrangian for all generations of charged leptons and up-quarks. As an example, with y=10^{-3}, it is shown that a set of additional dimensionless parameters in width range less than 0.5 is sufficient to obtain the masses of all known charged leptons and up-quarks. In this sense, MESM bypasses the problem of the fermion mass hierarchy. With this choice of parameters, MESM predicts that vacuum expectation value for the mirror Higgs field is 10^{14}GeV and masses of mirror particles are in the range 10^{8}GeV-10^{14}GeV. There is only gravitational interaction between particles of the SM and mirror sectors. Hence, mirror particles can constitute dark matter. The vacuum is realized as a limiting state in the cosmological evolution of the inflaton and classical Higgs fields, in which the energy stored in them becomes minimal, providing the maximum possible contribution of these fields to the entropy of the Universe. If further study of the model reveals the existence of an effective mechanism for preheating the Universe, this will mean that the cosmological constant problem is absent.


title: Directional Convergence Analysis under Spherically Symmetric Distribution

abstract: We consider the fundamental problem of learning linear predictors (i.e., separable datasets with zero margin) using neural networks with gradient flow or gradient descent. Under the assumption of spherically symmetric data distribution, we show directional convergence guarantees with exact convergence rate for two-layer non-linear networks with only two hidden nodes, and (deep) linear networks. Moreover, our discovery is built on dynamic from the initialization without both initial loss and perfect classification constraint in contrast to previous works. We also point out and study the challenges in further strengthening and generalizing our results.


title: Two-arc-transitive graphs of odd order -- II

abstract: It is shown that each subgroup of odd index in an alternating group of degree at least 10 has all insoluble composition factors to be alternating. A classification is then given of 2-arc-transitive graphs of odd order admitting an alternating group or a symmetric group. This is the second of a series of papers aiming towards a classification of 2-arc-transitive graphs of odd order.


title: Loop homotopy of $6$-manifolds over $4$-manifolds

abstract: Let $M$ be the $6$-manifold $M$ as the total space of the sphere bundle of a rank $3$ vector bundle over a simply connected closed $4$-manifold. We show that after looping $M$ is homotopy equivalent to a product of loops on spheres in general. This particularly implies the cohomology rigidity property of $M$ after looping. Furthermore, passing to the rational homotopy, we show that such $M$ is Koszul in the sense of Berglund.


title: The breakdown of magneto-hydrodynamics near AdS$_2$ fixed point and energy diffusion bound

abstract: We investigate the breakdown of magneto-hydrodynamics at low temperature ($T$) with black holes whose extremal geometry is AdS$_2\times$R$^2$. The breakdown is identified by the equilibration scales ($\omega_{\text{eq}}, k_{\text{eq}}$) defined as the collision point between the diffusive hydrodynamic mode and the longest-lived non-hydrodynamic mode. We show ($\omega_{\text{eq}}, k_{\text{eq}}$) at low $T$ is determined by the diffusion constant $D$ and the scaling dimension $\Delta(0)$ of an infra-red operator: $\omega_{\text{eq}} = 2\pi T \Delta(0), \, k_{\text{eq}}^2 = \omega_{\text{eq}}/D$, where $\Delta(0)=1$ in the presence of magnetic fields. For the purpose of comparison, we have analytically shown $\Delta(0)=2$ for the axion model independent of the translational symmetry breaking pattern (explicit or spontaneous), which is complementary to previous numerical results. Our results support the conjectured universal upper bound of the energy diffusion $D \,\le\, \omega_{\text{eq}}/k_{\text{eq}}^2 \,:=\, v_{\text{eq}}^2 \, \tau_{\text{eq}}$ where $v_{\text{eq}}:= \omega_{\text{eq}}/k_{\text{eq}}$ and $\tau_{\text{eq}}:=\omega_{\text{eq}}^{-1}$ are the velocity and the timescale associated to equilibration, implying that the breakdown of hydrodynamics sets the upper bound of the diffusion constant $D$ at low $T$.


title: Perturbative expansion of the fundamental equation of online user dynamics for describing changes in eigenfrequencies

abstract: The oscillation model has been proposed as a theoretical framework for describing user dynamics in online social networks. This model can model the user dynamics generated by a particular network structure and allow its causal relationships to be explicitly described. In this paper, by applying perturbation theory to the fundamental equation of the oscillation model, we confirm that we can explicitly trace, at least in principle, the changes in user dynamics associated with changes in the network structure. Specifically, we formulate perturbative expansions up to infinite order, by drawing on inferences from regularities found in perturbative expansions; the accuracy of perturbative expansions of finite order is evaluated by numerical experiments.


title: Arithmetic-Geometric Spectral Radius of Trees and Unicyclic Graphs

abstract: The arithmetic-geometric matrix $A_{ag}(G)$ of a graph $G$ is a square matrix, where the $(i,j)$-entry is equal to $\displaystyle \frac{d_{i}+d_{j}}{2\sqrt{d_{i}d_{j}}}$ if the vertices $v_{i}$ and $v_{j}$ are adjacent, and 0 otherwise. The arithmetic-geometric spectral radius of $G$, denoted by $\rho_{ag}(G)$, is the largest eigenvalue of the arithmetic-geometric matrix $A_{ag}(G)$. Let $S_{n}$ be the star of order $n\geq3$ and $S_{n}+e$ be the unicyclic graph obtained from $S_{n}$ by adding an edge. In this paper, we prove that for any tree $T$ of order $n\geq2$, $\displaystyle 2\cos\frac{\pi}{n+1}\leq\rho_{ag}(P_{n})\leq\rho_{ag}(T)\leq\rho_{ag}(S_{n})=\frac{n}{2},$ with equality if and only if $T\cong P_{n}$ for the lower bound, and if and only if $T\cong S_{n}$ for the upper bound. We also prove that for any unicyclic graph $G$ of order $n\geq3$, $\displaystyle 2=\rho_{ag}(C_{n})\leq\rho_{ag}(G)\leq\rho_{ag}(S_{n}+e),$ the lower (upper, respectively) bound is attained if and only if $T\cong C_{n}$ ($T\cong S_{n}+e$, respectively) and $\displaystyle\rho_{ag}(S_{n}+e)<\frac{n}{2}$ for $n\geq7$.


title: Unexpected Spontaneously Dynamic Oxygen Migration on Carbon Nanotubes

abstract: Using the density functional theory calculations, we show that the oxygen functional groups exhibit unexpected spontaneously dynamic behaviors on the interior surface of single-walled carbon nanotubes (SWCNT). Two types of dynamic oxygen migrations - hydroxyl and epoxy migrations - are achieved by the breaking/reforming of C-O bond reaction and the proton transfer reaction. It is demonstrated that the spontaneously dynamic characteristic is attributed to the sharply reduced energy barrier less than or comparable to thermal fluctuations. We also observe a stable intermediate state with a dangling C-O bond, which permits the successive migration of oxygen functional groups. However, on the exterior surface of SWCNT, the oxygen groups are difficult to migrate spontaneously due to the relatively high energy barriers, and the dangling C-O bond prefers to transform into the more stable epoxy configuration. The spontaneous oxygen migration is further confirmed by the long-distance oxygen migration, which comprises three hydroxyl migration reactions and one C-O bond reaction. Our work provides a new understanding of the behavior of oxygen functional groups on interfaces and gives a potential route to design new carbon-based dynamic materials.


title: A statistical study of magnetic flux emergence in solar active regions prior to strongest flares

abstract: Using the data on magnetic field maps and continuum intensity for Solar Cycles 23 and 24, we explored 100 active regions (ARs) that produced M5.0 or stronger flares. We focus on the presence/absence of the emergence of magnetic flux in these ARs 2-3 days before the strong flare onset. We found that 29 ARs in the sample emerged monotonously amidst quiet-Sun. A major emergence of a new magnetic flux within pre-existing AR yielding the formation of a complex flare-productive configuration was observed in another 24 cases. For 30 ARs, an insignificant (in terms of the total magnetic flux of pre-existing AR) emergence of a new magnetic flux within the pre-existing magnetic configuration was observed; for some of them the emergence resulted in a formation of a configuration with a small $\delta$-sunspot. 11 out of 100 ARs exhibited no signatures of magnetic flux emergence during the entire interval of observation. In 6 cases the emergence was in progress when the AR appeared on the Eastern limb, so that the classification and timing of emergence were not possible. We conclude that the recent flux emergence is not a necessary and/or sufficient condition for strong flaring of an AR. The flux emergence rate of analyzed here flare-productive ARs was compared with that of flare-quiet ARs analyzed in our previous studies. We revealed that the flare-productive ARs tend to display faster emergence than the flare-quiet ones do.


title: Lawformer: A Pre-trained Language Model for Chinese Legal Long Documents

abstract: Legal artificial intelligence (LegalAI) aims to benefit legal systems with the technology of artificial intelligence, especially natural language processing (NLP). Recently, inspired by the success of pre-trained language models (PLMs) in the generic domain, many LegalAI researchers devote their effort to apply PLMs to legal tasks. However, utilizing PLMs to address legal tasks is still challenging, as the legal documents usually consist of thousands of tokens, which is far longer than the length that mainstream PLMs can process. In this paper, we release the Longformer-based pre-trained language model, named as Lawformer, for Chinese legal long documents understanding. We evaluate Lawformer on a variety of LegalAI tasks, including judgment prediction, similar case retrieval, legal reading comprehension, and legal question answering. The experimental results demonstrate that our model can achieve promising improvement on tasks with long documents as inputs.


title: Teaching Physics by Arduino during COVID-19 Pandemic: The Free Falling Body Experiment

abstract: One of the difficulties related to the COVID-19 pandemic is the shifting from face-to-face to distance teaching. Both schools and universities had suddenly to organize on-line lectures. To perform laboratory practice even in this period, easily accessible materials, smartphones physics apps, on-line tools and devices can be used. In this paper a method to measure the gravitational acceleration studying the free falling body using Arduino board is presented.


title: Conformer: Local Features Coupling Global Representations for Visual Recognition

abstract: Within Convolutional Neural Network (CNN), the convolution operations are good at extracting local features but experience difficulty to capture global representations. Within visual transformer, the cascaded self-attention modules can capture long-distance feature dependencies but unfortunately deteriorate local feature details. In this paper, we propose a hybrid network structure, termed Conformer, to take advantage of convolutional operations and self-attention mechanisms for enhanced representation learning. Conformer roots in the Feature Coupling Unit (FCU), which fuses local features and global representations under different resolutions in an interactive fashion. Conformer adopts a concurrent structure so that local features and global representations are retained to the maximum extent. Experiments show that Conformer, under the comparable parameter complexity, outperforms the visual transformer (DeiT-B) by 2.3% on ImageNet. On MSCOCO, it outperforms ResNet-101 by 3.7% and 3.6% mAPs for object detection and instance segmentation, respectively, demonstrating the great potential to be a general backbone network. Code is available at https://github.com/pengzhiliang/Conformer.