title: Microscopic piezoelectric behavior of clamped and membrane (001) PMN-30PT thin films

abstract: Bulk single-crystal relaxor-ferroelectrics, like Pb(Mg1/3Nb2/3)O3-PbTiO3 (PMN-PT), are widely known for their large piezoelectricity. This is attributed to polarization rotation which is facilitated by the presence of various crystal symmetries for compositions near a morphotropic phase boundary (MPB). Relaxor-ferroelectric thin films, which are necessary for low-voltage applications, suffer a reduction in their piezoelectric response due to clamping by the passive substrate. To understand the microscopic behavior of this adverse phenomenon, we employ AC electric field driven in-operando synchrotron x-ray diffraction (XRD) on patterned device structures to investigate the piezoelectric domain behavior under an electric field for both a clamped (001) PMN-PT thin film on Si and a (001) PMN-PT membrane released from its substrate. In the clamped film, the substrate inhibits the field induced rhombohedral (R) to tetragonal (T) phase transition resulting in a reversible R to Monoclinic (M) transition with a reduced longitudinal piezoelectric coefficient d33 < 100 pm/V. Releasing the film from the substrate results in recovery of the R to T transition and results in a d33 > 1000 pm/V. Using diffraction with spatial mapping, we find that lateral constraints imposed by the boundary between active and inactive material also inhibits the R to T transition. Phase-field calculations on both clamped and released PMN-PT thin films simulate our experimental findings. Resolving the suppression of thin film piezoelectric response is critical to their application in piezo-driven technologies.


title: Elastic Shape Analysis of Tree-like 3D Objects using Extended SRVF Representation

abstract: How can one analyze detailed 3D biological objects, such as neurons and botanical trees, that exhibit complex geometrical and topological variation? In this paper, we develop a novel mathematical framework for representing, comparing, and computing geodesic deformations between the shapes of such tree-like 3D objects. A hierarchical organization of subtrees characterizes these objects -- each subtree has the main branch with some side branches attached -- and one needs to match these structures across objects for meaningful comparisons. We propose a novel representation that extends the Square-Root Velocity Function (SRVF), initially developed for Euclidean curves, to tree-shaped 3D objects. We then define a new metric that quantifies the bending, stretching, and branch sliding needed to deform one tree-shaped object into the other. Compared to the current metrics, such as the Quotient Euclidean Distance (QED) and the Tree Edit Distance (TED), the proposed representation and metric capture the full elasticity of the branches (i.e., bending and stretching) as well as the topological variations (i.e., branch death/birth and sliding). It completely avoids the shrinkage that results from the edge collapse and node split operations of the QED and TED metrics. We demonstrate the utility of this framework in comparing, matching, and computing geodesics between biological objects such as neurons and botanical trees. The framework is also applied to various shape analysis tasks: (i) symmetry analysis and symmetrization of tree-shaped 3D objects, (ii) computing summary statistics (means and modes of variations) of populations of tree-shaped 3D objects, (iii) fitting parametric probability distributions to such populations, and (iv) finally synthesizing novel tree-shaped 3D objects through random sampling from estimated probability distributions.


title: Exponential sums and rigid cohomology

abstract: In this article, we prove a comparison theorem between the Dwork cohomology introduced by Adolphson and Sperber and the rigid cohomology. As a corollary, we can calculate the rigid cohomology of Dwork isocrystal on torus.


title: Towards Instance-Optimal Offline Reinforcement Learning with Pessimism

abstract: We study the offline reinforcement learning (offline RL) problem, where the goal is to learn a reward-maximizing policy in an unknown Markov Decision Process (MDP) using the data coming from a policy $\mu$. In particular, we consider the sample complexity problems of offline RL for finite-horizon MDPs. Prior works study this problem based on different data-coverage assumptions, and their learning guarantees are expressed by the covering coefficients which lack the explicit characterization of system quantities. In this work, we analyze the Adaptive Pessimistic Value Iteration (APVI) algorithm and derive the suboptimality upper bound that nearly matches \[ O\left(\sum_{h=1}^H\sum_{s_h,a_h}d^{\pi^\star}_h(s_h,a_h)\sqrt{\frac{\mathrm{Var}_{P_{s_h,a_h}}{(V^\star_{h+1}+r_h)}}{d^\mu_h(s_h,a_h)}}\sqrt{\frac{1}{n}}\right). \] In complementary, we also prove a per-instance information-theoretical lower bound under the weak assumption that $d^\mu_h(s_h,a_h)>0$ if $d^{\pi^\star}_h(s_h,a_h)>0$. Different from the previous minimax lower bounds, the per-instance lower bound (via local minimaxity) is a much stronger criterion as it applies to individual instances separately. Here $\pi^\star$ is a optimal policy, $\mu$ is the behavior policy and $d_h^\mu$ is the marginal state-action probability. We call the above equation the intrinsic offline reinforcement learning bound since it directly implies all the existing optimal results: minimax rate under uniform data-coverage assumption, horizon-free setting, single policy concentrability, and the tight problem-dependent results. Later, we extend the result to the assumption-free regime (where we make no assumption on $ \mu$) and obtain the assumption-free intrinsic bound. Due to its generic form, we believe the intrinsic bound could help illuminate what makes a specific problem hard and reveal the fundamental challenges in offline RL.


title: The Chern Number Governs Soliton Motion in Nonlinear Thouless Pumps

abstract: Nonlinear Thouless pumps for bosons exhibit quantized pumping via soliton motion, despite the lack of a meaningful notion of filled bands. However, the theoretical underpinning of this quantization, as well as its relationship to the Chern number, has thus far been lacking. Here we show that for low power solitons, transport is dictated by the Chern number of the band from which the soliton bifurcates. We do this by expanding the discrete nonlinear Schr\"odinger equation (equivalently, the Gross-Pitaevskii equation) in the basis of Wannier states, showing that the soliton's position is dictated by that of the Wannier state throughout the pump cycle. Furthermore, we describe soliton pumping in two dimensions.

categories: cond-mat.mes-hall cond-mat.other cond-mat.quant-gas nlin.PS physics.optics


title: Improving Dither Modulation based Robust Steganography by Overflow Suppression

abstract: Nowadays, people are sharing their pictures on online social networks (OSNs), so OSN is a good platform for Steganography. But OSNs usually perform JPEG compression on the uploaded image, which will invalidate most of the existing steganography algorithms. Recently, some works try to design robust steganography which can resist JPEG compression, such as Dither Modulation-based robust Adaptive Steganography (DMAS) and Generalized dither Modulation-based robust Adaptive Steganography (GMAS). They relieve the problem that the receivers cannot extract the message correctly when the quality factor of channel JPEG compression is larger than that of cover images. However, they only can realize limited resistance to detection and compression due to robust domain selection. To overcome this problem, we meticulously explore three lossy operations in the JPEG recompression and discover that the key problem is spatial overflow. Then two preprocessing methods Overall Scaling (OS) and Specific Truncation (ST) are presented to remove overflow before message embedding as well as generate a reference image. The reference image is employed as the guidance to build asymmetric distortion for removing overflow during embedding. Experimental results show that the proposed methods significantly surpass GMAS in terms of security and achieve comparable robustness.


title: State of the Art of Augmented Reality (AR) Capabilities for Civil Infrastructure Applications

abstract: Augmented Reality (AR) is a technology superimposing interactional virtual objects onto a real environment. Since the beginning of the millennium, AR technologies have shown rapid growth, with significant research publications in engineering and science. However, the civil infrastructure community has minimally implemented AR technologies to date. One of the challenges that civil engineers face when understanding and using AR is the lack of a classification of AR in the context of capabilities for civil infrastructure applications. Practitioners in civil infrastructure, like most engineering fields, prioritize understanding the level of maturity of a new technology before considering its adoption and field implementation. This paper compares the capabilities of sixteen AR Head-Mounted Devices (HMDs) available in the market since 2017, ranking them in terms of performance for civil infrastructure implementations. Finally, the authors recommend a development framework for practical AR interfaces with civil infrastructure and operations.


title: Spectral flow inside essential spectrum VI: on essentially singular points

abstract: Let $H_0$ be a self-adjoint operator on a Hilbert space $\mathcal H$ endowed with a rigging $F,$ which is a zero-kernel closed operator from $\mathcal H$ to another Hilbert space $\mathcal K$ such that the sandwiched resolvent $F (H_0 - z)^{-1}F^*$ is compact. Assume that $H_0$ obeys the limiting absorption principle (LAP) in the sense that the norm limit $F (H_0 - \lambda - i0)^{-1}F^*$ exists for a.e.~$\lambda.$ Numbers~$\lambda$ for which such limit exists we call $H_0$-regular. A number~$\lambda$ we call semi-regular, if the limit $F (H_0 + F^*JF - \lambda - i0)^{-1}F^*$ exists for at least one bounded self-adjoint operator $J$ on $\mathcal K;$ otherwise we call~$\lambda$ essentially singular. In this paper I discuss essentially singular points. In particular, I give different conditions which ensure that a real number~$\lambda$ is essentially singular, and discuss their relation to eigenvalues of infinite multiplicity which are known examples of essentially singular points.


title: Visualization of Real-time Displacement Time History superimposed with Dynamic Experiments using Wireless Smart Sensors (WSS) and Augmented Reality (AR)

abstract: Wireless Smart Sensors (WSS) process field data and inform structural engineers and owners about the infrastructure health and safety. In bridge engineering, inspectors make decisions using objective data from each bridge. They decide about repairs and replacements and prioritize the maintenance of certain structure elements on the basis of changes in displacements under loads. However, access to displacement information in the field and in real-time remains a challenge. Displacement data provided by WSS in the field undergoes additional processing and is seen at a different location by an inspector and a sensor specialist. When the data is shared and streamed to the field inspector, there is a inter-dependence between inspectors, sensor specialists, and infrastructure owners, which limits the actionability of the data related to the bridge condition. If inspectors were able to see structural displacements in real-time at the locations of interest, they could conduct additional observations, which would create a new, information-based, decision-making reality in the field. This paper develops a new, human-centered interface that provides inspectors with real-time access to actionable structural data (real-time displacements under loads) during inspection and monitoring enhanced by Augmented Reality (AR). It summarizes the development and validation of the new human-infrastructure interface and evaluates its efficiency through laboratory experiments. The experiments demonstrate that the interface accurately estimates dynamic displacements in comparison with the laser. Using this new AR interface tool, inspectors can observe and compare displacement data, share it across space and time, and visualize displacements in time history.


title: Measuring Total Transverse Reference-free Displacements of Railroad Bridges using 2 Degrees of Freedom (2DOF): Experimental Validation

abstract: Railroad bridge engineers are interested in the displacement of railroad bridges when the train is crossing the bridge for engineering decision making of their assets. Measuring displacements under train crossing events is difficult. If simplified reference-free methods would be accurate and validated, owners would conduct objective performance assessment of their bridge inventories under trains. Researchers have developed new sensing technologies (reference-free) to overcome the limitations of reference point-based displacement sensors. Reference-free methods use accelerometers to estimate displacements, by decomposing the total displacement in two parts: a high-frequency dynamic displacement component, and a low-frequency pseudo-static displacement component. In the past, researchers have used the Euler-Bernoulli beam theory formula to estimate the pseudo-static displacement assuming railroad bridge piles and columns can be simplified as cantilever beams. However, according to railroad bridge managers, railroad bridges have a different degree of fixity for each pile of each bent. Displacements can be estimated assuming a similar degree of fixity for deep foundations, but inherent errors will affect the accuracy of displacement estimation. This paper solves this problem expanding the 1 Degree of Freedom (1DOF) solution to a new 2 Degrees of Freedom (2DOF), to collect displacements under trains and enable cost-effective condition-based information related to bridge safety. Researchers developed a simplified beam to demonstrate the total displacement estimation using 2DOF and further conducted experimental results in the laboratory. The estimated displacement of the 2DOF model is more accurate than that of the 1DOF model for ten train crossing events. With only one sensor added to the ground of the pile, this method provides owners with approximately 40% more accurate displacements.


title: SIN:Superpixel Interpolation Network

abstract: Superpixels have been widely used in computer vision tasks due to their representational and computational efficiency. Meanwhile, deep learning and end-to-end framework have made great progress in various fields including computer vision. However, existing superpixel algorithms cannot be integrated into subsequent tasks in an end-to-end way. Traditional algorithms and deep learning-based algorithms are two main streams in superpixel segmentation. The former is non-differentiable and the latter needs a non-differentiable post-processing step to enforce connectivity, which constraints the integration of superpixels and downstream tasks. In this paper, we propose a deep learning-based superpixel segmentation algorithm SIN which can be integrated with downstream tasks in an end-to-end way. Owing to some downstream tasks such as visual tracking require real-time speed, the speed of generating superpixels is also important. To remove the post-processing step, our algorithm enforces spatial connectivity from the start. Superpixels are initialized by sampled pixels and other pixels are assigned to superpixels through multiple updating steps. Each step consists of a horizontal and a vertical interpolation, which is the key to enforcing spatial connectivity. Multi-layer outputs of a fully convolutional network are utilized to predict association scores for interpolations. Experimental results show that our approach runs at about 80fps and performs favorably against state-of-the-art methods. Furthermore, we design a simple but effective loss function which reduces much training time. The improvements of superpixel-based tasks demonstrate the effectiveness of our algorithm. We hope SIN will be integrated into downstream tasks in an end-to-end way and benefit the superpixel-based community. Code is available at: \href{https://github.com/yuanqqq/SIN}{https://github.com/yuanqqq/SIN}.


title: Emergence of Kinematic Space from Quantum Modular Geometric Tensor

abstract: We generalize the Quantum Geometric Tensor by replacing a Hamiltonian with a modular Hamiltonian. The symmetric part of the Quantum Geometric Tensor provides a Fubini-Study metric, and its anti-symmetric sector gives a Berry curvature. Now the generalization or Quantum Modular Geometric Tensor gives a Kinematic Space and a modular Berry curvature. Here we demonstrate the emergence by focusing on a spherical entangling surface. We also use the result of the identity Virasoro block to relate the connected correlator of two Wilson lines to the two-point function of a modular Hamiltonian. This result realizes a novel holographic entanglement formula for two intervals of a general separation. This formula does not only hold for a classical gravity sector but also Quantum Gravity. The formula also provides a new Quantum Information interpretation to the connected correlators of Wilson lines as the mutual information. Our study provides an opportunity to explore Quantum Kinematic Space through Quantum Modular Geometric Tensor and hence go beyond symmetry.


title: A Q-Learning-based Approach for Distributed Beam Scheduling in mmWave Networks

abstract: We consider the problem of distributed downlink beam scheduling and power allocation for millimeter-Wave (mmWave) cellular networks where multiple base stations (BSs) belonging to different service operators share the same unlicensed spectrum with no central coordination or cooperation among them. Our goal is to design efficient distributed beam scheduling and power allocation algorithms such that the network-level payoff, defined as the weighted sum of the total throughput and a power penalization term, can be maximized. To this end, we propose a distributed scheduling approach to power allocation and adaptation for efficient interference management over the shared spectrum by modeling each BS as an independent Q-learning agent. As a baseline, we compare the proposed approach to the state-of-the-art non-cooperative game-based approach which was previously developed for the same problem. We conduct extensive experiments under various scenarios to verify the effect of multiple factors on the performance of both approaches. Experiment results show that the proposed approach adapts well to different interference situations by learning from experience and can achieve higher payoff than the game-based approach. The proposed approach can also be integrated into our previously developed Lyapunov stochastic optimization framework for the purpose of network utility maximization with optimality guarantee. As a result, the weights in the payoff function can be automatically and optimally determined by the virtual queue values from the sub-problems derived from the Lyapunov optimization framework.


title: Adaptive Non-singular Terminal Sliding Mode Fault-tolerant Control of Robotic Manipulators Based on Contour Error Compensation

abstract: To achieve accurate contour tracking of robotic manipulators with dynamic uncertainties, coupling and actuator faults, an adaptive non-singular terminal sliding mode control (ANTSMC) based on cross-coupling is proposed. Firstly, the singularity is eliminated completely by using a terminal sliding mode manifold. Secondly, an adaptive tuning approach is selected for avoid the demand of the bound of system uncertainty, and the stability of the proposed control strategy is demonstrated by the sense of the finite-time stability theory. Furthermore, the cross-coupled ANTSMC law is proposed for contour tracking at the end-effectors level of robotic manipulators. Thirdly, a unified framework of cross-coupling contour compensation and reference position pre-compensation is designed by combining cross-coupling control with parabolic transition trajectory planning. Finally, numerical simulation and experimental results are shown to prove the effectiveness of the proposed control strategy.


title: Cordiality of Digraphs

abstract: A $(0,1)$-labelling of a set is said to be {\em friendly} if approximately one half the elements of the set are labelled 0 and one half labelled 1. Let $g$ be a labelling of the edge set of a graph that is induced by a labelling $f$ of the vertex set. If both $g$ and $f$ are friendly then $g$ is said to be a {\em cordial} labelling of the graph. We extend this concept to directed graphs and investigate the cordiality of sets of directed graphs. We investigate a specific type of cordiality on digraphs, a restriction of quasigroup-cordiality called $(2,3)$-cordiality. A directed graph is $(2,3)$-cordial if there is a friendly labelling $f$ of the vertex set which induces a $(1,-1,0)$-labelling of the arc set $g$ such that about one third of the arcs are labelled 1, about one third labelled -1 and about one third labelled 0. In particular we determine which tournaments are $(2,3)$-cordial, which orientations of the $n$-wheel are $(2,3)$-cordial, and which orientations of the $n -$fan are $(2,3)$-cordial.


title: Novel Secret-Key-Assisted Schemes for Secure MISOME-OFDM Systems

abstract: We propose a new secure transmission scheme for uplink multiple-input single-output (MISO) orthogonal-frequency multiplexing (OFDM) systems in the presence of multiple eavesdroppers. Our proposed scheme utilizes the sub-channels orthogonality of OFDM systems to simultaneously transmit data and secret key symbols. The base station, Bob, shares secret key symbols with the legitimate user, Alice, using wiretap coding over a portion of the sub-channels. Concurrently, Alice uses the accumulated secret keys in her secret-key queue to encrypt data symbols using a one time pad (OTP) cipher and transmits them to Bob over the remaining sub-channels. if Alice did not accumulate sufficient keys in her secret-key queue, she employs wiretap coding to secure her data transmissions. We propose fixed and dynamic sub-channel allocation schemes to divide the sub-channels between data and secret keys. We derive the secrecy outage probability (SOP) and the secure throughput for the proposed scheme. We quantify the system's security under practical non-Gaussian transmissions where discrete signal constellation points are transmitted by the legitimate source nodes. Numerical results validate our theoretical findings and quantify the impact of different system design parameters.


title: Robust Pedestrian Attribute Recognition Using Group Sparsity for Occlusion Videos

abstract: Occlusion processing is a key issue in pedestrian attribute recognition (PAR). Nevertheless, several existing video-based PAR methods have not yet considered occlusion handling in depth. In this paper, we formulate finding non-occluded frames as sparsity-based temporal attention of a crowded video. In this manner, a model is guided not to pay attention to the occluded frame. However, temporal sparsity cannot include a correlation between attributes when occlusion occurs. For example, "boots" and "shoe color" cannot be recognized when the foot is invisible. To solve the uncorrelated attention issue, we also propose a novel group sparsity-based temporal attention module. Group sparsity is applied across attention weights in correlated attributes. Thus, attention weights in a group are forced to pay attention to the same frames. Experimental results showed that the proposed method achieved a higher F1-score than the state-of-the-art methods on two video-based PAR datasets.


title: Order and uo-convergence in spaces of continuous functions

abstract: We present several characterizations of uo-convergent nets or sequences in spaces of continuous functions $C(\Omega)$, $C_b(\Omega)$, $C_0(\Omega)$, and $C^\infty(\Omega)$, extending results of [vdW18]. In particular, it is shown that a sequence uo-converges iff it converges pointwise on a co-meagre set. We also characterize order bounded sets in spaces of continuous functions. This leads to characterizations of order convergence.


title: NeuralArTS: Structuring Neural Architecture Search with Type Theory

abstract: Neural Architecture Search (NAS) algorithms automate the task of finding optimal deep learning architectures given an initial search space of possible operations. Developing these search spaces is usually a manual affair with pre-optimized search spaces being more efficient, rather than searching from scratch. In this paper we present a new framework called Neural Architecture Type System (NeuralArTS) that categorizes the infinite set of network operations in a structured type system. We further demonstrate how NeuralArTS can be applied to convolutional layers and propose several future directions.


title: Single laser pulse driven thermal limit of the quasi-two dimensional magnetic ordering in Sr$_2$IrO$_4$

abstract: Upon femtosecond-laser stimulation, generally materials are expected to recover back to their thermal-equilibrium conditions, with only a few exceptions reported. Here we demonstrate that deviation from the thermal-equilibrium pathway can be induced in canonical 3D antiferromagnetically (AFM) ordered Sr$_2$IrO$_4$ by a single 100-fs-laser pulse, appearing as losing long-range magnetic correlation along one direction into a glassy condition. We further discover a `critical-threshold ordering' behavior for fluence above approximately 12 mJ/cm$^2$ which we show corresponds to the smallest thermodynamically stable $c$-axis correlation length needed to maintain long-range quasi-two-dimensional AFM order. We suggest that this behavior arises from the crystalline anisotropy of the magnetic-exchange parameters in Sr$_2$IrO$_4$, whose strengths are associated with distinctly different timescales. As a result, they play out very differently in the ultrafast recovery processes, compared with the thermal equilibrium evolution. Thus, our observations are expected to be relevant to a wide range of problems in the nonequilibrium behavior of low-dimensional magnets and other related ordering phenomena.


title: Black-box Adversarial Attacks on Network-wide Multi-step Traffic State Prediction Models

abstract: Traffic state prediction is necessary for many Intelligent Transportation Systems applications. Recent developments of the topic have focused on network-wide, multi-step prediction, where state of the art performance is achieved via deep learning models, in particular, graph neural network-based models. While the prediction accuracy of deep learning models is high, these models' robustness has raised many safety concerns, given that imperceptible perturbations added to input can substantially degrade the model performance. In this work, we propose an adversarial attack framework by treating the prediction model as a black-box, i.e., assuming no knowledge of the model architecture, training data, and (hyper)parameters. However, we assume that the adversary can oracle the prediction model with any input and obtain corresponding output. Next, the adversary can train a substitute model using input-output pairs and generate adversarial signals based on the substitute model. To test the attack effectiveness, two state of the art, graph neural network-based models (GCGRNN and DCRNN) are examined. As a result, the adversary can degrade the target model's prediction accuracy up to $54\%$. In comparison, two conventional statistical models (linear regression and historical average) are also examined. While these two models do not produce high prediction accuracy, they are either influenced negligibly (less than $3\%$) or are immune to the adversary's attack.


title: Pareto Navigation Gradient Descent: a First-Order Algorithm for Optimization in Pareto Set

abstract: Many modern machine learning applications, such as multi-task learning, require finding optimal model parameters to trade-off multiple objective functions that may conflict with each other. The notion of the Pareto set allows us to focus on the set of (often infinite number of) models that cannot be strictly improved. But it does not provide an actionable procedure for picking one or a few special models to return to practical users. In this paper, we consider \emph{optimization in Pareto set (OPT-in-Pareto)}, the problem of finding Pareto models that optimize an extra reference criterion function within the Pareto set. This function can either encode a specific preference from the users, or represent a generic diversity measure for obtaining a set of diversified Pareto models that are representative of the whole Pareto set. Unfortunately, despite being a highly useful framework, efficient algorithms for OPT-in-Pareto have been largely missing, especially for large-scale, non-convex, and non-linear objectives in deep learning. A naive approach is to apply Riemannian manifold gradient descent on the Pareto set, which yields a high computational cost due to the need for eigen-calculation of Hessian matrices. We propose a first-order algorithm that approximately solves OPT-in-Pareto using only gradient information, with both high practical efficiency and theoretically guaranteed convergence property. Empirically, we demonstrate that our method works efficiently for a variety of challenging multi-task-related problems.


title: Statistics for p-ranks of Artin-Schreier covers

abstract: Given a prime $p$ and $q$ a power of $p$, we study the statistics of $p$-ranks of Artin--Schreier covers of given genus defined over $\mathbb{F}_q$, in the large $q$-limit. We refer to this problem as the geometric problem. We also study an arithmetic variation of this problem, and consider Artin--Schreier covers defined over $\mathbb{F}_p$, letting $p$ go to infinity. Distribution of $p$-ranks has been previously studied for Artin--Schreier covers over a fixed finite field as the genus is allowed to go to infinity. The method requires that we count isomorphism classes of covers that are unramified at $\infty$.


title: Summing Inflationary Logarithms in Nonlinear Sigma Models

abstract: We consider two nonlinear sigma models on de Sitter background which involve the same derivative interactions as quantum gravity but without the gauge issue. The first model contains only a single field, which can be reduced to a free theory by a local field redefinition; the second contains two fields and cannot be so reduced. Loop corrections in both models produce large temporal and spatial logarithms which cause perturbation theory to break down at late times and large distances. Many of these logarithms derive from the "tail" part of the propagator and can be summed using a variant of Starobinsky's stochastic formalism involving a curvature-dependent effective potential. The remaining logarithms derive from the ultraviolet and can be summed using a variant of the renormalization group based on a special class of curvature-dependent renormalizations. Explicit results are derived at 1-loop and 2-loop orders.


title: Multifractal of mass function

abstract: Multifractal plays an important role in many fields. However, there is few attentions about mass function, which can better deal with uncertain information than probability. In this paper, we proposed multifractal of mass function. Firstly, the definition of multifractal spectrum of mass function is given. Secondly, the multifractal dimension of mass function is defined as $D_{\alpha}$. When mass function degenerates to probability distribution, $D_{\alpha}$ degenerates to $d_{\alpha}$, which is information dimension proposed by Renyi. One interesting property is that the multifractal dimension of mass function with maximum Deng entropy is 1.585 no matter the order. Other interesting properties and numerical examples are shown to illustrate proposed model.


title: Hand Gesture Recognition Using Temporal Convolutions and Attention Mechanism

abstract: Advances in biosignal signal processing and machine learning, in particular Deep Neural Networks (DNNs), have paved the way for the development of innovative Human-Machine Interfaces for decoding the human intent and controlling artificial limbs. DNN models have shown promising results with respect to other algorithms for decoding muscle electrical activity, especially for recognition of hand gestures. Such data-driven models, however, have been challenged by their need for a large number of trainable parameters and their structural complexity. Here we propose the novel Temporal Convolutions-based Hand Gesture Recognition architecture (TC-HGR) to reduce this computational burden. With this approach, we classified 17 hand gestures via surface Electromyogram (sEMG) signals by the adoption of attention mechanisms and temporal convolutions. The proposed method led to 81.65% and 80.72% classification accuracy for window sizes of 300ms and 200ms, respectively. The number of parameters to train the proposed TC-HGR architecture is 11.9 times less than that of its state-of-the-art counterpart.


title: AE-StyleGAN: Improved Training of Style-Based Auto-Encoders

abstract: StyleGANs have shown impressive results on data generation and manipulation in recent years, thanks to its disentangled style latent space. A lot of efforts have been made in inverting a pretrained generator, where an encoder is trained ad hoc after the generator is trained in a two-stage fashion. In this paper, we focus on style-based generators asking a scientific question: Does forcing such a generator to reconstruct real data lead to more disentangled latent space and make the inversion process from image to latent space easy? We describe a new methodology to train a style-based autoencoder where the encoder and generator are optimized end-to-end. We show that our proposed model consistently outperforms baselines in terms of image inversion and generation quality. Supplementary, code, and pretrained models are available on the project website.


title: CLASP: Constrained Latent Shape Projection for Refining Object Shape from Robot Contact

abstract: Robots need both visual and contact sensing to effectively estimate the state of their environment. Camera RGBD data provides rich information of the objects surrounding the robot, and shape priors can help correct noise and fill in gaps and occluded regions. However, when the robot senses unexpected contact, the estimate should be updated to explain the contact. To address this need, we propose CLASP: Constrained Latent Shape Projection. This approach consists of a shape completion network that generates a prior from RGBD data and a procedure to generate shapes consistent with both the network prior and robot contact observations. We find CLASP consistently decreases the Chamfer Distance between the predicted and ground truth scenes, while other approaches do not benefit from contact information.


title: Centroid Approximation for Bootstrap: Improving Particle Quality at Inference

abstract: Bootstrap is a principled and powerful frequentist statistical tool for uncertainty quantification. Unfortunately, standard bootstrap methods are computationally intensive due to the need of drawing a large i.i.d. bootstrap sample to approximate the ideal bootstrap distribution; this largely hinders their application in large-scale machine learning, especially deep learning problems. In this work, we propose an efficient method to explicitly \emph{optimize} a small set of high quality ``centroid'' points to better approximate the ideal bootstrap distribution. We achieve this by minimizing a simple objective function that is asymptotically equivalent to the Wasserstein distance to the ideal bootstrap distribution. This allows us to provide an accurate estimation of uncertainty with a small number of bootstrap centroids, outperforming the naive i.i.d. sampling approach. Empirically, we show that our method can boost the performance of bootstrap in a variety of applications.


title: CAE-Transformer: Transformer-based Model to Predict Invasiveness of Lung Adenocarcinoma Subsolid Nodules from Non-thin Section 3D CT Scans

abstract: Lung cancer is the leading cause of mortality from cancer worldwide and has various histologic types, among which Lung Adenocarcinoma (LUAC) has recently been the most prevalent one. The current approach to determine the invasiveness of LUACs is surgical resection, which is not a viable solution to fight lung cancer in a timely fashion. An alternative approach is to analyze chest Computed Tomography (CT) scans. The radiologists' analysis based on CT images, however, is subjective and might result in a low accuracy. In this paper, a transformer-based framework, referred to as the "CAE-Transformer", is developed to efficiently classify LUACs using whole CT images instead of finely annotated nodules. The proposed CAE-Transformer can achieve high accuracy over a small dataset and requires minor supervision from radiologists. The CAE Transformer utilizes an encoder to automatically extract informative features from CT slices, which are then fed to a modified transformer to capture global inter-slice relations and provide classification labels. Experimental results on our in-house dataset of 114 pathologically proven Sub-Solid Nodules (SSNs) demonstrate the superiority of the CAE-Transformer over its counterparts, achieving an accuracy of 87.73%, sensitivity of 88.67%, specificity of 86.33%, and AUC of 0.913, using a 10-fold cross-validation.


title: Hausdorff Dimension and Lebesgue Measure of Codiagonal of Embedded Vector Bundles over Submanifolds in Euclidean Space

abstract: In this paper we study measure theoretical size of the image of naturally embedded vector bundles in $\mathbb{R}^{n} \times \mathbb{R}^{n}$ under the codiagonal morphism, i.e. $\Delta_{*}$ in the category of finite dimensional $\mathbb{R}$-vector spaces. Under very weak smoothness condition we show that codiagonal of normal bundles always contain an open subset of the ambient space, and we give corresponding criterions for the tangent bundles. For any differentiable hypersurface we show that the codiagonal of its tangent bundle has non-empty interior, unless the hypersurface is contained in a hyperplane. Assuming further smoothness (e.g. twice differentiable) we show that union of any family of hyperplanes that covers the hypersurface has maximal possible Hausdorff dimension. We also define and study a notion of degeneracy of embedded $C^{1}$ vector bundles over a $C^{1}$ submanifold and show as a corollary that if the base manifold has at least one non-inflection point then codiagonal of any $C^{1}$ line bundle over it has positive Lebesgue measure. Finally we show that codiagonal of any line bundle over an $n$-dimensional ellipsoid or a convex curve has non-empty interior, and the same assertion also holds for any non-tangent line bundle over a hyperplane.


title: Gender identity and relative income within household: Evidence from China

abstract: How does women's obedience to traditional gender roles affect their labour outcomes? To investigate on this question, we employ discontinuity tests and fixed effect regressions with time lag to measure how married women in China diminish their labour outcomes so as to maintain the bread-winning status of their husbands. In the first half of this research, our discontinuity test exhibits a missing mass of married women who just out-earn their husbands, which is interpreted as an evidence showing that these females diminish their earnings under the influence of gender norms. In the second half, we use fixed effect regressions with time lag to assess the change of a female's future labour outcomes if she currently earns more than her husband. Our results suggest that women's future labour participation decisions (whether they still join the workforce) are unaffected, but their yearly incomes and weekly working hours will be reduced in the future. Lastly, heterogeneous studies are conducted, showing that low-income and less educated married women are more susceptible to the influence of gender norms.


title: Isolation of the diamond graph

abstract: A graph is $H$-free if it does not contain $H$ as a subgraph. The diamond graph is the graph obtained from $K_4$ by deleting one edge. We prove that if $G$ is a connected graph with order $n\geq 10$, then there exists a subset $S\subseteq V(G)$ with $|S|\leq n/5$ such that the graph induced by $V(G)\setminus N[S]$ is diamond-free, where $N[S]$ is the closed neighborhood of $S$. Furthermore, the bound is sharp.


title: A Riemannian Mean Field Formulation for Two-layer Neural Networks with Batch Normalization

abstract: The training dynamics of two-layer neural networks with batch normalization (BN) is studied. It is written as the training dynamics of a neural network without BN on a Riemannian manifold. Therefore, we identify BN's effect of changing the metric in the parameter space. Later, the infinite-width limit of the two-layer neural networks with BN is considered, and a mean-field formulation is derived for the training dynamics. The training dynamics of the mean-field formulation is shown to be the Wasserstein gradient flow on the manifold. Theoretical analysis are provided on the well-posedness and convergence of the Wasserstein gradient flow.


title: Data Shapley Value for Handling Noisy Labels: An application in Screening COVID-19 Pneumonia from Chest CT Scans

abstract: A long-standing challenge of deep learning models involves how to handle noisy labels, especially in applications where human lives are at stake. Adoption of the data Shapley Value (SV), a cooperative game theoretical approach, is an intelligent valuation solution to tackle the issue of noisy labels. Data SV can be used together with a learning model and an evaluation metric to validate each training point's contribution to the model's performance. The SV of a data point, however, is not unique and depends on the learning model, the evaluation metric, and other data points collaborating in the training game. However, effects of utilizing different evaluation metrics for computation of the SV, detecting the noisy labels, and measuring the data points' importance has not yet been thoroughly investigated. In this context, we performed a series of comparative analyses to assess SV's capabilities to detect noisy input labels when measured by different evaluation metrics. Our experiments on COVID-19-infected of CT images illustrate that although the data SV can effectively identify noisy labels, adoption of different evaluation metric can significantly influence its ability to identify noisy labels from different data classes. Specifically, we demonstrate that the SV greatly depends on the associated evaluation metric.


title: Graph-less Neural Networks: Teaching Old MLPs New Tricks via Distillation

abstract: Graph Neural Networks (GNNs) are popular for graph machine learning and have shown great results on wide node classification tasks. Yet, they are less popular for practical deployments in the industry owing to their scalability challenges incurred by data dependency. Namely, GNN inference depends on neighbor nodes multiple hops away from the target, and fetching them burdens latency-constrained applications. Existing inference acceleration methods like pruning and quantization can speed up GNNs by reducing Multiplication-and-ACcumulation (MAC) operations, but the improvements are limited given the data dependency is not resolved. Conversely, multi-layer perceptrons (MLPs) have no graph dependency and infer much faster than GNNs, even though they are less accurate than GNNs for node classification in general. Motivated by these complementary strengths and weaknesses, we bring GNNs and MLPs together via knowledge distillation (KD). Our work shows that the performance of MLPs can be improved by large margins with GNN KD. We call the distilled MLPs Graph-less Neural Networks (GLNNs) as they have no inference graph dependency. We show that GLNNs with competitive accuracy infer faster than GNNs by 146X-273X and faster than other acceleration methods by 14X-27X. Under a production setting involving both transductive and inductive predictions across 7 datasets, GLNN accuracies improve over stand-alone MLPs by 12.36% on average and match GNNs on 6/7 datasets. Comprehensive analysis shows when and why GLNNs can achieve competitive accuracies to GNNs and suggests GLNN as a handy choice for latency-constrained applications.


title: On universally optimal lattice phase transitions and energy minimizers of completely monotone potentials

abstract: We consider the minimizing problem for energy functionals with two types of competing particles and completely monotone potential on a lattice. We prove that the minima of sum of two completely monotone functions among lattices is located exactly on a special curve which is part of the boundary of the fundamental region. We also establish a universal result for square lattice being the optimal in certain interval, which is surprising. Our result establishes the hexagonal-rhombic-square-rectangular transition lattice shapes in many physical and biological system (such as Bose-Einstein condensates and two-component Ginzburg-Landau systems). It turns out, our results also apply to locating the minimizers of sum of two Eisenstein series, which is new in number theory.


title: VoteHMR: Occlusion-Aware Voting Network for Robust 3D Human Mesh Recovery from Partial Point Clouds

abstract: 3D human mesh recovery from point clouds is essential for various tasks, including AR/VR and human behavior understanding. Previous works in this field either require high-quality 3D human scans or sequential point clouds, which cannot be easily applied to low-quality 3D scans captured by consumer-level depth sensors. In this paper, we make the first attempt to reconstruct reliable 3D human shapes from single-frame partial point clouds.To achieve this, we propose an end-to-end learnable method, named VoteHMR. The core of VoteHMR is a novel occlusion-aware voting network that can first reliably produce visible joint-level features from the input partial point clouds, and then complete the joint-level features through the kinematic tree of the human skeleton. Compared with holistic features used by previous works, the joint-level features can not only effectively encode the human geometry information but also be robust to noisy inputs with self-occlusions and missing areas. By exploiting the rich complementary clues from the joint-level features and global features from the input point clouds, the proposed method encourages reliable and disentangled parameter predictions for statistical 3D human models, such as SMPL. The proposed method achieves state-of-the-art performances on two large-scale datasets, namely SURREAL and DFAUST. Furthermore, VoteHMR also demonstrates superior generalization ability on real-world datasets, such as Berkeley MHAD.


title: A general formula to solve quintic equation

abstract: After Abel Ruffini theorem and Galois Theory the search for a method or formula to solve quintic equation ends. This paper discuss about the radical solution of quintic equation using a method that could be proved in some simple steps. A quintic equation as an example was given for understand better this method.


title: Improving End-To-End Modeling for Mispronunciation Detection with Effective Augmentation Mechanisms

abstract: Recently, end-to-end (E2E) models, which allow to take spectral vector sequences of L2 (second-language) learners' utterances as input and produce the corresponding phone-level sequences as output, have attracted much research attention in developing mispronunciation detection (MD) systems. However, due to the lack of sufficient labeled speech data of L2 speakers for model estimation, E2E MD models are prone to overfitting in relation to conventional ones that are built on DNN-HMM acoustic models. To alleviate this critical issue, we in this paper propose two modeling strategies to enhance the discrimination capability of E2E MD models, each of which can implicitly leverage the phonetic and phonological traits encoded in a pretrained acoustic model and contained within reference transcripts of the training data, respectively. The first one is input augmentation, which aims to distill knowledge about phonetic discrimination from a DNN-HMM acoustic model. The second one is label augmentation, which manages to capture more phonological patterns from the transcripts of training data. A series of empirical experiments conducted on the L2-ARCTIC English dataset seem to confirm the efficacy of our E2E MD model when compared to some top-of-the-line E2E MD models and a classic pronunciation-scoring based method built on a DNN-HMM acoustic model.


title: A Deep Learning-based Approach for Real-time Facemask Detection

abstract: The COVID-19 pandemic is causing a global health crisis. Public spaces need to be safeguarded from the adverse effects of this pandemic. Wearing a facemask becomes one of the effective protection solutions adopted by many governments. Manual real-time monitoring of facemask wearing for a large group of people is becoming a difficult task. The goal of this paper is to use deep learning (DL), which has shown excellent results in many real-life applications, to ensure efficient real-time facemask detection. The proposed approach is based on two steps. An off-line step aiming to create a DL model that is able to detect and locate facemasks and whether they are appropriately worn. An online step that deploys the DL model at edge computing in order to detect masks in real-time. In this study, we propose to use MobileNetV2 to detect facemask in real-time. Several experiments are conducted and show good performances of the proposed approach (99% for training and testing accuracy). In addition, several comparisons with many state-of-the-art models namely ResNet50, DenseNet, and VGG16 show good performance of the MobileNetV2 in terms of training time and accuracy.


title: LoveDA: A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentation

abstract: Deep learning approaches have shown promising results in remote sensing high spatial resolution (HSR) land-cover mapping. However, urban and rural scenes can show completely different geographical landscapes, and the inadequate generalizability of these algorithms hinders city-level or national-level mapping. Most of the existing HSR land-cover datasets mainly promote the research of learning semantic representation, thereby ignoring the model transferability. In this paper, we introduce the Land-cOVEr Domain Adaptive semantic segmentation (LoveDA) dataset to advance semantic and transferable learning. The LoveDA dataset contains 5987 HSR images with 166768 annotated objects from three different cities. Compared to the existing datasets, the LoveDA dataset encompasses two domains (urban and rural), which brings considerable challenges due to the: 1) multi-scale objects; 2) complex background samples; and 3) inconsistent class distributions. The LoveDA dataset is suitable for both land-cover semantic segmentation and unsupervised domain adaptation (UDA) tasks. Accordingly, we benchmarked the LoveDA dataset on eleven semantic segmentation methods and eight UDA methods. Some exploratory studies including multi-scale architectures and strategies, additional background supervision, and pseudo-label analysis were also carried out to address these challenges. The code and data are available at https://github.com/Junjue-Wang/LoveDA.


title: C*-envelopes of tensor algebras of product systems

abstract: Let $P$ be a submonoid of a group $G$ and let $\mathcal{E}=(\mathcal{E}_p)_{p\in P}$ be a product system over $P$ with coefficient C*-algebra $A$. We show that the following C*-algebras are canonically isomorphic: the C*-envelope of the tensor algebra $\mathcal{T}_\lambda(\mathcal{E})^+$ of $\mathcal{E}$; the reduced cross sectional C*-algebra of the Fell bundle associated to the canonical coaction of $G$ on the covariance algebra $A\times_{\mathcal{E}}P$ of $\mathcal{E}$; and the C*-envelope of the cosystem obtained by restricting the canonical gauge coaction on $\mathcal{T}_\lambda(\mathcal{E})$ to the tensor algebra. As a consequence, for every submonoid $P$ of a group $G$ and every product system $\mathcal{E}=(\mathcal{E}_p)_{p\in P}$ over $P$, the C*-envelope $\mathcal{C}^*_{\mathrm{env}}(\mathcal{T}_\lambda(\mathcal{E})^+)$ automatically carries a coaction of $G$ that is compatible with the canonical gauge coaction on $\mathcal{T}_\lambda(\mathcal{E})$. This answers a question left open by Dor-On, Kakariadis, Katsoulis, Laca and Li. We also analyse co-universal properties of $\mathcal{C}^*_{\mathrm{env}}(\mathcal{T}_\lambda(\mathcal{E})^+)$ with respect to injective gauge-compatible representations of $\mathcal{E}$. When $\mathcal{E}=\mathbb{C}^P$ is the canonical product system over $P$ with one-dimensional fibres, our main result implies that the boundary quotient $\partial\mathcal{T}_\lambda(P)$ is canonically isomorphic to the C*-envelope of the closed non-selfadjoint subalgebra spanned by the canonical generating isometries of $\mathcal{T}_\lambda(P)$. Our results on co-universality imply that $\partial\mathcal{T}_\lambda(P)$ is a quotient of every nonzero C*-algebra generated by a gauge-compatible isometric representation of $P$ that in an appropriate sense respects the zero element of the semilattice of constructible right ideals of $P$.


title: Exceptional Point modulated by Kerr effect in Anti-Parity-Time Symmetry System

abstract: With respect to parity-time (PT) symmetry, anti-parity-time (APT) symmetric system exhibits much easier readout mechanism due to its real frequency splitting. Generally, such systems need to be operated at exceptional points (EPs) to obtain the best performance. However, strict conditons to locate APT symmetric systems at their EPs precisely put restraints on their practical applications. To overcome this problem, we propose a scheme to manipulate the EPs in APT symmetric configuration by Kerr effect. It is demonstrated that operating EPs by self-phase modulation alone will impede the frequency splitting caused by external perturbations, while cross-phase modulation can enhance the response to measurable perturbations. We also investigate the thermal effect induced by high light intensity, which could reduce the power to manipulate EPs. This proposed scheme can pave a new way in fabricating devices based on APT symmetry.


title: On the existence of solutions of quasilinear Beltrami equations with two characteristics

abstract: We study Beltrami-type equations with two given complex characteristics. Under certain conditions on the complex coefficients, we obtained theorems on the existence of homeomorphic $ ACL $ -solutions of this equation. In addition, for some relatively weak conditions, we obtained theorems on the existence of the corresponding continuous $ ACL $ -solutions that are loga -rith\-mi\-cally H\"{o}lder in a given domain.


title: Pulsating propagation and extinction of hydrogen detonations in ultrafine water sprays

abstract: The Eulerian-Lagrangian method is applied to simulate pulsating propagation and extinction of stoichiometric hydrogen/oxygen/argon detonations in ultrafine water sprays. Three detonation propagation modes are found: (1) pulsating propagation, (2) propagation followed by extinction, and (3) immediate extinction. For pulsating detonation, within one cycle, the propagation speeds and the distance between reaction front (RF) and shock front (SF) change periodically. The pulsating phenomenon originates from the interactions between gas dynamics, chemical kinetics, and droplet dynamics inside the induction zone. Multiple pressure waves are emanated from the RF within one cycle, which overtake and intensify the lead SF. An autoigniting spot arises in the shocked gas after the contact surface. The relative locations of SF, RF, shock-frame sonic point, and two-phase contact surface remain unchanged in a pulsating cycle, but their distances have periodic variations. Moreover, the unsteady behaviors of detonation extinction include continuously increased distance between the RF and SF and quickly reduced pressure peaks, temperature, and combustion heat release. The decoupling of RF and SF leads to significantly increasing chemical timescale of the shocked mixture. The hydrodynamic structure also changes considerably when detonation extinction occurs. Moreover, the predicted map of detonation propagation and extinction illustrates that the critical mass loading for detonation extinction reduces significantly when the droplet size becomes smaller. It is also found that for the same droplet size, the average detonation speed monotonically decreases with water mass loading. However, detonation speed and pulsating frequency have a non-monotonic dependence on droplet size under a constant water mass loading.


title: The Game of Arrows on 3-Legged Spider Graphs

abstract: The Game of Cycles is a combinatorial game introduced by Francis Su in 2020 in which players take turns marking arrows on the edges of a simple plane graph, avoiding the creation of sinks and sources and seeking to complete a "cycle cell." Su and his collaborators (2021) found winning strategies on graphs with certain types of symmetry using reverse mirroring. In this paper, we for the first time determine the winning player in the Game of Cycles on an infinite family of graphs lacking symmetry. In particular, we use the Sprague-Grundy Theorem to show that player two has a winning strategy for the Game of Cycles on any 3-legged spider graph with legs of odd length. Because the cycle cell victory condition is extraneous for tree graphs (including spiders), we drop it from the rules and call the result the Game of Arrows. Our proof leans heavily on a notion of state isomorphism that allows us to decompose a game state into states of smaller pieces of a graph, leading to nim-sum calculations with Grundy values.


title: Nakayama functors for coalgebras and their applications to Frobenius tensor categories

abstract: We introduce Nakayama functors for coalgebras and investigate their basic properties. These functors are expressed by certain (co)ends as in the finite case discussed by Fuchs, Schaumann, and Schweigert. This observation allows us to define Nakayama functors for Frobenius tensor categories in an intrinsic way. As applications, we establish the categorical Radford $S^4$-formula for Frobenius tensor categories and obtain some related results. These are generalizations of works of Etingof, Nikshych, and Ostrik on finite tensor categories and some known facts on co-Frobenius Hopf algebras.


title: Robust Kalman filters with unknown covariance of multiplicative noise

abstract: In this paper, state and noise covariance estimation problems for linear system with unknown multiplicative noise are considered. The measurement likelihood is modelled as a mixture of two Gaussian distributions and a Student's t distribution, respectively. The unknown covariance of multiplicative noise is modelled as an inverse Gamma/Wishart distribution and the initial condition is formulated as the nominal covariance. By using robust design and choosing hierarchical priors, two variational Bayesian based robust Kalman filters are proposed. Stability and covergence of the proposed filters, the covariance parameters, the VB inference, and the estimation error dynamics are analyzed. The lower and upper bounds are also provided to guarantee the performance of the proposed filters. A target tracking simulation is provided to validate the effectiveness of the proposed filters.


title: Minimal Conditions for Beneficial Local Search

abstract: This paper investigates why it is beneficial, when solving a problem, to search in the neighbourhood of a current solution. The paper identifies properties of problems and neighbourhoods that support two novel proofs that neighbourhood search is beneficial over blind search. These are: firstly a proof that search within the neighbourhood is more likely to find an improving solution in a single search step than blind search; and secondly a proof that a local improvement, using a sequence of neighbourhood search steps, is likely to achieve a greater improvement than a sequence of blind search steps. To explore the practical impact of these properties, a range of problem sets and neighbourhoods are generated, where these properties are satisfied to different degrees. Experiments reveal that the benefits of neighbourhood search vary dramatically in consequence. Random problems of a classical combinatorial optimisation problem are analysed, in order to demonstrate that the underlying theory is reflected in practice.


title: Efficient World-line-based Quantum Monte Carlo Method Without Hubbard-Stratonovich Transformation

abstract: By precisely writing down the matrix element of the local Boltzmann operator, we have proposed a new path integral formulation for quantum field theory and developed a corresponding Monte Carlo algorithm. With current formula, the Hubbard-Stratonovich transformation is not necessary, and is not based on the determinant approach, which can improve the computational efficiency. The results show that, the simulation time has the square-law scaling with system sizes, which is comparable with the usual first-principle calculation. The current formula also improves the accuracy of the Suzuki-Trotter decomposition. As an example, we have studied the one-dimensional half-filled Hubbard model at finite temperature. The obtained results are in excellent agreement with the known solutions. The new formula and Monte Carlo algorithm can be used in various studies.


title: GNN-LM: Language Modeling based on Global Contexts via GNN

abstract: Inspired by the notion that ``{\it to copy is easier than to memorize}``, in this work, we introduce GNN-LM, which extends the vanilla neural language model (LM) by allowing to reference similar contexts in the entire training corpus. We build a directed heterogeneous graph between an input context and its semantically related neighbors selected from the training corpus, where nodes are tokens in the input context and retrieved neighbor contexts, and edges represent connections between nodes. Graph neural networks (GNNs) are constructed upon the graph to aggregate information from similar contexts to decode the token. This learning paradigm provides direct access to the reference contexts and helps improve a model's generalization ability. We conduct comprehensive experiments to validate the effectiveness of the GNN-LM: GNN-LM achieves a new state-of-the-art perplexity of 14.8 on WikiText-103 (a 3.9 point improvement over its counterpart of the vanilla LM model), and shows substantial improvement on One Billion Word and Enwiki8 datasets against strong baselines. In-depth ablation studies are performed to understand the mechanics of GNN-LM. \footnote{The code can be found at https://github.com/ShannonAI/GNN-LM


title: A model for full local image interpretation

abstract: We describe a computational model of humans' ability to provide a detailed interpretation of components in a scene. Humans can identify in an image meaningful components almost everywhere, and identifying these components is an essential part of the visual process, and of understanding the surrounding scene and its potential meaning to the viewer. Detailed interpretation is beyond the scope of current models of visual recognition. Our model suggests that this is a fundamental limitation, related to the fact that existing models rely on feed-forward but limited top-down processing. In our model, a first recognition stage leads to the initial activation of class candidates, which is incomplete and with limited accuracy. This stage then triggers the application of class-specific interpretation and validation processes, which recover richer and more accurate interpretation of the visible scene. We discuss implications of the model for visual interpretation by humans and by computer vision models.


title: Reminding the Incremental Language Model via Data-Free Self-Distillation

abstract: Incremental language learning with pseudo-data can alleviate catastrophic forgetting in neural networks. However, to obtain better performance, former methods have higher demands for pseudo-data of the previous tasks. The performance dramatically decreases when fewer pseudo-data are employed. In addition, the distribution of pseudo-data gradually deviates from the real data with the sequential learning of different tasks. The deviation will be greater with more tasks learned, which results in more serious catastrophic forgetting. To address these issues, we propose reminding incremental language model via data-free self-distillation (DFSD), which includes self-distillation based on the Earth Mover's Distance and hidden data augmentation. By estimating the knowledge distribution in all layers of GPT-2 and transforming it from teacher model to student model, the Self-distillation based on the Earth Mover's Distance can significantly reduce the demand for pseudo-data. Hidden data augmentation can greatly alleviate the catastrophic forgetting caused by deviations via modeling the generation of pseudo-data as a hidden data augmentation process, where each sample is a mixture of all trained task data. The experimental results demonstrate that our DFSD can exceed the previous state-of-the-art methods even if the maximum decrease in pseudo-data is 90%.


title: Spectral Efficiency of OTFS Based Orthogonal Multiple Access with Rectangular Pulses

abstract: In this paper we consider Orthogonal Time Frequency Space (OTFS) modulation based multiple-access (MA). We specifically consider Orthogonal MA methods (OMA) where the user terminals (UTs) are allocated non-overlapping physical resource in the delay-Doppler (DD) and/or time-frequency (TF) domain. To the best of our knowledge, in prior literature, the performance of OMA methods have been reported only for ideal transmit and receive pulses. In [20] and [21], OMA methods were proposed which were shown to achieve multi-user interference (MUI) free communication with ideal pulses. Since ideal pulses are not realizable, in this paper we study the spectral efficiency (SE) performance of these OMA methods with practical rectangular pulses. For these OMA methods, we derive the expression for the received DD domain symbols at the base station (BS) receiver and the effective DD domain channel matrix when rectangular pulses are used. We then derive the expression for the achievable sum SE. These expressions are also derived for another well known OMA method where guard bands (GB) are used to reduce MUI (called as the GB based MA methods) [19]. Through simulations, we observe that with rectangular pulses the sum SE achieved by the method in [21] is almost invariant of the Doppler shift and is higher than that achieved by the methods in [19], [20] at practical values of the received signal-to-noise ratio.


title: JEL ratio test for independence of time to failure and cause of failure in competing risks

abstract: In the present article, we propose jackknife empirical likelihood (JEL) ratio test for testing the independence of time to failure and cause of failure in competing risks data. We use U-statistic theory to derive the JEL ratio test. The asymptotic distribution of the test statistic is shown to be chi-square distribution with one degree of freedom. A Monte Carlo simulation study is carried out to assess the finite sample behaviour of the proposed test. The performance of proposed JEL test is compared with the test given in Dewan et al. (2004). Finally we illustrate our test procedure using various real data sets.


title: A new class of finitely generated polynomial subalgebras without finite SAGBI bases

abstract: The notion of initial ideal for an ideal of a polynomial ring appears in the theory of Gr\"obner basis. Similarly to the initial ideals, we can define the initial algebra for a subalgebra of a polynomial ring, or more generally of a Laurent polynomial ring, which is used in the theory of SAGBI (Subalgebra Analogue to Gr\"obner Bases for Ideals) basis. The initial algebra of a finitely generated subalgebra is not always finitely generated, and no general criterion for finite generation is known. The aim of this paper is to present a new class of finitely generated subalgebras having non-finitely generated initial algebras. The class contains a subalgebra for which the set of initial algebras is continuum, as well as a subalgebra with finitely many distinct initial algebras.


title: Note on the analytical integration of circumterrestrial orbits

abstract: The acclaimed merits of analytical solutions based on a fictitious time developed in the 1970's were partially overvalued due to a common misuse of classical analytical solutions based on the physical time that were taken as reference. With the main problem of the artificial satellite theory as a model, we carry out a more objective comparison of both kinds of theories. We find that the proper initialization of classical solutions notably balances the performance of the two distinct approaches in what respects to accuracy. Besides, extension of both kinds of satellite theories to higher orders show additional pros and cons of each different perturbation approach, thus providing complementary information to prospective users on which kind of analytical solution may better support their needs.


title: TIP: Task-Informed Motion Prediction for Intelligent Vehicles

abstract: When predicting trajectories of road agents, motion predictors usually approximate the future distribution by a limited number of samples. This constraint requires the predictors to generate samples that best support the task given task specifications. However, existing predictors are often optimized and evaluated via task-agnostic measures without accounting for the use of predictions in downstream tasks, and thus could result in sub-optimal task performance. In this paper, we propose a task-informed motion prediction model that better supports the tasks through its predictions, by jointly reasoning about prediction accuracy and the utility of the downstream tasks, which is commonly used to evaluate the task performance. The task utility function does not require the full task information, but rather a specification of the utility of the task, resulting in predictors that serve a wide range of downstream tasks. We demonstrate our approach on two use cases of common decision making tasks and their utility functions, in the context of autonomous driving and parallel autonomy. Experiment results show that our predictor produces accurate predictions that improve the task performance by a large margin in both tasks when compared to task-agnostic baselines on the Waymo Open Motion dataset.


title: Petals and Books: The largest Laplacian spectral gap from 1

abstract: We prove that, for any connected graph on $N\geq 3$ vertices, the spectral gap from the value $1$ with respect to the normalized Laplacian is at most $1/2$. Moreover, we show that equality is achieved if and only if the graph is either a petal graph (for $N$ odd) or a book graph (for $N$ even). This implies that $(\frac12,\frac32)$ is a maximal gap interval for the normalized Laplacian on connected graphs. This is closely related to the Alon-Boppana bound on regular graphs and a recent result by Koll\'ar and Sarnak on cubic graphs. Our result also provides a sharp bound for the convergence rate of some eigenvalues of the Laplacian on neighborhood graphs.


title: SN 2015bq: A Luminous Type Ia Supernova with Early Flux Excess

abstract: We present optical and ultraviolet (UV) observations of a luminous type Ia supernova (SN Ia) SN 2015bq characterized by the early flux excess. This SN reaches a B-band absolute magnitude at $M_B = -19.68 \pm 0.41$ mag and a peak bolometric luminosity at $L = (1.75 \pm 0.37) \times 10^{43}$ erg s$^{-1}$, with a relatively small post-maximum decline rate [$\Delta m_{15}(B) = 0.82 \pm 0.05$ mag]. The flux excess observed in the light curves of SN 2015bq a few days after the explosion, especially seen in the UV bands, might be due to the radioactive decay of $^{56}$Ni mixed into the surface. The radiation from the decay of the surface $^{56}$Ni heats the outer layer of this SN. It produces blue $U-B$ color followed by monotonically reddening in the early phase, dominated iron-group lines, and weak intermediate-mass elements absorption features in the early spectra. The scenario of enhanced $^{56}$Ni in the surface is consistent with a large amount of $^{56}$Ni ($M_{ \rm ^{56}{\rm Ni}}$ = 0.97 $\pm 0.20$ $M_{\odot}$) synthesized during the explosion. The properties of SN 2015bq are found to locate between SN 1991T and SN 1999aa, suggesting the latter two subclasses of SNe Ia may have a common origin.


title: Understanding Players' Interaction Patterns with Mobile Game App UI via Visualizations

abstract: Understanding how players interact with the mobile game app on smartphone devices is important for game experts to develop and refine their app products. Conventionally, the game experts achieve their purposes through intensive user studies with target players or iterative UI design processes, which can not capture interaction patterns of large-scale individual players. Visualizing the recorded logs of users' UI operations is a promising way for quantitatively understanding the interaction patterns. However, few visualization tools have been developed for mobile game app interaction, which is challenging with multi-touch dynamic operations and complex UI. In this work, we fill the gap by presenting a visualization approach that aims to understand players' interaction patterns in a multi-touch gaming app with more complex interactions supported by joysticks and a series of skill buttons. Particularly, we identify players' dynamic gesture patterns, inspect the similarities and differences of gesture behaviors, and explore the potential gaps between the current mobile game app UI design and the real-world practice of players. Three case studies indicate that our approach is promising and can be potentially complementary to theoretical UI designs for further research.


title: Fully-Connected Tensor Network Decomposition for Robust Tensor Completion Problem

abstract: The robust tensor completion (RTC) problem, which aims to reconstruct a low-rank tensor from partially observed tensor contaminated by a sparse tensor, has received increasing attention. In this paper, by leveraging the superior expression of the fully-connected tensor network (FCTN) decomposition, we propose a $\textbf{FCTN}$-based $\textbf{r}$obust $\textbf{c}$onvex optimization model (RC-FCTN) for the RTC problem. Then, we rigorously establish the exact recovery guarantee for the RC-FCTN. For solving the constrained optimization model RC-FCTN, we develop an alternating direction method of multipliers (ADMM)-based algorithm, which enjoys the global convergence guarantee. Moreover, we suggest a $\textbf{FCTN}$-based $\textbf{r}$obust $\textbf{n}$on$\textbf{c}$onvex optimization model (RNC-FCTN) for the RTC problem. A proximal alternating minimization (PAM)-based algorithm is developed to solve the proposed RNC-FCTN. Meanwhile, we theoretically derive the convergence of the PAM-based algorithm. Comprehensive numerical experiments in several applications, such as video completion and video background subtraction, demonstrate that proposed methods are superior to several state-of-the-art methods.


title: On symmetry of energy minimizing harmonic-type maps on cylindrical surfaces

abstract: The paper concerns the analysis of global minimizers of a Dirichlet-type energy functional in the class of $\mathbb{S}^2$-valued maps defined in cylindrical surfaces. The model naturally arises as a curved thin-film limit in the theories of nematic liquid crystals and micromagnetics. We show that minimal configurations are $z$-invariant and that energy minimizers in the class of weakly axially symmetric competitors are, in fact, axially symmetric. Our main result is a family of sharp Poincar\'e-type inequality on the circular cylinder, which allows establishing a nearly complete picture of the energy landscape. The presence of symmetry-breaking phenomena is highlighted and discussed. Finally, we provide a complete characterization of in-plane minimizers, which typically appear in numerical simulations for reasons we explain.


title: Stability evaluation of the Russian sociologists online community: 2011-2018 years

abstract: This study deals with the stability evaluation of the online community of Russian sociologists. Based on the data from the Facebook group, which consists of 7 years of communication from 2011 till 2018, we constructed the networks based on commenting and reacting. The participants activity includes four main periods for stability evaluation of the community. The blockmodeling discloses the structural patterns of interactions in the community. The results show the "core-periphery" type of the global structure. The core and periphery are structured differently in the networks of comments and reactions. The stability between the positions in the global structure is high and while the structure may vary in some periods, the size of the core and periphery fluctuates. However, the stability within the positions of the global structure is low, according to the modified Rand index (Cugmas, Ferligoj, 2018).


title: On the triplet of holographic phase transition

abstract: We start from an Einstein $-$ Maxwell system coupled with a charged scalar field in Anti$-$de Sitter space$-$time. In the setup where the pressure $P$ is identified with the cosmological constant, the AdS black hole (BH) undergoes the phase transition from small to large BHs, which is similar to the transition from liquid to gas in the van der Waals theory. Based on this framework, we study the triplet of holographic superconducting states, consisting of ground state and two lowest excited states. Our numerical calculations show that the pressure variation in the bulk creates a mechanism in the boundary which causes changes in the physical properties of excited states, namely: a) when the pressure $ P $ is higher than the critical pressure ${P_c}$ ($ P > {P_c} $) of the phase transition from small to large BHs the ground state and the first excited state are superconducting states while the second excited state is the normal one. However, at lower pressure, $P \le P_c$, the ground state is solely the superconducting state. We conjecture that the precedent phenomena could take place when the scalar field in the bulk is replaced by other matter fields.


title: Human learning for molecular simulations: the Collective Variables Dashboard in VMD

abstract: The Collective Variables Dashboard is a software tool for real-time, seamless exploration of molecular structures and trajectories in a customizable space of collective variables. The Dashboard arises from the integration of the Collective Variables Module with the visualization software VMD, augmented with a fully discoverable graphical interface offering interactive workflows for the design and analysis of collective variables. Typical use cases include a priori design of collective variables for enhanced sampling and free energy simulations as well as post-mortem analysis of any type of simulation or collection of structures in a collective variable space. A combination of those cases commonly occurs when preliminary simulations, biased or unbiased, reveal that an optimized set of collective variables is necessary to improve sampling in further simulations. Then the Dashboard provides an efficient way to intuitively explore the space of likely collective variables, validate them on existing data, and use the resulting collective variable definitions directly in further biased simulations using the Collective Variables Module. We illustrate the use of the Dashboard on two applications: discovering coordinates to describe ligand unbinding from a protein binding site, and designing volume-based variables to bias the hydration of a transmembrane pore.


title: Minimal number of singular fibers in a nonorientable Lefschetz fibration

abstract: We show that there exists an admissible nonorientable genus $g$ Lefschetz fibration with only one singular fiber over a closed orientable surface of genus $h$ if and only if $g \geq 4$ and $h \geq 1$.


title: Adapting Membership Inference Attacks to GNN for Graph Classification: Approaches and Implications

abstract: Graph Neural Networks (GNNs) are widely adopted to analyse non-Euclidean data, such as chemical networks, brain networks, and social networks, modelling complex relationships and interdependency between objects. Recently, Membership Inference Attack (MIA) against GNNs raises severe privacy concerns, where training data can be leaked from trained GNN models. However, prior studies focus on inferring the membership of only the components in a graph, e.g., an individual node or edge. How to infer the membership of an entire graph record is yet to be explored. In this paper, we take the first step in MIA against GNNs for graph-level classification. Our objective is to infer whether a graph sample has been used for training a GNN model. We present and implement two types of attacks, i.e., training-based attacks and threshold-based attacks from different adversarial capabilities. We perform comprehensive experiments to evaluate our attacks in seven real-world datasets using five representative GNN models. Both our attacks are shown effective and can achieve high performance, i.e., reaching over 0.7 attack F1 scores in most cases. Furthermore, we analyse the implications behind the MIA against GNNs. Our findings confirm that GNNs can be even more vulnerable to MIA than the models with non-graph structures. And unlike the node-level classifier, MIAs on graph-level classification tasks are more co-related with the overfitting level of GNNs rather than the statistic property of their training graphs.


title: Interpolation and approximation via Momentum ResNets and Neural ODEs

abstract: In this article, we explore the effects of memory terms in continuous-layer Deep Residual Networks by studying Neural ODEs (NODEs). We investigate two types of models. On one side, we consider the case of Residual Neural Networks with dependence on multiple layers, more precisely Momentum ResNets. On the other side, we analyze a Neural ODE with auxiliary states playing the role of memory states. We examine the interpolation and universal approximation properties for both architectures through a simultaneous control perspective. We also prove the ability of the second model to represent sophisticated maps, such as parametrizations of time-dependent functions. Numerical simulations complement our study.


title: Inconsistency-aware Uncertainty Estimation for Semi-supervised Medical Image Segmentation

abstract: In semi-supervised medical image segmentation, most previous works draw on the common assumption that higher entropy means higher uncertainty. In this paper, we investigate a novel method of estimating uncertainty. We observe that, when assigned different misclassification costs in a certain degree, if the segmentation result of a pixel becomes inconsistent, this pixel shows a relative uncertainty in its segmentation. Therefore, we present a new semi-supervised segmentation model, namely, conservative-radical network (CoraNet in short) based on our uncertainty estimation and separate self-training strategy. In particular, our CoraNet model consists of three major components: a conservative-radical module (CRM), a certain region segmentation network (C-SN), and an uncertain region segmentation network (UC-SN) that could be alternatively trained in an end-to-end manner. We have extensively evaluated our method on various segmentation tasks with publicly available benchmark datasets, including CT pancreas, MR endocardium, and MR multi-structures segmentation on the ACDC dataset. Compared with the current state of the art, our CoraNet has demonstrated superior performance. In addition, we have also analyzed its connection with and difference from conventional methods of uncertainty estimation in semi-supervised medical image segmentation.


title: Spectral analysis and long-time asymptotics of complex mKdV equation

abstract: In this paper, we obtain the long-time asymptotics of complex mKdV equation via Defit-Zhou method (Non-linear steepest descent method). The Cauchy problem of complex mKdV equation is transformed into the corresponding Riemann-Hilbert problem on the basis of the Lax pair and the scattering matrix. After that Riemann-Hilbert problems are converted through a decomposition of the matrix-valued spectral function and factorizations of the jump matrix for Riemann-Hilbert problem. Finally, by solving the last model problem, the long-time asymptotics of complex mKdV equation are derived.


title: S-Cyc: A Learning Rate Schedule for Iterative Pruning of ReLU-based Networks

abstract: We explore a new perspective on adapting the learning rate (LR) schedule to improve the performance of the ReLU-based network as it is iteratively pruned. Our work and contribution consist of four parts: (i) We find that, as the ReLU-based network is iteratively pruned, the distribution of weight gradients tends to become narrower. This leads to the finding that as the network becomes more sparse, a larger value of LR should be used to train the pruned network. (ii) Motivated by this finding, we propose a novel LR schedule, called S-Cyclical (S-Cyc) which adapts the conventional cyclical LR schedule by gradually increasing the LR upper bound (max_lr) in an S-shape as the network is iteratively pruned.We highlight that S-Cyc is a method agnostic LR schedule that applies to many iterative pruning methods. (iii) We evaluate the performance of the proposed S-Cyc and compare it to four LR schedule benchmarks. Our experimental results on three state-of-the-art networks (e.g., VGG-19, ResNet-20, ResNet-50) and two popular datasets (e.g., CIFAR-10, ImageNet-200) demonstrate that S-Cyc consistently outperforms the best performing benchmark with an improvement of 2.1% - 3.4%, without substantial increase in complexity. (iv) We evaluate S-Cyc against an oracle and show that S-Cyc achieves comparable performance to the oracle, which carefully tunes max_lr via grid search.


title: Temporal Knowledge Graph Reasoning Triggered by Memories

abstract: Inferring missing facts in temporal knowledge graphs is a critical task and has been widely explored. Extrapolation in temporal reasoning tasks is more challenging and gradually attracts the attention of researchers since no direct history facts for prediction. Previous works attempted to apply evolutionary representation learning to solve the extrapolation problem. However, these techniques do not explicitly leverage various time-aware attribute representations, i.e. the reasoning performance is significantly affected by the history length. To alleviate the time dependence when reasoning future missing facts, we propose a memory-triggered decision-making (MTDM) network, which incorporates transient memories, long-short-term memories, and deep memories. Specifically, the transient learning network considers transient memories as a static knowledge graph, and the time-aware recurrent evolution network learns representations through a sequence of recurrent evolution units from long-short-term memories. Each evolution unit consists of a structural encoder to aggregate edge information, a time encoder with a gating unit to update attribute representations of entities. MTDM utilizes the crafted residual multi-relational aggregator as the structural encoder to solve the multi-hop coverage problem. We also introduce the dissolution learning constraint for better understanding the event dissolution process. Extensive experiments demonstrate the MTDM alleviates the history dependence and achieves state-of-the-art prediction performance. Moreover, compared with the most advanced baseline, MTDM shows a faster convergence speed and training speed.


title: On minimax estimation problem for stationary stochastic sequences from observations in special sets of points

abstract: The problem of the mean-square optimal estimation of the linear functionals which depend on the unknown values of a stochastic stationary sequence from observations of the sequence in special sets of points is considered. Formulas for calculating the mean-square error and the spectral characteristic of the optimal linear estimate of the functionals are derived under the condition of spectral certainty, where the spectral density of the sequence is exactly known. The minimax (robust) method of estimation is applied in the case where the spectral density of the sequence is not known exactly while some sets of admissible spectral densities are given. Formulas that determine the least favourable spectral densities and the minimax spectral characteristics are derived for some special sets of admissible densities.


title: A Turbulent Heating Model Combining Diffusion and Advection Effects for Giant Planet Magnetospheres

abstract: The ion temperature of the magnetospheres of Jupiter and Saturn was observed to increase substantially from about 10 to 30 planet radii. Different heating mechanisms have been proposed to explain such observations, including a heating model for Jupiter based on MHD turbulence with flux-tube diffusion. More recently, an MHD turbulent heating model based on advection was shown to also explain the temperature increase at Jupiter and Saturn. We further develop this turbulent heating model by combining effects from both diffusion and advection. The combined model resolves the physical consistency requirement that diffusion should dominate over advection when the radial flow velocity is small and vice versa when it is large. Comparisons with observations show that previous agreements, using the advection only model, are still valid for larger radial distance. Moreover, the additional heating by diffusion results in a better agreement with the temperature observations for smaller radial distance.


title: A Framework of Mahalanobis-Distance Metric with Supervised Learning for Clustering Multipath Components in MIMO Channel Analysis

abstract: As multipath components (MPCs) are experimentally observed to appear in clusters, cluster-based channel models have been focused in the wireless channel study. However, most of the MPC clustering algorithms for MIMO channels with delay and angle information of MPCs are based on the distance metric that quantifies the similarity of two MPCs and determines the preferred cluster shape, greatly impacting MPC clustering quality. In this paper, a general framework of Mahalanobis-distance metric is proposed for MPC clustering in MIMO channel analysis, without user-specified parameters. Remarkably, the popular multipath component distance (MCD) is proved to be a special case of the proposed distance metric framework. Furthermore, two machine learning algorithms, namely, weak-supervised Mahalanobis metric for clustering and supervised large margin nearest neighbor, are introduced to learn the distance metric. To evaluate the effectiveness, a modified channel model is proposed based on the 3GPP spatial channel model to generate clustered MPCs with delay and angular information, since the original 3GPP spatial channel model (SCM) is incapable to evaluate clustering quality. Experiment results show that the proposed distance metric can significantly improve the clustering quality of existing clustering algorithms, while the learning phase requires considerably limited efforts of labeling MPCs.


title: Charm and beauty isolation from heavy flavor decay electrons in p+p and Pb+Pb collisions at $\sqrt{s_{\mathrm{NN}}}$ = 5.02 TeV at LHC

abstract: We present an analysis on the heavy flavor hadron decay electrons with charm and beauty contributions decomposed via a data driven method in p+p and Pb+Pb collisions at $\sqrt{s_{\mathrm{NN}}}$ = 5.02 TeV at LHC. The transverse momentum $p_{\mathrm{T}}$ spectra, nuclear modification factor $R_{\mathrm{AA}}$ and azimuthal anisotropic flow $v_2$ distributions of electrons from charm and beauty decays are obtained. We find that the electron $R_{\mathrm{AA}}$ from charm ($R_{\mathrm{AA}}^{\mathrm{c\rightarrow e}}$) and beauty ($R_{\mathrm{AA}}^{\mathrm{b\rightarrow e}}$) decays are suppressed at $p_{\mathrm{T}}$ $>$ 2.0 and $p_{\mathrm{T}}$ $>$ 3.0 GeV/$c$ in Pb+Pb collisions, respectively, which indicates that charm and beauty interact with and lose their energy in the hot-dense medium. A less suppression of electron $R_{\mathrm{AA}}$ from beauty decays than that from charm decays at 2.0 $<$ $p_{\mathrm{T}}$ $<$ 8.0 GeV/$c$ is observed, which is consistent with the mass-dependent partonic energy loss scenario. A non-zero electron $v_2$ from beauty decays ($v_{2}^{\mathrm{b\rightarrow e}}$) is observed and in good agreement with ALICE measurement. At low $p_{\mathrm{T}}$ region from 1.0 to 3.0 GeV/$c$, a discrepancy between RHIC and LHC results is observed with 68\% confidence level, which suggests different degree of thermalization of beauty quark under different temperatures of the medium. At 3.0 GeV/$c$ $<$ $p_{\mathrm{T}}$ $<$ 7.0 GeV/$c$, $v_{2}^{\mathrm{b\rightarrow e}}$ deviates from a number-of-constituent-quark (NCQ) scaling hypothesis, which favors that beauty quark is unlikely thermalized in heavy-ion collisions at LHC energy.


title: Towards Better Long-range Time Series Forecasting using Generative Adversarial Networks

abstract: Long-range time series forecasting is usually based on one of two existing forecasting strategies: Direct Forecasting and Iterative Forecasting, where the former provides low bias, high variance forecasts and the later leads to low variance, high bias forecasts. In this paper, we propose a new forecasting strategy called Generative Forecasting (GenF), which generates synthetic data for the next few time steps and then makes long-range forecasts based on generated and observed data. We theoretically prove that GenF is able to better balance the forecasting variance and bias, leading to a much smaller forecasting error. We implement GenF via three components: (i) a novel conditional Wasserstein Generative Adversarial Network (GAN) based generator for synthetic time series data generation, called CWGAN-TS. (ii) a transformer based predictor, which makes long-range predictions using both generated and observed data. (iii) an information theoretic clustering algorithm to improve the training of both the CWGAN-TS and the transformer based predictor. The experimental results on five public datasets demonstrate that GenF significantly outperforms a diverse range of state-of-the-art benchmarks and classical approaches. Specifically, we find a 5% - 11% improvement in predictive performance (mean absolute error) while having a 15% - 50% reduction in parameters compared to the benchmarks. Lastly, we conduct an ablation study to demonstrate the effectiveness of the components comprising GenF.


title: An LSTM-based Plagiarism Detection via Attention Mechanism and a Population-based Approach for Pre-Training Parameters with imbalanced Classes

abstract: Plagiarism is one of the leading problems in academic and industrial environments, which its goal is to find the similar items in a typical document or source code. This paper proposes an architecture based on a Long Short-Term Memory (LSTM) and attention mechanism called LSTM-AM-ABC boosted by a population-based approach for parameter initialization. Gradient-based optimization algorithms such as back-propagation (BP) are widely used in the literature for learning process in LSTM, attention mechanism, and feed-forward neural network, while they suffer from some problems such as getting stuck in local optima. To tackle this problem, population-based metaheuristic (PBMH) algorithms can be used. To this end, this paper employs a PBMH algorithm, artificial bee colony (ABC), to moderate the problem. Our proposed algorithm can find the initial values for model learning in all LSTM, attention mechanism, and feed-forward neural network, simultaneously. In other words, ABC algorithm finds a promising point for starting BP algorithm. For evaluation, we compare our proposed algorithm with both conventional and population-based methods. The results clearly show that the proposed method can provide competitive performance.


title: Zero-order-free complex beam shaping

abstract: The unwanted zero-order diffraction is still an issue in beam shaping using pixelated spatial light modulators. In this paper, we report a new approach for zero-order free beam shaping by designing an asymmetric triangle reflector and introducing a digital blazed grating and a digital lens to the phase hologram addressed onto the spatial light modulator. By adding the digital lens phase to the previously reported complex-amplitude coding algorithms, we realized the generation of complex beams without the burden of zero-order diffraction. We comparatively investigated the produced complex light fields using the modified complex-amplitude coding algorithms to validate the proposed method.


title: Inverse medium scattering problems with Kalman filter techniques I. Linear case

abstract: In this paper, we study the inverse acoustic medium scattering problem to reconstruct the unknown inhomogeneous medium from far field patterns of scattered waves. We propose the reconstruction scheme based on the Kalman filter, which becomes possible to sequentially estimate the inhomogeneous medium. We also show that in the linear inverse problem, the estimation for the Kalman filter is equivalent to that for the Tikhonov regularization. Finally, we give numerical examples to demonstrate our proposed method.