title: Stock Market Trend Analysis Using Hidden Markov Model and Long Short Term Memory

abstract: This paper intends to apply the Hidden Markov Model into stock market and and make predictions. Moreover, four different methods of improvement, which are GMM-HMM, XGB-HMM, GMM-HMM+LSTM and XGB-HMM+LSTM, will be discussed later with the results of experiment respectively. After that we will analyze the pros and cons of different models. And finally, one of the best will be used into stock market for timing strategy.

categories: q-fin.PR cs.LG q-fin.CP q-fin.PM q-fin.TR


title: Free-form tumor synthesis in computed tomography images via richer generative adversarial network

abstract: The insufficiency of annotated medical imaging scans for cancer makes it challenging to train and validate data-hungry deep learning models in precision oncology. We propose a new richer generative adversarial network for free-form 3D tumor/lesion synthesis in computed tomography (CT) images. The network is composed of a new richer convolutional feature enhanced dilated-gated generator (RicherDG) and a hybrid loss function. The RicherDG has dilated-gated convolution layers to enable tumor-painting and to enlarge perceptive fields; and it has a novel richer convolutional feature association branch to recover multi-scale convolutional features especially from uncertain boundaries between tumor and surrounding healthy tissues. The hybrid loss function, which consists of a diverse range of losses, is designed to aggregate complementary information to improve optimization. We perform a comprehensive evaluation of the synthesis results on a wide range of public CT image datasets covering the liver, kidney tumors, and lung nodules. The qualitative and quantitative evaluations and ablation study demonstrated improved synthesizing results over advanced tumor synthesis methods.


title: Inverse design enables large-scale high-performance meta-optics reshaping virtual reality

abstract: Meta-optics has achieved major breakthroughs in the past decade; however, conventional forward design faces challenges as functionality complexity and device size scale up. Inverse design aims at optimizing meta-optics design but has been currently limited by expensive brute-force numerical solvers to small devices, which are also difficult to realize experimentally. Here, we present a general inverse design framework for aperiodic large-scale complex meta-optics in three dimensions, which alleviates computational cost for both simulation and optimization via a fast-approximate solver and an adjoint method, respectively. Our framework naturally accounts for fabrication constraints via a surrogate model. In experiments, we demonstrate, for the first time, aberration-corrected metalenses working in the visible with high numerical aperture, poly-chromatic focusing, and large diameter up to centimeter scale. Such large-scale meta-optics opens a new paradigm for applications, and we demonstrate its potential for future virtual-reality platforms by using a meta-eyepiece and a laser back-illuminated micro-Liquid Crystal Display.


title: Bridging between soft and hard thresholding by scaling

abstract: In this article, we developed and analyzed a thresholding method in which soft thresholding estimators are independently expanded by empirical scaling values. The scaling values have a common hyper-parameter that is an order of expansion of an ideal scaling value that achieves hard thresholding. We simply call this estimator a scaled soft thresholding estimator. The scaled soft thresholding is a general method that includes the soft thresholding and non-negative garrote as special cases and gives an another derivation of adaptive LASSO. We then derived the degree of freedom of the scaled soft thresholding by means of the Stein's unbiased risk estimate and found that it is decomposed into the degree of freedom of soft thresholding and the reminder connecting to hard thresholding. In this meaning, the scaled soft thresholding gives a natural bridge between soft and hard thresholding methods. Since the degree of freedom represents the degree of over-fitting, this result implies that there are two sources of over-fitting in the scaled soft thresholding. The first source originated from soft thresholding is determined by the number of un-removed coefficients and is a natural measure of the degree of over-fitting. We analyzed the second source in a particular case of the scaled soft thresholding by referring a known result for hard thresholding. We then found that, in a sparse, large sample and non-parametric setting, the second source is largely determined by coefficient estimates whose true values are zeros and has an influence on over-fitting when threshold levels are around noise levels in those coefficient estimates. In a simple numerical example, these theoretical implications has well explained the behavior of the degree of freedom. Moreover, based on the results here and some known facts, we explained the behaviors of risks of soft, hard and scaled soft thresholding methods.


title: Bistability and equilibria of creased annular sheets and strips

abstract: A creased thin disk is generally bistable since the crease could be pushed through to form a stable cone-like inverted state with an elastic singularity corresponding to the vertex of the conical surface. In a recent study, we found that this bistability could be destroyed by removing the singularity through cutting a hole around the vertex, depending on the size and shape of the hole. This paper extends our recent work and is based on the following observations in tabletop models of creased disks with circular holes: (i) reducing the circumference of the creased disk by removing an annular sector could increase the hole size to be as large as the disk without destroying the bistability, (ii) with a single crease, the circular hole could be as large as the disk without loss of the bistability, and (iii) a family of stable inverted states can be obtained by inverting the disk almost anywhere along the crease. An inextensible strip model is implemented to investigate these phenomena. We formulate a minimal facet of the creased disk as a two-point boundary value problem with the creases modeled as nonlinear hinges, and use numerical continuation to conduct parametric studies. Specifically, we focus on geometric parameters which include an angle deficit that determines the circumference of the disk, the rest crease angle, the number of evenly distributed creases, and an eccentricity that determines the position of the hole on the crease. Our numerical results confirm the qualitative observations in (i)-(iii) and further reveal unexpected results caused by the coupling between these geometric parameters. Our results demonstrate that by varying the geometry of a simply creased disk, surprisingly rich nonlinear behaviors can be obtained, which shed new light on the mechanics and design of origami, kirigami, and morphable structures.


title: Neural Tree Expansion for Multi-Robot Planning in Non-Cooperative Environments

abstract: We present a self-improving, Neural Tree Expansion (NTE) method for multi-robot online planning in non-cooperative environments, where each robot attempts to maximize its cumulative reward while interacting with other self-interested robots. Our algorithm adapts the centralized, perfect information, discrete-action space method from AlphaZero to a decentralized, partial information, continuous action space setting for multi-robot applications. Our method has three interacting components: (i) a centralized, perfect-information "expert" Monte Carlo Tree Search (MCTS) with large computation resources that provides expert demonstrations, (ii) a decentralized, partial-information "learner" MCTS with small computation resources that runs in real-time and provides self-play examples, and (iii) policy & value neural networks that are trained with the expert demonstrations and bias both the expert and the learner tree growth. Our numerical experiments demonstrate Neural Tree Expansion's computational advantage by finding better solutions than a MCTS with 20 times more resources. The resulting policies are dynamically sophisticated, demonstrate coordination between robots, and play the Reach-Target-Avoid differential game significantly better than the state-of-the-art control-theoretic baseline for multi-robot, double-integrator systems. Our hardware experiments on an aerial swarm demonstrate the computational advantage of Neural Tree Expansion, enabling online planning at 20Hz with effective policies in complex scenarios.


title: Several consequences of adding or removing an edge from an electric network

abstract: In certain instances an electric network transforms in natural ways by the addition or removal of an edge. This can have interesting consequences for random walks, in light of the known relationships between electric resistance and random walks. We exhibit several instances in which this can be used to prove facts or simplify calculations. In particular, a new proof is given for the formula for the expected return time of a random walk on a graph. We also show how hitting times can be calculated in certain instances when a network differs from a highly symmetric one by one edge.


title: Recursive constructions of amoebas

abstract: Global amoebas are a wide and rich family of graphs that emerged from the study of certain Ramsey-Tur\'an problems in $2$-colorings of the edges of the complete graph $K_n$ that deal with the appearance of unavoidable patterns once a certain amount of edges in each color is guaranteed. Indeed, it turns out that, as soon as such coloring constraints are satisfied and if $n$ is sufficiently large, then every global amoeba can be found embedded in $K_n$ such that it has half its edges in each color. Even more surprising, every bipartite global amoeba $G$ is unavoidable in every tonal-variation, meaning that, for any pair of integers $r, b$ such that $r + b $ is the number of edges of $G$, there is a subgraph of $K_n$ isomorphic to $G$ with $r$ edges in the first color and $b$ edges in the second. The feature that makes global amoebas work are one-by-one edge replacements that leave the structure of the graph invariant. By means of a group theoretical approach, the dynamics of this feature can be modeled. As a counterpart to the global amoebas that "live" inside a possibly large complete graph $K_n$, we also consider local amoebas which are spanning subgraphs of $K_n$ with the same feature. In an effort to highlight their richness and versatility, we present here three different recursive constructions of amoebas, two of them yielding interesting families per se and one of them offering a wide range of possibilities.


title: Distributed nonlinear model predictive control of an autonomous tractor-trailer system

abstract: This paper addresses the trajectory tracking problem of an autonomous tractor-trailer system by using a fast distributed nonlinear model predictive control algorithm in combination with nonlinear moving horizon estimation for the state and parameter estimation in which constraints on the inputs and the states can be incorporated. The proposed control algorithm is capable of driving the tractor-trailer system to any desired trajectory ensuring high control accuracy and robustness against environmental disturbances.


title: Weighted K-stability and coercivity with applications to extremal Kahler and Sasaki metrics

abstract: We show that a compact weighted extremal Kahler manifold (as defined by the third named author) has coercive weighted Mabuchi energy with respect to a maximal complex torus in the reduced group of complex automorphisms. This provides a vast extension and a unification of a number of results concerning Kahler metrics satisfying special curvature conditions, including constant scalar curvature Kahler metrics, extremal Kahler metrics, Kahler-Ricci solitons and their weighted extensions. Our result implies the strict positivity of the weighted Donaldson-Futaki invariant of any non-product equivariant smooth K\"ahler test configuration with reduced central fibre, a property also known as weighted K-polystability on such test configurations. For a class of fibre-bundles, we use our result in conjunction with the recent results of Chen-Cheng, He, and Han-Li in order to characterize the existence of extremal Kahler metrics and Calabi-Yau cones associated to the total space, in terms of the coercivity of the weighted Mabuchi energy of the fibre. In particular, this yields an existence result for Sasaki-Einstein metrics on Fano toric fibrations, extending the results of Futaki-Ono-Wang in the toric Fano case, and of Mabuchi-Nakagawa in the case of Fano projective line bundles.


title: Congruences for dimensions of spaces of Siegel cusp forms and $4$-core partitions

abstract: Using the relationship between Siegel cusp forms of degree $2$ and cuspidal automorphic representations of $\mathrm{GSp}(4,\mathbb{A}_{\mathbb{Q}})$, we derive some congruences involving dimensions of spaces of Siegel cusp forms of degree $2$ and the class number of $\mathbb{Q}(\sqrt{-p})$. We also obtain some congruences between the $4$-core partition function $c_4(n)$ and dimensions of spaces of Siegel cusp forms of degree $2$.


title: Transmit Correlation Diversity: Generalization, New Techniques, and Improved Bounds

abstract: When the users in a MIMO broadcast channel experience different spatial transmit correlation matrices, a class of gains is produced that is denoted transmit correlation diversity. This idea was conceived for channels in which transmit correlation matrices have mutually exclusive eigenspaces, allowing non-interfering training and transmission. This paper broadens the scope of transmit correlation diversity to the case of partially and fully overlapping eigenspaces and introduces techniques to harvest these generalized gains. For the two-user MIMO broadcast channel, we derive achievable degrees of freedom (DoF) and achievable rate regions with/without channel state information at the receiver (CSIR). When CSIR is available, the proposed achievable DoF region is tight in some configurations of the number of receive antennas and the channel correlation ranks. We then extend the DoF results to the $K$-user case by analyzing the interference graph that characterizes the overlapping structure of the eigenspaces. Our achievability results employ a combination of product superposition in the common part of the eigenspaces, and pre-beamforming (rate splitting) to create multiple data streams in non-overlapping parts of the eigenspaces. Massive MIMO is a natural example in which spatially correlated link gains are likely to occur. We study the achievable downlink sum rate for a frequency-division duplex massive MIMO system under transmit correlation diversity.


title: Problems and Countermeasures in Natural Language Processing Evaluation

abstract: Evaluation in natural language processing guides and promotes research on models and methods. In recent years, new evalua-tion data sets and evaluation tasks have been continuously proposed. At the same time, a series of problems exposed by ex-isting evaluation have also restricted the progress of natural language processing technology. Starting from the concept, com-position, development and meaning of natural language evaluation, this article classifies and summarizes the tasks and char-acteristics of mainstream natural language evaluation, and then summarizes the problems and causes of natural language pro-cessing evaluation. Finally, this article refers to the human language ability evaluation standard, puts forward the concept of human-like machine language ability evaluation, and proposes a series of basic principles and implementation ideas for hu-man-like machine language ability evaluation from the three aspects of reliability, difficulty and validity.


title: Hierarchically Modeling Micro and Macro Behaviors via Multi-Task Learning for Conversion Rate Prediction

abstract: Conversion Rate (\emph{CVR}) prediction in modern industrial e-commerce platforms is becoming increasingly important, which directly contributes to the final revenue. In order to address the well-known sample selection bias (\emph{SSB}) and data sparsity (\emph{DS}) issues encountered during CVR modeling, the abundant labeled macro behaviors ($i.e.$, user's interactions with items) are used. Nonetheless, we observe that several purchase-related micro behaviors ($i.e.$, user's interactions with specific components on the item detail page) can supplement fine-grained cues for \emph{CVR} prediction. Motivated by this observation, we propose a novel \emph{CVR} prediction method by Hierarchically Modeling both Micro and Macro behaviors ($HM^3$). Specifically, we first construct a complete user sequential behavior graph to hierarchically represent micro behaviors and macro behaviors as one-hop and two-hop post-click nodes. Then, we embody $HM^3$ as a multi-head deep neural network, which predicts six probability variables corresponding to explicit sub-paths in the graph. They are further combined into the prediction targets of four auxiliary tasks as well as the final $CVR$ according to the conditional probability rule defined on the graph. By employing multi-task learning and leveraging the abundant supervisory labels from micro and macro behaviors, $HM^3$ can be trained end-to-end and address the \emph{SSB} and \emph{DS} issues. Extensive experiments on both offline and online settings demonstrate the superiority of the proposed $HM^3$ over representative state-of-the-art methods.


title: Entanglement robustness via spatial deformation of identical particle wave functions

abstract: We address the problem of entanglement protection against surrounding noise by a procedure suitably exploiting spatial indistinguishability of identical subsystems. To this purpose, we take two initially separated and entangled identical qubits interacting with two independent noisy environments. Three typical models of environments are considered: amplitude damping channel, phase damping channel and depolarizing channel. After the interaction, we deform the wave functions of the two qubits to make them spatially overlap before performing spatially localized operations and classical communication (sLOCC) and eventually computing the entanglement of the resulting state. This way, we show that spatial indistinguishability of identical qubits can be utilized within the sLOCC operational framework to partially recover the quantum correlations spoiled by the environment. A general behavior emerges: the higher the spatial indistinguishability achieved via deformation, the larger the amount of recovered entanglement.


title: AdaSpeech 2: Adaptive Text to Speech with Untranscribed Data

abstract: Text to speech (TTS) is widely used to synthesize personal voice for a target speaker, where a well-trained source TTS model is fine-tuned with few paired adaptation data (speech and its transcripts) on this target speaker. However, in many scenarios, only untranscribed speech data is available for adaptation, which brings challenges to the previous TTS adaptation pipelines (e.g., AdaSpeech). In this paper, we develop AdaSpeech 2, an adaptive TTS system that only leverages untranscribed speech data for adaptation. Specifically, we introduce a mel-spectrogram encoder to a well-trained TTS model to conduct speech reconstruction, and at the same time constrain the output sequence of the mel-spectrogram encoder to be close to that of the original phoneme encoder. In adaptation, we use untranscribed speech data for speech reconstruction and only fine-tune the TTS decoder. AdaSpeech 2 has two advantages: 1) Pluggable: our system can be easily applied to existing trained TTS models without re-training. 2) Effective: our system achieves on-par voice quality with the transcribed TTS adaptation (e.g., AdaSpeech) with the same amount of untranscribed data, and achieves better voice quality than previous untranscribed adaptation methods. Synthesized speech samples can be found at https://speechresearch.github.io/adaspeech2/.


title: Decidability and Complexity in Weakening and Contraction Hypersequent Substructural Logics

abstract: We establish decidability for the infinitely many axiomatic extensions of the commutative Full Lambek logic with weakening FLew (i.e. IMALLW) that have a cut-free hypersequent proof calculus (specifically: every analytic structural rule extension). Decidability for the corresponding extensions of its contraction counterpart FLec was established recently but their computational complexity was left unanswered. In the second part of this paper, we introduce just enough on length functions for well-quasi-orderings and the fast-growing complexity classes to obtain complexity upper bounds for both the weakening and contraction extensions. A specific instance of this result yields the first complexity bound for the prominent fuzzy logic MTL (monoidal t-norm based logic) providing an answer to a long-standing open problem.


title: A Recursive Approach to Solving Parity Games in Quasipolynomial Time

abstract: Zielonka's classic recursive algorithm for solving parity games is perhaps the simplest among the many existing parity game algorithms. However, its complexity is exponential, while currently the state-of-the-art algorithms have quasipolynomial complexity. Here, we present a modification of Zielonka's classic algorithm that brings its complexity down to $n^{O\left(\log\left(1+\frac{d}{\log n}\right)\right)}$, for parity games of size $n$ with $d$ priorities, in line with previous quasipolynomial-time solutions.


title: SU(1,1) interferometry with parity measurement

abstract: We present a new operator method in the Heisenberg representation to obtain the signal of parity measurement within a lossless SU(1,1) interferometer. Based on this method, it is convenient to derive the parity signal directly in terms of input states, including general Gaussian or non-Gaussian state. As applications, we revisit the signal of parity measurement within an SU(1,1) interferometer when a coherent or thermal state and a squeezed vacuum state are considered as input states. In addition, we also obtain the parity signal of a Fock state when it passes through an SU(1,1) interferometer, which is also a new result. Therefore, the operator method proposed in this work may bring convenience to the study of quantum metrology, particularly the phase estimation based on an SU(1,1) interferometer.


title: Effects of Interregional Travels and Vaccination in Infection Spreads Simulated by Lattice of SEIRS Circuits

abstract: The SEIRS model, an extension of the SEIR model for analyzing and predicting the spread of virus infection, was further extended to consider the movement of people across regions. In contrast to previous models that con-sider the risk of travelers from/to other regions, we consider two factors. First, we consider the movements of susceptible (S), exposed (E), and recovered (R) individuals who may get infected and infect others in the destination region, as well as infected (I) individuals. Second, people living in a region and moving from other regions are dealt as separate but interacting groups with respect to their states, S, E, R, or I. This enables us to consider the potential influence of movements before individuals become infected, difficult to detect by testing at the time of immigration, on the spread of infection. In this paper, we show the results of the simulation where individuals travel across regions, which means prefectures here, and the government chooses regions to vaccinate with priority. We found a general law that a quantity of vaccines can be used efficiently by maximizing an index value, the conditional entropy Hc, when we distribute vaccines to regions. The efficiency of this strategy, which maximizes Hc, was found to outperform that of vaccinating regions with a larger effective re-generation number. This law also explains the surprising result that travel activities across regional borders may suppress the spread if vaccination is processed at a sufficiently high pace, introducing the concept of social muddling.


title: Robust MMSE Precoding and Power Allocation for Cell-Free Networks

abstract: We consider the downlink of a cell-free massive multiple-input multiple-output (MIMO) system with \textcolor{red}{single}-antenna access points (APs) and single-antenna users. An iterative robust minimum mean-square error (RMMSE) precoder based on generalized loading is developed to mitigate interference in the presence of imperfect channel state information (CSI). An achievable rate analysis is carried out and optimal and uniform power allocation schemes are developed based on the signal-to-interference-plus-noise ratio. An analysis of the computational costs of the proposed RMMSE and existing schemes is also presented. Numerical results show the improvement provided by the proposed RMMSE precoder against linear minimum mean-square error, zero-forcing and conjugate beamforming precoders in the presence of imperfect CSI.


title: Tomography in Loop Quantum Cosmology

abstract: We analyze the tomographic representation for the Friedmann-Robertson-Walker (FRW) model within the Loop Quantum Cosmology framework. We focus on the Wigner quasi-probability distributions associated with Gaussian and Schr\"odinger cat states, and then, by applying a Radon integral transform for those Wigner functions, we are able to obtain the symplectic tomograms which define measurable probability distributions that fully characterize the quantum model of our interest. By appropriately introducing the quantum dispersion for a rotated and squeezed quadrature operator in terms of the position and momentum, we efficiently interpret the properties of such tomograms, being consequent with Heisenberg's uncertainty principle. We also obtain, by means of the dual tomographic symbols, the expectation value for the volume operator, which coincides with the values reported in the literature. We expect that our findings result interesting as the introduced tomographic representation may be further benefited from the well-developed measure techniques in the areas of Quantum optics and Quantum information theory.


title: Staircase Sign Method for Boosting Adversarial Attacks

abstract: Crafting adversarial examples for the transfer-based attack is challenging and remains a research hot spot. Currently, such attack methods are based on the hypothesis that the substitute model and the victim model learn similar decision boundaries, and they conventionally apply Sign Method (SM) to manipulate the gradient as the resultant perturbation. Although SM is efficient, it only extracts the sign of gradient units but ignores their value difference, which inevitably leads to a deviation. Therefore, we propose a novel Staircase Sign Method (S$^2$M) to alleviate this issue, thus boosting attacks. Technically, our method heuristically divides the gradient sign into several segments according to the values of the gradient units, and then assigns each segment with a staircase weight for better crafting adversarial perturbation. As a result, our adversarial examples perform better in both white-box and black-box manner without being more visible. Since S$^2$M just manipulates the resultant gradient, our method can be generally integrated into the family of FGSM algorithms, and the computational overhead is negligible. Extensive experiments on the ImageNet dataset demonstrate the effectiveness of our proposed methods, which significantly improve the transferability (i.e., on average, \textbf{5.1\%} for normally trained models and \textbf{12.8\%} for adversarially trained defenses). Our code is available at \url{https://github.com/qilong-zhang/Staircase-sign-method}.


title: Transport and Diffusion Enhancement in Experimentally Realized Non-Gaussian Correlated Ratchets

abstract: Living cells are known to generate non-Gaussian active fluctuations significantly larger than thermal fluctuations owing to various active processes. Understanding the effect of these active fluctuations on various physicochemical processes, such as the transport of molecular motors, is a fundamental problem in nonequilibrium physics. Therefore, we experimentally and numerically study an active Brownian ratchet comprising a colloidal particle in an optically generated asymmetric periodic potential driven by non-Gaussian noise having finite-amplitude active bursts, each arriving at random and decaying exponentially. We find that the particle velocity is maximum for relatively sparse bursts with finite correlation time and non-Gaussian distribution. These occasional kicks, which produce Brownian yet non-Gaussian diffusion, are more efficient for transport and diffusion enhancement of the particle than the incessant kicks of active Ornstein-Uhlenbeck noise.


title: On a conjecture of Coleman concerning Euler systems

abstract: We prove a distribution-theoretic conjecture of Robert Coleman, thereby also obtaining an explicit description of the complete set of Euler systems for the multiplicative group over Q.


title: Quasinormal modes and shadows of a new family of Ay\'{o}n-Beato-Garc\'{\i}a black holes

abstract: We obtain a type of Ay\'{o}n-Beato-Garc\'{\i}a (ABG) related black hole solutions with five parameters: the mass $m$, the charge $q$, and three dimensionless parameters $\alpha$, $\beta$ and $\gamma$ associated with nonlinear electrodynamics. We find that this type of black holes is regular under the conditions: $\alpha \gamma \geqslant 6$, $\beta \gamma \geqslant 8$, and $\gamma >0$. Here we focus on the saturated case: $\alpha={6}/{\gamma}$ and $\beta ={8}/{\gamma }$, such that only three parameters $m$, $q$ and $\gamma$ remain, which leads to a new family of ABG black holes. For such a family of black holes, we investigate the influence of the charge $q$ and the parameter $\gamma$ on the horizon radius and the Hawking temperature. In addition, we calculate the quasinormal mode frequencies of massless scalar field perturbations by using the sixth-order WKB approximation method and the unstable circular null geodesic method in the eikonal limit. We also compute the shadow radius for the new family of ABG black holes and use the shadow data of the $M87^{*}$ black hole detected by the Event Horizon Telescope to provide an upper limit on the charge $q$ of the new black holes. Using the shadow data of the $M87^{*}$ black hole, we find that the upper limit of the charge $q$ increases rapidly at first and then slowly but does not exceed the mass of the $M87^{*}$ black hole at last when the parameter $\gamma$ is increasing and going to infinity, and that the data restrict the frequency range of the fundamental mode with $l=1$ to $1.4\times 10^{-6}Hz\sim 1.9\times 10^{-6} Hz$.


title: Stirling numbers with level $2$ and poly-Bernoulli numbers with level $2$

abstract: In this paper, we introduce poly-Bernoulli numbers with level $2$, related to the Stirling numbers of the second kind with level $2$, and study several properties of poly-Bernoulli numbers with level $2$ from their expressions, relations, and congruences. Poly-Bernoulli numbers with level $2$ have strong connections with poly-Cauchy numbers with level $2$. In a special case, we can determine the denominators of Bernoulli numbers with level $2$ by showing a von Staudt-Clausen like theorem.


title: Constraining bright optical counterparts of Fast Radio Bursts

abstract: Fast Radio Bursts (FRBs) are extremely energetic pulses of millisecond duration and unknown origin. In order to understand the phenomenon that emits these pulses, targeted and untargeted searches have been performed for multi-wavelength counterparts, including the optical. The objective of this work is to search for optical transients at the position of 8 well-localized FRBs, after the arrival of the burst on different time-scales (typically at one day, several months, and one year after FRB detection) in order to compare with known transient optical light curves. We used the Las Cumbres Observatory Global Telescope Network (LCOGT), which allows us to promptly take images owing to its network of twenty-three telescopes working around the world. We used a template subtraction technique on all the images we collected at different epochs. We have divided the subtractions into two groups, in one group we use the image of the last epoch as a template and in the other group we use the image of the first epoch as a template. We have searched for bright optical transients at the localizations of the FRBs (<1 arcsec) in the template subtracted images. We have found no optical transients, so we have set limiting magnitudes of optical counterparts. Typical limiting magnitudes in apparent (absolute) magnitudes for our LCOGT data are ~22 (-19) mag in the r-band. We have compared our limiting magnitudes with light curves of superluminous supernovae (SLSNe), type Ia supernovae (SNe), supernovae associated with gamma-ray bursts (GRB SNe), a kilonova, and tidal disruption events (TDEs). We rule out that FRBs are associated with SLSN at a confidence of ~99.9%. We can also rule out the brightest sub-types of type Ia SNe, GRB SNe and TDEs (under some conditions) at similar confidence, though we cannot exclude scenarios where FRBs are associated with the faintest sub-type of each of these transient classes.


title: Production of dual species Bose-Einstein condensates of $^{39}$K and $^{87}$Rb

abstract: We report the production of $^{39}$K and $^{87}$Rb Bose-Einstein condensates (BECs) in the lowest hyperfine states $| F=1,m_{F}=1 \rangle$ simultaneously. We collect atoms in bright/dark magneto-optical traps (MOTs) of $^{39}$K/$^{87}$Rb to overcome the light-assisted losses of $^{39}$K atoms. Gray molasses cooling on the D1 line of the $^{39}$K is used to effectively increase the phase density, which improves the loading efficiency of $^{39}$K into the quadrupole magnetic trap. Simultaneously, the normal molasses are employed for $^{87}$Rb. After the microwave evaporation cooling on $^{87}$Rb in the optically plugged magnetic trap, the atoms mixture is transferred to a crossed optical dipole trap, where the collisional properties of the two species in different combinations of the hyperfine states are studied. The dual species BECs of $^{39}$K and $^{87}$Rb are obtained by further evaporative cooling in optical dipole trap at a magnetic field of 372.6 G with the background repulsive interspecies scattering length $a_{KRb}$ = 34 $a_{0}$ ($a_{0}$ is the Bohr radius) and the intraspecies scattering length $a_{K}$ = 20.05 $a_{0}$.


title: Alexander modules, Mellin transformation and variations of mixed Hodge structures

abstract: To any complex algebraic variety endowed with a morphism to a complex affine torus we associate multivariable cohomological Alexander modules, and define natural mixed Hodge structures on their maximal Artinian submodules. The key ingredients of our construction are Gabber-Loeser's Mellin transformation and Hain-Zucker's work on unipotent variations of mixed Hodge structures. As applications, we prove the quasi-unipotence of monodromy, we obtain upper bounds on the sizes of the Jordan blocks of monodromy, and we explore the change in the Alexander modules after removing fibers of the map. We also give an example of a variety whose Alexander module has non-semisimple torsion.


title: Critical Window Variable Selection for Mixtures: Estimating the Impact of Multiple Air Pollutants on Stillbirth

abstract: Understanding the role of time-varying pollution mixtures on human health is critical as people are simultaneously exposed to multiple pollutants during their lives. For vulnerable sub-populations who have well-defined exposure periods (e.g., pregnant women), questions regarding critical windows of exposure to these mixtures are important for mitigating harm. We extend Critical Window Variable Selection (CWVS) to the multipollutant setting by introducing CWVS for Mixtures (CWVSmix), a hierarchical Bayesian method that combines smoothed variable selection and temporally correlated weight parameters to (i) identify critical windows of exposure to mixtures of time-varying pollutants, (ii) estimate the time-varying relative importance of each individual pollutant and their first order interactions within the mixture, and (iii) quantify the impact of the mixtures on health. Through simulation, we show that CWVSmix offers the best balance of performance in each of these categories in comparison to competing methods. Using these approaches, we investigate the impact of exposure to multiple ambient air pollutants on the risk of stillbirth in New Jersey, 2005-2014. We find consistent elevated risk in gestational weeks 2, 16-17, and 20 for non-Hispanic Black mothers, with pollution mixtures dominated by ammonium (weeks 2, 17, 20), nitrate (weeks 2, 17), nitrogen oxides (weeks 2, 16), PM2.5 (week 2), and sulfate (week 20). The method is available in the R package CWVSmix.


title: Random walks on complex networks with first-passage resetting

abstract: We study discrete-time random walks on arbitrary networks with first-passage resetting processes. To the end, a set of nodes are chosen as observable nodes, and the walker is reset instantaneously to a given resetting node whenever it hits either of observable nodes. We derive exact expressions of the stationary occupation probability, the average number of resets in the long time, and the mean first-passage time between arbitrary two non-observable nodes. We show that all the quantities can be expressed in terms of the fundamental matrix $\textbf{Z}=(\textbf{I}-\textbf{Q})^{-1}$, where $\textbf{I}$ is the identity matrix and $\textbf{Q}$ is the transition matrix between non-observable nodes. Finally, we use ring networks, 2d square lattices, barbell networks, and Cayley trees to demonstrate the advantage of first-passage resetting in global search on such networks.


title: Knowledge Distillation as Semiparametric Inference

abstract: A popular approach to model compression is to train an inexpensive student model to mimic the class probabilities of a highly accurate but cumbersome teacher model. Surprisingly, this two-step knowledge distillation process often leads to higher accuracy than training the student directly on labeled data. To explain and enhance this phenomenon, we cast knowledge distillation as a semiparametric inference problem with the optimal student model as the target, the unknown Bayes class probabilities as nuisance, and the teacher probabilities as a plug-in nuisance estimate. By adapting modern semiparametric tools, we derive new guarantees for the prediction error of standard distillation and develop two enhancements -- cross-fitting and loss correction -- to mitigate the impact of teacher overfitting and underfitting on student performance. We validate our findings empirically on both tabular and image data and observe consistent improvements from our knowledge distillation enhancements.


title: Query-by-Sketch: Scaling Shortest Path Graph Queries on Very Large Networks

abstract: Computing shortest paths is a fundamental operation in processing graph data. In many real-world applications, discovering shortest paths between two vertices empowers us to make full use of the underlying structure to understand how vertices are related in a graph, e.g. the strength of social ties between individuals in a social network. In this paper, we study the shortest-path-graph problem that aims to efficiently compute a shortest path graph containing exactly all shortest paths between any arbitrary pair of vertices on complex networks. Our goal is to design an exact solution that can scale to graphs with millions or billions of vertices and edges. To achieve high scalability, we propose a novel method, Query-by-Sketch (QbS), which efficiently leverages offline labelling (i.e., precomputed labels) to guide online searching through a fast sketching process that summarizes the important structural aspects of shortest paths in answering shortest-path-graph queries. We theoretically prove the correctness of this method and analyze its computational complexity. To empirically verify the efficiency of QbS, we conduct experiments on 12 real-world datasets, among which the largest dataset has 1.7 billion vertices and 7.8 billion edges. The experimental results show that QbS can answer shortest-path graph queries in microseconds for million-scale graphs and less than half a second for billion-scale graphs.


title: Locally Private k-Means in One Round

abstract: We provide an approximation algorithm for k-means clustering in the one-round (aka non-interactive) local model of differential privacy (DP). This algorithm achieves an approximation ratio arbitrarily close to the best non private approximation algorithm, improving upon previously known algorithms that only guarantee large (constant) approximation ratios. Furthermore, this is the first constant-factor approximation algorithm for k-means that requires only one round of communication in the local DP model, positively resolving an open question of Stemmer (SODA 2020). Our algorithmic framework is quite flexible; we demonstrate this by showing that it also yields a similar near-optimal approximation algorithm in the (one-round) shuffle DP model.


title: Cut Reggeon Field Theory as a Stochastic Process

abstract: Reggeon field theory (RFT), originally developed in the context of high energy diffraction scattering, has a much wider applicability, describing, for example, the universal critical behavior of stochastic population models as well as probabilistic geometric problems such as directed percolation. In 1975 Suranyi and others developed cut RFT, which can incorporate the cutting rules of Abramovskii, Gribov and Kancheli for how each diagram contributes to inclusive cross-sections. In this note we describe the corresponding probabilistic interpretations of cut RFT: as a population model of two genotypes, which can reproduce both asexually and sexually; and as a kind of bicolor directed percolation problem. In both cases the AGK rules correspond to simple limiting cases of these problems.


title: Hypervolume-Optimal $\mu$-Distributions on Line/Plane-based Pareto Fronts in Three Dimensions

abstract: Hypervolume is widely used in the evolutionary multi-objective optimization (EMO) field to evaluate the quality of a solution set. For a solution set with $\mu$ solutions on a Pareto front, a larger hypervolume means a better solution set. Investigating the distribution of the solution set with the largest hypervolume is an important topic in EMO, which is the so-called hypervolume optimal $\mu$-distribution. Theoretical results have shown that the $\mu$ solutions are uniformly distributed on a linear Pareto front in two dimensions. However, the $\mu$ solutions are not always uniformly distributed on a single-line Pareto front in three dimensions. They are only uniform when the single-line Pareto front has one constant objective. In this paper, we further investigate the hypervolume optimal $\mu$-distribution in three dimensions. We consider the line- and plane-based Pareto fronts. For the line-based Pareto fronts, we extend the single-line Pareto front to two-line and three-line Pareto fronts, where each line has one constant objective. For the plane-based Pareto fronts, the linear triangular and inverted triangular Pareto fronts are considered. First, we show that the $\mu$ solutions are not always uniformly distributed on the line-based Pareto fronts. The uniformity depends on how the lines are combined. Then, we show that a uniform solution set on the plane-based Pareto front is not always optimal for hypervolume maximization. It is locally optimal with respect to a $(\mu+1)$ selection scheme. Our results can help researchers in the community to better understand and utilize the hypervolume indicator.


title: A Blueprint for the Milky Way's Stellar Populations. III. Spatial Distributions and Population Fractions of Local Halo Stars

abstract: We analyze the observed spatial, chemical and dynamical distributions of local metal-poor stars, based on photometrically derived metallicity and distance estimates along with proper motions from the Gaia mission. Along the Galactic prime meridian, we identify stellar populations with distinct properties in the metallicity versus rotational velocity space, including Gaia Sausage/Enceladus (GSE), the metal-weak thick disk (MWTD), and the Splash (sometimes referred to as the "in situ" halo). We model the observed phase-space distributions using Gaussian mixtures and refine their positions and fractional contributions as a function of distances from the Galactic plane ($|Z|$) and the Galactic center ($R_{\rm GC}$), providing a global perspective of the major stellar populations in the local halo. Within the sample volume ($|Z|<6$ kpc), stars associated with GSE exhibit a larger proportion of metal-poor stars at greater $R_{\rm GC}$ ($\Delta \langle{\rm[Fe/H]}\rangle /\Delta R_{\rm GC} =-0.05\pm0.02$ dex kpc$^{-1}$). This observed trend, along with a mild anticorrelation of the mean rotational velocity with metallicity ($\Delta \langle v_\phi \rangle / \Delta \langle{\rm[Fe/H]} \rangle \sim -10$ km s$^{-1}$ dex$^{-1}$), implies that more metal-rich stars in the inner region of the GSE progenitor were gradually stripped away, while the prograde orbit of the merger at infall became radialized by dynamical friction. The metal-rich GSE stars are causally disconnected from the Splash structure, whose stars are mostly found on prograde orbits ($>94\%$) and exhibit a more centrally concentrated distribution than GSE. The MWTD exhibits a similar spatial distribution to the Splash, suggesting earlier dynamical heating of stars in the primordial disk of the Milky Way, possibly before the GSE merger.


title: Constraining Mixed Dark-Matter Scenarios of WIMPs and Primordial Black Holes from CMB and 21-cm observations

abstract: We consider the dark matter (DM) scenarios consisting of the mixture of WIMPs and PBHs and study how much fraction of the total DM can be PBHs. In such scenarios, PBHs can accrete the WIMPs and consequently enhance the heating and ionization in the intergalactic medium due to WIMP annihilations. We demonstrate that the CMB data can give the stringent bounds on the allowed PBH fraction which are comparable or even tighter than those from the gamma ray data depending on the DM masses. For instance, the MCMC likelihood analysis using the Planck CMB data leads to the bound on PBH DM fraction with respect to the total dark matter $f_{\rm PBH} \lesssim {\cal O}( 10^{-10}\sim 10^{-8})$ for the WIMP mass $m_{\chi}\sim {\cal O}(10\sim 10^3)$ GeV with the conventional DM annihilation cross section $\langle \sigma v \rangle=3 \times 10^{-26}~\rm cm^3/s $. We also investigate the feasibility of the global 21-cm signal measurement to provide the stringent constraints on the PBH fraction.


title: First-principles study of magnetic structures of triangular antiferromagnets NaYbS$_2$ and NaYbO$_2$

abstract: We investigate the magnetic interactions in triangular rare-earth delafossites materials NaYbO$_2$ and NaYbS$_2$ via first-principles calculations. The calculated Curie-Weiss temperatures are in good agreement with experiments. We perform classical Monte Carlo simulations of the two compounds using the extracted exchange parameters. We find that if only the nearest neighbor interactions are considered, the magnetic ground states of NaYbO$_2$ and NaYbS$_2$ are a stripe and a planar 120\degree~ N\'{e}el state, respectively. The simulated transition temperatures are much higher than the lowest experimental temperatures, where no magnetic ordering was observed. However, we show by adding suitable second neighbor interactions, the {\it classical} magnetic ground state of NaYbO$_2$ becomes to the $Z_2$ vortex phase, and the simulated specific heat $C_v$ are very similar to the experimental observations, with no obvious phase transition down to the extremely low temperature.


title: Void defect induced magnetism and structure change of carbon materials-1, Graphene nano ribbon

abstract: Void defect is a possible origin of ferromagnetic like feature of pure carbon material. Applying density functional theory to void defect induced graphene nano ribbon (GNR), a detailed relationship between multiple spin state and structure change was studied. An equitorial triangle of an initial initial void having six electrons is distorted to isosceles triangle by rebonding carbon atoms. Among possible spin states, the most stable state was Sz=2/2. The case of Sz=4/2 is remarkable that initial flat ribbon turned to three dimentional curled one having highly polarized spin configuration at ribbon edges. Total energy of Sz=4/2 was very close to that of Sz=2/2, which suggests coexistence of flat and curled ribbons. As a model of three dimensional graphite, bilayered AB stacked GNR was analyzed. Spin distribution was limited to the void created layer. Distributed void triangle show 60 degree clockwise rotation for differrent site void, which was consistent with experimental observation using the scanning tunneling microscope. (To be published on Journal of the Magnetic Society of Japan, 2021 )

categories: cond-mat.mtrl-sci astro-ph.GA cond-mat.mes-hall physics.atm-clus


title: A Shape Optimization Problem Constrained with the Stokes Equations to Address Maximization of Vortices

abstract: We study an optimization problem that aims to determine the shape of an obstacle that is submerged in a fluid governed by the Stokes equations. The mentioned flow takes place in a channel, which motivated the imposition of a Poiseuille-like input function on one end and a do-nothing boundary condition on the other. The maximization of the vorticity is addressed by the $L^2$-norm of the curl and the {\it det-grad} measure of the fluid. We impose a Tikhonov regularization in the form of a perimeter functional and a volume constraint to address the possibility of topological change. Having been able to establish the existence of an optimal shape, the first order necessary condition was formulated by utilizing the so-called rearrangement method. Finally, numerical examples are presented by utilizing a finite element method on the governing states, and a gradient descent method for the deformation of the domain. On the said gradient descent method, we use two approaches to address the volume constraint: one is by utilizing the augmented Lagrangian method; and the other one is by utilizing a class of divergence-free deformation fields.


title: Mitigating Temporal-Drift: A Simple Approach to Keep NER Models Crisp

abstract: Performance of neural models for named entity recognition degrades over time, becoming stale. This degradation is due to temporal drift, the change in our target variables' statistical properties over time. This issue is especially problematic for social media data, where topics change rapidly. In order to mitigate the problem, data annotation and retraining of models is common. Despite its usefulness, this process is expensive and time-consuming, which motivates new research on efficient model updating. In this paper, we propose an intuitive approach to measure the potential trendiness of tweets and use this metric to select the most informative instances to use for training. We conduct experiments on three state-of-the-art models on the Temporal Twitter Dataset. Our approach shows larger increases in prediction accuracy with less training data than the alternatives, making it an attractive, practical solution.


title: Neural tuning and representational geometry

abstract: A central goal of neuroscience is to understand the representations formed by brain activity patterns and their connection to behavior. The classical approach is to investigate how individual neurons encode the stimuli and how their tuning determines the fidelity of the neural representation. Tuning analyses often use the Fisher information to characterize the sensitivity of neural responses to small changes of the stimulus. In recent decades, measurements of large populations of neurons have motivated a complementary approach, which focuses on the information available to linear decoders. The decodable information is captured by the geometry of the representational patterns in the multivariate response space. Here we review neural tuning and representational geometry with the goal of clarifying the relationship between them. The tuning induces the geometry, but different sets of tuned neurons can induce the same geometry. The geometry determines the Fisher information, the mutual information, and the behavioral performance of an ideal observer in a range of psychophysical tasks. We argue that future studies can benefit from considering both tuning and geometry to understand neural codes and reveal the connections between stimulus, brain activity, and behavior.


title: Emergence of multiple Higgs modes due to spontaneous breakdown of a $\mathbb{Z}_2$ symmetry in a superconductor

abstract: We study the Higgs mode in a Bardeen-Cooper-Schrieffer (BCS) superconductor. Motivated by the observation that U(1) symmetry of the BCS Hamiltonian is not essential for the Higgs mode, we study the Ising-like Hamiltonian in the pseudospin representation. We show that the Higgs mode emerges as the lowest excited state of the Ising-like Hamiltonian due to spontaneous breakdown of $\mathbb{Z}_2$ symmetry under the time-reversal operation $\mathcal T$ in the pseudospin space. We further predict the existence of multiple Higgs modes that have quantized energy $2(n+1)\Delta_0$ ($0\le n\le N_{k_F}$), where $\Delta_0$ is the superconducting gap, $n$ is an integer, and $N_{k_F}$ is the number of states on the Fermi surface.

categories: cond-mat.supr-con cond-mat.quant-gas cond-mat.str-el hep-th


title: Void defect induced magnetism and structure change of carbon material-2, Graphene molecules

abstract: Void-defect is a possible origin of ferromagnetic feature on pure carbon materials. In our previous paper, void-defect on graphene-nanoribbon show highly polarized spin configuration. In this paper, we studied cases for graphene molecules by quantum theory, by astronomical observation and by laboratory experiment. Model molecules for the density functional theory are graphene molecules of C23 and C53 induced by a void-defect. They have carbon pentagon ring within a hexagon network. Single void has three radical carbons, holding six spins. Those spins make several spin-states, which affects to molecular structure and molecular vibration, finally to infrared spectrum. The stable spin state was triplet, not singlet. This suggests magnetic pure carbon molecule. It was a surprise that those molecules show close infrared spectrum with astronomically observed one, especially observed on carbon rich planetary nebulae. We could assign major band at 18.9 micrometer, and sub-bands at 6.6, 7.0, 7.6, 8.1, 8.5, 9.0 and 17.4 micrometer. Also, calculated spectrum roughly coincides with that of laboratory experiment by the laser-induced carbon plasma, which is an analogy of cosmic carbon creation in interstellar space.


title: Computing Arlequin coupling coefficient for concurrent FE-MD approaches

abstract: Arlequin coupling coefficient is essential for concurrent FE-MD models with overlapping domains, but the calculation of its value is quite difficult when the geometry of the coupling region is complicated. In this work, we introduce a general procedure for the preprocessing of a concurrent FE-MD model, given that the mesh and atoms have already been created. The procedure is independent of the geometry of the coupling region and can be used for both 2D and 3D problems. The procedure includes steps of determining the relative positions of atoms inside the FE elements in the coupling region, as well as computing the Arlequin coupling coefficient for an arbitrary point inside the coupling region or on its boundary. Two approaches are provided for determining the coefficient: the direct approach and the temperature approach.


title: Void defect induced magnetism and structure change of carbon material-3, Polycyclic aromatic hydrocarbon

abstract: Void-defect induced magnetism of graphene molecule was recently reported in our previous paper of this series study. This paper investigated the case of hydrogenated graphene molecule, in chemical term, polycyclic aromatic hydrocarbon (PAH). Molecular infrared spectrum obtained by density functional theory was compared with astronomical observation. Void-defect on PAH caused serious structure change. Typical example of C23H12 had two carbon pentagon rings among hexagon networks. Stable spin state was non-magnetic singlet state. This is contrary to pure carbon case of C23, which show magnetic triplet state. It was discussed that Hydrogen played an important role to diminish magnetism by creating an SP3-bond among SP2-networks. Such a structure change affected molecular vibration and finally to photoemission spectrum in infrared region. The dication-C23H12 showed featured bands at 3.2, 6.3, 7.7, 8.6, 11.2, and 12.7 micrometer. It was surprising that those calculated bands coincided well with astronomically observed bands in many planetary nebulae. To confirm our study, large size molecule of C53H18 was studied. Calculation reproduced again similar astronomical bands. Also, small size molecule of C12H8 showed good coincidence with the spectrum observed for young stars. This paper would be the first report to indicate the specific PAH in space.


title: Waveform Phasicity Prediction from Arterial Sounds through Spectrogram Analysis using Convolutional Neural Networks for Limb Perfusion Assessment

abstract: Peripheral Arterial Disease (PAD) is a common form of arterial occlusive disease that is challenging to evaluate at the point-of-care. Hand-held dopplers are the most ubiquitous device used to evaluate circulation and allows providers to audibly "listen" to the blood flow. Providers use the audible feedback to subjectively assess whether the sound characteristics are consistent with Monophasic, Biphasic, or Triphasic waveforms. Subjective assessment of doppler sounds raises suspicion of PAD and leads to further testing, often delaying definitive treatment. Misdiagnoses are also possible with subjective interpretation of doppler waveforms. This paper presents a Deep Learning system that has the ability to predict waveform phasicity through analysis of hand-held doppler sounds. We collected 268 four-second recordings on an iPhone taken during a formal vascular lab study in patients with cardiovascular disease. Our end-to-end system works by converting input sound into a spectrogram which visually represents frequency changes in temporal patterns. This conversion enables visual differentiation between the phasicity classes. With these changes present, a custom trained Convolutional Neural Network (CNN) is used for prediction through learned feature extraction. The performance of the model was evaluated via calculation of the F1 score and accuracy metrics. The system received an F1 score of 90.57% and an accuracy of 96.23%. Our Deep Learning system is not computationally expensive and has the ability for integration within several applications. When used in a clinic, this system has the capability of preventing misdiagnosis and gives practitioners a second opinion that can be useful in the evaluation of PAD.


title: Interpolation of Microscale Stress and Strain Fields Based on Mechanical Models

abstract: In this short contribution we introduce a new procedure to recover the stress and strain fields for particle systems by mechanical models. Numerical tests for simple loading conditions have shown an excellent match between the estimated values and the reference values. The estimated stress field is also consistent with the so called Quasicontinuum stress field, which suggests its potential application for scale bridging techniques. The estimated stress fields for complicated loading conditions such as defect and indentation are also demonstrated


title: Joint Online Learning and Decision-making via Dual Mirror Descent

abstract: We consider an online revenue maximization problem over a finite time horizon subject to lower and upper bounds on cost. At each period, an agent receives a context vector sampled i.i.d. from an unknown distribution and needs to make a decision adaptively. The revenue and cost functions depend on the context vector as well as some fixed but possibly unknown parameter vector to be learned. We propose a novel offline benchmark and a new algorithm that mixes an online dual mirror descent scheme with a generic parameter learning process. When the parameter vector is known, we demonstrate an $O(\sqrt{T})$ regret result as well an $O(\sqrt{T})$ bound on the possible constraint violations. When the parameter is not known and must be learned, we demonstrate that the regret and constraint violations are the sums of the previous $O(\sqrt{T})$ terms plus terms that directly depend on the convergence of the learning process.


title: Smooth Solutions to Asymptotic Plateau Type Problem in Hyperbolic Space

abstract: We investigate on the existence of smooth complete hypersurface with prescribed Weingarten curvature and asymptotic boundary at infinity in hyperbolic space under the assumption that there exists an asymptotic subsolution. We give an affirmative answer for the case $k = n$ when the asymptotic boundary $\Gamma$ bounds a uniformly convex domain, and for $k < n$ when $\Gamma$ bounds a disk, utilizing Pogorelov type interior second order estimate. Our result complements our previous work \cite{Sui2019, Sui-Sun}, and generalizes the asymptotic Plateau type problem to non-constant prescribed curvature case.


title: Flow-based Video Segmentation for Human Head and Shoulders

abstract: Video segmentation for the human head and shoulders is essential in creating elegant media for videoconferencing and virtual reality applications. The main challenge is to process high-quality background subtraction in a real-time manner and address the segmentation issues under motion blurs, e.g., shaking the head or waving hands during conference video. To overcome the motion blur problem in video segmentation, we propose a novel flow-based encoder-decoder network (FUNet) that combines both traditional Horn-Schunck optical-flow estimation technique and convolutional neural networks to perform robust real-time video segmentation. We also introduce a video and image segmentation dataset: ConferenceVideoSegmentationDataset. Code and pre-trained models are available on our GitHub repository: \url{https://github.com/kuangzijian/Flow-Based-Video-Matting}.


title: Supervisory Control of Quantum Discrete Event Systems

abstract: Discrete event systems (DES) have been deeply developed and applied in practice, but state complexity in DES still is an important problem to be better solved with innovative methods. With the development of quantum computing and quantum control, a natural problem is to simulate DES by means of quantum computing models and to establish {\it quantum DES} (QDES). The motivation is twofold: on the one hand, QDES have potential applications when DES are simulated and processed by quantum computers, where quantum systems are employed to simulate the evolution of states driven by discrete events, and on the other hand, QDES may have essential advantages over DES concerning state complexity for imitating some practical problems. So, the goal of this paper is to establish a basic framework of QDES by using {\it quantum finite automata} (QFA) as the modelling formalisms, and the supervisory control theorems of QDES are established and proved. Then we present a polynomial-time algorithm to decide whether or not the controllability condition holds. In particular, we construct a number of new examples of QFA to illustrate the supervisory control of QDES and to verify the essential advantages of QDES over classical DES in state complexity.


title: Hierarchical entropy and domain interaction to understand the structure in an image

abstract: In this study, we devise a model that introduces two hierarchies into information entropy. The two hierarchies are the size of the region for which entropy is calculated and the size of the component that determines whether the structures in the image are integrated or not. And this model uses two indicators, hierarchical entropy and domain interaction. Both indicators increase or decrease due to the integration or fragmentation of the structure in the image. It aims to help people interpret and explain what the structure in an image looks like from two indicators that change with the size of the region and the component. First, we conduct experiments using images and qualitatively evaluate how the two indicators change. Next, we explain the relationship with the hidden structure of Vermeer's girl with a pearl earring using the change of hierarchical entropy. Finally, we clarify the relationship between the change of domain interaction and the appropriate segment result of the image by an experiment using a questionnaire.


title: Refined Littlewood identity for spin Hall-Littlewood symmetric rational functions

abstract: Fully inhomogeneous spin Hall-Littlewood symmetric rational functions $F_\lambda$ are multiparameter deformations of the classical Hall-Littlewood symmetric polynomials and can be viewed as partition functions in $\mathfrak{sl}(2)$ higher spin six vertex models. We obtain a refined Littlewood identity expressing a weighted sum of $F_\lambda$'s over all partitions $\lambda$ with even multiplicities as a certain Pfaffian. This Pfaffian can be derived as a partition function of the six vertex model in a triangle with suitably decorated domain wall boundary conditions. The proof is based on the Yang-Baxter equation.


title: Scattering for the non-radial focusing inhomogeneous nonlinear Schr\"odinger-Choquard equation

abstract: In this paper, we study the long-time behavior of global solutions to the Schr\"odinger-Choquard equation $$i\partial_tu+\Delta u=-(I_\alpha\ast|\cdot|^b|u|^{p})|\cdot|^b|u|^{p-2}u.$$ Inspired by Murphy, who gave a simple proof of scattering for the non-radial inhomogeneous NLS, we prove scattering theory below the ground state for the intercritical case in energy space without radial assumption.


title: Imaginative Walks: Generative Random Walk Deviation Loss for Improved Unseen Learning Representation

abstract: We propose a novel loss for generative models, dubbed as GRaWD (Generative Random Walk Deviation), to improve learning representations of unexplored visual spaces. Quality learning representation of unseen classes (or styles) is critical to facilitate novel image generation and better generative understanding of unseen visual classes, i.e., zero-shot learning (ZSL). By generating representations of unseen classes based on their semantic descriptions, e.g., attributes or text, generative ZSL attempts to differentiate unseen from seen categories. The proposed GRaWD loss is defined by constructing a dynamic graph that includes the seen class/style centers and generated samples in the current minibatch. Our loss initiates a random walk probability from each center through visual generations produced from hallucinated unseen classes. As a deviation signal, we encourage the random walk to eventually land after t steps in a feature representation that is difficult to classify as any of the seen classes. We demonstrate that the proposed loss can improve unseen class representation quality inductively on text-based ZSL benchmarks on CUB and NABirds datasets and attribute-based ZSL benchmarks on AWA2, SUN, and aPY datasets. In addition, we investigate the ability of the proposed loss to generate meaningful novel visual art on the WikiArt dataset. The results of experiments and human evaluations demonstrate that the proposed GRaWD loss can improve StyleGAN1 and StyleGAN2 generation quality and create novel art that is significantly more preferable. Our code is made publicly available at https://github.com/Vision-CAIR/GRaWD.


title: An Efficient Approach for Anomaly Detection in Traffic Videos

abstract: Due to its relevance in intelligent transportation systems, anomaly detection in traffic videos has recently received much interest. It remains a difficult problem due to a variety of factors influencing the video quality of a real-time traffic feed, such as temperature, perspective, lighting conditions, and so on. Even though state-of-the-art methods perform well on the available benchmark datasets, they need a large amount of external training data as well as substantial computational resources. In this paper, we propose an efficient approach for a video anomaly detection system which is capable of running at the edge devices, e.g., on a roadside camera. The proposed approach comprises a pre-processing module that detects changes in the scene and removes the corrupted frames, a two-stage background modelling module and a two-stage object detector. Finally, a backtracking anomaly detection algorithm computes a similarity statistic and decides on the onset time of the anomaly. We also propose a sequential change detection algorithm that can quickly adapt to a new scene and detect changes in the similarity statistic. Experimental results on the Track 4 test set of the 2021 AI City Challenge show the efficacy of the proposed framework as we achieve an F1-score of 0.9157 along with 8.4027 root mean square error (RMSE) and are ranked fourth in the competition.


title: Generalized quantum process discrimination problems

abstract: We study a broad class of quantum process discrimination problems that can handle many optimization strategies such as the Bayes, Neyman-Pearson, and unambiguous strategies, where each process can consist of multiple time steps and can have an internal memory. Given a collection of candidate processes, our task is to find a discrimination strategy, which may be adaptive and/or entanglement-assisted, that maximizes a given objective function subject to given constraints. Our problem can be formulated as a convex problem. Its Lagrange dual problem with no duality gap and necessary and sufficient conditions for an optimal solution are derived. We also show that if a problem has a certain symmetry and at least one optimal solution exists, then there also exists an optimal solution with the same type of symmetry. A minimax strategy for a process discrimination problem is also discussed. As applications of our results, we provide some problems in which an adaptive strategy is not necessary for optimal discrimination. We also present an example of single-shot channel discrimination for which an analytical solution can be obtained.


title: HCMS: Hierarchical and Conditional Modality Selection for Efficient Video Recognition

abstract: Videos are multimodal in nature. Conventional video recognition pipelines typically fuse multimodal features for improved performance. However, this is not only computationally expensive but also neglects the fact that different videos rely on different modalities for predictions. This paper introduces Hierarchical and Conditional Modality Selection (HCMS), a simple yet efficient multimodal learning framework for efficient video recognition. HCMS operates on a low-cost modality, i.e., audio clues, by default, and dynamically decides on-the-fly whether to use computationally-expensive modalities, including appearance and motion clues, on a per-input basis. This is achieved by the collaboration of three LSTMs that are organized in a hierarchical manner. In particular, LSTMs that operate on high-cost modalities contain a gating module, which takes as inputs lower-level features and historical information to adaptively determine whether to activate its corresponding modality; otherwise it simply reuses historical information. We conduct extensive experiments on two large-scale video benchmarks, FCVID and ActivityNet, and the results demonstrate the proposed approach can effectively explore multimodal information for improved classification performance while requiring much less computation.


title: Potential Automorphy for $GL_n$

abstract: We prove potential automorphy results for a single Galois representation $G_F \rightarrow GL_n(\overline{\mathbb{Q}}_l)$ where $F$ is a CM number field. The strategy is to use the $p,q$ switch trick and modify the Dwork motives employed in \cite{HSBT} to break self-duality of the motives, but not the Hodge-Tate weights. Another key result to prove is the ordinarity of certain $p$-adic representations, which follows from log geometry techniques. One input is the automorphy lifting theorem in \cite{tap}.


title: Learning Semantic-Aware Dynamics for Video Prediction

abstract: We propose an architecture and training scheme to predict video frames by explicitly modeling dis-occlusions and capturing the evolution of semantically consistent regions in the video. The scene layout (semantic map) and motion (optical flow) are decomposed into layers, which are predicted and fused with their context to generate future layouts and motions. The appearance of the scene is warped from past frames using the predicted motion in co-visible regions; dis-occluded regions are synthesized with content-aware inpainting utilizing the predicted scene layout. The result is a predictive model that explicitly represents objects and learns their class-specific motion, which we evaluate on video prediction benchmarks.


title: A mathematical analysis of Casimir interactions I: The scalar field

abstract: Starting from the construction of the free quantum scalar field of mass $m\geq 0$ we give mathematically precise and rigorous versions of three different approaches to computing the Casimir forces between compact obstacles. We then prove that they are equivalent.


title: Crystal structure prediction of materials with high symmetry using differential evolution

abstract: Crystal structure determines properties of materials. With the crystal structure of a chemical substance, many physical and chemical properties can be predicted by first-principles calculations or machine learning models. Since it is relatively easy to generate a hypothetical chemically valid formula, crystal structure prediction becomes an important method for discovering new materials. In our previous work, we proposed a contact map-based crystal structure prediction method, which uses global optimization algorithms such as genetic algorithms to maximize the match between the contact map of the predicted structure and the contact map of the real crystal structure to search for the coordinates at the Wyckoff Positions(WP). However, when predicting the crystal structure with high symmetry, we found that the global optimization algorithm has difficulty to find an effective combination of WPs that satisfies the chemical formula, which is mainly caused by the inconsistency between the dimensionality of the contact map of the predicted crystal structure and the dimensionality of the contact map of the target crystal structure. This makes it challenging to predict the crystal structures of high-symmetry crystals. In order to solve this problem, here we propose to use PyXtal to generate and filter random crystal structures with given symmetry constraints based on the information such as chemical formulas and space groups. With contact map as the optimization goal, we use differential evolution algorithms to search for non-special coordinates at the Wyckoff positions to realize the structure prediction of high-symmetry crystal materials. Our experimental results show that our proposed algorithm CMCrystalHS can effectively solve the problem of inconsistent contact map dimensions and predict the crystal structures with high symmetry.


title: Seed Word Selection for Weakly-Supervised Text Classification with Unsupervised Error Estimation

abstract: Weakly-supervised text classification aims to induce text classifiers from only a few user-provided seed words. The vast majority of previous work assumes high-quality seed words are given. However, the expert-annotated seed words are sometimes non-trivial to come up with. Furthermore, in the weakly-supervised learning setting, we do not have any labeled document to measure the seed words' efficacy, making the seed word selection process "a walk in the dark". In this work, we remove the need for expert-curated seed words by first mining (noisy) candidate seed words associated with the category names. We then train interim models with individual candidate seed words. Lastly, we estimate the interim models' error rate in an unsupervised manner. The seed words that yield the lowest estimated error rates are added to the final seed word set. A comprehensive evaluation of six binary classification tasks on four popular datasets demonstrates that the proposed method outperforms a baseline using only category name seed words and obtained comparable performance as a counterpart using expert-annotated seed words.


title: Solution landscape of the Onsager model identifies non-axisymmetric critical points

abstract: We investigate critical points of the Onsager free-energy model on a sphere with different potential kernels, including the dipolar potential, the Maier-Saupe potential, the coupled dipolar/Maier-Saupe potential, and the Onsager potential. A uniform sampling method is implemented for the discretization of the Onsager model, and solution landscapes of the Onsager model are constructed using saddle dynamics coupled with downward/upward search algorithms. We first construct the solution landscapes with the dipolar and Maier-Saupe potentials, for which all critical points are axisymmetric. For the coupled dipolar/Maier-Saupe potential, the solution landscape shows a novel non-axisymmetric critical point, named tennis, which exists for a wide range of parameters. We further demonstrate various non-axisymmetric critical points in the Onsager model with the Onsager potential, including square, hexagon, octahedral, cubic, quarter, icosahedral}, and dodecahedral states. The bifurcation diagram is presented to show the primary and secondary bifurcations of the isotropic state and reveal the emergence of the critical points. The solution landscape provides an efficient approach to show the global structure of the model system as well as the bifurcations of critical points, which can not only support the previous theoretical conjectures but also propose new conjectures based on the numerical findings.


title: A new direct discontinuous Galerkin method with interface correction for two-dimensional compressible Navier-Stokes equations

abstract: We propose a new formula for the nonlinear viscous numerical flux and extend the direct discontinuous Galerkin method with interface correction (DDGIC) of Liu and Yan (H. Liu, J. Yan, The direct discontinuous Galerkin (DDG) method for diffusion with interface corrections, Communications in Computational Physics 8 (3) (2010) 541) to compressible Navier-Stokes equations. The new DDGIC framework is based on the observation that the nonlinear diffusion can be represented as a sum of multiple individual diffusion processes corresponding to each conserved variable. A set of direction vectors corresponding to each individual diffusion process is defined and approximated by the average value of the numerical solution at the cell interfaces. The new framework only requires the computation of conserved variables' gradient, which is linear and approximated by the original direct DG numerical flux formula. The proposed method greatly simplifies the implementation, and thus, can be easily extended to general equations and turbulence models. Numerical experiments with $P_1$, $P_2$, $P_3$ and $P_4$ polynomial approximations are performed to verify the optimal $(k+1)^{th}$ high-order accuracy of the method. The new DDGIC method is shown to be able to accurately calculate physical quantities such as lift, drag, and friction coefficients as well as separation angle and Strouhal number.


title: SME: A High Productivity FPGA Tool for Software Programmers

abstract: For several decades, the CPU has been the standard model to use in the majority of computing. While the CPU does excel in some areas, heterogeneous computing, such as reconfigurable hardware, is showing increasing potential in areas like parallelization, performance, and power usage. This is especially prominent in problems favoring deep pipelining or tight latency requirements. However, due to the nature of these problems, they can be hard to program, at least for software developers. Synchronous Message Exchange (SME) is a runtime environment that allows development, testing and verification of hardware designs for FPGA devices in C#, with access to modern debugging and code features. The goal is to create a framework for software developers to easily implement systems for FPGA devices without having to obtain heavy hardware programming knowledge. This article presents a short introduction to the SME model as well as new updates to SME. Lastly, a selection of student projects and examples will be presented in order to show how it is possible to create quite complex structures in SME, even by students with no hardware experience.


title: Enzyme regulation and mutation in a model serial dilution ecosystem

abstract: Microbial communities are ubiquitous in nature and come in a multitude of forms, ranging from communities dominated by a handful of species to communities containing a wide variety of metabolically distinct organisms. This huge range in diversity is not a curiosity - microbial diversity has been linked to outcomes of substantial ecological and medical importance. However, the mechanisms underlying microbial diversity are still under debate, as simple mathematical models only permit as many species to coexist as there are resources. A plethora of mechanisms have been proposed to explain the origins of microbial diversity, but many of these analyses omit a key property of real microbial ecosystems: the propensity of the microbes themselves to change their growth properties within and across generations. In order to explore the impact of this key property on microbial diversity, we expand upon a recently developed model of microbial diversity in fluctuating environments. We implement changes in growth strategy in two distinct ways. First, we consider the regulation of a cell's enzyme levels within short, ecological times, and second we consider evolutionary changes driven by mutations across generations. Interestingly, we find that these two types of microbial responses to the environment can have drastically different outcomes. Enzyme regulation may collapse diversity over long enough times while, conversely, strategy-randomizing mutations can produce a "rich-get-poorer" effect that promotes diversity. This work makes explicit, using a simple serial-dilutions framework, the conflicting ways that microbial adaptation and evolution can affect community diversity.


title: M2TR: Multi-modal Multi-scale Transformers for Deepfake Detection

abstract: The widespread dissemination of Deepfakes demands effective approaches that can detect perceptually convincing forged images. In this paper, we aim to capture the subtle manipulation artifacts at different scales using transformer models. In particular, we introduce a Multi-modal Multi-scale TRansformer (M2TR), which operates on patches of different sizes to detect local inconsistencies in images at different spatial levels. M2TR further learns to detect forgery artifacts in the frequency domain to complement RGB information through a carefully designed cross modality fusion block. In addition, to stimulate Deepfake detection research, we introduce a high-quality Deepfake dataset, SR-DF, which consists of 4,000 DeepFake videos generated by state-of-the-art face swapping and facial reenactment methods. We conduct extensive experiments to verify the effectiveness of the proposed method, which outperforms state-of-the-art Deepfake detection methods by clear margins.


title: GLiDE: Generalizable Quadrupedal Locomotion in Diverse Environments with a Centroidal Model

abstract: Model-free reinforcement learning (RL) for legged locomotion commonly relies on a physics simulator that can accurately predict the behaviors of every degree of freedom of the robot. In contrast, approximate reduced-order models are commonly used for many model predictive control strategies. In this work we abandon the conventional use of high-fidelity dynamics models in RL and we instead seek to understand what can be achieved when using RL with a much simpler centroidal model when applied to quadrupedal locomotion. We show that RL-based control of the accelerations of a centroidal model is surprisingly effective, when combined with a quadratic program to realize the commanded actions via ground contact forces. It allows for a simple reward structure, reduced computational costs, and robust sim-to-real transfer. We show the generality of the method by demonstrating flat-terrain gaits, stepping-stone locomotion, two-legged in-place balance, balance beam locomotion, and direct sim-to-real transfer.


title: Constraints on axionic fuzzy dark matter from light bending and Shapiro time delay

abstract: Ultralight axion like particles (ALPs) of mass $m_a\in (10^{-21}\rm{eV}-10^{-22}\rm{eV})$ with axion decay constant $f_a\sim 10^{17}\rm{GeV}$ can be candidates for fuzzy dark matter (FDM). If celestial bodies like Earth and Sun are immersed in a low mass axionic FDM potential and if the ALPs have coupling with nucleons then the coherent oscillation of the axionic field results a long range axion hair outside of the celestial bodies. The range of the axion mediated Yukawa type fifth force is determined by the distance between the Earth and the Sun which fixes the upper bound of the mass of axion as $m_a\lesssim10^{-18}\rm{eV}$. The long range axionic Yukawa potential between the Earth and Sun changes the gravitational potential between them and contribute to the light bending and the Shapiro time delay. From the observational uncertainties of those experiments, we put an upper bound on the axion decay constant as $f_a\lesssim 9.85\times 10^{6}\rm{GeV}$, which is the stronger bound obtained from Shapiro time delay. This implies if ALPs are FDM, then they do not couple to nucleons.


title: Long-term impact of a primary school intervention on aspects of Einsteinian physics

abstract: The physics that underpins modern technology is based on Einstein's theories of relativity and quantum mechanics. Most school students complete their compulsory science education without being taught any of these Einsteinian concepts. Only those who take a specialised physics course have the opportunity to learn modern physics. In 2011, the first study of a modern physics teaching intervention with an Australian upper primary (aged 10{11) class was conducted. The initial intervention was the first step of the Einstein-First collaboration towards challenging the current paradigm of Newtonian teaching in schools. It was found that modern physics concepts could be taught to these students. In 2020, 11 participants of the initial study (out of a total of 26) were contacted for a follow-up questionnaire and interview to investigate any long-term impact. The results of the follow-up indicate that the intervention maintained a positive impression on participants. The models and analogies used during the six-week intervention were highly memorable. The participants indicated that they found the intervention to be beneficial to their future learning. Even close to ten years after the intervention, the participants remembered several key concepts (such as curved space-time). The long-term follow-up indicates that Einsteinian physics can be taught at the upper primary level and be recalled several years later.


title: An Analysis of Indexing and Querying Strategies on a Technologically Assisted Review Task

abstract: This paper presents a preliminary experimentation study using the CLEF 2017 eHealth Task 2 collection for evaluating the effectiveness of different indexing methodologies of documents and query parsing techniques. Furthermore, it is an attempt to advance and share the efforts of observing the characteristics and helpfulness of various methodologies for indexing PubMed documents and for different topic parsing techniques to produce queries. For this purpose, my research includes experimentation with different document indexing methodologies, by utilising existing tools, such as the Lucene4IR (L4IR) information retrieval system, the Technology Assisted Reviews for Empirical Medicine tool for parsing topics of the CLEF collection and the TREC evaluation tool to appraise system's performance. The results showed that including a greater number of fields to the PubMed indexer of L4IR is a decisive factor for the retrieval effectiveness of L4IR.


title: On the transition density function of the diffusion process generated by the Grushin operator

abstract: The short-time asymptotic behavior of the transition density function of the diffusion process generated by the general Grushin operator will be investigated, by using its explicit expression in terms of expectation. Further the dependence on of the asymptotics will be seen.


title: Inferring Exoplanet Disequilibria with Multivariate Information in Atmospheric Reaction Networks

abstract: Inferring the properties of exoplanets from their atmospheres, while confronting low resolution and low signal-to-noise in the context of the quantities we want to derive, poses rigorous demands upon the data collected from observation. Further compounding this challenge is that inferences of exoplanet properties are built from forward models, which can include errors due to incomplete or inaccurate assumptions in atmospheric physics and chemistry. The confluence of observational noise and model error makes developing techniques to identify predictive features that are robust to both low s/n and model error increasingly important for exoplanet science. We demonstrate how both issues can be addressed simultaneously by taking advantage of underutilized multivariate information already present in current atmospheric models, including thermodynamic statistics and reaction network structure. To do so, we provide a case study of the prediction of vertical mixing (parameterized as eddy diffusion) in hot Jupiter atmospheres and show how prediction efficacy depends on what model information is used - e.g. chemical species abundances, network statistics, and/or thermodynamic statistics. We also show how the variables with the most predictive power vary with planetary properties such as temperature and metallicity. Our results demonstrate how inferences built on single metrics do not have utility across all possible use cases. We also show how statistical measures derived from network analyses tend to be better predictors when accounting for the possibility of missing data or observational uncertainty. We discuss future directions applying multivariate and network model information as a framework for increasing confidence in inferences aimed at extracting features relevant to exoplanet atmospheres and future applications to the detection of life on terrestrial worlds.


title: Subsentence Extraction from Text Using Coverage-Based Deep Learning Language Models

abstract: Sentiment prediction remains a challenging and unresolved task in various research fields, including psychology, neuroscience, and computer science. This stems from its high degree of subjectivity and limited input sources that can effectively capture the actual sentiment. This can be even more challenging with only text-based input. Meanwhile, the rise of deep learning and an unprecedented large volume of data have paved the way for artificial intelligence to perform impressively accurate predictions or even human-level reasoning. Drawing inspiration from this, we propose a coverage-based sentiment and subsentence extraction system that estimates a span of input text and recursively feeds this information back to the networks. The predicted subsentence consists of auxiliary information expressing a sentiment. This is an important building block for enabling vivid and epic sentiment delivery (within the scope of this paper) and for other natural language processing tasks such as text summarisation and Q&A. Our approach outperforms the state-of-the-art approaches by a large margin in subsentence prediction (i.e., Average Jaccard scores from 0.72 to 0.89). For the evaluation, we designed rigorous experiments consisting of 24 ablation studies. Finally, our learned lessons are returned to the community by sharing software packages and a public dataset that can reproduce the results presented in this paper.


title: Convergence of Gaussian process regression: Optimality, robustness, and relationship with kernel ridge regression

abstract: In this work, we investigate Gaussian process regression used to recover a function based on noisy observations. We derive upper and lower error bounds for Gaussian process regression with possibly misspecified correlation functions. The optimal convergence rate can be attained even if the smoothness of the imposed correlation function exceeds that of the true correlation function and the sampling scheme is quasi-uniform. As byproducts, we also obtain convergence rates of kernel ridge regression with misspecified kernel function, where the underlying truth is a deterministic function. The convergence rates of Gaussian process regression and kernel ridge regression are closely connected, which is aligned with the relationship between sample paths of Gaussian process and the corresponding reproducing kernel Hilbert space.


title: Privacy-aware VR streaming

abstract: Proactive tile-based virtual reality (VR) video streaming employs the current tracking data of a user to predict future requested tiles, then renders and delivers the predicted tiles to be requested before playback. The quality of experience (QoE) depends on the overall performance of prediction, computing (i.e., rendering) and communication. All prior works neglect that users may have privacy requirement, i.e., not all the current tracking data are allowed to be uploaded. In this paper, we investigate the privacy-aware VR streaming. We first establish a dataset that collects the privacy requirement of 66 users among 18 panoramic videos. The dataset shows that the privacy requirements of 360$^{\circ}$ videos are heterogeneous. Only 41\% of the total watched videos have no privacy requirement. Based on these findings, we formulate the privacy requirement as the \textit{degree of privacy} (DoP), and investigate the impact of DoP on the proactive VR streaming. First, we find that with DoP, the length of the observation window and prediction window of a tile predictor should be variable. Then, we jointly optimize the durations for computing and transmitting the selected tiles as well as the computing and communication capability, aimed at maximizing the QoE given arbitrary predictor and configured resources. From the obtained optimal closed-form solution, we find a resource-saturated region where DoP has no impact on the QoE and a resource-unsaturated region where the two-fold impacts of DoP are contradictory. On the one hand, the increase of DoP will degrade the prediction performance and thus degrade the QoE. On the other hand, the increase of DoP will improve the capability of computing and communication and thus improve the QoE. Simulation results using two predictors and a real dataset validate the analysis and demonstrate the overall impact of DoP on the QoE.


title: Role-Aware Modeling for N-ary Relational Knowledge Bases

abstract: N-ary relational knowledge bases (KBs) represent knowledge with binary and beyond-binary relational facts. Especially, in an n-ary relational fact, the involved entities play different roles, e.g., the ternary relation PlayCharacterIn consists of three roles, ACTOR, CHARACTER and MOVIE. However, existing approaches are often directly extended from binary relational KBs, i.e., knowledge graphs, while missing the important semantic property of role. Therefore, we start from the role level, and propose a Role-Aware Modeling, RAM for short, for facts in n-ary relational KBs. RAM explores a latent space that contains basis vectors, and represents roles by linear combinations of these vectors. This way encourages semantically related roles to have close representations. RAM further introduces a pattern matrix that captures the compatibility between the role and all involved entities. To this end, it presents a multilinear scoring function to measure the plausibility of a fact composed by certain roles and entities. We show that RAM achieves both theoretical full expressiveness and computation efficiency, which also provides an elegant generalization for approaches in binary relational KBs. Experiments demonstrate that RAM outperforms representative baselines on both n-ary and binary relational datasets.


title: Symmetric polynomials in the variety generated by Grassmann algebras

abstract: Let $\mathcal{G}$ denote the variety generated by infinite dimensional Grassmann algebras; i.e., the collection of all unitary associative algebras satisfying the identity $[[z_1,z_2],z_3]=0$, where $[z_i,z_j]=z_iz_j-z_jz_i$. Consider the free algebra $F_3$ in $\mathcal{G}$ generated by $X_3=\{x_1,x_2,x_3\}$. The commutator ideal $F_3'$ of the algebra $F_3$ has a natural $K[X_3]$-module structure. We call an element $p\in F_3$ symmetric if $p(x_1,x_2,x_3)=p(x_{\xi1},x_{\xi2},x_{\xi3})$ for each permutation $\xi\in S_3$. Symmetric elements form the subalgebra $F_3^{S_3}$ of invariants of the symmetric group $S_3$ in $F_3$. We give a free generating set for the $K[X_3]^{S_3}$-module $(F_3')^{S_3}$.