title: APB2FaceV2: Real-Time Audio-Guided Multi-Face Reenactment

abstract: Audio-guided face reenactment aims to generate a photorealistic face that has matched facial expression with the input audio. However, current methods can only reenact a special person once the model is trained or need extra operations such as 3D rendering and image post-fusion on the premise of generating vivid faces. To solve the above challenge, we propose a novel \emph{R}eal-time \emph{A}udio-guided \emph{M}ulti-face reenactment approach named \emph{APB2FaceV2}, which can reenact different target faces among multiple persons with corresponding reference face and drive audio signal as inputs. Enabling the model to be trained end-to-end and have a faster speed, we design a novel module named Adaptive Convolution (AdaConv) to infuse audio information into the network, as well as adopt a lightweight network as our backbone so that the network can run in real time on CPU and GPU. Comparison experiments prove the superiority of our approach than existing state-of-the-art methods, and further experiments demonstrate that our method is efficient and flexible for practical applications https://github.com/zhangzjn/APB2FaceV2


title: Adversarial Robust Low Rank Matrix Estimation: Compressed Sensing and Matrix Completion

abstract: We consider robust low rank matrix estimation as a trace regression when outputs are contaminated by adversaries. The adversaries are allowed to add arbitrary values to arbitrary outputs. Such values can depend on any samples. We deal with matrix compressed sensing, including lasso as a partial problem, and matrix completion, and then we obtain sharp estimation error bounds. To obtain the error bounds for different models such as matrix compressed sensing and matrix completion, we propose a simple unified approach based on a combination of the Huber loss function and the nuclear norm penalization, which is a different approach from the conventional ones. Some error bounds obtained in the present paper are sharper than the past ones.


title: Large power dissipation of hot Dirac fermions in twisted bilayer graphene

abstract: We have carried out a theoretical investigation of hot electron power loss $P$, involving electron-acoustic phonon interaction, as a function of twist angle $\theta$, electron temperature $T_e$ and electron density $n_s$ in twisted bilayer graphene (tBLG). It is found that as $\theta$ decreases closer to magic angle $\theta_m$, $P$ enhances strongly and $\theta$ acts as an important tunable parameter, apart from $T_e$ and $n_s$. In the range of $T_e$ =1-50 K, this enhancement is $\sim$ 250-450 times the $P$ in monolayer graphene (MLG), which is manifestation of the great suppression of Fermi velocity ${v_F}^*$ of electrons in moir\'e flat band. As $\theta$ increases away from $\theta_m$, the impact of $\theta$ on $P$ decreases, tending to that of MLG at $\theta$ $\sim$ 3$^{\circ}$. In the Bloch-Gr\"uneisen (BG) regime, $P$ $\sim$ ${T_e}^4$, ${n_s}^{-1/2}$ and ${v_F}^{*-2}$. In the higher temperature region ($\sim$10- 50 K), $P$ $\sim$ ${T_e}^{\delta}$, with $\delta \sim$ 2.0, and the behavior is still super linear in $T_e$, unlike the phonon limited linear-in- $T$ ( lattice temperature) resistivity $\rho_p$. $P$ is weakly, decreasing (increasing) with increasing $n_s$ at lower (higher) $T_e$, as found in MLG. The energy relaxation time $\tau_e$ is also discussed as a function of $\theta$ and $T_e$. Expressing the power loss $P = F_e(T_e)- F_e(T)$, in the BG regime, we have obtained a simple and useful relation $F_e(T) \mu_p (T) = (e{v_s}^2$/2) i.e. $Fe(T) = (n_se^2 {v_s}^2/2)\rho_p$, where $\mu_p$ is the acoustic phonon limited mobility and $v_s$ is the acoustic phonon velocity. The $\rho_p$ estimated from this relation using our calculated $F_e(T)$ is nearly agreeing with the $\rho_p$ of Wu et al (Phys. Rev. B 99, 165112 (2019)).


title: The Smoothed Complexity of Computing Kemeny and Slater Rankings

abstract: The computational complexity of winner determination under common voting rules is a classical and fundamental topic in the field of computational social choice. Previous work has established the NP-hardness of winner determination under some commonly-studied voting rules, especially the Kemeny rule and the Slater rule. In a recent blue-sky paper, Baumeister, Hogrebe, and Rothe (2020) questioned the relevance of the worst-case nature of NP-hardness in social choice and proposed to conduct smoothed complexity analysis (Spielman and Teng 2009) under Blaser and Manthey (2015)'s framework. In this paper, we develop the first smoothed complexity results for winner determination in voting. We illustrate the inappropriateness of Blaser and Manthey (2015)'s smoothed complexity framework in social choice contexts by proving a paradoxical result, which states that the exponential-time brute force search algorithm is smoothed poly-time according to their definition. We then prove the smoothed hardness of Kemeny and Slater using the classical smoothed complexity analysis, and prove a parameterized typical-case smoothed easiness result for Kemeny. Overall, our results show that smoothed complexity analysis in computational social choice is a challenging and fruitful topic.


title: Multimodal Sensor Fusion with Differentiable Filters

abstract: Leveraging multimodal information with recursive Bayesian filters improves performance and robustness of state estimation, as recursive filters can combine different modalities according to their uncertainties. Prior work has studied how to optimally fuse different sensor modalities with analytical state estimation algorithms. However, deriving the dynamics and measurement models along with their noise profile can be difficult or lead to intractable models. Differentiable filters provide a way to learn these models end-to-end while retaining the algorithmic structure of recursive filters. This can be especially helpful when working with sensor modalities that are high dimensional and have very different characteristics. In contact-rich manipulation, we want to combine visual sensing (which gives us global information) with tactile sensing (which gives us local information). In this paper, we study new differentiable filtering architectures to fuse heterogeneous sensor information. As case studies, we evaluate three tasks: two in planar pushing (simulated and real) and one in manipulating a kinematically constrained door (simulated). In extensive evaluations, we find that differentiable filters that leverage crossmodal sensor information reach comparable accuracies to unstructured LSTM models, while presenting interpretability benefits that may be important for safety-critical systems. We also release an open-source library for creating and training differentiable Bayesian filters in PyTorch, which can be found on our project website: https://sites.google.com/view/multimodalfilter


title: Deterministic generation of parametrically driven dissipative Kerr soliton

abstract: We theoretically study the nature of parametrically driven dissipative Kerr soliton (PD-DKS) in a doubly resonant degenerate micro-optical parametric oscillator (DR-D{\mu}OPO) with the cooperation of \c{hi}(2) and \c{hi}(3) nonlinearities. Lifting the assumption of close-to-zero group velocity mismatch (GVM) that requires extensive dispersion engineering, we show that there is a threshold GVM above which single PD-DKS in DR-D{\mu}OPO can be generated deterministically. We find that the exact PD-DKS generation dynamics can be divided into two distinctive regimes depending on the phase matching condition. In both regimes, the perturbative effective third-order nonlinearity resulting from the cascaded quadratic process is responsible for the soliton annihilation and the deterministic single PD-DKS generation. We also develop the experimental design guidelines for accessing such deterministic single PD-DKS state. The working principle can be applied to different material platforms as a competitive ultrashort pulse and broadband frequency comb source architecture at the mid-infrared spectral range.


title: MLANE: Meta-Learning Based Adaptive Network Embedding

abstract: Most existing random walk based network embedding methods often follow only one of two principles, homophily or structural equivalence. In real world networks, however, nodes exhibit a mixture of homophily and structural equivalence, which requires adaptive network embedding that can adaptively preserve both homophily and structural equivalence for different nodes in different down-stream analysis tasks. In this paper, we propose a novel method called Meta-Learning based Adaptive Network Embedding (MLANE), which can learn adaptive sampling strategy for different nodes in different tasks by incorporating sampling strategy learning with embedding learning into one optimization problem that can be solved via an end-to-end meta-learning framework. In extensive experiments on real datasets, MLANE shows significant performance improvements over the baselines. The source code of MLANE and the datasets used in experiments and all the hyperparameter settings for baselines are available at https://github.com/7733com/MLANE.


title: Emergence and Stability of Self-Evolved Cooperative Strategies using Stochastic Machines

abstract: To investigate the origin of cooperative behaviors, we developed an evolutionary model of sequential strategies and tested our model with computer simulations. The sequential strategies represented by stochastic machines were evaluated through games of Iterated Prisoner's Dilemma (IPD) with other agents in the population, allowing co-evolution to occur. We expanded upon past works by proposing a novel mechanism to mutate stochastic Moore machines that enables a richer class of machines to be evolved. These machines were then subjected to various selection mechanisms and the resulting evolved strategies were analyzed. We found that cooperation can indeed emerge spontaneously in evolving populations playing iterated PD, specifically in the form of trigger strategies. In addition, we found that the resulting populations converged to evolutionarily stable states and were resilient towards mutation. In order to test the generalizability of our proposed mutation mechanism and simulation approach, we also evolved the machines to play other games such as Chicken, Stag Hunt, and Battle, and obtained strategies that perform as well as mixed strategies in Nash Equilibrium.


title: Global to local impacts on atmospheric CO2 caused by COVID-19 lockdown

abstract: The world-wide lockdown in response to the COVID-19 pandemic in year 2020 led to economic slowdown and large reduction of fossil fuel CO2 emissions, but it is unclear how much it would reduce atmospheric CO2 concentration, and whether it can be observed. We estimated that a 7.9% reduction in emissions for 4 months would result in a 0.25 ppm decrease in the Northern Hemisphere CO2, an increment that is within the capability of current CO2 analyzers, but is a few times smaller than natural CO2 variabilities caused by weather and the biosphere such as El Nino. We used a state-of-the-art atmospheric transport model to simulate CO2, driven by a new daily fossil fuel emissions dataset and hourly biospheric fluxes from a carbon cycle model forced with observed climate variability. Our results show a 0.13 ppm decrease in atmospheric column CO2 anomaly averaged over 50S-50N for the period February-April 2020 relative to a 10-year climatology. A similar decrease was observed by the carbon satellite GOSAT3. Using model sensitivity experiments, we further found that COVID, the biosphere and weather contributed 54%, 23%, and 23% respectively. This seemingly small change stands out as the largest sub-annual anomaly in the last 10 years. Measurements from global ground stations were analyzed. At city scale, on-road CO2 enhancement measured in Beijing shows reduction of 20-30 ppm, consistent with drastically reduced traffic during the lockdown. The ability of our current carbon monitoring systems in detecting the small and short-lasting COVID signal on the background of fossil fuel CO2 accumulated over the last two centuries is encouraging. The COVID-19 pandemic is an unintended experiment whose impact suggests that to keep atmospheric CO2 at a climate-safe level will require sustained effort of similar magnitude and improved accuracy and expanded spatiotemporal coverage of our monitoring systems.


title: On synthetic data generation for anomaly detection in complex social networks

abstract: This paper studies the feasibility of synthetic data generation for mission-critical applications. The emphasis is on synthetic data generation for anomalous detection in complex social networks. In particular, the development of a heuristic generative model, capable of creating data for anomalous rare activities in complex social networks is sought. To this end, lessons from social and political literature are applied to prototype a novel implementation of the Agent-based Modeling (ABM) framework, based on simple social interactions between agents, for synthetic data generation in the context of terrorist profile desegregation. The conclusion offers directions for further verification, fine-tuning, and proposes future directions of work for the ABM prototype, as a complex-societal approach to synthetic data generation, by identifying heuristic hyper-parameter tuning methodologies to further ensure the generated data distribution is similar to the true distribution of the original data-sets. While a rigorous mathematical optimization for reducing the distances in distributions is not offered in this work, we opine that this prototype of an autonomous-agent generative complex social model is useful for studying and researching on pattern of life and anomaly detection where there is strict limitation or lack of sufficient data for using practical machine learning solutions in mission-critical applications.


title: Verification of the Optical System of the 9.7-m Prototype Schwarzschild-Couder Telescope

abstract: For the first time in the history of ground-based $\gamma$-ray astronomy, the on-axis performance of the dual mirror, aspheric, aplanatic Schwarzschild-Couder optical system has been demonstrated in a $9.7$-m aperture imaging atmospheric Cherenkov telescope. The novel design of the prototype Schwarzschild-Couder Telescope (pSCT) is motivated by the need of the next-generation Cherenkov Telescope Array (CTA) observatory to have the ability to perform wide ($\geq 8^{\circ}$) field-of-view observations simultaneously with superior imaging of atmospheric cascades (resolution of $0.067^{\circ}$ per pixel or better). The pSCT design, if implemented in the CTA installation, has the potential to improve significantly both the $\gamma$-ray angular resolution and the off-axis sensitivity of the observatory, reaching nearly the theoretical limit of the technique and thereby making a major impact on the CTA observatory sky survey programs, follow-up observations of multi-messenger transients with poorly known initial localization, as well as on the spatially resolved spectroscopic studies of extended $\gamma$-ray sources. This contribution reports on the initial alignment procedures and point-spread-function results for the challenging segmented aspheric primary and secondary mirrors of the pSCT.


title: CRAB: Class Representation Attentive BERT for Hate Speech Identification in Social Media

abstract: In recent years, social media platforms have hosted an explosion of hate speech and objectionable content. The urgent need for effective automatic hate speech detection models have drawn remarkable investment from companies and researchers. Social media posts are generally short and their semantics could drastically be altered by even a single token. Thus, it is crucial for this task to learn context-aware input representations, and consider relevancy scores between input embeddings and class representations as an additional signal. To accommodate these needs, this paper introduces CRAB (Class Representation Attentive BERT), a neural model for detecting hate speech in social media. The model benefits from two semantic representations: (i) trainable token-wise and sentence-wise class representations, and (ii) contextualized input embeddings from state-of-the-art BERT encoder. To investigate effectiveness of CRAB, we train our model on Twitter data and compare it against strong baselines. Our results show that CRAB achieves 1.89% relative improved Macro-averaged F1 over state-of-the-art baseline. The results of this research open an opportunity for the future research on automated abusive behavior detection in social media


title: Detecting abnormal connectivity in schizophrenia via a joint directed acyclic graph estimation model

abstract: Functional connectivity (FC) has been widely used to study brain network interactions underlying the emerging cognition and behavior of an individual. FC is usually defined as the correlation or partial correlation between brain regions. Although FC is proved to be a good starting point to understand the brain organization, it fails to tell the causal relationship or the direction of interactions. Many directed acyclic graph (DAG) based methods were applied to study the directed interactions using functional magnetic resonance imaging (fMRI) data but the performance was severely limited by the small sample size and high dimensionality, hindering its applications. To overcome the obstacles, we propose a score based joint directed acyclic graph model to estimate the directed FC in fMRI data. Instead of using a combinatorial optimization framework, the structure of DAG is characterized with an algebra equation and further regularized with sparsity and group similarity terms. The simulation results have demonstrated the improved accuracy of the proposed model in detecting causality as compared to other existing methods. In our case-control study of the MIND Clinical Imaging Consortium (MCIC) data, we have successfully identified decreased functional integration, disrupted hub structures and characteristic edges (CtEs) in schizophrenia (SZ) patients. Further comparison between the results from directed FC and undirected FC illustrated the their different emphasis on selected features. We speculate that combining the features from undirected graphical model and directed graphical model might be a promising way to do FC analysis.


title: Hybrid MAP and PIC Detection for OTFS Modulation

abstract: Orthogonal time frequency space (OTFS) modulation has attracted substantial attention recently due to its great potential of providing reliable communications in high-mobility scenarios. In this paper, we propose a novel hybrid signal detection algorithm for OTFS modulation. By characterizing the input-output relationship of OTFS modulation, we derive the near-optimal symbol-wise maximum a posteriori (MAP) detection algorithm for OTFS modulation, which aims to extract the information of each transmitted symbol based on the corresponding related received symbols. Furthermore, in order to reduce the detection complexity, we propose a partitioning rule that separates the related received symbols into two subsets for detecting each transmitted symbol, according to the corresponding path gains. We then introduce a hybrid detection algorithm to exploit the power discrepancy of each subset, where the MAP detection is applied to the subset with larger channel gains, while the parallel interference cancellation (PIC) detection is applied to the subset with smaller channel gains. Simulation results show that the proposed algorithms can not only approach the performance of the near-optimal symbol-wise MAP algorithms, but also offer a substantial performance gain compared with existing algorithms.


title: Towards Medical Knowmetrics: Representing and Computing Medical Knowledge using Semantic Predications as the Knowledge Unit and the Uncertainty as the Knowledge Context

abstract: In China, Prof. Hongzhou Zhao and Zeyuan Liu are the pioneers of the concept "knowledge unit" and "knowmetrics" for measuring knowledge. However, the definition of "computable knowledge object" remains controversial so far in different fields. For example, it is defined as 1) quantitative scientific concept in natural science and engineering, 2) knowledge point in the field of education research, and 3) semantic predications, i.e., Subject-Predicate-Object (SPO) triples in biomedical fields. The Semantic MEDLINE Database (SemMedDB), a high-quality public repository of SPO triples extracted from medical literature, provides a basic data infrastructure for measuring medical knowledge. In general, the study of extracting SPO triples as computable knowledge unit from unstructured scientific text has been overwhelmingly focusing on scientific knowledge per se. Since the SPO triples would be possibly extracted from hypothetical, speculative statements or even conflicting and contradictory assertions, the knowledge status (i.e., the uncertainty), which serves as an integral and critical part of scientific knowledge has been largely overlooked. This article aims to put forward a framework for Medical Knowmetrics using the SPO triples as the knowledge unit and the uncertainty as the knowledge context. The lung cancer publications dataset is used to validate the proposed framework. The uncertainty of medical knowledge and how its status evolves over time indirectly reflect the strength of competing knowledge claims, and the probability of certainty for a given SPO triple. We try to discuss the new insights using the uncertainty-centric approaches to detect research fronts, and identify knowledge claims with high certainty level, in order to improve the efficacy of knowledge-driven decision support.


title: Byzantine Resilient Distributed Multi-Task Learning

abstract: Distributed multi-task learning provides significant advantages in multi-agent networks with heterogeneous data sources where agents aim to learn distinct but correlated models simultaneously.However, distributed algorithms for learning relatedness among tasks are not resilient in the presence of Byzantine agents. In this paper, we present an approach for Byzantine resilient distributed multi-task learning. We propose an efficient online weight assignment rule by measuring the accumulated loss using an agent's data and its neighbors' models. A small accumulated loss indicates a large similarity between the two tasks. In order to ensure the Byzantine resilience of the aggregation at a normal agent, we introduce a step for filtering out larger losses. We analyze the approach for convex models and show that normal agents converge resiliently towards the global minimum.Further, aggregation with the proposed weight assignment rule always results in an improved expected regret than the non-cooperative case. Finally, we demonstrate the approach using three case studies, including regression and classification problems, and show that our method exhibits good empirical performance for non-convex models, such as convolutional neural networks.


title: Robust Hierarchical Planning with Policy Delegation

abstract: We propose a novel framework and algorithm for hierarchical planning based on the principle of delegation. This framework, the Markov Intent Process, features a collection of skills which are each specialised to perform a single task well. Skills are aware of their intended effects and are able to analyse planning goals to delegate planning to the best-suited skill. This principle dynamically creates a hierarchy of plans, in which each skill plans for sub-goals for which it is specialised. The proposed planning method features on-demand execution---skill policies are only evaluated when needed. Plans are only generated at the highest level, then expanded and optimised when the latest state information is available. The high-level plan retains the initial planning intent and previously computed skills, effectively reducing the computation needed to adapt to environmental changes. We show this planning approach is experimentally very competitive to classic planning and reinforcement learning techniques on a variety of domains, both in terms of solution length and planning time.


title: EGGTART: A computational tool to visualize the dynamics of biophysical transport processes under the inhomogeneous $\ell$-TASEP

abstract: The totally asymmetric simple exclusion process (TASEP), which describes the stochastic dynamics of interacting particles on a lattice, has been actively studied over the past several decades and applied to model important biological transport processes. Here we present a software package, called EGGTART (Extensive GUI gives TASEP-realization in real time), which quantifies and visualizes the dynamics associated with a generalized version of the TASEP with an extended particle size and heterogeneous jump rates. This computational tool is based on analytic formulas obtained from deriving and solving the hydrodynamic limit of the process. It allows an immediate quantification of the particle density, flux, and phase diagram, as a function of a few key parameters associated with the system, which would be difficult to achieve via conventional stochastic simulations. Our software should therefore be of interest to biophysicists studying general transport processes, and can in particular be used in the context of gene expression to model and quantify mRNA translation of different coding sequences.


title: Enactive Mandala: Audio-visualizing Brain Waves

abstract: We are exploring the design and implementation of artificial expressions, kinetic audio-visual representations of real-time physiological data that reflect emotional and cognitive state. In this work, we demonstrate a prototype, the Enactive Mandala, which maps real-time EEG signals to modulate ambient music and animated visual music. Transparent real-time audio-visual feedback of brainwave qualities supports intuitive insight into the connection between thoughts and physiological states.


title: Trading Strategies of a Leveraged ETF in a Continuous Double Auction Market Using an Agent-Based Simulation

abstract: A leveraged ETF is a fund aimed at achieving a rate of return several times greater than that of the underlying asset such as Nikkei 225 futures. Recently, it has been suggested that rebalancing trades of a leveraged ETF may destabilize the financial markets. An empirical study using an agent-based simulation indicated that a rebalancing trade strategy could affect the price formation of an underlying asset market. However, no leveraged ETF trading method for suppressing the increase in volatility as much as possible has yet been proposed. In this paper, we compare different strategies of trading for a proposed trading model and report the results of our investigation regarding how best to suppress an increase in market volatility. As a result, it was found that as the minimum number of orders in a rebalancing trade increases, the impact on the market price formation decreases.


title: Powerful t-SNE technique leading to clear separation of type-2 AGN and HII galaxies in BPT diagrams

abstract: Narrow emission-line galaxies can be distinguished in the well-known BPT diagrams through narrow emission line properties. However, there are no boundaries visible to the naked eye between type-2 AGN and HII galaxies in BPT diagrams, besides the extreme dividing lines expected by theoretical photoionization models. Here, based on powerful t-SNE technique applied to the local narrow emission-line galaxies in SDSS DR15, type-2 AGN and HII galaxies can be clearly separated in the t-SNE determined two-dimensional projected map, and then the dividing lines can be mathematically determined in BPT diagrams, leading to charming harmonization of the theoretical expectations and the actual results from real observed properties. The results not only provide an interesting and robust method to determine the dividing lines in BPT diagrams through the powerful t-SNE technique, but also lead to further confirmation on previously defined composite galaxies more efficiently classified in the BPT diagram of [OIII]/H$\beta$ versus [NII]/H$\alpha$.


title: Analysis of the Impact of High-Frequency Trading on Artificial Market Liquidity

abstract: Many empirical studies have discussed market liquidity, which is regarded as a measure of a booming financial market. Further, various indicators for objectively evaluating market liquidity have also been proposed and their merits have been discussed. In recent years, the impact of high-frequency traders (HFTs) on financial markets has been a focal concern, but no studies have systematically discussed their relationship with major market liquidity indicators, including volume, tightness, resiliency, and depth. In this study, we used agent-based simulations to compare the major liquidity indicators in an artificial market where an HFT participated was compared to one where no HFT participated. The results showed that all liquidity indicators in the market where an HFT participated improved more than those in the market where no HFT participated. Furthermore, as a result of investigating the correlations between the major liquidity indicators in our simulations and the extant empirical literature, we found that market liquidity can be measured not only by the major liquidity indicators but also by execution rate. Therefore, it is suggested that it could be appropriate to employ execution rate as a novel liquidity indicator in future studies.


title: Statistical optimality and stability of tangent transform algorithms in logit models

abstract: A systematic approach to finding variational approximation in an otherwise intractable non-conjugate model is to exploit the general principle of convex duality by minorizing the marginal likelihood that renders the problem tractable. While such approaches are popular in the context of variational inference in non-conjugate Bayesian models, theoretical guarantees on statistical optimality and algorithmic convergence are lacking. Focusing on logistic regression models, we provide mild conditions on the data generating process to derive non-asymptotic upper bounds to the risk incurred by the variational optima. We demonstrate that these assumptions can be completely relaxed if one considers a slight variation of the algorithm by raising the likelihood to a fractional power. Next, we utilize the theory of dynamical systems to provide convergence guarantees for such algorithms in logistic and multinomial logit regression. In particular, we establish local asymptotic stability of the algorithm without any assumptions on the data-generating process. We explore a special case involving a semi-orthogonal design under which a global convergence is obtained. The theory is further illustrated using several numerical studies.


title: Fine-tuning ERNIE for chest abnormal imaging signs extraction

abstract: Chest imaging reports describe the results of chest radiography procedures. Automatic extraction of abnormal imaging signs from chest imaging reports has a pivotal role in clinical research and a wide range of downstream medical tasks. However, there are few studies on information extraction from Chinese chest imaging reports. In this paper, we formulate chest abnormal imaging sign extraction as a sequence tagging and matching problem. On this basis, we propose a transferred abnormal imaging signs extractor with pretrained ERNIE as the backbone, named EASON (fine-tuning ERNIE with CRF for Abnormal Signs ExtractiON), which can address the problem of data insufficiency. In addition, to assign the attributes (the body part and degree) to corresponding abnormal imaging signs from the results of the sequence tagging model, we design a simple but effective tag2relation algorithm based on the nature of chest imaging report text. We evaluate our method on the corpus provided by a medical big data company, and the experimental results demonstrate that our method achieves significant and consistent improvement compared to other baselines.


title: On the Bieri-Neumann-Strebel-Renz invariants of the weak commutativity construction $\X(G)$

abstract: For a finitely generated group $G$ we calculate the Bieri-Neumann-Strebel-Renz invariant $\Sigma^1(\X(G))$ for the weak commutativity construction $\X(G)$. Identifying $S(\X(G))$ with $S(\X(G) / W(G))$ we show $\Sigma^2(\X(G),\Z) \subseteq \Sigma^2(\X(G)/ W(G),\Z)$ and $\Sigma^2(\X(G)) \subseteq $ $ \Sigma^2(\X(G)/ W(G))$ that are equalities when $W(G)$ is finitely generated and we explicitly calculate $\Sigma^2(\X(G)/ W(G),\Z)$ and $ \Sigma^2(\X(G)/ W(G))$ in terms of the $\Sigma$-invariants of $G$. We calculate completely the $\Sigma$-invariants in dimensions 1 and 2 of the group $\nu(G)$ and show that if $G$ is finitely generated group with finitely presented commutator subgroup then the non-abelian tensor square $G \otimes G$ is finitely presented.


title: A Novel Move-To-Front-or-Logarithmic Position (MFLP) Online List Update Algorithm

abstract: In this paper we propose a novel online deterministic list update algorithm known as Move-To-Front-or-Logarithmic Position (MFLP). Our proposed algorithm MFLP achieves a competitive ratio of 2 for larger list with respect to static optimum offline algorithm, whereas MFLP is not competitive for smaller list. We also show that MFLP is 2 competitive with respect to dynamic optimum offline algorithm. Our results open up a new direction of work towards classifying the online algorithms based on competitive and not competitive.


title: On Countable Stationary Towers

abstract: In this paper, we investigate properties of countable stationary towers. We derive the regularity properties of sets of reals in $L(\mathbf R)$ from some properties of countable stationary towers without explicit use of strong large cardinals such as Woodin cardinals. We also introduce the notion of semiprecipitousness and investigate its relation to precipitousness and presaturation of countable stationary towers. We show that precipitousness of countable stationary towers of weakly compact height implies the regularity properties of sets of reals in $L(\mathbf R)$.


title: Chiral symmetry breaking and chemical equilibrium in a heavy-ion collisions

abstract: We examine the thermalization of an ensemble of the octet of pseudoscalar mesons, in the isospin symmetric limit, whose interactions are constrained through chiral symmetry, unitarity, and measurements. The reaction amplitudes generate all resonances up to masses of about 2 GeV, with twelve input parameters, namely f_pi, three masses, and eight low energy constants (LECs) of chiral perturbation theory. In linear response theory, we find that matter takes an extremely long time to thermalize. These long relaxation times are directly related to the fact that these mesons are pseudo-Goldstone bosons of chiral symmetry breaking. This result indicates that fireballs created with zero baryon number in heavy-ion collisions will drop out of chemical equilibrium once they enter the chiral symmetry broken phase.


title: Origin of Irradiation Synergistic Effects in Silicon Bipolar Transistors: a Review

abstract: The practical damage of silicon bipolar devices subjected to mixed ionization and displacement irradiations is usually evaluated by the sum of separated ionization and displacement damages. However, recent experiments show clear difference between the practical and summed damages, indicating significant irradiation synergistic effects (ISEs). Understanding the behaviors and mechanisms of ISEs is essential to predict the practical damages. In this work, we first make a brief review on the state of the art, critically emphasizing on the difficulty encountered in previous models to understand the dose rate dependence of the ISEs. We then introduce in detail our models explaining this basic phenomenon, which can be described as follows. Firstly, we show our experimental works on PNP and NPN transistors. A variable neutron fluence and $\gamma$-ray dose setup is adopted. Fluence-dependent `tick'-like and sublinear dose profiles are observed for PNP and NPN transistors, respectively. Secondly, we describe our theoretical investigations on the positive ISE in NPN transistors. We propose an atomistic model of transformation and annihilation of $\rm V_2$ displacement defects in p-type silicon under ionization irradiation, which is totally different from the traditional picture of Coulomb interaction of oxide trapped charges in silica on charge carriers in irradiated silicon. The predicted novel dose and fluence dependences are fully verified by the experimental data. Thirdly, the mechanism of the observed negative ISE in PNP transistors is investigated in a similar way as in the NPN transistor case. The difference is that in n-type silicon, VO displacement defects also undergo an ionization-induced transformation and annihilation process. Our results show that, the evolution of displacement defects due to carrier-enhanced defect diffusion and reaction is the dominating mechanism of the ISEs.


title: CLRGaze: Contrastive Learning of Representations for Eye Movement Signals

abstract: Eye movements are intricate and dynamic biosignals that contain a wealth of cognitive information about the subject. However, these are ambiguous signals and therefore require meticulous feature engineering to be used by machine learning algorithms. We instead propose to learn feature vectors of eye movements in a self-supervised manner. We adopt a contrastive learning approach and propose a set of data transformations that encourage a deep neural network to discern salient and granular gaze patterns. This paper presents a novel experiment utilizing six eye-tracking data sets despite different data specifications and experimental conditions. We assess the learned features on biometric tasks with only a linear classifier, achieving 84.6% accuracy on a mixed dataset, and up to 97.3% accuracy on a single dataset. Our work advances the state of machine learning for eye movements and provides insights into a general representation learning method not only for eye movements but also for similar biosignals.


title: Orthros: Non-autoregressive End-to-end Speech Translation with Dual-decoder

abstract: Fast inference speed is an important goal towards real-world deployment of speech translation (ST) systems. End-to-end (E2E) models based on the encoder-decoder architecture are more suitable for this goal than traditional cascaded systems, but their effectiveness regarding decoding speed has not been explored so far. Inspired by recent progress in non-autoregressive (NAR) methods in text-based translation, which generates target tokens in parallel by eliminating conditional dependencies, we study the problem of NAR decoding for E2E-ST. We propose a novel NAR E2E-ST framework, Orthros, in which both NAR and autoregressive (AR) decoders are jointly trained on the shared speech encoder. The latter is used for selecting better translation among various length candidates generated from the former, which dramatically improves the effectiveness of a large length beam with negligible overhead. We further investigate effective length prediction methods from speech inputs and the impact of vocabulary sizes. Experiments on four benchmarks show the effectiveness of the proposed method in improving inference speed while maintaining competitive translation quality compared to state-of-the-art AR E2E-ST systems.


title: Differentially Private Weighted Sampling

abstract: Common datasets have the form of elements with keys (e.g., transactions and products) and the goal is to perform analytics on the aggregated form of key and frequency pairs. A weighted sample of keys by (a function of) frequency is a highly versatile summary that provides a sparse set of representative keys and supports approximate evaluations of query statistics. We propose private weighted sampling (PWS): A method that ensures element-level differential privacy while retaining, to the extent possible, the utility of a respective non-private weighted sample. PWS maximizes the reporting probabilities of keys and estimation quality of a broad family of statistics. PWS improves over the state of the art also for the well-studied special case of private histograms, when no sampling is performed. We empirically demonstrate significant performance gains compared with prior baselines: 20%-300% increase in key reporting for common Zipfian frequency distributions and accuracy for $\times 2$-$ 8$ lower frequencies in estimation tasks. Moreover, PWS is applied as a simple post-processing of a non-private sample, without requiring the original data. This allows for seamless integration with existing implementations of non-private schemes and retaining the efficiency of schemes designed for resource-constrained settings such as massive distributed or streamed data. We believe that due to practicality and performance, PWS may become a method of choice in applications where privacy is desired.


title: Commonsense knowledge adversarial dataset that challenges ELECTRA

abstract: Commonsense knowledge is critical in human reading comprehension. While machine comprehension has made significant progress in recent years, the ability in handling commonsense knowledge remains limited. Synonyms are one of the most widely used commonsense knowledge. Constructing adversarial dataset is an important approach to find weak points of machine comprehension models and support the design of solutions. To investigate machine comprehension models' ability in handling the commonsense knowledge, we created a Question and Answer Dataset with common knowledge of Synonyms (QADS). QADS are questions generated based on SQuAD 2.0 by applying commonsense knowledge of synonyms. The synonyms are extracted from WordNet. Words often have multiple meanings and synonyms. We used an enhanced Lesk algorithm to perform word sense disambiguation to identify synonyms for the context. ELECTRA achieves the state-of-art result on the SQuAD 2.0 dataset in 2019. With scale, ELECTRA can achieve similar performance as BERT does. However, QADS shows that ELECTRA has little ability to handle commonsense knowledge of synonyms. In our experiment, ELECTRA-small can achieve 70% accuracy on SQuAD 2.0, but only 20% on QADS. ELECTRA-large did not perform much better. Its accuracy on SQuAD 2.0 is 88% but dropped significantly to 26% on QADS. In our earlier experiments, BERT, although also failed badly on QADS, was not as bad as ELECTRA. The result shows that even top-performing NLP models have little ability to handle commonsense knowledge which is essential in reading comprehension.


title: Semiconductor Physics: A Density Functional Journey

abstract: The journey of theoretical study on semiconductors is reviewed in a non-conventional way. We have started with the basic introduction of Hartree-Fock method and introduce the fundamentals of Density Functional Theory (DFT). From the oldest Local Density Approximations (LDA) to the most recent developments of semi-local corrections [Generalised Gradient Approximation (GGA), Meta-GGAs], hybrid functionals and orbital dependent methodologies are discussed in detail. To showcase the performance of DFT, results obtained via different approximations are compared. We indicate the success of semi-local approximations in structural properties prediction. We also show how less computationally costly but withstand architecture of some semi-local DFT methods can solve the long riddle of bandgap underestimation. In semiconductor physics, the importance of not only the band structure prediction, but also, the proper calculation of Fermi energy, and, exact finding of band alignment is argued. The comparison of Fermi energy dependent properties can channelize the theoretical studies on modern age environment-friendly researches on semiconductors, like artificial photocatalysis, energy efficient opto-electronic devices, etc. This prescription on proper choice of DFT method is potentially competent to complement the experimental findings as well as can open up a pathway of advanced semiconducting materials discoveries.


title: Light-Curve Evolution due to Secular Dynamics and the Vanishing Transits of KOI 120.01

abstract: Non-Keplerian dynamics of planetary orbits manifest in the transit light-curve as variations of different types. In addition to Transit Timing Variations (TTV's), the shape of the transits contains additional information on variations in the geometry of the orbit. This study presents an analytic approach to light-curve fitting: dynamical variations in the orbital elements are transformed to a light-curve using an analytic function with a restricted set of fitting parameters. Our method requires no N-body integration, resulting in a smaller number of degrees of freedom and a faster calculation. The approach described here is for the case of secular perturbations. By assuming that the orbital motion is dominated by nodal and apsidal precessions, analytic expressions for the light-curve transit parameters are derived as a function of the orbital variations. Detecting and characterizing such dynamical scenarios provides information regarding the possible existence of non-transiting companions, or the non-spherical mass distribution of the host star. The variations may imply forces out of the orbital plane, and thus probe mutual inclinations among components of the system. The derived models successfully reproduce the vanishing transit signals of KOI 120.01, and suggest a possible interesting scenario of a planet orbiting one member of a close-in binary system undergoing unusually rapid nodal regression. The model parameters are degenerate, so we provide relevant information for followup observations, which are suggested in order to place further constraints on this unique Kepler object.


title: Solar east-west flow correlations that persist for months at low latitudes are dominated by active region inflows

abstract: Context: Giant-cell convection is believed to be an important component of solar dynamics. For example, it is expected to play a crucial role in maintaining the Sun's differential rotation. Aims: We re-examine early reports of giant convective cells detected using correlation analysis of Dopplergrams. We extend this analysis using 19 years of space and ground-based observations of near-surface horizontal flows. Method: Flow maps are derived through local correlation tracking of granules and helioseismic ring-diagram analysis. We compute temporal auto-correlation functions of the east-west flows at fixed latitude. Results: Correlations in the east-west velocity can be clearly seen up to five rotation periods. The signal consists of features with longitudinal wavenumbers up to m=9 at low latitudes. Comparison with magnetic images indicates that these flow features are associated with magnetic activity. The signal is not seen above the noise level during solar minimum. Conclusions: Our results show that the long-term correlations in east-west flows at low latitudes are dominantly due to inflows into active regions and not to giant convective cells.


title: Speakerfilter-Pro: an improved target speaker extractor combines the time domain and frequency domain

abstract: This paper introduces an improved target speaker extractor, referred to as Speakerfilter-Pro, based on our previous Speakerfilter model. The Speakerfilter uses a bi-direction gated recurrent unit (BGRU) module to characterize the target speaker from anchor speech and use a convolutional recurrent network (CRN) module to separate the target speech from a noisy signal.Different from the Speakerfilter, the Speakerfilter-Pro sticks a WaveUNet module in the beginning and the ending, respectively. The WaveUNet has been proven to have a better ability to perform speech separation in the time domain. In order to extract the target speaker information better, the complex spectrum instead of the magnitude spectrum is utilized as the input feature for the CRN module. Experiments are conducted on the two-speaker dataset (WSJ0-mix2) which is widely used for speaker extraction. The systematic evaluation shows that the Speakerfilter-Pro outperforms the Speakerfilter and other baselines, and achieves a signal-to-distortion ratio (SDR) of 14.95 dB.


title: Applying convolutional neural networks to extremely sparse image datasets using an image subdivision approach

abstract: Purpose: The aim of this work is to demonstrate that convolutional neural networks (CNN) can be applied to extremely sparse image libraries by subdivision of the original image datasets. Methods: Image datasets from a conventional digital camera was created and scanning electron microscopy (SEM) measurements were obtained from the literature. The image datasets were subdivided and CNN models were trained on parts of the subdivided datasets. Results: The CNN models were capable of analyzing extremely sparse image datasets by utilizing the proposed method of image subdivision. It was furthermore possible to provide a direct assessment of the various regions where a given API or appearance was predominant.


title: Regularizing Towards Permutation Invariance in Recurrent Models

abstract: In many machine learning problems the output should not depend on the order of the input. Such "permutation invariant" functions have been studied extensively recently. Here we argue that temporal architectures such as RNNs are highly relevant for such problems, despite the inherent dependence of RNNs on order. We show that RNNs can be regularized towards permutation invariance, and that this can result in compact models, as compared to non-recurrent architectures. We implement this idea via a novel form of stochastic regularization. Existing solutions mostly suggest restricting the learning problem to hypothesis classes which are permutation invariant by design. Our approach of enforcing permutation invariance via regularization gives rise to models which are \textit{semi permutation invariant} (e.g. invariant to some permutations and not to others). We show that our method outperforms other permutation invariant approaches on synthetic and real world datasets.


title: Proactive Action Visual Residual Reinforcement Learning for Contact-Rich Tasks Using a Torque-Controlled Robot

abstract: Contact-rich manipulation tasks are commonly found in modern manufacturing settings. However, manually designing a robot controller is considered hard for traditional control methods as the controller requires an effective combination of modalities and vastly different characteristics. In this paper, we firstly consider incorporating operational space visual and haptic information into reinforcement learning(RL) methods to solve the target uncertainty problem in unstructured environments. Moreover, we propose a novel idea of introducing a proactive action to solve the partially observable Markov decision process problem. Together with these two ideas, our method can either adapt to reasonable variations in unstructured environments and improve the sample efficiency of policy learning. We evaluated our method on a task that involved inserting a random-access memory using a torque-controlled robot, and we tested the success rates of the different baselines used in the traditional methods. We proved that our method is robust and can tolerate environmental variations very well.


title: Contextualized Word Embeddings Encode Aspects of Human-Like Word Sense Knowledge

abstract: Understanding context-dependent variation in word meanings is a key aspect of human language comprehension supported by the lexicon. Lexicographic resources (e.g., WordNet) capture only some of this context-dependent variation; for example, they often do not encode how closely senses, or discretized word meanings, are related to one another. Our work investigates whether recent advances in NLP, specifically contextualized word embeddings, capture human-like distinctions between English word senses, such as polysemy and homonymy. We collect data from a behavioral, web-based experiment, in which participants provide judgments of the relatedness of multiple WordNet senses of a word in a two-dimensional spatial arrangement task. We find that participants' judgments of the relatedness between senses are correlated with distances between senses in the BERT embedding space. Homonymous senses (e.g., bat as mammal vs. bat as sports equipment) are reliably more distant from one another in the embedding space than polysemous ones (e.g., chicken as animal vs. chicken as meat). Our findings point towards the potential utility of continuous-space representations of sense meanings.


title: Adaptive Federated Learning and Digital Twin for Industrial Internet of Things

abstract: Industrial Internet of Things (IoT) enables distributed intelligent services varying with the dynamic and realtime industrial devices to achieve Industry 4.0 benefits. In this paper, we consider a new architecture of digital twin empowered Industrial IoT where digital twins capture the characteristics of industrial devices to assist federated learning. Noticing that digital twins may bring estimation deviations from the actual value of device state, a trusted based aggregation is proposed in federated learning to alleviate the effects of such deviation. We adaptively adjust the aggregation frequency of federated learning based on Lyapunov dynamic deficit queue and deep reinforcement learning, to improve the learning performance under the resource constraints. To further adapt to the heterogeneity of Industrial IoT, a clustering-based asynchronous federated learning framework is proposed. Numerical results show that the proposed framework is superior to the benchmark in terms of learning accuracy, convergence, and energy saving.


title: A QP-adaptive Mechanism for CNN-based Filter in Video Coding

abstract: Convolutional neural network (CNN)-based filters have achieved great success in video coding. However, in most previous works, individual models are needed for each quantization parameter (QP) band. This paper presents a generic method to help an arbitrary CNN-filter handle different quantization noise. We model the quantization noise problem and implement a feasible solution on CNN, which introduces the quantization step (Qstep) into the convolution. When the quantization noise increases, the ability of the CNN-filter to suppress noise improves accordingly. This method can be used directly to replace the (vanilla) convolution layer in any existing CNN-filters. By using only 25% of the parameters, the proposed method achieves better performance than using multiple models with VTM-6.3 anchor. Besides, an additional BD-rate reduction of 0.2% is achieved by our proposed method for chroma components.


title: Semi-Blind Source Separation for Nonlinear Acoustic Echo Cancellation

abstract: The mismatch between the numerical and actual nonlinear models is a challenge to nonlinear acoustic echo cancellation (NAEC) when the nonlinear adaptive filter is utilized. To alleviate this problem, we combine a basis-generic expansion of the memoryless nonlinearity into semi-blind source separation (SBSS). By regarding all the basis functions of the far-end input signal as the known equivalent reference signals, an SBSS updating algorithm is derived following the constrained scaled natural gradient strategy. Unlike the commonly utilized adaptive algorithm, the proposed SBSS is based on the independence between the near-end signal and the reference signals, and is less sensitive to the mismatch of nonlinearity between the numerical and actual models. Experimental results show that the proposed method outperforms conventional methods in terms of echo return loss enhancement (ERLE) and near-end speech quality evaluated by perceptual evaluation of speech quality (PESQ) and short-time objective intelligibility (STOI).


title: Recurrent Conditional Heteroskedasticity

abstract: We propose a new class of financial volatility models, called the REcurrent Conditional Heteroskedastic (RECH) models, to improve both in-sample analysis and out-ofsample forecasting of the traditional conditional heteroskedastic models. In particular, we incorporate auxiliary deterministic processes, governed by recurrent neural networks, into the conditional variance of the traditional conditional heteroskedastic models, e.g. GARCH-type models, to flexibly capture the dynamics of the underlying volatility. RECH models can detect interesting effects in financial volatility overlooked by the existing conditional heteroskedastic models such as the GARCH, GJR and EGARCH. The new models often have good out-of-sample forecasts while still explaining well the stylized facts of financial volatility by retaining the well-established features of econometric GARCH-type models. These properties are illustrated through simulation studies and applications to thirty-one stock indices and exchange rate data. . An user-friendly software package together with the examples reported in the paper are available at https://github.com/vbayeslab.


title: Transgender Community Sentiment Analysis from Social Media Data: A Natural Language Processing Approach

abstract: Transgender community is experiencing a huge disparity in mental health conditions compared with the general population. Interpreting the social medial data posted by transgender people may help us understand the sentiments of these sexual minority groups better and apply early interventions. In this study, we manually categorize 300 social media comments posted by transgender people to the sentiment of negative, positive, and neutral. 5 machine learning algorithms and 2 deep neural networks are adopted to build sentiment analysis classifiers based on the annotated data. Results show that our annotations are reliable with a high Cohen's Kappa score over 0.8 across all three classes. LSTM model yields an optimal performance of accuracy over 0.85 and AUC of 0.876. Our next step will focus on using advanced natural language processing algorithms on a larger annotated dataset.


title: Crowdsourcing approach for subjective evaluation of echo impairment

abstract: The quality of acoustic echo cancellers (AECs) in real-time communication systems is typically evaluated using objective metrics like ERLE and PESQ, and less commonly with lab-based subjective tests like ITU-T Rec. P.831. We will show that these objective measures are not well correlated to subjective measures. We then introduce an open-source crowdsourcing approach for subjective evaluation of echo impairment which can be used to evaluate the performance of AECs. We provide a study that shows this tool is accurate and highly reproducible. This new tool has been recently used in the ICASSP 2021 AEC Challenge which made the challenge possible to do quickly and cost effectively.


title: Further Analysis of Outlier Detection with Deep Generative Models

abstract: The recent, counter-intuitive discovery that deep generative models (DGMs) can frequently assign a higher likelihood to outliers has implications for both outlier detection applications as well as our overall understanding of generative modeling. In this work, we present a possible explanation for this phenomenon, starting from the observation that a model's typical set and high-density region may not conincide. From this vantage point we propose a novel outlier test, the empirical success of which suggests that the failure of existing likelihood-based outlier tests does not necessarily imply that the corresponding generative model is uncalibrated. We also conduct additional experiments to help disentangle the impact of low-level texture versus high-level semantics in differentiating outliers. In aggregate, these results suggest that modifications to the standard evaluation practices and benchmarks commonly applied in the literature are needed.


title: Refined probabilistic global well-posedness for the weakly dispersive NLS

abstract: We continue our study of the cubic fractional NLS with very weak dispersion $\alpha>1$ and data distributed according to the Gibbs measure. We construct the natural strong solutions for $\alpha>\alpha_0=\frac{31-\sqrt{233}}{14}\approx 1.124$ which is strictly smaller than $\frac{8}{7}$, the threshold beyond which the first nontrivial Picard iteration has no longer the Sobolev regularity needed for the deterministic well-posedness theory. This also improves our previous result in Sun-Tzvetkov \cite{Sun-Tz2}. We rely on recent ideas of Bringmann \cite{Bringmann} and Deng-Nahmod-Yue \cite{Deng2}. In particular we adapt to our situation the new resolution ansatz in \cite{Deng2} which captures the most singular frequency interaction parts in the $X^{s,b}$ type space. To overcome the difficulties caused by the weakly dispersive effect, our specific strategy is to benefit from the "almost" transport effect of these singular parts and to exploit their $L^{\infty}$ as well as the Fourier-Lebesgue property in order to inherit the random feature from the linear evolution of high frequency portions.


title: Sudakov effects in central-forward dijet production in high energy factorization

abstract: We discuss central-forward dijet production at LHC energies within the framework of high energy factorization. In our study, we profit from the recent progress on consistent merging of Sudakov resummation with small-$x$ effects, which allows us to compute two different gluon distributions which depend on longitudinal momentum, transverse momentum and the hard scale of the process: one for the quark channel and one for the gluon channel. The small-$x$ resummation is included by means of the BK equation supplemented with a kinematic constraint and subleading corrections. We test the new gluon distributions against existing CMS data for transverse momentum spectra in forward-central dijet production. We obtain results which are largely consistent with our earlier predictions based on model implementation of Sudakov form factors. In addition, we study dijet azimuthal decorrelations for the forward-central jets, which are known to be sensitive to the modeling of soft radiation.


title: Black holes in a type-II minimally modified gravity

abstract: In the context of the recently proposed type-II minimally modified gravity theory, i.e. a metric theory of gravity with two local physical degrees of freedom that does not possess an Einstein frame, we study spherically symmetric vacuum solutions to explore the strong gravity regime. Despite the absence of extra degrees of freedom in the gravity sector, the vacuum solutions are locally different from the Schwarzschild or Schwarzschild-(A)dS metric in general and thus the Birkhoff theorem does not hold. The general solutions are parameterized by several free functions of time and admit regular trapping and event horizons. Depending on the choice of the free functions of time, the null convergence condition may be violated in vacuum. Even in the static limit, while the solutions in this limit reduce to the Schwarzschild or Schwarzschild-(A)dS solutions, the effective cosmological constant deduced from the solutions is in general different from the cosmological value that is determined by the action. Nonetheless, once a set of suitable asymptotic conditions is imposed so that the solutions represent compact objects in the corresponding cosmological setup, the standard Schwarzschild or Schwarzschild-(A)dS metric is recovered and the effective cosmological constant agrees with the value inferred from the action.


title: Backward difference formula: The energy technique for subdiffusion equation

abstract: Based on the equivalence of A-stability and G-stability, the energy technique of the six-step BDF method for the heat equation has been discussed in [Akrivis, Chen, Yu, Zhou, Math. Comp., Revised]. Unfortunately, this theory is hard to extend the time-fractional PDEs. In this work, we consider three types of subdiffusion models, namely single-term, multi-term and distributed order fractional diffusion equations. We present a novel and concise stability analysis of time stepping schemes generated by $k$-step backward difference formula (BDF$k$), for approximately solving the subdiffusion equation. The analysis mainly relies on the energy technique by applying Grenander-Szeg\"{o} theorem. This kind of argument has been widely used to confirm the stability of various $A$-stable schemes (e.g., $k=1,2$). However, it is not an easy task for the higher-order BDF methods, due to the loss the $A$-stability. The core object of this paper is to fill in this gap.


title: Proofs of two conjectures on the real zeros of the cylinder and Airy functions

abstract: We prove the enveloping property of the known divergent asymptotic expansions of the large real zeros of the cylinder and Airy functions, and thereby answering in the affirmative two conjectures posed by Elbert and Laforgia and by Fabijonas and Olver, respectively. The essence of the proof is the construction of analytic functions that return the zeros when evaluated along certain discrete sets of real numbers. By manipulating contour integrals of these functions, we derive the asymptotic expansions of the large zeros truncated after a finite number of terms plus remainders that can be estimated efficiently. The conjectures are then deduced as corollaries of these estimates. An analogous result for the associated phase function is also discussed.


title: Dynamic Adversarial Patch for Evading Object Detection Models

abstract: Recent research shows that neural networks models used for computer vision (e.g., YOLO and Fast R-CNN) are vulnerable to adversarial evasion attacks. Most of the existing real-world adversarial attacks against object detectors use an adversarial patch which is attached to the target object (e.g., a carefully crafted sticker placed on a stop sign). This method may not be robust to changes in the camera's location relative to the target object; in addition, it may not work well when applied to nonplanar objects such as cars. In this study, we present an innovative attack method against object detectors applied in a real-world setup that addresses some of the limitations of existing attacks. Our method uses dynamic adversarial patches which are placed at multiple predetermined locations on a target object. An adversarial learning algorithm is applied in order to generate the patches used. The dynamic attack is implemented by switching between optimized patches dynamically, according to the camera's position (i.e., the object detection system's position). In order to demonstrate our attack in a real-world setup, we implemented the patches by attaching flat screens to the target object; the screens are used to present the patches and switch between them, depending on the current camera location. Thus, the attack is dynamic and adjusts itself to the situation to achieve optimal results. We evaluated our dynamic patch approach by attacking the YOLOv2 object detector with a car as the target object and succeeded in misleading it in up to 90% of the video frames when filming the car from a wide viewing angle range. We improved the attack by generating patches that consider the semantic distance between the target object and its classification. We also examined the attack's transferability among different car models and were able to mislead the detector 71% of the time.


title: Work and work-energy theorem in curved spacetime

abstract: The definitions of gravitational work as well as work done by the total external force on a massive probe particle moving in generic spacetime backgrounds are proposed. These definitions are given in the form of scalar integrals and thus, are independent of coordinate choices. However, the dependence on the choice of observer field is essential and inevitable. The definitions are checked in the case of Minkowski, Schwarzschild, Reisner-Nordstr\"om and Kerr-Newman spacetimes and agreements with Newtonian mechanical definitions are verified in the slow motion or the far field limit.


title: LIRO: Tightly Coupled Lidar-Inertia-Ranging Odometry

abstract: In recent years, thanks to the continuously reduced cost and weight of 3D Lidar, the applications of this type of sensor in robotics community have become increasingly popular. Despite many progresses, estimation drift and tracking loss are still prevalent concerns associated with these systems. However, in theory these issues can be resolved with the use of some observations to fixed landmarks in the environments. This motivates us to investigate a tightly coupled sensor fusion scheme of Ultra-Wideband (UWB) range measurements with Lidar and inertia measurements. First, data from IMU, Lidar and UWB are associated with the robot's states on a sliding windows based on their timestamps. Then, we construct a cost function comprising of factors from UWB, Lidar and IMU preintegration measurements. Finally an optimization process is carried out to estimate the robot's position and orientation. Via some real world experiments, we show that the method can effectively resolve the drift issue, while only requiring two or three anchors deployed in the environment.


title: Fast and Accurate Light Field Saliency Detection through Deep Encoding

abstract: Light field saliency detection -- important due to utility in many vision tasks -- still lacks speed and can improve in accuracy. Due to the formulation of the saliency detection problem in light fields as a segmentation task or a memorizing task, existing approaches consume unnecessarily large amounts of computational resources for training, and have longer execution times for testing. We solve this by aggressively reducing the large light field images to a much smaller three-channel feature map appropriate for saliency detection using an RGB image saliency detector with attention mechanisms. We achieve this by introducing a novel convolutional neural network based features extraction and encoding module. Our saliency detector takes $0.4$ s to process a light field of size $9\times9\times512\times375$ in a CPU and is significantly faster than state-of-the-art light field saliency detectors, with better or comparable accuracy. Furthermore, model size of our architecture is significantly lower compared to state-of-the-art light field saliency detectors. Our work shows that extracting features from light fields through aggressive size reduction and the attention mechanism results in a faster and accurate light field saliency detector leading to near real-time light field processing.


title: Topologically protected long-range coherent energy transfer

abstract: The realization of robust coherent energy transfer with a long range from a donor to an acceptor has many important applications in the field of quantum optics. However, it is hard to be realized using conventional schemes. Here, we demonstrate theoretically that the robust energy transfer can be achieved using a photonic crystal platform, which includes the topologically protected edge state and zero-dimensional topological corner cavities. When the donor and the acceptor are put into a pair of separated topological cavities, respectively, the energy transfer between them can be fulfilled with the assistance of the topologically protected interface state. Such an energy transfer is robust against various kinds of defects, and can also occur over very long distances, which is very beneficial for biological detections, sensors, quantum information science and so on.


title: Topologically protected strong coupling and entanglement between distant quantum emitters

abstract: The realization of robust strong coupling and entanglement between distant quantum emitters (QEs) is very important for scalable quantum information processes. However, it is hard to achieve it based on conventional systems. Here, we propose theoretically and demonstrate numerically a scheme to realize such strong coupling and entanglement. Our scheme is based on the photonic crystal platform with topologically protected edge state and zero-dimensional topological corner cavities. When the QEs are put into topological cavities, the strong coupling between them can be fulfilled with the assistance of the topologically protected interface state. Such a strong coupling can maintain a very long distance and be robust against various defects. Especially, we numerically prove that the topologically protected entanglement between two QEs can also be realized. Moreover, the duration of quantum beats for such entanglement can reach several orders longer than that for the entanglement in a conventional photonic cavity, making it be very beneficial for a scalable quantum information process.


title: Producing circle patterns via configurations

abstract: This paper studies circle patterns from the viewpoint of configurations. By using the topological degree theory, we extend the Koebe-Andreev-Thurston Theorem to include circle patterns with obtuse exterior intersection angles. As a consequence, we obtain a generalized Andreev's Theorem which allows obtuse dihedral angles.


title: Matrix-Analytic Methods for the analysis of Stochastic Fluid-Fluid Models

abstract: Stochastic fluid-fluid models (SFFMs) offer powerful modeling ability for a wide range of real-life systems of significance. The existing theoretical framework for this class of models is in terms of operator-analytic methods. For the first time, we establish matrix-analytic methods for the efficient analysis of SFFMs. We illustrate the theory with numerical examples.


title: Distributed Nash Equilibrium Seeking for Monotone Generalized Noncooperative Games by a Regularized Penalty Method

abstract: In this work, we study the distributed Nash equilibrium seeking problem for monotone generalized noncooperative games with set constraints and shared affine inequality constraints. A distributed regularized penalty method is proposed. The idea is to use a differentiable penalty function with a time-varying penalty parameter to deal with the inequality constraints. A time-varying regularization term is used to deal with the ill-poseness caused by the monotonicity assumption and the time-varying penalty term. The asymptotic convergence to the least-norm variational equilibrium of the game is proven. Numerical examples show the effectiveness and efficiency of the proposed algorithm.


title: Dwork hypersurfaces of degree six and Greene's hypergeometric function

abstract: In this paper, we give a formula for the number of rational points on the Dwork hypersurfaces of degree six over finite fields by using Greene's finite-field hypergeometric function, which is a generalization of Goodson's formula for the Dwork hypersurfaces of degree four. Our formula is also a higher-dimensional and a finite field analogue of Matsumoto-Terasoma-Yamazaki's formula. Furthermore, we also explain the relation between our formula and Miyatani's formula.


title: Exploiting Heterogeneous Graph Neural Networks with Latent Worker/Task Correlation Information for Label Aggregation in Crowdsourcing

abstract: Crowdsourcing has attracted much attention for its convenience to collect labels from non-expert workers instead of experts. However, due to the high level of noise from the non-experts, an aggregation model that learns the true label by incorporating the source credibility is required. In this paper, we propose a novel framework based on graph neural networks for aggregating crowd labels. We construct a heterogeneous graph between workers and tasks and derive a new graph neural network to learn the representations of nodes and the true labels. Besides, we exploit the unknown latent interaction between the same type of nodes (workers or tasks) by adding a homogeneous attention layer in the graph neural networks. Experimental results on 13 real-world datasets show superior performance over state-of-the-art models.


title: Performance Analysis of Demand-Oblivious and Demand-Aware Optical Datacenter Network Designs

abstract: This paper presents a performance analysis of the design space of optical datacenter networks, including both demand-oblivious (static or dynamic) and demand-aware networks. We formally show that the number of specific optical switch types which should be used in an optimized datacenter network, depends on the traffic pattern, and in particular, the flow size distribution.


title: Context Aware 3D UNet for Brain Tumor Segmentation

abstract: Deep convolutional neural network (CNN) achieves remarkable performance for medical image analysis. UNet is the primary source in the performance of 3D CNN architectures for medical imaging tasks, including brain tumor segmentation. The skip connection in the UNet architecture concatenates features from both encoder and decoder paths to extract multi-contextual information from image data. The multi-scaled features play an essential role in brain tumor segmentation. However, the limited use of features can degrade the performance of the UNet approach for segmentation. In this paper, we propose a modified UNet architecture for brain tumor segmentation. In the proposed architecture, we used densely connected blocks in both encoder and decoder paths to extract multi-contextual information from the concept of feature reusability. In addition, residual-inception blocks (RIB) are used to extract the local and global information by merging features of different kernel sizes. We validate the proposed architecture on the multi-modal brain tumor segmentation challenge (BRATS) 2020 testing dataset. The dice (DSC) scores of the whole tumor (WT), tumor core (TC), and enhancing tumor (ET) are 89.12%, 84.74%, and 79.12%, respectively.


title: How to Make Deep RL Work in Practice

abstract: In recent years, challenging control problems became solvable with deep reinforcement learning (RL). To be able to use RL for large-scale real-world applications, a certain degree of reliability in their performance is necessary. Reported results of state-of-the-art algorithms are often difficult to reproduce. One reason for this is that certain implementation details influence the performance significantly. Commonly, these details are not highlighted as important techniques to achieve state-of-the-art performance. Additionally, techniques from supervised learning are often used by default but influence the algorithms in a reinforcement learning setting in different and not well-understood ways. In this paper, we investigate the influence of certain initialization, input normalization, and adaptive learning techniques on the performance of state-of-the-art RL algorithms. We make suggestions which of those techniques to use by default and highlight areas that could benefit from a solution specifically tailored to RL.


title: Five-zero texture in neutrino-dark matter model within the framework of minimal extended seesaw

abstract: We study a model of neutrino and dark matter within the framework of a minimal extended seesaw. This model is based on $A_4$ flavour symmetry along with the discrete $Z_3\times Z_4$ symmetry to stabilize the dark matter and construct desired mass matrices for neutrino mass. Five-zero textures are imposed in the final $4\times4$ active-sterile mass matrix, which significantly reduces free parameter in the model. Three right-handed neutrinos were considered, two of them have nearly degenerate masses which help us to achieve baryogenesis via resonant leptogenesis. A singlet fermion (sterile neutrino) with mass $\sim\mathcal{O}$(eV) is also considered, and we are able to put bounds on active-sterile mixing parameters via neutrino oscillation data. Resonant enhancement of lepton asymmetry is studied at TeV scale, where we discuss a few aspects of baryogenesis considering the flavour effects. Possibility of improvement in effective mass from $0\nu\beta\beta$ in the presence of a single generation of sterile neutrino flavour is also studied within the fermion sector. In the scalar sector, the imaginary component of the complex singlet scalar is behaving as a potential dark matter candidate and simultaneously the real part of the complex scalar is associated with the fermion sector for sterile mass generation. A broad region of dark matter mass is analyzed from various annihilation processes, and the VEV of the complex scalar plays a pivotal role to achieve the observed relic density at the right ballpark.


title: Coherent Loss: A Generic Framework for Stable Video Segmentation

abstract: Video segmentation approaches are of great importance for numerous vision tasks especially in video manipulation for entertainment. Due to the challenges associated with acquiring high-quality per-frame segmentation annotations and large video datasets with different environments at scale, learning approaches shows overall higher accuracy on test dataset but lack strict temporal constraints to self-correct jittering artifacts in most practical applications. We investigate how this jittering artifact degrades the visual quality of video segmentation results and proposed a metric of temporal stability to numerically evaluate it. In particular, we propose a Coherent Loss with a generic framework to enhance the performance of a neural network against jittering artifacts, which combines with high accuracy and high consistency. Equipped with our method, existing video object/semantic segmentation approaches achieve a significant improvement in term of more satisfactory visual quality on video human dataset, which we provide for further research in this field, and also on DAVIS and Cityscape.


title: Entangled and correlated photon mixed strategy for social decision making

abstract: Collective decision making is important for maximizing total benefits while preserving equality among individuals in the competitive multi-armed bandit (CMAB) problem, wherein multiple players try to gain higher rewards from multiple slot machines. The CMAB problem represents an essential aspect of applications such as resource management in social infrastructure. In a previous study, we theoretically and experimentally demonstrated that entangled photons can physically resolve the difficulty of the CMAB problem. This decision-making strategy completely avoids decision conflicts while ensuring equality. However, decision conflicts can sometimes be beneficial if they yield greater rewards than non-conflicting decisions, indicating that greedy actions may provide positive effects depending on the given environment. In this study, we demonstrate a mixed strategy of entangled- and correlated-photon-based decision-making so that total rewards can be enhanced when compared to the entangled-photon-only decision strategy. We show that an optimal mixture of entangled- and correlated-photon-based strategies exists depending on the dynamics of the reward environment as well as the difficulty of the given problem. This study paves the way for utilizing both quantum and classical aspects of photons in a mixed manner for decision making and provides yet another example of the supremacy of mixed strategies known in game theory, especially in evolutionary game theory.


title: Crystallite-size Dependent Harmonic Magneto-electricity in SmFeO3

abstract: First- and second-harmonic dielectric susceptibilities are maidenly studied on Samarium Orthoferrite of mesoscopic/500 nm and nanoscopic/55 nm grainsizes. Magneto-electrically coupled to the antiferromagnetic and spin-reorientation transitions, fundamental and harmonic dielectricity consistently reflect the global/local polarization effects of crystallite-size dependent electrical orderings. Bulk and incipient ferroelectricity respectively in nanoscopic and mesoscopic crystallites concur the higher-temperature antiferromagnetic ordering (T_N ~670 K). Upon the spin-reorientation transition at lower-temperature (T_SR ~470 K), re-entrant relaxor state in the nano-crystallites and bulk-like/temperature-windowed ferroelectricity in the meso-crystallites emerge. In the nano-crystallites, magneto-electric signature of interfacial spins' de-pinning (T_SP ~540 K) is exclusively revealed by the scaled-harmonics.


title: High-field solution state DNP using cross-correlations

abstract: At the magnetic fields of common NMR instruments, electron Zeeman frequencies are too high for efficient electron-nuclear dipolar cross-relaxation to occur in solution. The rate of that process fades with the electron Zeeman frequency as omega^{-2} - in the absence of isotropic hyperfine couplings, liquid state dynamic nuclear polarisation (DNP) in high-field magnets is therefore impractical. However, contact coupling and dipolar cross-relaxation are not the only mechanisms that can move electron magnetisation to nuclei in liquids: multiple cross-correlated (CC) relaxation processes also exist, involving various combinations of interaction tensor anisotropies. The rates of some of those processes have more favourable high-field behaviour than dipolar cross-relaxation, but due to the difficulty of their numerical - and particularly analytical - treatment, they remain largely uncharted. In this communication, we report analytical evaluation of every rotationally driven relaxation process in liquid state for 1e1n and 2e1n spin systems, as well as numerical optimisations of the steady-state DNP with respect to spin Hamiltonian parameters. A previously unreported cross-correlation DNP (CCDNP) mechanism was identified for the 2e1n system, involving multiple relaxation interference effects and inter-electron exchange coupling. Using simulations, we found realistic spin Hamiltonian parameters that yield stronger nuclear polarisation at high magnetic fields than dipolar cross-relaxation.


title: Hidden spatiotemporal symmetries and intermittency in turbulence

abstract: We consider general infinite-dimensional dynamical systems with the Galilean and spatiotemporal scaling symmetry groups. Introducing the equivalence relation with respect to temporal scalings and Galilean transformations, we define a representative set containing a single element within each equivalence class. Temporal scalings and Galilean transformations do not commute with the evolution operator (flow) and, hence, the equivalence relation is not invariant. Despite of that, we prove that a normalized flow with an invariant probability measure can be introduced on the representative set, such that symmetries are preserved in the statistical sense. We focus on hidden symmetries, which are broken in the original system but restored in the normalized system. The central motivation and application of this construction is the intermittency phenomenon in turbulence. We show that hidden symmetries yield power law scaling for structure functions, and derive formulas for their exponents in terms of normalized measures. The use of Galilean transformation in the equivalence relation leads to the Quasi--Lagrangian description, making the developed theory applicable to the Euler and Navier-Stokes systems.


title: Crystal chemistry criteria of the existence of spin liquids on the kagome lattice

abstract: The structural-magnetic models of 25 AFM kagome cuprates similar to herbertsmithite (ZnCu3(OH)6Cl2) - a perspective spin liquid - have been calculated and analyzed. Main correlations between the structure and magnetic properties of these compounds were revealed. It has been demonstrated that, in all AFM kagome cuprates, including herbertsmithite, there exists the competition between the exchange interaction and the antisymmetric anisotropic exchange one (the Dzyaloshinskii-Moriya interaction), as magnetic ions are not linked to the center of inversion in the kagome lattice. This competition is strengthened in all the kagome AFM, except herbertsmithite, by one more type of the anisotropy (duality) of the third in length J3 magnetic couplings (strong J3(J12) next-to-nearest-neighbor couplings in linear chains along the triangle edges and very weak FM or AFM J3(Jd) couplings along the hexagon diagonals). The above couplings are crystallographically identical, but are divided to two types of different in strength magnetic interactions. The existence of duality of J3 couplings originated from the structure of the kagome lattice itself. Only combined contributions of dual J3 couplings with anisotropic DM interactions are capable to suppress frustration of kagome AFM. It has been demonstrated that the possibility of elimination of such a duality in herbertsmithite, which made it a spin liquid, constitutes a rare lucky event in the kagome system. Three crystal chemistry criteria of the existence of spin liquids on the kagome lattice have been identified: first, the presence of frustrated kagome lattices with strong dominant antiferromagnetic nearest-neighbor J1 couplings competing only with each other in small triangles; second, magnetic isolation of these frustrated kagome lattices; and third, the absence of duality of the third in length J3 magnetic couplings.


title: On the microscopic mechanisms behind hyperferroelectricity

abstract: Hyperferroelectrics are receiving a growing interest thanks to their unique property to retain a spontaneous polarization even in presence of a depolarizing field. Nevertheless, general microscopic mechanisms driving hyperferroelectricity, which is ascribed to the softening of a polar $LO$ mode, are still missing. Here, by means of phonons calculations and force constants analysis in two class of hyperferroelectrics, the ABO$_3$-LiNbO3-type systems and the prototypical hexagonal-ABC systems, we unveiled common features in the dynamical properties of a hyperferroelectric behind such $LO$ instability: negative or vanishing on-site force constant associated to the cation driving the $LO$ polar distortion, and destabilizing cation-anion interactions, both induced by short-range forces. We also predict possible enhancement of the hyperferroelectric properties by applying an external positive pressure; pressure strengthens the destabilizing short-range interactions. Particularly, the increase in the mode effective charges associated to the unstable $LO$ mode under pressure suggests an eventual enhancement of the $D$=0 polarization under compressive strain.


title: An Improved Event-Independent Network for Polyphonic Sound Event Localization and Detection

abstract: Polyphonic sound event localization and detection (SELD), which jointly performs sound event detection (SED) and direction-of-arrival (DoA) estimation, detects the type and occurrence time of sound events as well as their corresponding DoA angles simultaneously. We study the SELD task from a multi-task learning perspective. Two open problems are addressed in this paper. Firstly, to detect overlapping sound events of the same type but with different DoAs, we propose to use a trackwise output format and solve the accompanying track permutation problem with permutation-invariant training. Multi-head self-attention is further used to separate tracks. Secondly, a previous finding is that, by using hard parameter-sharing, SELD suffers from a performance loss compared with learning the subtasks separately. This is solved by a soft parameter-sharing scheme. We term the proposed method as Event Independent Network V2 (EINV2), which is an improved version of our previously-proposed method and an end-to-end network for SELD. We show that our proposed EINV2 for joint SED and DoA estimation outperforms previous methods by a large margin, and has comparable performance to state-of-the-art ensemble models.


title: Quantum Projective Planes Finite over their Centers

abstract: For a $3$-dimensional quantum polynomial algebra $A=\mathcal{A}(E,\sigma)$, Artin-Tate-Van den Bergh showed that $A$ is finite over its center if and only if $|\sigma|<\infty$. Moreover, Artin showed that if $A$ is finite over its center and $E\neq \mathbb{P}^2$, then $A$ has a fat point module, which plays an important role in noncommutative algebraic geometry, however the converse is not true in general. In this paper, we will show that, if $E\neq \mathbb{P}^2$, then $A$ has a fat point module if and only if the quantum projective plane $\mathsf{Proj}_{{\rm nc}} A$ is finite over its center in the sense of this paper if and only if $|\nu^*\sigma^3|<\infty$ where $\nu$ is the Nakayama automorphism of $A$.In particular, we will show that if the second Hessian of $E$ is zero, then $A$ has no fat point module.


title: Autoencoding Improves Pre-trained Word Embeddings

abstract: Prior work investigating the geometry of pre-trained word embeddings have shown that word embeddings to be distributed in a narrow cone and by centering and projecting using principal component vectors one can increase the accuracy of a given set of pre-trained word embeddings. However, theoretically, this post-processing step is equivalent to applying a linear autoencoder to minimise the squared l2 reconstruction error. This result contradicts prior work (Mu and Viswanath, 2018) that proposed to remove the top principal components from pre-trained embeddings. We experimentally verify our theoretical claims and show that retaining the top principal components is indeed useful for improving pre-trained word embeddings, without requiring access to additional linguistic resources or labelled data.


title: Anomalous Hall conductivity of the holographic $\mathbb{Z}_2$ Dirac semimetals

abstract: The anomalous spin Hall conductivity in the holographic model of Dirac semimetals with two Dirac nodes protected by the crystal symmetry has been elaborated. Such system besides the chiral anomaly possesses another anomaly which is related to the $\mathbb{Z}_2$ topological charge of the system. The holographic model of the system contains matter action with two $U(1)$-gauge fields as well as the appropriate combination of the Chern-Simons gauge terms. We also allow for the coupling of two gauge fields {\it via} the kinetic mixing parametrised by the coupling $\alpha$. The holographic approach in the probe limit enables us to obtain Hall conductivity. The aim of this work is to describe the phase transitions in the $\mathbb{Z}_2$ Dirac semimetals between the topologically trivial and non-trivial phases. Interestingly the anomalous Hall conductivity plays a role of the order parameter of this phase transition. The holographically found prefactor of the Hall conductivity in the topologically non-trivial phase, depends on the coupling $\alpha$ and the Chern - Simons couplings.


title: Deductive Stability Proofs for Ordinary Differential Equations

abstract: Stability is required for real world controlled systems as it ensures that those systems can tolerate small, real world perturbations around their desired operating states. This paper shows how stability for continuous systems modeled by ordinary differential equations (ODEs) can be formally verified in differential dynamic logic (dL). The key insight is to specify ODE stability by suitably nesting the dynamic modalities of dL with first-order logic quantifiers. Elucidating the logical structure of stability properties in this way has three key benefits: i) it provides a flexible means of formally specifying various stability properties of interest, ii) it yields rigorous proofs of those stability properties from dL's axioms with dL's ODE safety and liveness proof principles, and iii) it enables formal analysis of the relationships between various stability properties which, in turn, inform proofs of those properties. These benefits are put into practice through an implementation of stability proofs for several examples in KeYmaera X, a hybrid systems theorem prover based on dL.


title: The $\lambda$-point anomaly in view of the seven-loop Hypergeometric resummation for the critical exponent $\nu$ of the $O(2)$ $\phi^4$ model

abstract: In this work, we use a specific parameterization of the hypergeometric approximants ( the one by Mera et.al in Phys. Rev. Let. 115, 143001 (2015)) to approximate the seven-loop critical exponent $\nu$ for the $O(2)$-symmetric $\phi^4$ model. Our prediction gives the result $\nu=0.6711(7)$ which is compatible with the value $\nu=0.6709(1)$ from the famous experiment carried on the space shuttle Columbia. On the other hand, our result is also compatible with recent precise theoretical predictions that are excluding the experimental result. These theoretical results include non-perturbative renormalization group calculations ( $\nu=0.6716(6)$), the most precise result from Monte Carlo simulations ($\nu=0.67169(7)$) as well as the recent conformal bootstrap calculations ($\nu=0.67175(10)$). Although our result is compatible with experiment, the plot of renormalization group result versus the number of loops suggests that higher orders are expected to add significantly to accuracy and precision of the $\nu$ exponent in a way that may favor the theoretical predictions.


title: On the geometry of Banach spaces of the form $\mathrm{Lip}_0(C(K))$

abstract: We investigate the problem of classifying the Banach spaces $\mathrm{Lip}_0(C(K))$ for Hausdorff compacta $K$. In particular, sufficient conditions are established for a space $\mathrm{Lip}_0(C(K))$ to be isomorphic to $\mathrm{Lip}_0(c_0(\varGamma))$ for some uncountable set $\varGamma$.


title: Real-Time Variable-to-Fixed Lossless Source Coding of Randomly Arriving Symbols

abstract: We address the recently suggested problem of causal lossless coding of a randomly arriving source samples. We construct variable-to-fixed coding schemes and show that they outperform the previously considered fixed-to-variable schemes when traffic is high both in terms of delay and Age of Information by appealing to tools from queueing theory. We supplement our theoretical bounds with numerical simulations.


title: Tensor Casting: Co-Designing Algorithm-Architecture for Personalized Recommendation Training

abstract: Personalized recommendations are one of the most widely deployed machine learning (ML) workload serviced from cloud datacenters. As such, architectural solutions for high-performance recommendation inference have recently been the target of several prior literatures. Unfortunately, little have been explored and understood regarding the training side of this emerging ML workload. In this paper, we first perform a detailed workload characterization study on training recommendations, root-causing sparse embedding layer training as one of the most significant performance bottlenecks. We then propose our algorithm-architecture co-design called Tensor Casting, which enables the development of a generic accelerator architecture for tensor gather-scatter that encompasses all the key primitives of training embedding layers. When prototyped on a real CPU-GPU system, Tensor Casting provides 1.9-21x improvements in training throughput compared to state-of-the-art approaches.