title: Spatial prediction of apartment rent using regression-based and machine learning-based approaches with a large dataset

abstract: Employing a large dataset (at most, the order of n = 10^6), this study attempts enhance the literature on the comparison between regression and machine learning (ML)-based rent price prediction models by adding new empirical evidence and considering the spatial dependence of the observations. The regression-based approach incorporates the nearest neighbor Gaussian processes (NNGP) model, enabling the application of kriging to large datasets. In contrast, the ML-based approach utilizes typical models: extreme gradient boosting (XGBoost), random forest (RF), and deep neural network (DNN). The out-of-sample prediction accuracy of these models was compared using Japanese apartment rent data, with a varying order of sample sizes (i.e., n = 10^4, 10^5, 10^6). The results showed that, as the sample size increased, XGBoost and RF outperformed NNGP with higher out-of-sample prediction accuracy. XGBoost achieved the highest prediction accuracy for all sample sizes and error measures in both logarithmic and real scales and for all price bands (when n = 10^5 and 10^6). A comparison of several methods to account for the spatial dependence in RF showed that simply adding spatial coordinates to the explanatory variables may be sufficient.


title: A Neurorobotics Approach to Behaviour Selection based on Human Activity Recognition

abstract: Behaviour selection has been an active research topic for robotics, in particular in the field of human-robot interaction. For a robot to interact effectively and autonomously with humans, the coupling between techniques for human activity recognition, based on sensing information, and robot behaviour selection, based on decision-making mechanisms, is of paramount importance. However, most approaches to date consist of deterministic associations between the recognised activities and the robot behaviours, neglecting the uncertainty inherent to sequential predictions in real-time applications. In this paper, we address this gap by presenting a neurorobotics approach based on computational models that resemble neurophysiological aspects of living beings. This neurorobotics approach was compared to a non-bioinspired, heuristics-based approach. To evaluate both approaches, a robot simulation is developed, in which a mobile robot has to accomplish tasks according to the activity being performed by the inhabitant of an intelligent home. The outcomes of each approach were evaluated according to the number of correct outcomes provided by the robot. Results revealed that the neurorobotics approach is advantageous, especially considering the computational models based on more complex animals.


title: BridgeNet: A Joint Learning Network of Depth Map Super-Resolution and Monocular Depth Estimation

abstract: Depth map super-resolution is a task with high practical application requirements in the industry. Existing color-guided depth map super-resolution methods usually necessitate an extra branch to extract high-frequency detail information from RGB image to guide the low-resolution depth map reconstruction. However, because there are still some differences between the two modalities, direct information transmission in the feature dimension or edge map dimension cannot achieve satisfactory result, and may even trigger texture copying in areas where the structures of the RGB-D pair are inconsistent. Inspired by the multi-task learning, we propose a joint learning network of depth map super-resolution (DSR) and monocular depth estimation (MDE) without introducing additional supervision labels. For the interaction of two subnetworks, we adopt a differentiated guidance strategy and design two bridges correspondingly. One is the high-frequency attention bridge (HABdg) designed for the feature encoding process, which learns the high-frequency information of the MDE task to guide the DSR task. The other is the content guidance bridge (CGBdg) designed for the depth map reconstruction process, which provides the content guidance learned from DSR task for MDE task. The entire network architecture is highly portable and can provide a paradigm for associating the DSR and MDE tasks. Extensive experiments on benchmark datasets demonstrate that our method achieves competitive performance. Our code and models are available at https://rmcong.github.io/proj_BridgeNet.html.


title: Energy-based Unknown Intent Detection with Data Manipulation

abstract: Unknown intent detection aims to identify the out-of-distribution (OOD) utterance whose intent has never appeared in the training set. In this paper, we propose using energy scores for this task as the energy score is theoretically aligned with the density of the input and can be derived from any classifier. However, high-quality OOD utterances are required during the training stage in order to shape the energy gap between OOD and in-distribution (IND), and these utterances are difficult to collect in practice. To tackle this problem, we propose a data manipulation framework to Generate high-quality OOD utterances with importance weighTs (GOT). Experimental results show that the energy-based detector fine-tuned by GOT can achieve state-of-the-art results on two benchmark datasets.


title: Ramanujan's trigonometric sums and para-orthogonal polynomials on the unit circle

abstract: Ramanujan's trigonometric sum $c_q(n)$ can be interpreted as a set of trigonometric moments of a finite measure concentrated at primitive $q$-th roots of unity with equal masses. This gives rise to sets of corresponding polynomials orthogonal on the unit circle. We present explicit expressions of these polynomials for special values of $q$, e.g. when $q=p$ or $q=2p$ or $q=p^k$, where $p$ is a prime number. We generalize this procedure taking the Kronecker polynomial instead of cyclotomic one. In this case the moments are expressed as finite sums of $c_q(n)$ with different $q$.


title: Human-Level Reinforcement Learning through Theory-Based Modeling, Exploration, and Planning

abstract: Reinforcement learning (RL) studies how an agent comes to achieve reward in an environment through interactions over time. Recent advances in machine RL have surpassed human expertise at the world's oldest board games and many classic video games, but they require vast quantities of experience to learn successfully -- none of today's algorithms account for the human ability to learn so many different tasks, so quickly. Here we propose a new approach to this challenge based on a particularly strong form of model-based RL which we call Theory-Based Reinforcement Learning, because it uses human-like intuitive theories -- rich, abstract, causal models of physical objects, intentional agents, and their interactions -- to explore and model an environment, and plan effectively to achieve task goals. We instantiate the approach in a video game playing agent called EMPA (the Exploring, Modeling, and Planning Agent), which performs Bayesian inference to learn probabilistic generative models expressed as programs for a game-engine simulator, and runs internal simulations over these models to support efficient object-based, relational exploration and heuristic planning. EMPA closely matches human learning efficiency on a suite of 90 challenging Atari-style video games, learning new games in just minutes of game play and generalizing robustly to new game situations and new levels. The model also captures fine-grained structure in people's exploration trajectories and learning dynamics. Its design and behavior suggest a way forward for building more general human-like AI systems.


title: Double Deep Q-learning Based Real-Time Optimization Strategy for Microgrids

abstract: The uncertainties from distributed energy resources (DERs) bring significant challenges to the real-time operation of microgrids. In addition, due to the nonlinear constraints in the AC power flow equation and the nonlinearity of the battery storage model, etc., the optimization of the microgrid is a mixed-integer nonlinear programming (MINLP) problem. It is challenging to solve this kind of stochastic nonlinear optimization problem. To address the challenge, this paper proposes a deep reinforcement learning (DRL) based optimization strategy for the real-time operation of the microgrid. Specifically, we construct the detailed operation model for the microgrid and formulate the real-time optimization problem as a Markov Decision Process (MDP). Then, a double deep Q network (DDQN) based architecture is designed to solve the MINLP problem. The proposed approach can learn a near-optimal strategy only from the historical data. The effectiveness of the proposed algorithm is validated by the simulations on a 10-bus microgrid system and a modified IEEE 69-bus microgrid system. The numerical simulation results demonstrate that the proposed approach outperforms several existing methods.


title: Einstein-{\ae}ther Scalar-tensor Cosmology

abstract: We propose an Einstein-{\ae}ther scalar-tensor cosmological model. In particular in the scalar-tensor Action Integral we introduce the {\ae}ther field with {\ae}ther coefficients to be functions of the scalar field. This cosmological model extends previous studies on Lorentz-violating theories. For a spatially flat Friedmann--Lema\^{\i}tre--Robertson--Walker background space we write the field equations which are of second-order with dynamical variables the scale factor and the scalar field. The physical evolution of the field equations depends upon three unknown functions which are related to the scalar-tensor coupling function, the scalar field potential and the {\ae}ther coefficient functions. We investigate the existence of analytic solutions for the field equations and the integrability properties according to the existence of linear in the momentum conservation laws. We define a new set of variables in which the dynamical evolution depends only upon the scalar field potential. Furthermore, the asymptotic behaviour and the cosmological history is investigated where we find that the theory provides inflationary eras similar with that of scalar-tensor theory but with Lorentz-violating terms provided by the {\ae}ther field. Finally, in the new variables we found that the field equations are integrable due to the existence of nonlocal conservation laws for arbitrary functional forms of the three free functions.


title: Probing neural networks with t-SNE, class-specific projections and a guided tour

abstract: We use graphical methods to probe neural nets that classify images. Plots of t-SNE outputs at successive layers in a network reveal increasingly organized arrangement of the data points. They can also reveal how a network can diminish or even forget about within-class structure as the data proceeds through layers. We use class-specific analogues of principal components to visualize how succeeding layers separate the classes. These allow us to sort images from a given class from most typical to least typical (in the data) and they also serve as very useful projection coordinates for data visualization. We find them especially useful when defining versions guided tours for animated data visualization.


title: KG4Vis: A Knowledge Graph-Based Approach for Visualization Recommendation

abstract: Visualization recommendation or automatic visualization generation can significantly lower the barriers for general users to rapidly create effective data visualizations, especially for those users without a background in data visualizations. However, existing rule-based approaches require tedious manual specifications of visualization rules by visualization experts. Other machine learning-based approaches often work like black-box and are difficult to understand why a specific visualization is recommended, limiting the wider adoption of these approaches. This paper fills the gap by presenting KG4Vis, a knowledge graph (KG)-based approach for visualization recommendation. It does not require manual specifications of visualization rules and can also guarantee good explainability. Specifically, we propose a framework for building knowledge graphs, consisting of three types of entities (i.e., data features, data columns and visualization design choices) and the relations between them, to model the mapping rules between data and effective visualizations. A TransE-based embedding technique is employed to learn the embeddings of both entities and relations of the knowledge graph from existing dataset-visualization pairs. Such embeddings intrinsically model the desirable visualization rules. Then, given a new dataset, effective visualizations can be inferred from the knowledge graph with semantically meaningful rules. We conducted extensive evaluations to assess the proposed approach, including quantitative comparisons, case studies and expert interviews. The results demonstrate the effectiveness of our approach.


title: DISP6D: Disentangled Implicit Shape and Pose Learning for Scalable 6D Pose Estimation

abstract: Scalable 6D pose estimation for rigid objects from RGB images aims at handling multiple objects and generalizing to novel objects. Building on a well-known auto-encoding framework to cope with object symmetry and the lack of labeled training data, we achieve scalability by disentangling the latent representation of auto-encoder into shape and pose sub-spaces. The latent shape space models the similarity of different objects through contrastive metric learning, and the latent pose code is compared with canonical rotations for rotation retrieval. Because different object symmetries induce inconsistent latent pose spaces, we re-entangle the shape representation with canonical rotations to generate shape-dependent pose codebooks for rotation retrieval. We show state-of-the-art performance on two benchmarks containing textureless CAD objects without category and daily objects with categories respectively, and further demonstrate improved scalability by extending to a more challenging setting of daily objects across categories.


title: Accelerated Multiple Precision Direct Method and Mixed Precision Iterative Refinement on Python Programming Environment

abstract: Current Python programming environment does not have any reliable and efficient multiple precision floating-point (MPF) arithmetic except ``mpmath" and ``gmpy2" packages based on GNU MP(GMP) and MPFR libraries. Although it is well known that multi-component-type MPF library can be utilized for middle length precision arithmetic under 200 bits, they are not widely used on Python environment. In this paper, we describe our accelerated MPF direct method with AVX2 techniques and its application to mixed precision iterative refinement combined with mpmath, and demonstrate their efficiency on x86\_64 computational environments.


title: Open quantum dynamics theory on the basis of periodical system-bath model for discrete Wigner function

abstract: Discretizing a distribution function in a phase space for an efficient quantum dynamics simulation is a non-trivial challenge, in particular for a case that a system is further coupled to environmental degrees of freedom. Such open quantum dynamics is described by a reduced equation of motion (REOM) most notably by a quantum Fokker-Planck equation (QFPE) for a Wigner distribution function (WDF). To develop a discretization scheme that is stable for numerical simulations from the REOM approach, we employ a two-dimensional (2D) periodically invariant system-bath (PISB) model with two heat baths. This model is an ideal platform not only for a periodic system but also for a non-periodic system confined by a potential. We then derive the numerically ''exact'' hierarchical equations of motion (HEOM) for a discrete WDF in terms of periodically invariant operators in both coordinate and momentum spaces. The obtained equations can treat non-Markovian heat-bath in a non-perturbative manner at finite temperatures regardless of the mesh size. As demonstrations, we numerically integrate the discrete QFPE for a 2D free rotor and harmonic potential systems in a high-temperature Markovian case using a coarse mesh with initial conditions that involve singularity.


title: Estimating high-dimensional Markov-switching VARs

abstract: Maximum likelihood estimation of large Markov-switching vector autoregressions (MS-VARs) can be challenging or infeasible due to parameter proliferation. To accommodate situations where dimensionality may be of comparable order to or exceeds the sample size, we adopt a sparse framework and propose two penalized maximum likelihood estimators with either the Lasso or the smoothly clipped absolute deviation (SCAD) penalty. We show that both estimators are estimation consistent, while the SCAD estimator also selects relevant parameters with probability approaching one. A modified EM-algorithm is developed for the case of Gaussian errors and simulations show that the algorithm exhibits desirable finite sample performance. In an application to short-horizon return predictability in the US, we estimate a 15 variable 2-state MS-VAR(1) and obtain the often reported counter-cyclicality in predictability. The variable selection property of our estimators helps to identify predictors that contribute strongly to predictability during economic contractions but are otherwise irrelevant in expansions. Furthermore, out-of-sample analyses indicate that large MS-VARs can significantly outperform "hard-to-beat" predictors like the historical average.


title: Search for chargino-neutralino production in events with Higgs and W bosons using 137 fb$^{-1}$ of proton-proton collisions at $\sqrt{s} =$ 13 TeV

abstract: A search for electroweak production of supersymmetric (SUSY) particles in final states with one lepton, a Higgs boson decaying to a pair of bottom quarks, and large missing transverse momentum is presented. The search uses data from proton-proton collisions at a center-of-mass energy of 13 TeV collected using the CMS detector at the LHC, corresponding to an integrated luminosity of 137 fb$^{-1}$. The observed yields are consistent with backgrounds expected from the standard model. The results are interpreted in the context of a simplified SUSY model of chargino-neutralino production, with the chargino decaying to a W boson and the lightest SUSY particle (LSP) and the neutralino decaying to a Higgs boson and the LSP. Charginos and neutralinos with masses up to 820 GeV are excluded at 95% confidence level when the LSP mass is small, and LSPs with mass up to 350 GeV are excluded when the masses of the chargino and neutralino are approximately 700 GeV.


title: Bi-Directional Grid Constrained Stochastic Processes' Link to Multi-Skew Brownian Motion

abstract: Bi-Directional Grid Constrained (BGC) stochastic processes (BGCSPs) constrain the random movement toward the origin steadily more and more, the further they deviate from the origin, rather than all at once imposing reflective barriers, as does the well-established theory of It^o diffusions with such reflective barriers. We identify that BGCSPs are a variant rather than a special case of the multi-skew Brownian motion (M-SBM). This is because they have their own complexities, such as the barriers being hidden (not known in advance) and not necessarily constant over time. We provide an M-SBM theoretical framework and also a simulation framework to elaborate deeper properties of BGCSPs. The simulation framework is then applied by generating numerous simulations of the constrained paths and the results are analysed. BGCSPs have applications in finance and indeed many other fields requiring graduated constraining, from both above and below the initial position.


title: Iwasawa Theory for $p$-torsion Class Group Schemes in Characteristic $p$

abstract: We investigate a novel geometric Iwasawa theory for $\mathbf{Z}_p$-extensions of function fields over a perfect field $k$ of characteristic $p>0$ by replacing the usual study of $p$-torsion in class groups with the study of $p$-torsion class group schemes. That is, if $\cdots \to X_2 \to X_1 \to X_0$ is the tower of curves over $k$ associated to a $\mathbf{Z}_p$-extension of function fields totally ramified over a finite non-empty set of places, we investigate the growth of the $p$-torsion group scheme in the Jacobian of $X_n$ as $n\rightarrow \infty$. By Dieudonn\'e theory, this amounts to studying the first de Rham cohomology groups of $X_n$ equipped with natural actions of Frobenius and of the Cartier operator $V$. We formulate and test a number of conjectures which predict striking regularity in the $k[V]$-module structure of the space $M_n:=H^0(X_n, \Omega^1_{X_n/k})$ of global regular differential forms as $n\rightarrow \infty.$ For example, for each tower in a basic class of $\mathbf{Z}_p$-towers we conjecture that the dimension of the kernel of $V^r$ on $M_n$ is given by $a_r p^{2n} + \lambda_r n + c_r(n)$ for all $n$ sufficiently large, where $a_r, \lambda_r$ are rational constants and $c_r : \mathbf{Z}/m_r \mathbf{Z} \to \mathbf{Q}$ is a periodic function, depending on $r$ and the tower. To provide evidence for these conjectures, we collect extensive experimental data based on new and more efficient algorithms for working with differentials on $\mathbf{Z}_p$-towers of curves, and we prove our conjectures in the case $p=2$ and $r=1$.


title: The Keck Planet Imager and Characterizer: A dedicated single-mode fiber injection unit for high resolution exoplanet spectroscopy

abstract: The Keck Planet Imager and Characterizer (KPIC) is a purpose-built instrument to demonstrate new technological and instrumental concepts initially developed for the exoplanet direct imaging field. Located downstream of the current Keck II adaptive optic system, KPIC contains a fiber injection unit (FIU) capable of combining the high-contrast imaging capability of the adaptive optics system with the high dispersion spectroscopy capability of the current Keck high resolution infrared spectrograph (NIRSPEC). Deployed at Keck in September 2018, this instrument has already been used to acquire high resolution spectra ($R > 30,000$) of multiple targets of interest. In the near term, it will be used to spectrally characterize known directly imaged exoplanets and low-mass brown dwarf companions visible in the northern hemisphere with a spectral resolution high enough to enable spin and planetary radial velocity measurements as well as Doppler imaging of atmospheric weather phenomena. Here we present the design of the FIU, the unique calibration procedures needed to operate a single-mode fiber instrument and the system performance.


title: Frobenius manifolds on orbits spaces

abstract: The orbits space of an irreducible linear representation of a finite group is a variety whose coordinate ring is the ring of invariant polynomials. Boris Dubrovin proved that the orbits space of the standard reflection representation of an irreducible finite Coxeter group $\mathcal W$ acquires a natural polynomial Frobenius manifold structure. We apply Dubrovin's method on various orbits spaces of linear representations of finite groups. We find some of them has non or several natural Frobenius manifold structures. On the other hand, these Frobenius manifold structures include rational and trivial structures which are not known to be related to the invariant theory of finite groups.


title: A new deduce of the strict binding inequality and its application: Ground state normalized solution to Schr\"odinger equations with potential

abstract: In the present paper, we prove the existence of solutions $(\lambda, u)\in \R\times H^1(\R^N)$ to the following elliptic equations with potential $\displaystyle -\Delta u+(V(x)+\lambda)u=g(u)\;\hbox{in}\;\R^N, $ satisfying the normalization constraint $\displaystyle \int_{\R^N}u^2=a>0,$ which is deduced by searching for solitary wave solution to the time-dependent nonlinear Schr\"odinger equations. Besides the importance in the applications, not negligible reasons of our interest for such problems with potential $V(x)$ are their stimulating and challenging mathematical difficulties. We develop an interesting way basing on iteration and give a new proof of the so-called "sub-additive inequality", which can simply the standard process in the traditional sense. Under some very relax assumption on the potential $V(x)$ and some other suitable assumptions on $g$, we can obtain the existence of ground state solution for prescribed $a>0$.


title: Determining the Indeterminate: On the Evaluation of Integrals that connect Riemann's, Hurwitz' and Dirichlet's Zeta, Eta and Beta functions

abstract: By applying the inverse Mellin transform to some simple closed form identities, a number of relationships are established that connect integrals containing Riemann's and Hurwitz' zeta functions and their alternating equivalents. Interesting special cases involving improper integrals containing $\zeta(\sigma+it)$ and a minimum of other functions in the integrand are identified. Many of these integrals do not appear in the literature and can be verified numerically. In one limit, the use of analytic continuation generates a family of improper integrals containing only the real and imaginary parts of $\zeta(\sigma+it)$ with and without simple trigonometric factors; the associated closed form contains an (unclassified) entity that has many of the attributes of an essential singularity, but probably is not. Consequently, this means that the associated integrals are indeterminate (i.e. non-single valued), so a new symbol is introduced to label the indeterminism. Much of this paper studies this singularity from several angles in an attempt to resolve the associated ambiguities. This is done by establishing a self-consistent way to remove the singularity and thereby evaluate members of the family. These new closed-form identities provide insight into the value of integrals of general interest. Some implications are proposed.


title: Perception-and-Regulation Network for Salient Object Detection

abstract: Effective fusion of different types of features is the key to salient object detection. The majority of existing network structure design is based on the subjective experience of scholars and the process of feature fusion does not consider the relationship between the fused features and highest-level features. In this paper, we focus on the feature relationship and propose a novel global attention unit, which we term the "perception- and-regulation" (PR) block, that adaptively regulates the feature fusion process by explicitly modeling interdependencies between features. The perception part uses the structure of fully-connected layers in classification networks to learn the size and shape of objects. The regulation part selectively strengthens and weakens the features to be fused. An imitating eye observation module (IEO) is further employed for improving the global perception ability of the network. The imitation of foveal vision and peripheral vision enables IEO to scrutinize highly detailed objects and to organize the broad spatial scene to better segment objects. Sufficient experiments conducted on SOD datasets demonstrate that the proposed method performs favorably against 22 state-of-the-art methods.


title: Resistance distance distribution in large sparse random graphs

abstract: We consider an Erdos-Renyi random graph consisting of N vertices connected by randomly and independently drawing an edge between every pair of them with probability c/N so that at N->infinity one obtains a graph of finite mean degree c. In this regime, we study the distribution of resistance distances between the vertices of this graph and develop an auxiliary field representation for this quantity in the spirit of statistical field theory. Using this representation, a saddle point evaluation of the resistance distance distribution is possible at N->infinity in terms of an 1/c expansion. The leading order of this expansion captures the results of numerical simulations very well down to rather small values of c; for example, it recovers the empirical distribution at c=4 or 6 with an overlap of around 90%. At large values of c, the distribution tends to a Gaussian of mean 2/c and standard deviation sqrt{2/c^3}. At small values of c, the distribution is skewed toward larger values, as captured by our saddle point analysis, and many fine features appear in addition to the main peak, including subleading peaks that can be traced back to resistance distances between vertices of specific low degrees and the rest of the graph. We develop a more refined saddle point scheme that extracts the corresponding degree-differentiated resistance distance distributions. We then use this approach to recover analytically the most apparent of the subleading peaks that originates from vertices of degree 1. Rather intuitively, this subleading peak turns out to be a copy of the main peak, shifted by one unit of resistance distance and scaled down by the probability for a vertex to have degree 1. We comment on a possible lack of smoothness in the true N->infinity distribution suggested by the numerics.

categories: cond-mat.dis-nn cond-mat.stat-mech hep-th math-ph math.MP math.PR


title: Cross-speaker Style Transfer with Prosody Bottleneck in Neural Speech Synthesis

abstract: Cross-speaker style transfer is crucial to the applications of multi-style and expressive speech synthesis at scale. It does not require the target speakers to be experts in expressing all styles and to collect corresponding recordings for model training. However, the performances of existing style transfer methods are still far behind real application needs. The root causes are mainly twofold. Firstly, the style embedding extracted from single reference speech can hardly provide fine-grained and appropriate prosody information for arbitrary text to synthesize. Secondly, in these models the content/text, prosody, and speaker timbre are usually highly entangled, it's therefore not realistic to expect a satisfied result when freely combining these components, such as to transfer speaking style between speakers. In this paper, we propose a cross-speaker style transfer text-to-speech (TTS) model with explicit prosody bottleneck. The prosody bottleneck builds up the kernels accounting for speaking style robustly, and disentangles the prosody from content and speaker timbre, therefore guarantees high quality cross-speaker style transfer. Evaluation result shows the proposed method even achieves on-par performance with source speaker's speaker-dependent (SD) model in objective measurement of prosody, and significantly outperforms the cycle consistency and GMVAE-based baselines in objective and subjective evaluations.


title: Parallel Detection for Efficient Video Analytics at the Edge

abstract: Deep Neural Network (DNN) trained object detectors are widely deployed in many mission-critical systems for real time video analytics at the edge, such as autonomous driving and video surveillance. A common performance requirement in these mission-critical edge services is the near real-time latency of online object detection on edge devices. However, even with well-trained DNN object detectors, the online detection quality at edge may deteriorate for a number of reasons, such as limited capacity to run DNN object detection models on heterogeneous edge devices, and detection quality degradation due to random frame dropping when the detection processing rate is significantly slower than the incoming video frame rate. This paper addresses these problems by exploiting multi-model multi-device detection parallelism for fast object detection in edge systems with heterogeneous edge devices. First, we analyze the performance bottleneck of running a well-trained DNN model at edge for real time online object detection. We use the offline detection as a reference model, and examine the root cause by analyzing the mismatch among the incoming video streaming rate, video processing rate for object detection, and output rate for real time detection visualization of video streaming. Second, we study performance optimizations by exploiting multi-model detection parallelism. We show that the model-parallel detection approach can effectively speed up the FPS detection processing rate, minimizing the FPS disparity with the incoming video frame rate on heterogeneous edge devices. We evaluate the proposed approach using SSD300 and YOLOv3 on benchmark videos of different video stream rates. The results show that exploiting multi-model detection parallelism can speed up the online object detection processing rate and deliver near real-time object detection performance for efficient video analytics at edge.


title: Normalized solutions for nonlinear Schr\"odinger systems with special mass-mixed terms: The linear couple case

abstract: In this paper, we prove the existence of positive solutions $(\lambda_1,\lambda_2, u,v)\in \R^2\times H^1(\R^N, \R^2)$ to the following coupled Schr\"odinger system $$\begin{cases} -\Delta u + \lambda_1 u= \mu_1|u|^{p-2}u+\beta v \quad &\hbox{in}\;\RN, \\ -\Delta v + \lambda_2 v= \mu_2|v|^{q-2}v+\beta u \quad &\hbox{in}\;\RN, \end{cases}$$ satisfying the normalization constraints $\displaystyle\int_{\RN}u^2 =a, ~ \int_{\RN}v^2 =b$. The parameters $\mu_1,\mu_2,\beta>0$ are prescribed and the masses $a,b>0$. Here $2+\frac{4}{N}<p,q\leq 2^*$, where $2^* = \frac{2N}{N-2} $ if $N \geq 3$ and $2^* =+ \infty $ if $N=2$. So that the terms $\mu_1|u|^{p-2}u$,$\mu_2|v|^{q-2}v$ are of the so-called mass supercritical, while the linear couple terms $\beta v, \beta u$ are of mass subcritical. An essential novelty is that this is the first try to deal with the linear couples in the normalized solution frame with mass mixed terms, which are big nuisances due to the lack of compactness of the embedding $H^1(\R^N)\hookrightarrow L^2(\R^N)$, even working in the radial subspace. For the Sobolev subcritical case, we can obtain the existence of positive ground state solution for any given $a,b>0$ and $\beta>0$, provided $2\leqslant N\leqslant 4$. For the Sobolev critical case with $N=3,4$, it can be viewed as a counterpart of the Brezis-Nirenberg critical semilinear elliptic problem for the system case in the context of normalized solutions. Under some suitable assumptions, we obtain the existence or non-existence of positive normalized ground state solution.


title: A Biomedically oriented automatically annotated Twitter COVID-19 Dataset

abstract: The use of social media data, like Twitter, for biomedical research has been gradually increasing over the years. With the COVID-19 pandemic, researchers have turned to more nontraditional sources of clinical data to characterize the disease in near real-time, study the societal implications of interventions, as well as the sequelae that recovered COVID-19 cases present (Long-COVID). However, manually curated social media datasets are difficult to come by due to the expensive costs of manual annotation and the efforts needed to identify the correct texts. When datasets are available, they are usually very small and their annotations do not generalize well over time or to larger sets of documents. As part of the 2021 Biomedical Linked Annotation Hackathon, we release our dataset of over 120 million automatically annotated tweets for biomedical research purposes. Incorporating best practices, we identify tweets with potentially high clinical relevance. We evaluated our work by comparing several SpaCy-based annotation frameworks against a manually annotated gold-standard dataset. Selecting the best method to use for automatic annotation, we then annotated 120 million tweets and released them publicly for future downstream usage within the biomedical domain.


title: Thunder CTF: Learning Cloud Security on a Dime

abstract: Organizations have rapidly shifted infrastructure and applications over to public cloud computing services such as AWS (Amazon Web Services), Google Cloud Platform, and Azure. Unfortunately, such services have security models that are substantially different and more complex than traditional enterprise security models. As a result, misconfiguration errors in cloud deployments have led to dozens of well-publicized breaches. This paper describes Thunder CTF, a scaffolded, scenario-based CTF (Capture-the-Flag) for helping students learn about and practice cloud security skills. Thunder CTF is easily deployed at minimal cost and is highly extensible to allow for crowd-sourced development of new levels as security issues evolve in the cloud.


title: Guided Optimization for Image Processing Pipelines

abstract: Writing high-performance image processing code is challenging and labor-intensive. The Halide programming language simplifies this task by decoupling high-level algorithms from "schedules" which optimize their implementation. However, even with this abstraction, it is still challenging for Halide programmers to understand complicated scheduling strategies and productively write valid, optimized schedules. To address this, we propose a programming support method called "guided optimization." Guided optimization provides programmers a set of valid optimization options and interactive feedback about their current choices, which enables them to comprehend and efficiently optimize image processing code without the time-consuming trial-and-error process of traditional text editors. We implemented a proof-of-concept system, Roly-poly, which integrates guided optimization, program visualization, and schedule cost estimation to support the comprehension and development of efficient Halide image processing code. We conducted a user study with novice Halide programmers and confirmed that Roly-poly and its guided optimization was informative, increased productivity, and resulted in higher-performing schedules in less time.


title: Version Space Algebras are Acyclic Tree Automata

abstract: Version space algebras are ways of representing spaces of programs which can be combined using union, intersection, and cross-product/``join" operators. In their reified form as ASTs with explicit union and join nodes, they have the ability to compactly represent exponentially-large spaces of programs, owing to which they have become become the most popular approach to enumerative program synthesis since the introduction of FlashFill in 2010. We present a linear-time semantics-preserving constructive embedding from version space algebras into nondeterministic finite tree automata, showing that the former are but a special case of the latter. Combined with recent results finding a correspondence between e-graphs and minimal deterministic tree automata, this shows that tree automata are strict generalizations of all recent major approaches to efficiently representing large spaces of programs by sharing.


title: Self-Supervised Video Object Segmentation by Motion-Aware Mask Propagation

abstract: We propose a self-supervised spatio-temporal matching method, coined Motion-Aware Mask Propagation (MAMP), for video object segmentation. MAMP leverages the frame reconstruction task for training without the need for annotations. During inference, MAMP extracts high-resolution features from each frame to build a memory bank from the features as well as the predicted masks of selected past frames. MAMP then propagates the masks from the memory bank to subsequent frames according to our proposed motion-aware spatio-temporal matching module to handle fast motion and long-term matching scenarios. Evaluation on DAVIS-2017 and YouTube-VOS datasets show that MAMP achieves state-of-the-art performance with stronger generalization ability compared to existing self-supervised methods, i.e., 4.2% higher mean J&F on DAVIS-2017 and 4.85% higher mean J&F on the unseen categories of YouTube-VOS than the nearest competitor. Moreover, MAMP performs at par with many supervised video object segmentation methods. Our code is available at: https://github.com/bo-miao/MAMP.


title: Ground state normalized solution to Schr\"odinger systems with general nonlinearities and potentials

abstract: In present paper, we study the following Schr\"odinger systems $$\begin{cases} -\Delta u_1+V_1(x)u_1+\lambda_1 u_1=\partial_1 G(u_1,u_2)\;\quad&\hbox{in}\;\R^N,\\ -\Delta u_2+V_2(x)u_2+\lambda_2 u_2=\partial_2G(u_1,u_2)\;\quad&\hbox{in}\;\R^N,\\ 0<u_1,u_2\in H^1(\R^N), N\geq 1,\\ \int_{\R^N}u_1^2dx=a_1, \int_{\R^N}u_2^2dx=a_2, \end{cases}$$ where the potentials $V_\iota(x) (\iota=1,2)$ are given functions and the nonlinearities $G(u_1,u_2)$ are considered of the form $$ \begin{cases} G(u_1, u_2):=\sum_{i=1}^{\ell}\frac{\mu_i}{p_i}|u_1|^{p_i}+\sum_{j=1}^{m}\frac{\nu_j}{q_j}|u_2|^{q_j}+\sum_{k=1}^{n}\beta_k |u_1|^{r_{1,k}}|u_2|^{r_{2,k}},~~\ell,m,n\in \mathbb{N}^+_0, \mu_i, \nu_j,\beta_k>0, ~2+\frac{4}{N}>r_{1,k}+r_{2,k}, p_i, q_j>2, ~r_{1,k}, r_{2,k}>1, i=1,2,\cdots, \ell; j=1,2,\cdots, m; k=1,2,\cdots, n. \end{cases} $$ Under some assumptions on $V_\iota$ $(\iota =1,2)$ and the parameters, we can show the existence of ground state normalized solution $(\lambda_1,\lambda_2; u_1, u_2)\in \R^2 \times H^1(\R^N, \R^2) $ to the above mass sub-critical problem for any given $a_1>0,a_2>0$. Here our nonlinearities are general. The potentials $V_1(x)$ and $V_2(x)$ are also very general such that $\inf ess~\sigma(-\Delta+V_\iota)>-\infty$, which are allowed to be singular at some points.


title: CFLOW-AD: Real-Time Unsupervised Anomaly Detection with Localization via Conditional Normalizing Flows

abstract: Unsupervised anomaly detection with localization has many practical applications when labeling is infeasible and, moreover, when anomaly examples are completely missing in the train data. While recently proposed models for such data setup achieve high accuracy metrics, their complexity is a limiting factor for real-time processing. In this paper, we propose a real-time model and analytically derive its relationship to prior methods. Our CFLOW-AD model is based on a conditional normalizing flow framework adopted for anomaly detection with localization. In particular, CFLOW-AD consists of a discriminatively pretrained encoder followed by a multi-scale generative decoders where the latter explicitly estimate likelihood of the encoded features. Our approach results in a computationally and memory-efficient model: CFLOW-AD is faster and smaller by a factor of 10x than prior state-of-the-art with the same input setting. Our experiments on the MVTec dataset show that CFLOW-AD outperforms previous methods by 0.36% AUROC in detection task, by 1.12% AUROC and 2.5% AUPRO in localization task, respectively. We open-source our code with fully reproducible experiments.


title: Unraveling the varied nature and roles of defects in hybrid halide perovskites with time-resolved photoemission electron microscopy

abstract: With rapidly growing photoconversion efficiencies, hybrid perovskite solar cells have emerged as promising contenders for next generation, low-cost photovoltaic technologies. Yet, the presence of nanoscale defect clusters, that form during the fabrication process, remains critical to overall device operation, including efficiency and long-term stability. To successfully deploy hybrid perovskites, we must understand the nature of the different types of defects, assess their potentially varied roles in device performance, and understand how they respond to passivation strategies. Here, by correlating photoemission and synchrotron-based scanning probe X-ray microscopies, we unveil three different types of defect clusters in state-of-the-art triple cation mixed halide perovskite thin films. Incorporating ultrafast time-resolution into our photoemission measurements, we show that defect clusters originating at grain boundaries are the most detrimental for photocarrier trapping, while lead iodide defect clusters are relatively benign. Hexagonal polytype defect clusters are only mildly detrimental individually, but can have a significant impact overall if abundant in occurrence. We also show that passivating defects with oxygen in the presence of light, a previously used approach to improve efficiency, has a varied impact on the different types of defects. Even with just mild oxygen treatment, the grain boundary defects are completely healed, while the lead iodide defects begin to show signs of chemical alteration. Our findings highlight the need for multi-pronged strategies tailored to selectively address the detrimental impact of the different defect types in hybrid perovskite solar cells.


title: Low Temperature Phase Transitions of the Ionic Liquid 1-Ethyl-3-methylimidazolium Dicyanamide

abstract: Several calorimetric measurements have shown that 1-ethyl-3-methylimidazolium dicyanamide, [C2C1im][N(CN)2], is a glass-forming liquid, even though it is a low-viscous liquid at room temperature. Here we found slow crystallization during cooling of [C2C1im][N(CN)2] along Raman spectroscopy measurements. The low-frequency range of the Raman spectrum shows that the same crystalline phase is obtained at 210 K either by cooling or by reheating the glass (cold-crystallization). Another crystalline phase is formed at ca. 260 K just prior the melting at 270 K. X-ray diffraction and calorimetric measurements confirm that there are two crystalline phases of [C2C1im][N(CN)2]. The Raman spectra indicate that polymorphism is related to [C2C1im]+ with the ethyl chain on the plane of the imidazolium ring (the low-temperature crystal) or non-planar (the high-temperature crystal). The structural reason for the glass-forming ability of [C2C1im][N(CN)2], despite of the relatively simple molecular structures of the ions, was pursued by quantum chemistry calculations and molecular dynamics (MD) simulations. Density functional theory (DFT) calculations were performed for ionic pairs in order to draw free energy surfaces of the anion around the cation. The MD simulations using a polarizable model provided maps of occurrence of anions around cations. Both the quantum and classical calculations suggest that the delocalization of preferred positions of the anion around the cation, which adopts different conformations of the ethyl chain, is on the origin of the crystallization being hampered during cooling and the resulting glass-forming ability of [C2C1im][N(CN)2].


title: Effect of an attached end mass in the dynamics of uncertainty nonlinear continuous random system

abstract: This work studies the dynamics of a one dimensional elastic bar with random elastic modulus and prescribed boundary conditions, say, fixed at one end, and attached to a lumped mass and two springs (one linear and another nonlinear) on the other extreme. The system analysis assumes that the elastic modulus has gamma probability distribution and uses Monte Carlo simulations to compute the propagation of uncertainty in this continuous--discrete system. After describing the deterministic and the stochastic modeling of the system, some configurations of the model are analyzed in order to characterize the effect of the lumped mass in the overall behavior of this dynamical system.


title: 3D Modeling of the Structure and Dynamics of a Main-Sequence F-type Star

abstract: Current state-of-the-art computational modeling makes it possible to build realistic models of stellar convection zones and atmospheres that take into account chemical composition, radiative effects, ionization, and turbulence. The standard 1D mixing-length-based evolutionary models are not able to capture many physical processes of the stellar interior dynamics. Mixing-length models provide an initial approximation of stellar structure that can be used to initialize 3D radiative hydrodynamics simulations which include realistic modeling of turbulence, radiation, and other phenomena. In this paper, we present 3D radiative hydrodynamic simulations of an F-type main-sequence star with 1.47 solar mass. The computational domain includes the upper layers of the radiation zone, the entire convection zone, and the photosphere. The effects of stellar rotation is modeled in the f-plane approximation. These simulations provide new insight into the properties of the convective overshoot region, the dynamics of the near-surface, highly turbulent layer, and the structure and dynamics of granulation. They reveal anti-solar-type differential rotation and latitudinal dependence of the tachocline location.


title: CCGL: Contrastive Cascade Graph Learning

abstract: Supervised learning, while prevalent for information cascade modeling, often requires abundant labeled data in training, and the trained model is not easy to generalize across tasks and datasets. It often learns task-specific representations, which can easily result in overfitting for downstream tasks. Recently, self-supervised learning is designed to alleviate these two fundamental issues in linguistic and visual tasks. However, its direct applicability for information cascade modeling, especially graph cascade related tasks, remains underexplored. In this work, we present Contrastive Cascade Graph Learning (CCGL), a novel framework for information cascade graph learning in a contrastive, self-supervised, and task-agnostic way. In particular, CCGL first designs an effective data augmentation strategy to capture variation and uncertainty by simulating the information diffusion in graphs. Second, it learns a generic model for graph cascade tasks via self-supervised contrastive pre-training using both unlabeled and labeled data. Third, CCGL learns a task-specific cascade model via fine-tuning using labeled data. Finally, to make the model transferable across datasets and cascade applications, CCGL further enhances the model via distillation using a teacher-student architecture. We demonstrate that CCGL significantly outperforms its supervised and semi-supervised counterparts for several downstream tasks.


title: Quantum control of nuclear spin qubits in a rapidly rotating diamond

abstract: Nuclear spins in certain solids couple weakly to their environment, making them attractive candidates for quantum information processing and inertial sensing. When coupled to the spin of an optically-active electron, nuclear spins can be rapidly polarized, controlled and read via lasers and radiofrequency fields. Possessing coherence times of several milliseconds at room temperature, nuclear spins hosted by a nitrogen-vacancy center in diamond are thus intriguing systems to observe how classical physical rotation at quantum timescales affects a quantum system. Unlocking this potential is hampered by precise and inflexible constraints on magnetic field strength and alignment in order to optically induce nuclear polarization, which restricts the scope for further study and applications. In this work, we demonstrate optical nuclear spin polarization and rapid quantum control of nuclear spins in a diamond physically rotating at $1\,$kHz, faster than the nuclear spin coherence time. Free from the need to maintain strict field alignment, we are able to measure and control nuclear spins in hitherto inaccessible regimes, such as in the presence of a large, time-varying magnetic field that makes an angle of more than $100^\circ$ to the nitrogen-lattice vacancy axis. The field induces spin mixing between the electron and nuclear states of the qubits, decoupling them from oscillating rf fields. We are able to demonstrate that coherent spin state control is possible at any point of the rotation, and even for up to six rotation periods. We combine continuous dynamical decoupling with quantum feedforward control to eliminate decoherence induced by imperfect mechanical rotation. Our work liberates a previously inaccessible degree of freedom of the NV nuclear spin, unlocking new approaches to quantum control and rotation sensing.


title: Dual Slot Selector via Local Reliability Verification for Dialogue State Tracking

abstract: The goal of dialogue state tracking (DST) is to predict the current dialogue state given all previous dialogue contexts. Existing approaches generally predict the dialogue state at every turn from scratch. However, the overwhelming majority of the slots in each turn should simply inherit the slot values from the previous turn. Therefore, the mechanism of treating slots equally in each turn not only is inefficient but also may lead to additional errors because of the redundant slot value generation. To address this problem, we devise the two-stage DSS-DST which consists of the Dual Slot Selector based on the current turn dialogue, and the Slot Value Generator based on the dialogue history. The Dual Slot Selector determines each slot whether to update slot value or to inherit the slot value from the previous turn from two aspects: (1) if there is a strong relationship between it and the current turn dialogue utterances; (2) if a slot value with high reliability can be obtained for it through the current turn dialogue. The slots selected to be updated are permitted to enter the Slot Value Generator to update values by a hybrid method, while the other slots directly inherit the values from the previous turn. Empirical results show that our method achieves 56.93%, 60.73%, and 58.04% joint accuracy on MultiWOZ 2.0, MultiWOZ 2.1, and MultiWOZ 2.2 datasets respectively and achieves a new state-of-the-art performance with significant improvements.


title: Remember What You have drawn: Semantic Image Manipulation with Memory

abstract: Image manipulation with natural language, which aims to manipulate images with the guidance of language descriptions, has been a challenging problem in the fields of computer vision and natural language processing (NLP). Currently, a number of efforts have been made for this task, but their performances are still distant away from generating realistic and text-conformed manipulated images. Therefore, in this paper, we propose a memory-based Image Manipulation Network (MIM-Net), where a set of memories learned from images is introduced to synthesize the texture information with the guidance of the textual description. We propose a two-stage network with an additional reconstruction stage to learn the latent memories efficiently. To avoid the unnecessary background changes, we propose a Target Localization Unit (TLU) to focus on the manipulation of the region mentioned by the text. Moreover, to learn a robust memory, we further propose a novel randomized memory training loss. Experiments on the four popular datasets show the better performance of our method compared to the existing ones.


title: Pointer Value Retrieval: A new benchmark for understanding the limits of neural network generalization

abstract: Central to the success of artificial neural networks is their ability to generalize. But does neural network generalization primarily rely on seeing highly similar training examples (memorization)? Or are neural networks capable of human-intelligence styled reasoning, and if so, to what extent? These remain fundamental open questions on artificial neural networks. In this paper, as steps towards answering these questions, we introduce a new benchmark, Pointer Value Retrieval (PVR) to study the limits of neural network reasoning. The PVR suite of tasks is based on reasoning about indirection, a hallmark of human intelligence, where a first stage (task) contains instructions for solving a second stage (task). In PVR, this is done by having one part of the task input act as a pointer, giving instructions on a different input location, which forms the output. We show this simple rule can be applied to create a diverse set of tasks across different input modalities and configurations. Importantly, this use of indirection enables systematically varying task difficulty through distribution shifts and increasing functional complexity. We conduct a detailed empirical study of different PVR tasks, discovering large variations in performance across dataset sizes, neural network architectures and task complexity. Further, by incorporating distribution shift and increased functional complexity, we develop nuanced tests for reasoning, revealing subtle failures and surprising successes, suggesting many promising directions of exploration on this benchmark.


title: Average-Case Analysis of Greedy Matching for D2D Resource Sharing

abstract: Given the proximity of many wireless users and their diversity in consuming local resources (e.g., data-plans, computation and even energy resources), device-to-device (D2D) resource sharing is a promising approach towards realizing a sharing economy. In the resulting networked economy, $n$ users segment themselves into sellers and buyers that need to be efficiently matched locally. This paper adopts an easy-to-implement greedy matching algorithm with distributed fashion and only sub-linear $O(\log n)$ parallel complexity, which offers a great advantage compared to the optimal but computational-expensive centralized matching. But is it efficient compared to the optimal matching? Extensive simulations indicate that in a large number of practical cases the average loss is no more than $10\%$, a far better result than the $50\%$ loss bound in the worst case. However, there is no rigorous average-case analysis in the literature to back up such encouraging findings, which is a fundamental step towards supporting the practical use of greedy matching in D2D sharing. This paper is the first to present the rigorous average analysis of certain representative classes of graphs with random parameters, by proposing a new asymptotic methodology. For typical 2D grids with random matching weights we rigorously prove that our greedy algorithm performs better than $84.9\%$ of the optimal, while for typical Erdos-Renyi random graphs we prove a lower bound of $79\%$ when the graph is neither dense nor sparse. Finally, we use realistic data to show that our random graph models approximate well D2D sharing networks encountered in practice.


title: Event-driven Two-stage Solution to Non-intrusive Load Monitoring

abstract: Existing methods of non-intrusive load monitoring (NILM) in literatures generally suffer from high computational complexity and/or low accuracy in identifying working household appliances. This paper proposes an event-driven Factorial Hidden Markov model (eFHMM) for multiple appliances with multiple states in a household, aiming for low computational complexity and high load disaggregation accuracy. The proposed eFHMM decreases the computational complexity to be linear to the event number, which ensures online load disaggregation. Furthermore, the eFHMM is solved in two stages, where the first stage identifies state-changing appliance using transient signatures and the second stage confirms the inferred states using steady-state signatures. The combination of transient and steady-state signatures, which are extracted from transient and steady periods segmented by detected events, enhances the uniqueness of each state transition and associated appliances, which ensures accurate load disaggregation. The event-driven two-stage NILM solution, termed as eFHMM-TS, is naturally fit into an edge-cloud framework, which makes possible the real-world application of NILM. The proposed eFHMM-TS method is validated on the LIFTED and synD datasets. Results demonstrate that the eFHMM-TS method outperforms other methods and can be applied in practice.


title: The applications of subsurface assemblies on thermoelectric generators for lunar processes

abstract: To take advantage of the distinctive nature of the lunar environment with respect to heat flow due to the low thermal conductivity of lunar soil and the moon's negligible atmosphere, thermoelectric generators have been identified as a potential power source to support self-sustaining processes on the lunar surface. These power-generating systems will take the form of top-down heat transfer systems, relying on soil as the heat sink to maintain significant temperature differentials. Installation of increasingly complex subsurface assemblies to redirect subsurface heat flow have demonstrated strong capability in both enhancing power output and limiting near-surface temperatures.


title: Darcy-Reynolds forces during intrusion into granular-fluid beds

abstract: We experimentally study intrusion into fluid-saturated granular beds by a free-falling sphere, varying particle size and fluid viscosity. We test our results against Darcy-Reynolds theory, where the deceleration of the sphere is controlled by Reynolds dilatancy and the Darcy flow resistance. We find the observed intruder dynamics are consistent with Darcy-Reynolds theory for varied particle size. We also find that our experimental results for varied viscosity are consistent with Darcy-Reynolds theory, but only for a limited range of the viscosity. For large viscosities, observed forces begin to decrease with increasing viscosity, in contrast with the theoretical prediction.


title: Nearest Neighborhood-Based Deep Clustering for Source Data-absent Unsupervised Domain Adaptation

abstract: In the classic setting of unsupervised domain adaptation (UDA), the labeled source data are available in the training phase. However, in many real-world scenarios, owing to some reasons such as privacy protection and information security, the source data is inaccessible, and only a model trained on the source domain is available. This paper proposes a novel deep clustering method for this challenging task. Aiming at the dynamical clustering at feature-level, we introduce extra constraints hidden in the geometric structure between data to assist the process. Concretely, we propose a geometry-based constraint, named semantic consistency on the nearest neighborhood (SCNNH), and use it to encourage robust clustering. To reach this goal, we construct the nearest neighborhood for every target data and take it as the fundamental clustering unit by building our objective on the geometry. Also, we develop a more SCNNH-compliant structure with an additional semantic credibility constraint, named semantic hyper-nearest neighborhood (SHNNH). After that, we extend our method to this new geometry. Extensive experiments on three challenging UDA datasets indicate that our method achieves state-of-the-art results. The proposed method has significant improvement on all datasets (as we adopt SHNNH, the average accuracy increases by over 3.0% on the large-scaled dataset). Code is available at https://github.com/tntek/N2DCX.


title: Extrapolation Estimation for Nonparametric Regression with Measurement Error

abstract: For the nonparametric regression models with covariates contaminated with normal measurement errors, this paper proposes an extrapolation algorithm to estimate the nonparametric regression functions. By applying the conditional expectation directly to the kernel-weighted least squares of the deviations between the local linear approximation and the observed responses, the proposed algorithm successfully bypasses the simulation step needed in the classical simulation extrapolation method, thus significantly reducing the computational time. It is noted that the proposed method also provides an exact form of the extrapolation function, but the extrapolation estimate generally cannot be obtained by simply setting the extrapolation variable to negative one in the fitted extrapolation function if the bandwidth is less than the standard deviation of the measurement error. Large sample properties of the proposed estimation procedure are discussed, as well as simulation studies and a real data example being conducted to illustrate its applications.


title: Heating Rates under Fast Periodic Driving beyond Linear Response

abstract: Heating under periodic driving is a generic nonequilibrium phenomenon, and it is a challenging problem in nonequilibrium statistical physics to derive a quantitatively accurate heating rate. In this work, we provide a simple formula on the heating rate under fast and strong periodic driving in classical and quantum many-body systems. The key idea behind the formula is constructing a time-dependent dressed Hamiltonian by moving to a rotating frame, which is found by a truncation of the high-frequency expansion of the micromotion operator, and applying the linear-response theory. It is confirmed for specific classical and quantum models that the second-order truncation of the high-frequency expansion yields quantitatively accurate heating rates beyond the linear-response regime. Our result implies that the information on heating dynamics is encoded in the first few terms of the high-frequency expansion, although heating is often associated with an asymptotically divergent behavior of the high-frequency expansion.


title: A Novel Interactive Two-stage Joint Retail Electricity Market for Multiple Microgrids

abstract: To accommodate the advent of microgrids (MG) managing distributed energy resources (DER) in distribution systems, an interactive two-stage joint retail electricity market mechanism is proposed to provide an effective platform for these prosumers to proactively join in retail transactions. Day-ahead stochastic energy trading between the distribution system operator (DSO) and MGs is conducted in the first stage of a centralized retail market, where a chance-constrained uncertainty distribution locational marginal price (CC-UDLMP) containing the cost of uncertainty precautions is used to settle transactions. In the second stage, a novel intra-day peer-to-peer-based (P2P) flexibility transaction pattern is implemented between MGs in local flexibility markets under the regulation of DSO to eliminate power imbalances caused by rolling-based estimates whilst considering systematic operations. A fully distributed iterative algorithm is presented to find the equilibrium solution of this two-stage sequential game framework. Moreover, in order to enhance the versatility of this algorithm, an improved Lp-box alternating direction methods of multipliers (ADMM) algorithm is used to efficiently resolve the first-stage stochastic economic dispatch problem with a mixed-integer second-order cone structure. It is verified that the proposed market mechanism can effectively improve the overall market efficiency under uncertainties.


title: Cross-modal Consensus Network for Weakly Supervised Temporal Action Localization

abstract: Weakly supervised temporal action localization (WS-TAL) is a challenging task that aims to localize action instances in the given video with video-level categorical supervision. Both appearance and motion features are used in previous works, while they do not utilize them in a proper way but apply simple concatenation or score-level fusion. In this work, we argue that the features extracted from the pretrained extractor, e.g., I3D, are not the WS-TALtask-specific features, thus the feature re-calibration is needed for reducing the task-irrelevant information redundancy. Therefore, we propose a cross-modal consensus network (CO2-Net) to tackle this problem. In CO2-Net, we mainly introduce two identical proposed cross-modal consensus modules (CCM) that design a cross-modal attention mechanism to filter out the task-irrelevant information redundancy using the global information from the main modality and the cross-modal local information of the auxiliary modality. Moreover, we treat the attention weights derived from each CCMas the pseudo targets of the attention weights derived from another CCM to maintain the consistency between the predictions derived from two CCMs, forming a mutual learning manner. Finally, we conduct extensive experiments on two common used temporal action localization datasets, THUMOS14 and ActivityNet1.2, to verify our method and achieve the state-of-the-art results. The experimental results show that our proposed cross-modal consensus module can produce more representative features for temporal action localization.


title: The Reflectance Spectra of CV-CK Carbonaceous chondrites from the Near Infrared to the Visible

abstract: Carbonaceous chondrite meteorites are so far the only available samples representing carbon-rich asteroids and in order to allow future comparison with samples returned by missions such as Hayabusa 2 and OSIRIS-Rex, is important to understand their physical properties. Future characterization of asteroid primitive classes, some of them targeted by sample-return missions, requires a better understanding of their mineralogy, the consequences of the exposure to space weathering, and how both affect the reflectance behavior of these objects. In this paper, the reflectance spectra of two chemically-related carbonaceous chondrites groups, precisely the Vigrano (CVs) and Karoonda (CKs), are measured and compared. The available sample suite includes polished sections exhibiting different petrologic types: from 3 (very low degree of thermal metamorphism) to 5 (high degree of thermal metamorphism). We found that the reflective properties and the comparison with the Cg asteroid reflectance class point toward a common chondritic reservoir from which the CV-CK asteroids collisionally evolved. In that scenario the CV and CK chondrites could be originated from 221 Eos asteroid family, but because of its collisional disruption, both chondrite groups evolved separately, experiencing different stages of thermal metamorphism, annealing and space weathering.


title: Combining Probabilistic Logic and Deep Learning for Self-Supervised Learning

abstract: Deep learning has proven effective for various application tasks, but its applicability is limited by the reliance on annotated examples. Self-supervised learning has emerged as a promising direction to alleviate the supervision bottleneck, but existing work focuses on leveraging co-occurrences in unlabeled data for task-agnostic representation learning, as exemplified by masked language model pretraining. In this chapter, we explore task-specific self-supervision, which leverages domain knowledge to automatically annotate noisy training examples for end applications, either by introducing labeling functions for annotating individual instances, or by imposing constraints over interdependent label decisions. We first present deep probabilistic logic(DPL), which offers a unifying framework for task-specific self-supervision by composing probabilistic logic with deep learning. DPL represents unknown labels as latent variables and incorporates diverse self-supervision using probabilistic logic to train a deep neural network end-to-end using variational EM. Next, we present self-supervised self-supervision(S4), which adds to DPL the capability to learn new self-supervision automatically. Starting from an initial seed self-supervision, S4 iteratively uses the deep neural network to propose new self supervision. These are either added directly (a form of structured self-training) or verified by a human expert (as in feature-based active learning). Experiments on real-world applications such as biomedical machine reading and various text classification tasks show that task-specific self-supervision can effectively leverage domain expertise and often match the accuracy of supervised methods with a tiny fraction of human effort.


title: Detection of cybersecurity attacks through analysis of web browsing activities using principal component analysis

abstract: Organizations such as government departments and financial institutions provide online service facilities accessible via an increasing number of internet connected devices which make their operational environment vulnerable to cyber attacks. Consequently, there is a need to have mechanisms in place to detect cyber security attacks in a timely manner. A variety of Network Intrusion Detection Systems (NIDS) have been proposed and can be categorized into signature-based NIDS and anomaly-based NIDS. The signature-based NIDS, which identify the misuse through scanning the activity signature against the list of known attack activities, are criticized for their inability to identify new attacks (never-before-seen attacks). Among anomaly-based NIDS, which declare a connection anomalous if it expresses deviation from a trained model, the unsupervised learning algorithms circumvent this issue since they have the ability to identify new attacks. In this study, we use an unsupervised learning algorithm based on principal component analysis to detect cyber attacks. In the training phase, our approach has the advantage of also identifying outliers in the training dataset. In the monitoring phase, our approach first identifies the affected dimensions and then calculates an anomaly score by aggregating across only those components that are affected by the anomalies. We explore the performance of the algorithm via simulations and through two applications, namely to the UNSW-NB15 dataset recently released by the Australian Centre for Cyber Security and to the well-known KDD'99 dataset. The algorithm is scalable to large datasets in both training and monitoring phases, and the results from both the simulated and real datasets show that the method has promise in detecting suspicious network activities.


title: PoBO: A Polynomial Bounding Method for Chance-Constrained Yield-Aware Optimization of Photonic ICs

abstract: Conventional yield optimization algorithms try to maximize the success rate of a circuit under process variations. These methods often obtain a high yield but reach a design performance that is far from the optimal value. This paper investigates an alternative yield-aware optimization for photonic ICs: we will optimize the circuit design performance while ensuring a high yield requirement. This problem was recently formulated as a chance-constrained optimization, and the chance constraint was converted to a stronger constraint with statistical moments. Such a conversion reduces the feasible set and sometimes leads to an over-conservative design. To address this fundamental challenge, this paper proposes a carefully designed polynomial function, called optimal polynomial kinship function, to bound the chance constraint more accurately. We modify existing kinship functions via relaxing the independence and convexity requirements, which fits our more general uncertainty modeling and tightens the bounding functions. The proposed method enables a global optimum search for the design variables via polynomial optimization. We validate this method with a synthetic function and two photonic IC design benchmarks, showing that our method can obtain better design performance while meeting a pre-specified yield requirement. Many other advanced problems of yield-aware optimization and more general safety-critical design/control can be solved based on this work in the future.


title: On the generalized Hamming weights of hyperbolic codes

abstract: A hyperbolic code is an evaluation code that improves a Reed-Muller because the dimension increases while the minimum distance is not penalized. We give the necessary and sufficient conditions, based on the basic parameters of the Reed-Muller, to determine whether a Reed-Muller coincides with a hyperbolic code. Given a hyperbolic code, we find the largest Reed-Muller containing the hyperbolic code and the smallest Reed-Muller in the hyperbolic code. We then prove that similarly to Reed-Muller and Cartesian codes, the $r$-th generalized Hamming weight and the $r$-th footprint of the hyperbolic code coincide. Unlike Reed-Muller and Cartesian, determining the $r$-th footprint of a hyperbolic code is still an open problem. We give upper and lower bounds for the $r$-th footprint of a hyperbolic code that, sometimes, are sharp.


title: Template-based Chatbot for Agriculture Related FAQs

abstract: Agriculture is the fundamental industry of the society, which is the basis of food supply and an important source of employment and GDP increase. However, the insufficient expert can not fulfill the demand of farmers. To address this problem, we design a chatbot to answer frequently asked questions in the Agriculture field. Template-based questions will be answered by AIML while LSA is used for other service-based questions. This chatbot will assist farmers by dealing with industry problems conveniently and efficiently.


title: Linear Quadratic Regulator Design for Multi-input Systems with A Distributed Cooperative Strategy

abstract: In this paper, a cooperative Linear Quadratic Regulator (LQR) problem is investigated for multi-input systems, where each input is generated by an agent in a network. The input matrices are different and locally possessed by the corresponding agents respectively, which can be regarded as different ways for agents to control the multi-input system. By embedding a fully distributed information fusion strategy, a novel cooperative LQR-based controller is proposed. Each agent only needs to communicate with its neighbors, rather than sharing information globally in a network. Moreover, only the joint controllability is required, which allows the multi-input system to be uncontrollable for every single agent or even all its neighbors. In particular, only one-time information exchange is necessary at every control step, which significantly reduces the communication consumption. It is proved that the boundedness (convergence) of the controller gains is guaranteed for time-varying (time-invariant) systems. Furthermore, the control performance of the entire system is ensured. Generally, the proposed controller achieves a better trade-off between the control performance and the communication overhead, compared with the existing centralized/decentralized/consensus-based LQR controllers. Finally, the effectiveness of the theoretical results is illustrated by several comparative numerical examples.


title: A Long-Term Investigation on the Effects of (Personalized) Gamification on Course Participation in a Gym

abstract: Gamification is frequently used to motivate people getting more physically active. However, most systems follow a one-size-fits-all gamification approach, although past research has shown that interpersonal differences exist in the perception of gamification elements. Also, most studies investigating the effects of gamification are rather short, although it has been shown that gamification can suffer from novelty effects. In this paper, we address both these issues by investigating whether gamification elements, integrated into a fitness course booking system, have an effect on how frequently users participate in fitness courses in a gym (N=52) over a duration of 275 days (548 days including baseline). Also, the gamification elements that we implemented are tailored to specific Hexad user types, which allows us to investigate whether using suitable gamification elements leads to an increased course participation. Our results show that gamification increased the participation in fitness courses significantly and that users who received a suitable set of gamification elements - according to their Hexad user type - increased their participation significantly more than others.


title: Identify Apple Leaf Diseases Using Deep Learning Algorithm

abstract: Agriculture is an essential industry in the both society and economy of a country. However, the pests and diseases cause a great amount of reduction in agricultural production while there is not sufficient guidance for farmers to avoid this disaster. To address this problem, we apply CNNs to plant disease recognition by building a classification model. Within the dataset of 3,642 images of apple leaves, We use a pre-trained image classification model Restnet34 based on a Convolutional neural network (CNN) with the Fastai framework in order to save the training time. Overall, the accuracy of classification is 93.765%.


title: Design Guidelines to Increase the Persuasiveness of Achievement Goals for Physical Activity

abstract: Achievement goals are frequently used to support behavior change. However, they are often not specifically designed for this purpose nor account for the degree to which a user is already intending to perform the target behavior. In this paper, we investigate the perceived persuasiveness of different goal types as defined by the 3x2 Achievement Goal Model, what people like and dislike about them and the role that behavior change intentions play when aiming at increasing step counts. We created visualizations for each goal type based on a qualitative pre-study (N=18) and ensured their comprehensibility (N=18). In an online experiment (N=118), we show that there are differences in the perception of these goal types and that behavior change intentions should be considered to maximize their persuasiveness as goals evolve. Next, we derive design guidelines on when to use which type of achievement goal and what to consider when using them


title: PiSLTRc: Position-informed Sign Language Transformer with Content-aware Convolution

abstract: Since the superiority of Transformer in learning long-term dependency, the sign language Transformer model achieves remarkable progress in Sign Language Recognition (SLR) and Translation (SLT). However, there are several issues with the Transformer that prevent it from better sign language understanding. The first issue is that the self-attention mechanism learns sign video representation in a frame-wise manner, neglecting the temporal semantic structure of sign gestures. Secondly, the attention mechanism with absolute position encoding is direction and distance unaware, thus limiting its ability. To address these issues, we propose a new model architecture, namely PiSLTRc, with two distinctive characteristics: (i) content-aware and position-aware convolution layers. Specifically, we explicitly select relevant features using a novel content-aware neighborhood gathering method. Then we aggregate these features with position-informed temporal convolution layers, thus generating robust neighborhood-enhanced sign representation. (ii) injecting the relative position information to the attention mechanism in the encoder, decoder, and even encoder-decoder cross attention. Compared with the vanilla Transformer model, our model performs consistently better on three large-scale sign language benchmarks: PHOENIX-2014, PHOENIX-2014-T and CSL. Furthermore, extensive experiments demonstrate that the proposed method achieves state-of-the-art performance on translation quality with $+1.6$ BLEU improvements.


title: Microphone Array Generalization for Multichannel Narrowband Deep Speech Enhancement

abstract: This paper addresses the problem of microphone array generalization for deep-learning-based end-to-end multichannel speech enhancement. We aim to train a unique deep neural network (DNN) potentially performing well on unseen microphone arrays. The microphone array geometry shapes the network's parameters when training on a fixed microphone array, and thus restricts the generalization of the trained network to another microphone array. To resolve this problem, a single network is trained using data recorded by various microphone arrays of different geometries. We design three variants of our recently proposed narrowband network to cope with the agnostic number of microphones. Overall, the goal is to make the network learn the universal information for speech enhancement that is available for any array geometry, rather than learn the one-array-dedicated characteristics. The experiments on both simulated and real room impulse responses (RIR) demonstrate the excellent across-array generalization capability of the proposed networks, in the sense that their performance measures are very close to, or even exceed the network trained with test arrays. Moreover, they notably outperform various beamforming methods and other advanced deep-learning-based methods.


title: Moving efficiently through a crowd: a nature inspired traffic rule

abstract: In this article, we propose a traffic rule inspired from nature, that facilitates an elite agent to move efficiently through a crowd of inert agents. When an object swims in a fluid medium or an intruder is forced through granular matter, characteristic flow-fields are created around them. We show that if inert agents, made small movements based on a traffic rule derived from these characteristic flow-fields, they efficiently reorganize and transport enough space for the elite to pass through. The traffic rule used in the article is a dipole-field which satisfactorily captures the features of the flow-fields around a moving intruder. We study the effectiveness of this dipole traffic rule using numerical simulations in a 2D periodic domain, where one self-propelled elite agent tries to move through a crowd of inert agents that prefer to stay in a state of rest. Simulations are carried out for a wide range of strengths of the traffic rule and packing density of the crowd. We characterize and analyze four regions in the parameter space, free-flow, motion due to cooperation, frozen and collective drift regions, and discuss the consequence of the traffic rule in light of the collective behavior observed. We believe that the proposed method can be of use in a swarm of robots working in constrained environments.


title: Federated Learning Meets Natural Language Processing: A Survey

abstract: Federated Learning aims to learn machine learning models from multiple decentralized edge devices (e.g. mobiles) or servers without sacrificing local data privacy. Recent Natural Language Processing techniques rely on deep learning and large pre-trained language models. However, both big deep neural and language models are trained with huge amounts of data which often lies on the server side. Since text data is widely originated from end users, in this work, we look into recent NLP models and techniques which use federated learning as the learning framework. Our survey discusses major challenges in federated natural language processing, including the algorithm challenges, system challenges as well as the privacy issues. We also provide a critical review of the existing Federated NLP evaluation methods and tools. Finally, we highlight the current research gaps and future directions.


title: Image Scene Graph Generation (SGG) Benchmark

abstract: There is a surge of interest in image scene graph generation (object, attribute and relationship detection) due to the need of building fine-grained image understanding models that go beyond object detection. Due to the lack of a good benchmark, the reported results of different scene graph generation models are not directly comparable, impeding the research progress. We have developed a much-needed scene graph generation benchmark based on the maskrcnn-benchmark and several popular models. This paper presents main features of our benchmark and a comprehensive ablation study of scene graph generation models using the Visual Genome and OpenImages Visual relationship detection datasets. Our codebase is made publicly available at https://github.com/microsoft/scene_graph_benchmark.


title: Similar Scale-invariant Behaviors between Soft Gamma-ray Repeaters and An Extreme Epoch from FRB 121102

abstract: The recent discovery of a Galactic fast radio burst (FRB) associated with a hard X-ray burst from the soft gamma-ray repeater (SGR) J1935+2154 has established the magnetar origin of at least some FRBs. In this work, we study the statistical properties of soft gamma-/hard X-ray bursts from SGRs 1806--20 and J1935+2154 and of radio bursts from the repeating FRB 121102. For SGRs, we show that the probability density functions for the differences of fluences, fluxes, and durations at different times have fat tails with a $q$-Gaussian form. The $q$ values in the $q$-Gaussian distributions are approximately steady and independent of the temporal interval scale adopted, implying a scale-invariant structure of SGRs. These features indicate that SGR bursts may be governed by a self-organizing criticality (SOC) process, confirming previous findings. Very recently, 1652 independent bursts from FRB 121102 have been detected by the Five-hundred-meter Aperture Spherical radio Telescope (FAST). Here we also investigate the scale-invariant structure of FRB 121102 based on the latest observations of FAST, and show that FRB 121102 and SGRs share similar statistical properties. Given the bimodal energy distribution of FRB 121102 bursts, we separately explore the scale-invariant behaviors of low- and high-energy bursts of FRB 121102. We find that the $q$ values of low- and high-energy bursts are different, which further strengthens the evidence of the bimodality of the energy distribution. Scale invariance in both the high-energy component of FRB 121102 and SGRs can be well explained within the same physical framework of fractal-diffusive SOC systems.


title: Measuring daily-life fear perception change: a computational study in the context of COVID-19

abstract: COVID-19, as a global health crisis, has triggered the fear emotion with unprecedented intensity. Besides the fear of getting infected, the outbreak of COVID-19 also created significant disruptions in people's daily life and thus evoked intensive psychological responses indirect to COVID-19 infections. Here, we construct an expressed fear database using 16 million social media posts generated by 536 thousand users between January 1st, 2019 and August 31st, 2020 in China. We employ deep learning techniques to detect the fear emotion within each post and apply topic models to extract the central fear topics. Based on this database, we find that sleep disorders ("nightmare" and "insomnia") take up the largest share of fear-labeled posts in the pre-pandemic period (January 2019-December 2019), and significantly increase during the COVID-19. We identify health and work-related concerns are the two major sources of fear induced by the COVID-19. We also detect gender differences, with females generating more posts containing the daily-life fear sources during the COVID-19 period. This research adopts a data-driven approach to trace back public emotion, which can be used to complement traditional surveys to achieve real-time emotion monitoring to discern societal concerns and support policy decision-making.


title: Ultra high-energy cosmic rays from beyond the Greisen-Zatsepin-Kuz'min horizon

abstract: Ultra-high-energy (UHE) cosmic rays (CRs) of energies $\sim (10^{18}-10^{20})~{\rm eV}$, accelerated in violent astrophysical environments, interact with cosmic background radiation fields via photo-hadronic processes, leading to strong attenuation. Typically, the Universe would become `opaque' to UHE CRs after several tens of Mpc, setting the boundary of the Greisen-Zatsepin-Kuz'min (GZK) horizon. In this work, we investigate the contribution of sources beyond the conventional GZK horizon to the UHE CR flux observed on Earth, when photo-spallation of the heavy nuclear CRs is taken into account. We demonstrate this contribution is substantial, despite the strong attenuation of UHE CRs. A significant consequence is the emergence of an isotropic background component in the observed flux of UHE CRs, coexisting with the anisotropic foreground component that are associated with nearby sources. Multi-particle CR horizons, which evolve over redshift, are determined by the CR nuclear composition. Thus, they are dependent on the source populations and source evolutionary histories.


title: Variational theory for the resonant T-curvature equation

abstract: We study the resonant prescribed T-curvature problem on a compact 4-dimensional Riemannian manifold with boundary. We derive sharp energy and gradient estimates of the associated Euler-Lagrange functional to characterize the critical points at infinity of the associated variational problem under a non-degeneracy on a naturally associated Hamiltonian function. Using this, we derive a Morse type lemma around the critical points at infinity. Using the Morse lemma at infinity, we prove new existence results of Morse theoretical type. Combining the Morse lemma at infinity and the Liouville version of the Barycenter technique of Bahri-Coron[13] developed in [46], we prove new existence results under a topological hypothesis on the boundary of the underlying manifold, and the entry and exit sets at infinity.


title: Tracking Fast Neural Adaptation by Globally Adaptive Point Process Estimation for Brain-Machine Interface

abstract: Brain-machine interfaces (BMIs) help the disabled restore body functions by translating neural activity into digital commands to control external devices. Neural adaptation, where the brain signals change in response to external stimuli or movements, plays an important role in BMIs. When subjects purely use neural activity to brain-control a prosthesis, some neurons will actively explore a new tuning property to accomplish the movement task. The prediction of this neural tuning property can help subjects adapt more efficiently to brain control and maintain good decoding performance. Existing prediction methods track the slow change of the tuning property in the manual control, which is not suitable for the fast neural adaptation in brain control. In order to identify the active neurons in brain control and track their tuning property changes, we propose a globally adaptive point process method (GaPP) to estimate the neural modulation state from spike trains, decompose the states into the hyper preferred direction and reconstruct the kinematics in a dual-model framework. We implement the method on real data from rats performing a two-lever discrimination task under manual control and brain control. The results show our method successfully predicts the neural modulation state and identifies the neurons that become active in brain control. Compared to existing methods, ours tracks the fast changes of the hyper preferred direction from manual control to brain control more accurately and efficiently and reconstructs the kinematics better and faster.


title: 3D cosmic-ray muon tomography using portable muography detector

abstract: A feasibility demonstration of three-dimensional (3D) muon tomography was performed for infrastructure equivalent targets using the proposed portable muography detector. For the target, we used two sets of lead blocks placed at different heights. The detector consists of two muon position-sensitive detectors, made of plastic scintillating fibers (PSFs) and multi-pixel photon counters (MPPCs) with an angular resolution of 8 msr. The maximum likelihood-expectation maximization (ML-EM) method was used for the 3D imaging reconstruction of the muography simulation and measurement. For both simulation and experiment, the reconstructed positions of the blocks produce consistent results with prior knowledge of the blocks' arrangement. This result demonstrates the potential of the 3D tomographic imaging of infrastructure by using eleven detection positions for portable muography detectors to image infrastructure scale targets.


title: Balancing Asymmetric Dark Matter with Baryon Asymmetry by Sphaleron Transitions

abstract: The effect of the electroweak sphaleron transition in balance between baryon excess and and the excess of stable quarks of 4th generation is studied in this paper. Considering the non-violation of $SU(2)$ symmetry and the conservation of electroweak and new charges and quantum numbers of the new family, it makes possible sphaleron transitions between baryons, leptons and 4th family of leptons and quarks. In this paper, we have tried to established a possible definite relationship between the value and sign of the 4th family excess relative to baryon asymmetry. If $U$-type quarks are the lightest quarks of the 4th family and sphaleron transitions provide excessive $\bar U$ antiquarks, asymmetric dark matter in the form of dark atom bound state of ($\bar{U} \bar{U} \bar{U}$) with primordial He nuclei is balanced with baryon asymmetry.


title: Poisoning Online Learning Filters: DDoS Attacks and Countermeasures

abstract: The recent advancements in machine learning have led to a wave of interest in adopting online learning-based approaches for long-standing attack mitigation issues. In particular, DDoS attacks remain a significant threat to network service availability even after more than two decades. These attacks have been well studied under the assumption that malicious traffic originates from a single attack profile. Based on this premise, malicious traffic characteristics are assumed to be considerably different from legitimate traffic. Consequently, online filtering methods are designed to learn network traffic distributions adaptively and rank requests according to their attack likelihood. During an attack, requests rated as malicious are precipitously dropped by the filters. In this paper, we conduct the first systematic study on the effects of data poisoning attacks on online DDoS filtering; introduce one such attack method, and propose practical protective countermeasures for these attacks. We investigate an adverse scenario where the attacker is "crafty", switching profiles during attacks and generating erratic attack traffic that is ever-shifting. This elusive attacker generates malicious requests by manipulating and shifting traffic distribution to poison the training data and corrupt the filters. To this end, we present a generative model MimicShift, capable of controlling traffic generation while retaining the originating traffic's intrinsic properties. Comprehensive experiments show that online learning filters are highly susceptible to poisoning attacks, sometimes performing much worse than a random filtering strategy in this attack scenario. At the same time, our proposed protective countermeasure diminishes the attack impact.


title: Iterative Reed-Muller Decoding

abstract: Reed-Muller (RM) codes are known for their good maximum likelihood (ML) performance in the short block-length regime. Despite being one of the oldest classes of channel codes, finding a low complexity soft-input decoding scheme is still an open problem. In this work, we present a belief propagation (BP) decoding architecture for RM codes based on their rich automorphism group. The decoding algorithm can be seen as a generalization of multiple-bases belief propagation (MBBP) using polar BP as constituent decoders. We provide extensive error-rate performance simulations and compare our results to existing decoding schemes. We report a near-ML performance for the RM(3,7)-code (e.g., 0.05 dB away from the ML bound at BLER of $10^{-4}$) at a competitive computational cost. To the best of our knowledge, our proposed decoder achieves the best performance of all iterative RM decoders presented thus far.