title: Data-driven Thermal Anomaly Detection for Batteries using Unsupervised Shape Clustering

abstract: For electric vehicles (EV) and energy storage (ES) batteries, thermal runaway is a critical issue as it can lead to uncontrollable fires or even explosions. Thermal anomaly detection can identify problematic battery packs that may eventually undergo thermal runaway. However, there are common challenges like data unavailability, environment and configuration variations, and battery aging. We propose a data-driven method to detect battery thermal anomaly based on comparing shape-similarity between thermal measurements. Based on their shapes, the measurements are continuously being grouped into different clusters. Anomaly is detected by monitoring deviations within the clusters. Unlike model-based or other data-driven methods, the proposed method is robust to data loss and requires minimal reference data for different pack configurations. As the initial experimental results show, the method not only can be more accurate than the onboard BMS and but also can detect unforeseen anomalies at the early stage.


title: Sharp and improved regularity for a class of doubly degenerate parabolic Pdes

abstract: In this manuscript we establish local H\"older regularity estimates for bounded solutions of a certain class of doubly degenerate evolution PDEs. By making use of intrinsic scaling techniques and geometric tangential methods, we derive sharp regularity estimates for such models, which depend only on universal and compatibility parameters of the problem. In such a scenario, our results are natural improvements for former ones in the context of nonlinear evolution PDEs with degenerate structure via a unified approach. As a consequence for our findings and approach, we address a Liouville type result for entire solutions of a related homogeneous problem with frozen coefficients and asymptotic estimates under a certain approximating regime, which may have their own mathematical interest. We also deliver explicit examples of degenerate PDEs where our results take place.


title: Global Solvability of 2D MHD Boundary Layer Equations in Analytic Function Spaces

abstract: In this paper we are concerned with the global well-posedness of solutions to magnetohydrodynamics (MHD) boundary layer equations in analytic function spaces. When the initial data is a small perturbation around a selected profile, and such a profile is governed by an one dimensional heat equation with a source term, we establish the global in time existence and uniqueness of analytic solutions to the two dimensional (2D) MHD boundary layer equations. It is noted that the far-field state of velocity is not required to be small initially, but decays to zero as time tends to infinity with suitable decay rates. The whole analysis is divided into two parts: When the initial far-field states are not small, we reformulate the original problem into a small perturbation problem by extracting a suitable background profile which is governed by a heat equation, then we prove a long-time existence of solutions, and the lower bound of lifespan of solutions is given in term of the small parameter of initial perturbation; After establishing the long-time existence, combining the decay properties of far-field state and the properties of solutions to the heat equation, it is shown that both the solution obtained in the first part and the background profile indeed satisfy some smallness requirements when time goes to the lower bound of lifespan of solutions. Then we can show the global existence of solutions after this moment.


title: Weighted estimates of commutators for $0<p<\infty$

abstract: We establish weighted inequalities for $BMO$ commutators of sublinear operators for all $0<p<\infty$. For weights $w$ satisfying the doubling condition of order $q$ with $0<q<p$ and the reverse H\"{o}lder condition, we prove that $\bullet$ commutators $T_b$, which are bounded on $L^p$ with $1<p<\infty$, are bounded from some subspaces of $L^p_w$ to $L^p_w$ and to themselves for all $0<p<\infty$, these are applied to the commutators of singular integral operators and Hardy-Littelwood maximal operator, et.al, which are known to fail to be bounded from $H^1$ to $L^1$ and whose estimate has been open problems for $0<p$ enough small; $\bullet$ commutators $T_b$, whose associated operators $T$ are bounded on $L^p$ with $1<p<\infty$, are bounded from some subspaces of $L^p_w$ to $L^p_w$ and from some subspaces of $L^p_w$ to others for all $0<p<\infty$, these are applied to the commutators of maximal operators such as singular integral maximal operators, Carleson operator and the polynomial Carleson operator, et.al, the estimate of these commutators has been open problems for each $0<p<\infty$; $\bullet$ in particular, these imply that the commutators above are bounded from $H^p_w$ to $L^p_w$ and to itself for all $0<p\leq 1$.


title: Predicting Opioid Use Disorder from Longitudinal Healthcare Data using Multi-stream Transformer

abstract: Opioid Use Disorder (OUD) is a public health crisis costing the US billions of dollars annually in healthcare, lost workplace productivity, and crime. Analyzing longitudinal healthcare data is critical in addressing many real-world problems in healthcare. Leveraging the real-world longitudinal healthcare data, we propose a novel multi-stream transformer model called MUPOD for OUD identification. MUPOD is designed to simultaneously analyze multiple types of healthcare data streams, such as medications and diagnoses, by attending to segments within and across these data streams. Our model tested on the data from 392,492 patients with long-term back pain problems showed significantly better performance than the traditional models and recently developed deep learning models.


title: Flow-based Self-supervised Density Estimation for Anomalous Sound Detection

abstract: To develop a machine sound monitoring system, a method for detecting anomalous sound is proposed. Exact likelihood estimation using Normalizing Flows is a promising technique for unsupervised anomaly detection, but it can fail at out-of-distribution detection since the likelihood is affected by the smoothness of the data. To improve the detection performance, we train the model to assign higher likelihood to target machine sounds and lower likelihood to sounds from other machines of the same machine type. We demonstrate that this enables the model to incorporate a self-supervised classification-based approach. Experiments conducted using the DCASE 2020 Challenge Task2 dataset showed that the proposed method improves the AUC by 4.6% on average when using Masked Autoregressive Flow (MAF) and by 5.8% when using Glow, which is a significant improvement over the previous method.


title: Parareal Neural Networks Emulating a Parallel-in-time Algorithm

abstract: As deep neural networks (DNNs) become deeper, the training time increases. In this perspective, multi-GPU parallel computing has become a key tool in accelerating the training of DNNs. In this paper, we introduce a novel methodology to construct a parallel neural network that can utilize multiple GPUs simultaneously from a given DNN. We observe that layers of DNN can be interpreted as the time step of a time-dependent problem and can be parallelized by emulating a parallel-in-time algorithm called parareal. The parareal algorithm consists of fine structures which can be implemented in parallel and a coarse structure which gives suitable approximations to the fine structures. By emulating it, the layers of DNN are torn to form a parallel structure which is connected using a suitable coarse network. We report accelerated and accuracy-preserved results of the proposed methodology applied to VGG-16 and ResNet-1001 on several datasets.


title: Ferromagnetic helical nodal line and Kane-Mele spin-orbit coupling in kagome metal Fe3Sn2

abstract: The two-dimensional kagome lattice hosts Dirac fermions at its Brillouin zone corners K and K', analogous to the honeycomb lattice. In the density functional theory electronic structure of ferromagnetic kagome metal Fe$_3$Sn$_2$, without spin-orbit coupling we identify two energetically split helical nodal lines winding along $z$ in the vicinity of K and K' resulting from the trigonal stacking of the kagome layers. We find that hopping across A-A stacking introduces a layer splitting in energy while that across A-B stacking controls the momentum space amplitude of the helical nodal lines. The effect of spin-orbit coupling is found to resemble that of a Kane-Mele term, where the nodal lines can either be fully gapped to quasi-two-dimensional massive Dirac fermions, or remain gapless at discrete Weyl points depending on the ferromagnetic moment orientation. Aside from numerically establishing Fe$_3$Sn$_2$ as a model Dirac kagome metal, our results provide insights into materials design of topological phases from the lattice point of view, where paradigmatic low dimensional lattice models often find realizations in crystalline materials with three-dimensional stacking.


title: Chebyshev expansion of spectral functions using restricted Boltzmann machines

abstract: Calculating the spectral function of two dimensional systems is arguably one of the most pressing challenges in modern computational condensed matter physics. While efficient techniques are available in lower dimensions, two dimensional systems present insurmountable hurdles, ranging from the sign problem in quantum Monte Carlo (MC), to the entanglement area law in tensor network based methods. We hereby present a variational approach based on a Chebyshev expansion of the spectral function and a neural network representation for the wave functions. The Chebyshev moments are obtained by recursively applying the Hamiltonian and projecting on the space of variational states using a modified natural gradient descent method. We compare this approach with a modified approximation of the spectral function which uses a Krylov subspace constructed from the "Chebyshev wave-functions". We present results for the one-dimensional and two-dimensional Heisenberg model on the square lattice, and compare to those obtained by other methods in the literature.


title: DDUO: General-Purpose Dynamic Analysis for Differential Privacy

abstract: Differential privacy enables general statistical analysis of data with formal guarantees of privacy protection at the individual level. Tools that assist data analysts with utilizing differential privacy have frequently taken the form of programming languages and libraries. However, many existing programming languages designed for compositional verification of differential privacy impose significant burden on the programmer (in the form of complex type annotations). Supplementary library support for privacy analysis built on top of existing general-purpose languages has been more usable, but incapable of pervasive end-to-end enforcement of sensitivity analysis and privacy composition. We introduce DDUO, a dynamic analysis for enforcing differential privacy. DDUO is usable by non-experts: its analysis is automatic and it requires no additional type annotations. DDUO can be implemented as a library for existing programming languages; we present a reference implementation in Python which features moderate runtime overheads on realistic workloads. We include support for several data types, distance metrics and operations which are commonly used in modern machine learning programs. We also provide initial support for tracking the sensitivity of data transformations in popular Python libraries for data analysis. We formalize the novel core of the DDUO system and prove it sound for sensitivity analysis via a logical relation for metric preservation. We also illustrate DDUO's usability and flexibility through various case studies which implement state-of-the-art machine learning algorithms.


title: Ferroelectric HfO$_2$ Memory Transistors with High-$\kappa$ Interfacial Layer and Write Endurance Exceeding $10^{10}$ Cycles

abstract: We demonstrate ferroelectric (FE) memory transistors on a crystalline silicon channel with endurance exceeding $10^{10}$ cycles. The ferroelectric transistors (FeFETs) incorporate a high-$\kappa$ interfacial layer (IL) of thermally grown silicon nitride (SiN$_x$) and a thin 4.5 nm layer of Zr-doped FE-HfO$_2$ on a $\sim$30 nm SOI channel. The device shows a $\sim$ 1V memory window in a DC sweep of just $\pm$ 2.5V, and can be programmed and erased with voltage pulses of $V_G= \pm$ 3V at a pulse width of 250 ns. The device also shows very good retention behavior. These results indicate that appropriate engineering of the IL layer could substantially improve FeFET device performance and reliability.


title: The small finitistic dimensions of commutative rings

abstract: Let $R$ be a commutative ring with identity. The small finitistic dimension $\fPD(R)$ of $R$ is defined to be the supremum of projective dimensions of $R$-modules with finite projective resolutions. In this paper, we characterize a ring $R$ with $\fPD(R)\leq n$ using finitely generated semi-regular ideals, tilting modules, cotilting modules of cofinite type or vaguely associated prime ideals. As an application, we obtain that if $R$ is a Noetherian ring, then $\fPD(R)= \sup\{\grade(\m,R)|\m\in \Max(R)\}$ where $\grade(\m,R)$ is the grade of $\m$ on $R$ . We also show that a ring $R$ satisfies $\fPD(R)\leq 1$ if and only if $R$ is a $\DW$ ring. As applications, we show that the small finitistic dimensions of strong \Prufer\ rings and $\LPVD$s are at most one. Moreover, for any given $n\in \mathbb{N}$, we obtain examples of total rings of quotients $R$ with $\fPD(R)=n$.


title: Track to Detect and Segment: An Online Multi-Object Tracker

abstract: Most online multi-object trackers perform object detection stand-alone in a neural net without any input from tracking. In this paper, we present a new online joint detection and tracking model, TraDeS (TRAck to DEtect and Segment), exploiting tracking clues to assist detection end-to-end. TraDeS infers object tracking offset by a cost volume, which is used to propagate previous object features for improving current object detection and segmentation. Effectiveness and superiority of TraDeS are shown on 4 datasets, including MOT (2D tracking), nuScenes (3D tracking), MOTS and Youtube-VIS (instance segmentation tracking). Project page: https://jialianwu.com/projects/TraDeS.html.


title: Robustly Optimized and Distilled Training for Natural Language Understanding

abstract: In this paper, we explore multi-task learning (MTL) as a second pretraining step to learn enhanced universal language representation for transformer language models. We use the MTL enhanced representation across several natural language understanding tasks to improve performance and generalization. Moreover, we incorporate knowledge distillation (KD) in MTL to further boost performance and devise a KD variant that learns effectively from multiple teachers. By combining MTL and KD, we propose Robustly Optimized and Distilled (ROaD) modeling framework. We use ROaD together with the ELECTRA model to obtain state-of-the-art results for machine reading comprehension and natural language inference.


title: H($\text{curl}^2$)-conforming quadrilateral spectral element method for quad-curl problems

abstract: In this paper, we propose an $H(\text{curl}^2)$-conforming quadrilateral spectral element method to solve quad-curl problems. Starting with generalized Jacobi polynomials, we first introduce quasi-orthogonal polynomial systems for vector fields over rectangles. $H(\text{curl}^2)$-conforming elements over arbitrary convex quadrilaterals are then constructed explicitly in a hierarchical pattern using the contravariant transform together with the bilinear mapping from the reference square onto each quadrilateral. It is astonishing that both the simplest rectangular and quadrilateral spectral elements possess only 8 degrees of freedom on each physical element. In the sequel, we propose our $H(\text{curl}^2)$-conforming quadrilateral spectral element approximation based on the mixed weak formulation to solve the quad-curl equation and its eigenvalue problem. Numerical results show the effectiveness and efficiency of our method.


title: Soft and subspace robust multivariate rank tests based on entropy regularized optimal transport

abstract: In this paper, we extend the recently proposed multivariate rank energy distance, based on the theory of optimal transport, for statistical testing of distributional similarity, to soft rank energy distance. Being differentiable, this in turn allows us to extend the rank energy to a subspace robust rank energy distance, dubbed Projected soft-Rank Energy distance, which can be computed via optimization over the Stiefel manifold. We show via experiments that using projected soft rank energy one can trade-off the detection power vs the false alarm via projections onto an appropriately selected low dimensional subspace. We also show the utility of the proposed tests on unsupervised change point detection in multivariate time series data. All codes are publicly available at the link provided in the experiment section.


title: 1I/'Oumuamua as an N2 ice fragment of an exo-pluto surface. II. Generation of N2 ice fragments and the origin of 'Oumuamua

abstract: The origin of the interstellar object 1I/'Oumuamua, has defied explanation. In a companion paper (Jackson & Desch, 2021), we show that a body of N2 ice with axes 45 m x 44 m x 7.5 m at the time of observation would be consistent with its albedo, non-gravitational acceleration, and lack of observed CO or CO2 or dust. Here we demonstrate that impacts on the surfaces of Pluto-like Kuiper belt objects (KBOs) would have generated and ejected ~10^14 collisional fragments--roughly half of them H2O ice fragments and half of them N2 ice fragments--due to the dynamical instability that depleted the primordial Kuiper belt. We show consistency between these numbers and the frequency with which we would observe interstellar objects like 1I/'Oumuamua, and more comet-like objects like 2I/Borisov, if other stellar systems eject such objects with efficiency like that of the Sun; we infer that differentiated KBOs and dynamical instabilities that eject impact-generated fragments may be near-universal among extrasolar systems. Galactic cosmic rays would erode such fragments over 4.5 Gyr, so that fragments are a small fraction (~0.1%) of long-period Oort comets, but C/2016 R2 may be an example. We estimate 'Oumuamua was ejected about 0.4-0.5 Gyr ago, from a young (~10^8 yr) stellar system, which we speculate was in the Perseus arm. Objects like 'Oumuamua may directly probe the surface compositions of a hitherto-unobserved type of exoplanet: "exo-plutos". 'Oumuamua may be the first sample of an exoplanet brought to us.


title: Multi-objective minimum time optimal control for low-thrust trajectory design

abstract: We propose a reachability approach for infinite and finite horizon multi-objective optimization problems for low-thrust spacecraft trajectory design. The main advantage of the proposed method is that the Pareto front can be efficiently constructed from the zero level set of the solution to a Hamilton-Jacobi-Bellman equation. We demonstrate the proposed method by applying it to a low-thrust spacecraft trajectory design problem. By deriving the analytic expression for the Hamiltonian and the optimal control policy, we are able to efficiently compute the backward reachable set and reconstruct the optimal trajectories. Furthermore, we show that any reconstructed trajectory will be guaranteed to be weakly Pareto optimal. The proposed method can be used as a benchmark for future research of applying reachability analysis to low-thrust spacecraft trajectory design.


title: Photonic Gap Antennas Based on High Index-Contrast Slot-Waveguides

abstract: Optical antennas made of low-loss dielectrics have several advantages over plasmonic antennas, including high radiative quantum efficiency, negligible heating and excellent photostability. However, due to weak spatial confinement, conventional dielectric antennas fail to offer light-matter interaction strengths on par with those of plasmonic antennas. We propose here an all-dielectric antenna configuration that can support strongly confined modes ($V\sim10^{-4}\lambda_{0}^3$) while maintaining unity antenna quantum efficiency. This configuration consists of a high-index pillar structure with a transverse gap that is filled with a low-index material, where the contrast of indices induces a strong enhancement of the electric field perpendicular to the gap. We provide a detailed explanation of the operation principle of such Photonic Gap Antennas (PGAs) based on the dispersion relation of symmetric and asymmetric horizontal slot-waveguides. To discuss the properties of PGAs, we consider silicon pillars with air or CYTOP as the gap-material. We show by full-wave simulations that PGAs with an emitter embedded in the gap can enhance the spontaneous emission rate by a factor of $\sim$1000 for air gaps and $\sim$400 for CYTOP gaps over a spectral bandwidth of $\Delta\lambda\approx300$ nm at $\lambda=1.25$ \textmu m. Furthermore, the PGAs can be designed to provide unidirectional out-of-plane radiation across a substantial portion of their spectral bandwidth. This is achieved by setting the position of the gap at an optimized off-centered position of the pillar so as to properly break the vertical symmetry of the structure. We also demonstrate that, when acting as receivers, PGAs can lead to a near-field intensity enhancement by a factor of $\sim$3000 for air gaps and $\sim$1200 for CYTOP gaps.


title: Some Size and Structure Metrics for Quantum Software

abstract: Quantum software plays a critical role in exploiting the full potential of quantum computing systems. As a result, it is drawing increasing attention recently. As research in quantum programming reaches maturity with a number of active research and practical products, software metric researchers need to focus on this new paradigm to evaluate it rigorously and quantitatively. As the first step, this paper proposes some basic metrics for quantum software, which mainly focus on measuring the size and structure of quantum software. These metrics are defined at different abstraction levels to represent various size and structure attributes in quantum software explicitly. The proposed metrics can be used to evaluate quantum software from various viewpoints.


title: Efficient computation of linear response of chaotic attractors with one-dimensional unstable manifolds

abstract: This paper presents the space-split sensitivity or the S3 algorithm to transform Ruelle's linear response formula into a well-conditioned ergodic-averaging computation. We prove a decomposition of Ruelle's formula that is differentiable on the unstable manifold, which we assume to be one-dimensional. This decomposition of Ruelle's formula ensures that one of the resulting terms, the stable contribution, can be computed using a regularized tangent equation, similar to in a non-chaotic system. The remaining term, known as the unstable contribution, is regularized and converted into an efficiently computable ergodic average. In this process, we develop new algorithms, which may be useful beyond linear response, to compute i) a fundamental statistical quantity we introduce called the density gradient, and ii) the unstable derivatives of the regularized tangent vector field and the unstable direction. We prove that the S3 algorithm, which combines these computational ingredients that enter the stable and unstable contribution, converges like a Monte Carlo approximation of Ruelle's formula. The algorithm presented here is hence a first step toward full-fledged applications of sensitivity analysis in chaotic systems, wherever such applications have been limited due to lack of availability of long-term sensitivities.


title: Connes Integration Formula without singular traces

abstract: A version of Connes Integration Formula which provides concrete asymptotics of the eigenvalues is given. This radically extending the class of quantum-integrable functions on compact Riemannian manifolds.


title: Coherence of assistance and assisted maximally coherent states

abstract: Coherence and entanglement are fundamental concepts in resource theory. The coherence (entanglement) of assistance is the coherence (entanglement) that can be extracted assisted by another party with local measurement and classical communication. We introduce and study the general coherence of assistance. First, in terms of real symmetric concave functions on the probability simplex, the coherence of assistance and the entanglement of assistance are shown to be in one-to-one correspondence. We then introduce two classes of quantum states: the assisted maximally coherent states and the assisted maximally entangled states. They can be transformed into maximally coherent or entangled pure states with the help of another party using local measurement and classical communication. We give necessary conditions for states to be assisted maximally coherent or assisted maximally entangled. Based on these, a unified framework between coherence and entanglement including coherence (entanglement) measures, coherence (entanglement) of assistance, coherence (entanglement) resources is proposed. Then we show that the coherence of assistance as well as entanglement of assistance are strictly larger than the coherence of convex roof and entanglement of convex roof for all full rank density matrices. So all full rank quantum states are distillable in the assisted coherence distillation.


title: A Novel Paper Recommendation Method Empowered by Knowledge Graph: for Research Beginners

abstract: Searching for papers from different academic databases is the most commonly used method by research beginners to obtain cross-domain technical solutions. However, it is usually inefficient and sometimes even useless because traditional search methods neither consider knowledge heterogeneity in different domains nor build the bottom layer of search, including but not limited to the characteristic description text of target solutions and solutions to be excluded. To alleviate this problem, a novel paper recommendation method is proposed herein by introducing "master-slave" domain knowledge graphs, which not only help users express their requirements more accurately but also helps the recommendation system better express knowledge. Specifically, it is not restricted by the cold start problem and is a challenge-oriented method. To identify the rationality and usefulness of the proposed method, we selected two cross-domains and three different academic databases for verification. The experimental results demonstrate the feasibility of obtaining new technical papers in the cross-domain scenario by research beginners using the proposed method. Further, a new research paradigm for research beginners in the early stages is proposed herein.


title: EX-RAY: Distinguishing Injected Backdoor from Natural Features in Neural Networks by Examining Differential Feature Symmetry

abstract: Backdoor attack injects malicious behavior to models such that inputs embedded with triggers are misclassified to a target label desired by the attacker. However, natural features may behave like triggers, causing misclassification once embedded. While they are inevitable, mis-recognizing them as injected triggers causes false warnings in backdoor scanning. A prominent challenge is hence to distinguish natural features and injected backdoors. We develop a novel symmetric feature differencing method that identifies a smallest set of features separating two classes. A backdoor is considered injected if the corresponding trigger consists of features different from the set of features distinguishing the victim and target classes. We evaluate the technique on thousands of models, including both clean and trojaned models, from the TrojAI rounds 2-4 competitions and a number of models on ImageNet. Existing backdoor scanning techniques may produce hundreds of false positives (i.e., clean models recognized as trojaned). Our technique removes 78-100% of the false positives (by a state-of-the-art scanner ABS) with a small increase of false negatives by 0-30%, achieving 17-41% overall accuracy improvement, and facilitates achieving top performance on the leaderboard. It also boosts performance of other scanners. It outperforms false positive removal methods using L2 distance and attribution techniques. We also demonstrate its potential in detecting a number of semantic backdoor attacks.


title: Investigating Globular Cluster Elemental Abundance Anomalies Using $(^3\text{He},d)$ Proton Transfer Reactions

abstract: Globular clusters are dense aggregates of stars that evolve in relative isolation. For the better part of $40$ years these clusters have been known to possess unique chemical signatures called abundance anomalies. Recent observations have found these abundance anomalies to be the result of distinct stellar populations with the youngest population undergoing an unknown enrichment process. Understanding these chemical signatures requires a precise understanding of the thermonuclear reaction rates at relatively low temperatures. At these low temperatures reaction rates suffer from large uncertainties arising from poorly understood resonances in several key reactions. Transfer reactions provide key constrains on nuclear inputs for these resonances. This thesis presents an updated understanding of the sodium and potassium destroying reactions $^{23}$Na$(p, \gamma)$ and $^{39}$K$(p, \gamma)$, respectively. A reevaluated rate for $^{39}$K$(p, \gamma)$ indicates that it is less precisely known than previously thought, and future experimental study is needed to reduce its impact on globular cluster nucleosynthesis. Novel Bayesian techniques assess the uncertainties arising from transfer measurements. These techniques are applied to the transfer reaction $^{23}$Na$(^3\text{He}, d)$, which was carried out at Triangle Universities Nuclear Laboratory. Results of this experiment indicate that the energy of an important resonance in $^{23}$Na$(p, \gamma)$ is much lower than previously thought at $E_r =132(3)$ keV. The transfer measurement also indicates tension between previous direct studies of the resonance strength and the current transfer measurement. The impact of these uncertainties on the $^{23}$Na$(p, \gamma)$ reaction rate is investigated, and it is shown that this rate requires more intensive study to provide the precision needed to constrain nucleosynthesis in globular clusters.


title: A Stochastic Variance Reduction Algorithm with Bregman Distances for Structured Composite Problems

abstract: We develop a novel stochastic primal dual splitting method with Bregman distances for solving a structured composite problems involving infimal convolutions in non-Euclidean spaces. The sublinear convergence in expectation of the primal-dual gap is proved under mild conditions on stepsize for the general case. The linear convergence rate is obtained under additional condition like the strong convexity relative to Bregman functions.


title: Density dependence of the quark condensate in isospin-asymmetric nuclear matter

abstract: We compute the density dependence of the quark condensate and how it changes under the influence of isospin-asymmetric nuclear matter. This is achieved by the calculation of the relevant Feynman diagrams using in-medium chiral perturbation theory. We find that the absolute value of the quark condensate decreases in nuclear matter by around 35% at normal nuclear density, in agreement with previous model-independent calculations. We also present an quantitative estimation of the difference of up- and down quark in-medium condensates.


title: Deep, Closely-Packed, Long-Lived Cyclones on Jupiter's Poles

abstract: Juno Mission to Jupiter has found closely-packed cyclones at the planet's two poles. The observation that these cyclones coexist in very confined space, with outer rims almost touching each other but without merging, poses a big puzzle. In this work, we present numerical calculations showing that convectively sustained, closely-packed cyclones can form and survive without merging for a very long time in polar region of a deep rotating convection zone (for thousands of planetary rotation periods). Through an idealized application of the inertial stability criterion for axisymmetric circulations, it is found that the large Coriolis parameter near the pole plays a crucial role in allowing the cyclones to be packed closely.

categories: astro-ph.EP physics.ao-ph physics.flu-dyn physics.geo-ph


title: An Efficient Vectorization Scheme for Stencil Computation

abstract: Stencil computation is one of the most important kernels in various scientific and engineering applications. A variety of work has focused on vectorization and tiling techniques, aiming at exploiting the in-core data parallelism and data locality respectively. In this paper, the downsides of existing vectorization schemes are analyzed. Briefly, they either incur data alignment conflicts or hurt the data locality when integrated with tiling. Then we propose a novel transpose layout to preserve the data locality for tiling and reduce the data reorganization overhead for vectorization simultaneously. To further improve the data reuse at the register level, a time loop unroll-and-jam strategy is designed to perform multistep stencil computation along the time dimension. Experimental results on the AVX-2 and AVX-512 CPUs show that our approach obtains a competitive performance.


title: GraphSMOTE: Imbalanced Node Classification on Graphs with Graph Neural Networks

abstract: Node classification is an important research topic in graph learning. Graph neural networks (GNNs) have achieved state-of-the-art performance of node classification. However, existing GNNs address the problem where node samples for different classes are balanced; while for many real-world scenarios, some classes may have much fewer instances than others. Directly training a GNN classifier in this case would under-represent samples from those minority classes and result in sub-optimal performance. Therefore, it is very important to develop GNNs for imbalanced node classification. However, the work on this is rather limited. Hence, we seek to extend previous imbalanced learning techniques for i.i.d data to the imbalanced node classification task to facilitate GNN classifiers. In particular, we choose to adopt synthetic minority over-sampling algorithms, as they are found to be the most effective and stable. This task is non-trivial, as previous synthetic minority over-sampling algorithms fail to provide relation information for newly synthesized samples, which is vital for learning on graphs. Moreover, node attributes are high-dimensional. Directly over-sampling in the original input domain could generates out-of-domain samples, which may impair the accuracy of the classifier. We propose a novel framework, GraphSMOTE, in which an embedding space is constructed to encode the similarity among the nodes. New samples are synthesize in this space to assure genuineness. In addition, an edge generator is trained simultaneously to model the relation information, and provide it for those new samples. This framework is general and can be easily extended into different variations. The proposed framework is evaluated using three different datasets, and it outperforms all baselines with a large margin.


title: Semi-Supervised Graph-to-Graph Translation

abstract: Graph translation is very promising research direction and has a wide range of potential real-world applications. Graph is a natural structure for representing relationship and interactions, and its translation can encode the intrinsic semantic changes of relationships in different scenarios. However, despite its seemingly wide possibilities, usage of graph translation so far is still quite limited. One important reason is the lack of high-quality paired dataset. For example, we can easily build graphs representing peoples' shared music tastes and those representing co-purchase behavior, but a well paired dataset is much more expensive to obtain. Therefore, in this work, we seek to provide a graph translation model in the semi-supervised scenario. This task is non-trivial, because graph translation involves changing the semantics in the form of link topology and node attributes, which is difficult to capture due to the combinatory nature and inter-dependencies. Furthermore, due to the high order of freedom in graph's composition, it is difficult to assure the generalization ability of trained models. These difficulties impose a tighter requirement for the exploitation of unpaired samples. Addressing them, we propose to construct a dual representation space, where transformation is performed explicitly to model the semantic transitions. Special encoder/decoder structures are designed, and auxiliary mutual information loss is also adopted to enforce the alignment of unpaired/paired examples. We evaluate the proposed method in three different datasets.


title: ARXON: A Framework for Approximate Communication over Photonic Networks-on-Chip

abstract: The approximate computing paradigm advocates for relaxing accuracy goals in applications to improve energy-efficiency and performance. Recently, this paradigm has been explored to improve the energy-efficiency of silicon photonic networks-on-chip (PNoCs). Silicon photonic interconnects suffer from high power dissipation because of laser sources, which generate carrier wavelengths, and tuning power required for regulating photonic devices under different uncertainties. In this paper, we propose a framework called ARXON to reduce such power dissipation overhead by enabling intelligent and aggressive approximation during communication over silicon photonic links in PNoCs. Our framework reduces laser and tuning-power overhead while intelligently approximating communication, such that application output quality is not distorted beyond an acceptable limit. Simulation results show that our framework can achieve up to 56.4% lower laser power consumption and up to 23.8% better energy-efficiency than the best-known prior work on approximate communication with silicon photonic interconnects and for the same application output quality.


title: Towards Indirect Top-Down Road Transport Emissions Estimation

abstract: Road transportation is one of the largest sectors of greenhouse gas (GHG) emissions affecting climate change. Tackling climate change as a global community will require new capabilities to measure and inventory road transport emissions. However, the large scale and distributed nature of vehicle emissions make this sector especially challenging for existing inventory methods. In this work, we develop machine learning models that use satellite imagery to perform indirect top-down estimation of road transport emissions. Our initial experiments focus on the United States, where a bottom-up inventory was available for training our models. We achieved a mean absolute error (MAE) of 39.5 kg CO$_{2}$ of annual road transport emissions, calculated on a pixel-by-pixel (100 m$^{2}$) basis in Sentinel-2 imagery. We also discuss key model assumptions and challenges that need to be addressed to develop models capable of generalizing to global geography. We believe this work is the first published approach for automated indirect top-down estimation of road transport sector emissions using visual imagery and represents a critical step towards scalable, global, near-real-time road transportation emissions inventories that are measured both independently and objectively.


title: Reliability-based Topology Optimization using Stochastic Gradients

abstract: This paper addresses the computational challenges in reliability-based topology optimization (RBTO) of structures associated with the estimation of statistics of the objective and constraints using standard sampling methods, and overcomes the accuracy issues of traditional methods that rely on approximating the limit state function. Herein, we present a stochastic gradient-based approach, where we estimate the probability of failure at every few iterations using an efficient sampling strategy. To estimate the gradients of the failure probability with respect to the design parameters, we apply Bayes' rule wherein we assume a parametric exponential model for the probability density function of the design parameters conditioned on the failure. The design parameters as well as the parameters of this probability density function are updated using a stochastic gradient descent approach requiring only a small, e.g., O(1), number of random samples per iteration, thus leading to a considerable reduction of the computational cost as compared to standard RBTO techniques. We illustrate the proposed approach with a benchmark example that has an analytical solution as well as two widely used problems in structural topology optimization. These examples illustrate the efficacy of the approach in producing reliable designs.


title: Regular saturated graphs and sum-free sets

abstract: In a recent paper, Gerbner, Patk\'{o}s, Tuza and Vizer studied regular $F$-saturated graphs. One of the essential questions is given $F$, for which $n$ does a regular $n$-vertex $F$-saturated graph exist. They proved that for all sufficiently large $n$, there is a regular $K_3$-saturated graph with $n$ vertices. We extend this result to both $K_4$ and $K_5$ and prove some partial results for larger complete graphs. Using a variation of sum-free sets from additive combinatorics, we prove that for all $k \geq 2$, there is a regular $C_{2k+1}$-saturated with $n$ vertices for infinitely many $n$. Studying the sum-free sets that give rise to $C_{2k+1}$-saturated graphs is an interesting problem on its own and we state an open problem in this direction.


title: Thermal Schwinger Effect: Defect Production in Compressed Filament Bundles

abstract: We discuss the response of biopolymer filament bundles bound by transient cross linkers to compressive loading. These systems admit a mechanical instability at stresses typically below that of traditional Euler buckling. In this instability, there is thermally-activated pair production of topological defects that generate localized regions of bending -- kinks. These kinks shorten the bundle's effective length thereby reducing the elastic energy of the mechanically loaded structure. This effect is the thermal analog of the Schwinger effect, in which a sufficiently large electric field causes electron-positron pair production. We discuss this analogy and describe the implications of this analysis for the mechanics of biopolymer filament bundles of various types under compression.


title: Skeleton Aware Multi-modal Sign Language Recognition

abstract: Sign language is commonly used by deaf or speech impaired people to communicate but requires significant effort to master. Sign Language Recognition (SLR) aims to bridge the gap between sign language users and others by recognizing signs from given videos. It is an essential yet challenging task since sign language is performed with the fast and complex movement of hand gestures, body posture, and even facial expressions. Recently, skeleton-based action recognition attracts increasing attention due to the independence between the subject and background variation. However, skeleton-based SLR is still under exploration due to the lack of annotations on hand keypoints. Some efforts have been made to use hand detectors with pose estimators to extract hand key points and learn to recognize sign language via Neural Networks, but none of them outperforms RGB-based methods. To this end, we propose a novel Skeleton Aware Multi-modal SLR framework (SAM-SLR) to take advantage of multi-modal information towards a higher recognition rate. Specifically, we propose a Sign Language Graph Convolution Network (SL-GCN) to model the embedded dynamics and a novel Separable Spatial-Temporal Convolution Network (SSTCN) to exploit skeleton features. RGB and depth modalities are also incorporated and assembled into our framework to provide global information that is complementary to the skeleton-based methods SL-GCN and SSTCN. As a result, SAM-SLR achieves the highest performance in both RGB (98.42\%) and RGB-D (98.53\%) tracks in 2021 Looking at People Large Scale Signer Independent Isolated SLR Challenge. Our code is available at https://github.com/jackyjsy/CVPR21Chal-SLR


title: GSVNet: Guided Spatially-Varying Convolution for Fast Semantic Segmentation on Video

abstract: This paper addresses fast semantic segmentation on video.Video segmentation often calls for real-time, or even fasterthan real-time, processing. One common recipe for conserving computation arising from feature extraction is to propagate features of few selected keyframes. However, recent advances in fast image segmentation make these solutions less attractive. To leverage fast image segmentation for furthering video segmentation, we propose a simple yet efficient propagation framework. Specifically, we perform lightweight flow estimation in 1/8-downscaled image space for temporal warping in segmentation outpace space. Moreover, we introduce a guided spatially-varying convolution for fusing segmentations derived from the previous and current frames, to mitigate propagation error and enable lightweight feature extraction on non-keyframes. Experimental results on Cityscapes and CamVid show that our scheme achieves the state-of-the-art accuracy-throughput trade-off on video segmentation.


title: Multi-Robot Routing with Time Windows: A Column Generation Approach

abstract: Robots performing tasks in warehouses provide the first example of wide-spread adoption of autonomous vehicles in transportation and logistics. The efficiency of these operations, which can vary widely in practice, are a key factor in the success of supply chains. In this work we consider the problem of coordinating a fleet of robots performing picking operations in a warehouse so as to maximize the net profit achieved within a time period while respecting problem- and robot-specific constraints. We formulate the problem as a weighted set packing problem where the elements in consideration are items on the warehouse floor that can be picked up and delivered within specified time windows. We enforce the constraint that robots must not collide, that each item is picked up and delivered by at most one robot, and that the number of robots active at any time does not exceed the total number available. Since the set of routes is exponential in the size of the input, we attack optimization of the resulting integer linear program using column generation, where pricing amounts to solving an elementary resource-constrained shortest-path problem. We propose an efficient optimization scheme that avoids consideration of every increment within the time windows. We also propose a heuristic pricing algorithm that can efficiently solve the pricing subproblem. While this itself is an important problem, the insights gained from solving these problems effectively can lead to new advances in other time-widow constrained vehicle routing problems.


title: Channel Estimation for Intelligent Reflecting Surface Assisted Backscatter Communication

abstract: Intelligent reflecting surface (IRS) is a promising technology to improve the performance of backscatter communication systems by smartly reconfiguring the multi-reflection channel. To fully exploit the passive beamforming gain of IRS in backscatter communication, channel state information (CSI) is indispensable but more practically challenging to acquire than conventional IRS-assisted systems, since IRS passively reflects signals over both the forward and backward (backscattering) links between the reader and tag. To address this issue, we propose in this letter a new and efficient channel estimation scheme for the IRS-assisted backscatter communication system. To minimize the mean-square error (MSE) of channel estimation, we formulate and solve an optimization problem by designing the IRS training reflection matrix for channel estimation under the constraints of unit-modulus elements and full rank. Simulation results verify the effectiveness of the proposed channel estimation scheme as compared to other baseline schemes.


title: Continuous Time Quantum Walks on Graphs: Group State Transfer

abstract: We introduce the concept of group state transfer on graphs, summarize its relationship to other concepts in the theory of quantum walks, set up a basic theory, and discuss examples. Let $X$ be a graph with adjacency matrix $A$ and consider quantum walks on the vertex set $V(X)$ governed by the continuous time-dependent unitary transition operator $U(t)= \exp(itA)$. For $S,T\subseteq V(X)$, we says $X$ admits "group state transfer" from $S$ to $T$ at time $\tau$ if the submatrix of $U(\tau)$ obtained by restricting to columns in $S$ and rows not in $T$ is the all-zero matrix. As a generalization of perfect state transfer, fractional revival and periodicity, group state transfer satisfies natural monotonicity and transitivity properties. Yet non-trivial group state transfer is still rare; using a compactness argument, we prove that bijective group state transfer (the optimal case where $|S|=|T|$) is absent for almost all $t$. Focusing on this bijective case, we obtain a structure theorem, prove that bijective group state transfer is "monogamous", and study the relationship between the projections of $S$ and $T$ into each eigenspace of the graph. Group state transfer is obviously preserved by graph automorphisms and this gives us information about the relationship between the setwise stabilizer of $S\subseteq V(X)$ and the stabilizers of naturally defined subsets obtained by spreading $S$ out over time and crudely reversing this process. These operations are sufficiently well-behaved to give us a topology on $V(X)$ which is likely to be simply the topology of subsets for which bijective group state transfer occurs at that time. We illustrate non-trivial group state transfer in bipartite graphs with integer eigenvalues, in joins of graphs, and in symmetric double stars. The Cartesian product allows us to build new examples from old ones.


title: Nanoscale trapping of interlayer excitons in a 2D semiconductor heterostructure

abstract: For quantum technologies based on single excitons and spins, the deterministic placement and control of a single exciton is a long-standing goal. MoSe2-WSe2 heterostructures host spatially indirect interlayer excitons (IXs) which exhibit highly tunable energies and unique spin-valley physics, making them promising candidates for quantum information processing. Previous IX trapping approaches involving moir\'e superlattices and nanopillars do not meet the quantum technology requirements of deterministic placement and energy tunability. Here, we use a nanopatterned graphene gate to create a sharply varying electric field in close proximity to a MoSe2-WSe2 heterostructure. The dipole interaction between the IX and the electric field creates an ~20 nm trap. The trapped IXs show the predicted electric field dependent energy, saturation at low excitation power, and increased lifetime, all signatures of strong spatial confinement. The demonstrated architecture is a crucial step towards deterministic trapping of single IXs, which has broad applications to scalable quantum technologies.


title: Abelian hearts of twin cotorsion pairs on extriangulated categories

abstract: It was shown recently that the heart of a twin cotorsion pair on an extriangulated category is semi-abelian. In this article, we consider a special kind of hearts of twin cotorsion pairs induced by $d$-cluster tilting subcategories in extriangulated categories. We give a necessary and sufficient condition for such hearts to be abelian. In particular, we also can see that such hearts are hereditary. As an application, this generalizes the work by Liu in an exact case, thereby providing new insights in a triangulated case.


title: Remote Monitoring of Patient Respiration with Mask Attachment -- A Pragmatic Solution for Medical Facilities

abstract: Remote monitoring of vital signs in infectious patients minimizes the risks of viral transmissions to healthcare professionals. Evidence indicates that donning face masks reduces the risk of viral transmissions and is now the norm in medical facilities. We propose attaching an acoustic-sensing device onto face masks to assist medical facilities in monitoring patients' respiration remotely. Usability and functionality studies of the modified face mask were evaluated on 16 healthy participants, who were blindfolded throughout the data collection. Around half of the participants noticed the difference between the modified and unmodified masks but they also reported there was no discomfort in using the modified mask. Respiratory rates of the participants were evaluated for one minute and the mean error of respiratory rate was found to be 2.0 +/- 1.3 breath per minute. As all participants were healthy, the wheeze detection algorithm was assessed by playing 176 wheezes and 176 normal breaths through a foam mannequin. The recordings were played at three different times to account for varying environmental noise. The overall accuracy of the wheeze detection algorithm was 91.9%. The current findings support and suggest the use of the mask attachment in medical facilities.


title: Simulation approach to reach the SQ limit in CIGS-based dual-heterojunction solar cell

abstract: In this article, we demonstrate the design and simulation of a highly-efficient n-CdS/p-CIGS/p+-CGS dual heterojunction solar cell. The simulation was performed using SCAPS-1D software with reported experimental physical parameters. The simulation performance of our proposed design arises 47% with Voc=0.98 V, Jsc=59.94 mA/cm2 and FF=80.07%, respectively. The high short circuit current and hence the high efficiency is predominantly originated from the longer wavelength absorption of photon through a tail-states-assisted two-step upconversion in dual heterojunction (DH) and thus reaches the SQ detailed balance limit of DH solar cell.


title: The Adoption of Blockchain-based Decentralized Exchanges

abstract: We investigate the market microstructure of Automated Market Makers (AMMs), the most prominent type of blockchain-based decentralized exchanges. We show that the order execution mechanism yields token value loss for liquidity providers if token exchange rates are volatile. AMMs are adopted only if their token pairs are of high personal use for investors, or the token price movements of the pair are highly correlated. A pricing curve with higher curvature reduces the arbitrage problem but also investors' surplus. Pooling multiple tokens exacerbates the arbitrage problem. We provide statistical support for our main model implications using transaction-level data of AMMs.


title: A Multilayer Network Model implementation for Covid-19

abstract: We present a numerical implementation for a multilayer network used to model the transmission of Covid-19 or other diseases with a similar transmission mechanism. The model incorporates different contact types between individuals (household, social contacts, and strangers), which allows flexibility compared to standard SIR type models. The algorithm described in this paper is a simplification of the model used to give public health authorities an additional tool for the decision-making process in Costa Rica, by simulating extensive possible scenarios and projections.


title: A stationary set method for estimating oscillatory integrals

abstract: We propose a new method of estimating oscillatory integrals, which we call a stationary set method. We use it to obtain the sharp convergence exponents of Tarry's problems in dimension two for every degree $k\ge 2$. As a consequence, we obtain sharp Fourier extension estimates for a family of monomial surfaces.


title: Closed-Loop Error Learning Control for Uncertain Nonlinear Systems With Experimental Validation on a Mobile Robot

abstract: This paper develops a Closed-Loop Error Learning Control (CLELC) algorithm for feedback linearizable systems with experimental validation on a mobile robot. Traditional feedback and feedforward controllers are designed based on the nominal model by using Feedback Linearization Control (FLC) method. Then, an intelligent controller is designed based on sliding mode learning algorithm that utilizes closed-loop error dynamics to learn the system behavior. The controllers are working in parallel, and the intelligent controller can gradually replace the feedback controller from the control of the system. In addition to the stability of the sliding mode learning algorithm, the closed-loop stability of an $n$th order feedback linearizable system is proven. The simulation results demonstrate that CLELC algorithm can improve control performance (e.g., smaller rise time, settling time and overshoot) in the absence of uncertainties, and also provides robust control performance in the presence of uncertainties as compared to traditional FLC method. To test the efficiency and efficacy of CLELC algorithm, the trajectory tracking problem of a tracked mobile robot is studied in real-time. The experimental results demonstrate that CLELC algorithm ensures high-accurate trajectory tracking performance than traditional FLC method.


title: A refined continuity correction for the negative binomial distribution and asymptotics of the median

abstract: In this paper, we prove a local limit theorem and a refined continuity correction for the negative binomial distribution. We present two applications of the results. First, we find the asymptotics of the median for a $\mathrm{Negative\hspace{0.5mm}Binomial}\hspace{0.2mm}(r,p)$ random variable jittered by a $\mathrm{Uniform}\hspace{0.2mm}(0,1)$, which answers a problem left open in Coeurjolly & Tr\'epanier (2020). This is used to construct a simple, robust and consistent estimator of the parameter $p$, when $r > 0$ is known. The case where $r$ is unknown is also briefly covered. Second, we find an upper bound on the Le Cam distance between negative binomial and normal experiments.


title: Distributional inequalities for noncommutative martingales

abstract: We establish distributional estimates for noncommutative martingales, in the sense of decreasing rearrangements of the spectra of unbounded operators, which generalises the study of distributions of random variables. Our results include distributional versions of the noncommutative Stein, dual Doob, martingale transform and Burkholder-Gundy inequalities. Our proof relies upon new and powerful extrapolation theorems. As an application, we obtain some new martingale inequalities in symmetric quasi-Banach operator spaces and some interesting endpoint estimates. Our main approach demonstrates a method to build the noncommutative and classical probabilistic inequalities in an entirely operator theoretic way.


title: An asymptotic preserving scheme for L\'{e}vy-Fokker-Planck equation with fractional diffusion limit

abstract: In this paper, we develop a numerical method for the L\'evy-Fokker-Planck equation with the fractional diffusive scaling. There are two main challenges. One comes from a two-fold nonlocality, that is, the need to apply the fractional Laplacian operator to a power law decay distribution. The other arises from long-time/small mean-free-path scaling, which introduces stiffness to the equation. To resolve the first difficulty, we use a change of variable to convert the unbounded domain into a bounded one and then apply the Chebyshev polynomial based pseudo-spectral method. To treat the multiple scales, we propose an asymptotic preserving scheme based on a novel micro-macro decomposition that uses the structure of the test function in proving the fractional diffusion limit analytically. Finally, the efficiency and accuracy of our scheme are illustrated by a suite of numerical examples.


title: Multilingual Multimodal Pre-training for Zero-Shot Cross-Lingual Transfer of Vision-Language Models

abstract: This paper studies zero-shot cross-lingual transfer of vision-language models. Specifically, we focus on multilingual text-to-video search and propose a Transformer-based model that learns contextualized multilingual multimodal embeddings. Under a zero-shot setting, we empirically demonstrate that performance degrades significantly when we query the multilingual text-video model with non-English sentences. To address this problem, we introduce a multilingual multimodal pre-training strategy, and collect a new multilingual instructional video dataset (MultiHowTo100M) for pre-training. Experiments on VTT show that our method significantly improves video search in non-English languages without additional annotations. Furthermore, when multilingual annotations are available, our method outperforms recent baselines by a large margin in multilingual text-to-video search on VTT and VATEX; as well as in multilingual text-to-image search on Multi30K. Our model and Multi-HowTo100M is available at http://github.com/berniebear/Multi-HT100M.


title: Few Shot System Identification for Reinforcement Learning

abstract: Learning by interaction is the key to skill acquisition for most living organisms, which is formally called Reinforcement Learning (RL). RL is efficient in finding optimal policies for endowing complex systems with sophisticated behavior. All paradigms of RL utilize a system model for finding the optimal policy. Modeling dynamics can be done by formulating a mathematical model or system identification. Dynamic models are usually exposed to aleatoric and epistemic uncertainties that can divert the model from the one acquired and cause the RL algorithm to exhibit erroneous behavior. Accordingly, the RL process sensitive to operating conditions and changes in model parameters and lose its generality. To address these problems, Intensive system identification for modeling purposes is needed for each system even if the model dynamics structure is the same, as the slight deviation in the model parameters can render the model useless in RL. The existence of an oracle that can adaptively predict the rest of the trajectory regardless of the uncertainties can help resolve the issue. The target of this work is to present a framework for facilitating the system identification of different instances of the same dynamics class by learning a probability distribution of the dynamics conditioned on observed data with variational inference and show its reliability in robustly solving different instances of control problems with the same model in model-based RL with maximum sample efficiency.


title: Macroscopically degenerate localized zero-energy states of quasicrystalline bilayer systems in strong coupling limit

abstract: When two identical two-dimensional (2D) periodic lattices are stacked in parallel after rotating one layer by a certain angle relative to the other layer, the resulting bilayer system can lose lattice periodicity completely and become a 2D quasicrystal. Twisted bilayer graphene with 30-degree rotation is a representative example. We show that such quasicrystalline bilayer systems generally develop macroscopically degenerate localized zero-energy states (ZESs) in strong coupling limit where the interlayer couplings are overwhelmingly larger than the intralayer couplings. The emergent chiral symmetry in strong coupling limit and aperiodicity of bilayer quasicrystals guarantee the existence of the ZESs. The macroscopically degenerate ZESs are analogous to the flat bands of periodic systems, in that both are composed of localized eigenstates, which give divergent density of states. For monolayers, we consider the triangular, square, and honeycomb lattices, comprised of homogenous tiling of three possible planar regular polygons: the equilateral triangle, square, and regular hexagon. We construct a compact theoretical framework, which we call the quasiband model, that describes the low energy properties of bilayer quasicrystals and counts the number of ZESs using a subset of Bloch states of monolayers. We also propose a simple geometric scheme in real space which can show the spatial localization of ZESs and count their number. Our work clearly demonstrates that bilayer quasicrystals in strong coupling limit are an ideal playground to study the intriguing interplay of flat band physics and the aperiodicity of quasicrystals.


title: Lite-HDSeg: LiDAR Semantic Segmentation Using Lite Harmonic Dense Convolutions

abstract: Autonomous driving vehicles and robotic systems rely on accurate perception of their surroundings. Scene understanding is one of the crucial components of perception modules. Among all available sensors, LiDARs are one of the essential sensing modalities of autonomous driving systems due to their active sensing nature with high resolution of sensor readings. Accurate and fast semantic segmentation methods are needed to fully utilize LiDAR sensors for scene understanding. In this paper, we present Lite-HDSeg, a novel real-time convolutional neural network for semantic segmentation of full $3$D LiDAR point clouds. Lite-HDSeg can achieve the best accuracy vs. computational complexity trade-off in SemanticKitti benchmark and is designed on the basis of a new encoder-decoder architecture with light-weight harmonic dense convolutions as its core. Moreover, we introduce ICM, an improved global contextual module to capture multi-scale contextual features, and MCSPN, a multi-class Spatial Propagation Network to further refine the semantic boundaries. Our experimental results show that the proposed method outperforms state-of-the-art semantic segmentation approaches which can run real-time, thus is suitable for robotic and autonomous driving applications.


title: Exclusion Process on two intersected lanes with constrained resources: Symmetry breaking and shock dynamics

abstract: We present a study of exclusion process on a peculiar topology of network with two intersected lanes, competing for the particles in a reservoir with finite capacity. To provide a theoretical ground for our findings, we exploit mean-field approximation along with domain-wall theory. The stationary properties of the system including phase transitions, density profiles and position of the domain-wall are derived analytically. Under the similar dynamical rules, the particles of both the lanes interact only at the intersected site. The symmetry of system is maintained till number of particles do not exceed total number of sites. However, beyond this the symmetry breaking phenomenon occurs resulting in the appearance of asymmetric phases and continues to persist even for infnite number of particles. The complexity of phase diagram shows a non-monotonic behaviour with increasing number of particles in the system. A bulk induced shock appears in a symmetric phase, whereas, a boundary induced shock is observed in symmetric as well as asymmetric phase. Monitoring the location of shock with increasing entry of particles, we explain the possible phase transitions. The theoretical results are supported by extensive Monte Carlo simulations and explained using simple physical arguments.


title: Investigation of passive flow control over an airfoil using leading edge tubercles

abstract: The present paper numerically investigates flow control over NACA0021 (National Advisory Committee for Aeronautics) airfoil by applying a leading-edge tubercle as a passive flow control device at transitional Reynolds number (Re) regime. The study includes simulations over the unmodified airfoil and modified airfoil operating at Re=120000 using kT-kL-{\omega} based Delayed Detached Eddy Simulation (DDES) model. The calculations include both the pre-stall and post-stall regions, while the performance of the mean flow aerodynamic properties like pressure, lift, skin-friction, and drag coefficients are also investigated in the presence of tubercles. The spanwise flow over the modified airfoil interacts with the primary flow. The turbulent separation gets delayed compared to the unmodified airfoil, thereby significantly improving the stall behavior and flow behavior in the post-stall region. The modified airfoil provides the gradual stall behavior against the steep stall behavior for the unmodified airfoil. To optimize tubercle configuration, the study considers two modified airfoils with different combinations of amplitude and wavelength. The unsteady analysis, including the reduced-order modeling, i.e. 3D Proper orthogonal decomposition (POD), characterizes the dominant vortical structure of the flow to evaluate the improvement in the aerodynamic performance of the modified airfoil. The model decomposition for flow over airfoil helps to provide a deeper understanding of the flow control phenomenon.


title: A Revisit of The Energy Quadratization Method with A Relaxation Technique

abstract: This letter revisits the energy quadratization (EQ) method by introducing a novel and essential relaxation technique to improve its accuracy and stability. The EQ method has witnessed significant popularity in the past few years. Though acknowledging its effectiveness in designing energy-stable schemes for thermodynamically consistent models, the primary known drawback is apparent, i.e., its preserves a "modified" energy law represented by auxiliary variables instead of the original variables. Truncation errors are introduced during numerical calculations so that the numerical solutions of the auxiliary variables are no longer equivalent to their original continuous definitions. Even though the "modified" energy dissipation law is preserved, the original energy dissipation law is not guaranteed. In this paper, we overcome this issue by introducing a relaxation technique. The computational cost of this extra technique is negligible compared with the baseline EQ method. Meanwhile, the relaxed-EQ method holds all the baseline EQ method's good properties, such as linearity and unconditionally energy stability. Then we apply the relaxed-EQ method to several widely-used phase field models to highlight its effectiveness.


title: Intelligent Stretch Reduction in Information-CentricNetworking towards 5G-Tactile Internet realization

abstract: In recent years, 5G is widely used in parallel with IoT networks to enable massive data connectivity and exchange with ultra-reliable and low latency communication (URLLC) services. The internet requirements from user's perspective have shifted from simple human to human interactions to different communication paradigms and information-centric networking (ICN). ICN distributes the content among the users based on their trending requests. ICN is responsible not only for the routing and caching but also for naming the network's content. ICN considers several parameters such as cache-hit ratio, content diversity, content redundancy, and stretch to route the content. ICN enables name-based caching of the required content according to the user's request based on the router's interest table. The stretch shows the path covered while retrieving the content from producer to consumer. Reduction in path length also leads to a reduction in end-to-end latency and better data rate availability. ICN routers must have the minimum stretch to obtain a better system efficiency. Reinforcement learning (RL) is widely used in networks environment to increase agent efficiency to make decisions. In ICN, RL can aid to increase caching and stretch efficiency. This paper investigates a stretch reduction strategy for ICN routers by formulating the stretch reduction problem as a Markov decision process. The evaluation of the proposed stretch reduction strategy's accuracy is done by employing Q-Learning, an RL technique. The simulation results indicate that by using the optimal parameters for the proposed stretch reduction strategy.


title: Role of dephasing on the conductance signatures of Majorana zero modes

abstract: Conductance signatures that signal the presence of Majorana zero modes in a three terminal nanowire-topological superconductor hybrid system are analyzed in detail, in both the clean nanowire limit and in the presence of non-coherent dephasing interactions. In the coherent transport regime for a clean wire, we point out contributions of the local Andreev reflection and the non-local transmissions toward the total conductance lineshapes while clarifying the role of contact broadening on the Majorana conductance lineshapes at the magnetic field parity crossings. Interestingly, at larger $B$-field parity crossings, the contribution of the Andreev reflection process decreases which is compensated by the non-local processes in order to maintain the conductance quantum regardless of contact coupling strength. In the non-coherent transport regime, we include dephasing that is introduced by momentum randomization processes, that allows one to smoothly transition to the diffusive limit. Here, as expected, we note that while the Majorana character of the zero modes is unchanged, there is a reduction in the conductance peak magnitude that scales with the strength of the impurity scattering potentials. Important distinctions between the effect of non-coherent dephasing processes and contact-induced tunnel broadenings in the coherent regime on the conductance lineshapes are elucidated. Most importantly our results reveal that the addition of dephasing in the set up does not lead to any notable length dependence to the conductance of the zero modes, contrary to what one would expect in a gradual transition to the diffusive limit. We believe this work paves a way for a systematic introduction of scattering processes into the realistic modeling of Majorana nanowire hybrid devices and assessing topological signatures in such systems in the presence of non-coherent scattering processes.


title: A Whipple $_7F_6$ formula revisited

abstract: A well-known formula of Whipple relates certain hypergeometric values $_7F_6(1)$ and $_4F_3(1)$. In this paper we revisit this relation from the viewpoint of the underlying hypergeometric data $HD$, to which there are also associated hypergeometric character sums and Galois representations. We explain a special structure behind Whipple's formula when the hypergeometric data $HD$ are primitive and self-dual. If the data are also defined over $\mathbb Q$, by the work of Katz, Beukers, Cohen, and Mellit, there are compatible families of $\ell$-adic representations of the absolute Galois group of $\mathbb Q$ attached to $HD$. For specialized choices of $HD$, these Galois representations are shown to be decomposable and automorphic. As a consequence, the values of the corresponding hypergeometric character sums can be explicitly expressed in terms of Fourier coefficients of certain modular forms. We further relate the hypergeometric values $_7F_6(1)$ in Whipple's formula to the periods of these modular forms.


title: The Hot and Dynamic Birth of Massive Stars from the ngVLA Perspective

abstract: The Next Generation Very Large Array (ngVLA) has excellent capabilities to unveil various dynamical and chemical processes in massive star formation at the unexplored innermost regions. Based on the recent observations of ALMA/VLA as well as theoretical predictions, we propose several intriguing topics in massive star formation from the perspective of the ngVLA. In the disk scale of $\lesssim$ 100 au around massive protostars, dust grains are expected to be destructed/sublimated because the physical conditions of temperature, shocks, and radiation are much more intense than those in the envelopes, which are typically observed as hot cores. The high sensitivity and resolution of the ngVLA will enable us to detect the gaseous refractories released by dust destruction, e.g., SiO, NaCl, and AlO, which trace disk kinematics and give new insights into the metallic elements in star-forming regions, i.e., astromineralogy. The multi-epoch survey by the ngVLA will provide demographics of forming massive multiples with separations of $\lesssim$ 10 au with their proper motion. Combining with observations of refractory molecular lines and hydrogen recombination lines, we can reproduce the three-dimensional orbital motions of massive proto-binaries. Moreover, the 1-mas resolution of the ngVLA could possibly take the first-ever picture of the photospheric surface of an accreting protostar, if it is bloated to the au scale by the high accretion rates of mass and thermal energy.


title: Adversarial YOLO: Defense Human Detection Patch Attacks via Detecting Adversarial Patches

abstract: The security of object detection systems has attracted increasing attention, especially when facing adversarial patch attacks. Since patch attacks change the pixels in a restricted area on objects, they are easy to implement in the physical world, especially for attacking human detection systems. The existing defenses against patch attacks are mostly applied for image classification problems and have difficulty resisting human detection attacks. Towards this critical issue, we propose an efficient and effective plug-in defense component on the YOLO detection system, which we name Ad-YOLO. The main idea is to add a patch class on the YOLO architecture, which has a negligible inference increment. Thus, Ad-YOLO is expected to directly detect both the objects of interest and adversarial patches. To the best of our knowledge, our approach is the first defense strategy against human detection attacks. We investigate Ad-YOLO's performance on the YOLOv2 baseline. To improve the ability of Ad-YOLO to detect variety patches, we first use an adversarial training process to develop a patch dataset based on the Inria dataset, which we name Inria-Patch. Then, we train Ad-YOLO by a combination of Pascal VOC, Inria, and Inria-Patch datasets. With a slight drop of $0.70\%$ mAP on VOC 2007 test set, Ad-YOLO achieves $80.31\%$ AP of persons, which highly outperforms $33.93\%$ AP for YOLOv2 when facing white-box patch attacks. Furthermore, compared with YOLOv2, the results facing a physical-world attack are also included to demonstrate Ad-YOLO's excellent generalization ability.


title: Tailored optical properties of atomic medium by a narrow bandwidth frequency comb

abstract: The quantum interference assisted enhanced optical activity due to the emergence of a steady-state atomic polarization is investigated. The Rubidium atoms in an antirelaxation coated cell provide a suitable platform to address the phenomena at multiple Larmors frequencies. It interacts with a narrow bandwidth frequency comb generated by the frequency modulation of the light field. The Lindblad master equation with a trichromatic field provides a microscopic picture of the atomic response to the narrow bandwidth frequency comb. The directive of the relative phase between the light fields, in the detuning dependence of the magnetic resonances, is conclusively captured with the trichromatic field model. The measured absorption, nonlinear magneto-optic rotation, and their dependencies on various experimental parameters are analysed. The ellipticity of the light field controls the extent of several physical processes at multiple Larmors frequencies. The investigation provides an approach to address the Zeeman coherence in the interaction of a narrow bandwidth frequency comb with an atomic ensemble and will have applications in various quantum devices.


title: Gumbel-Attention for Multi-modal Machine Translation

abstract: Multi-modal machine translation (MMT) improves translation quality by introducing visual information. However, the existing MMT model ignores the problem that the image will bring information irrelevant to the text, causing much noise to the model and affecting the translation quality. This paper proposes a novel Gumbel-Attention for multi-modal machine translation, which selects the text-related parts of the image features. Specifically, different from the previous attention-based method, we first use a differentiable method to select the image information and automatically remove the useless parts of the image features. Experiments prove that our method retains the image features related to the text, and the remaining parts help the MMT model generates better translations.


title: Super-Resolving Cross-Domain Face Miniatures by Peeking at One-Shot Exemplar

abstract: Conventional face super-resolution methods usually assume testing low-resolution (LR) images lie in the same domain as the training ones. Due to different lighting conditions and imaging hardware, domain gaps between training and testing images inevitably occur in many real-world scenarios. Neglecting those domain gaps would lead to inferior face super-resolution (FSR) performance. However, how to transfer a trained FSR model to a target domain efficiently and effectively has not been investigated. To tackle this problem, we develop a Domain-Aware Pyramid-based Face Super-Resolution network, named DAP-FSR network. Our DAP-FSR is the first attempt to super-resolve LR faces from a target domain by exploiting only a pair of high-resolution (HR) and LR exemplar in the target domain. To be specific, our DAP-FSR firstly employs its encoder to extract the multi-scale latent representations of the input LR face. Considering only one target domain example is available, we propose to augment the target domain data by mixing the latent representations of the target domain face and source domain ones, and then feed the mixed representations to the decoder of our DAP-FSR. The decoder will generate new face images resembling the target domain image style. The generated HR faces in turn are used to optimize our decoder to reduce the domain gap. By iteratively updating the latent representations and our decoder, our DAP-FSR will be adapted to the target domain, thus achieving authentic and high-quality upsampled HR faces. Extensive experiments on three newly constructed benchmarks validate the effectiveness and superior performance of our DAP-FSR compared to the state-of-the-art.


title: Three-dimensional imaging of waves and floe sizes in the marginal ice zone during an explosive cyclone

abstract: The marginal ice zone is the dynamic interface between the open ocean and consolidated inner pack ice. Surface gravity waves regulate marginal ice zone extent and properties, and, hence, fluxes between the atmosphere and ocean, and ice advance and retreat. Over the past decade, seminal experimental campaigns have generated much needed measurements of wave evolution in the marginal ice zone, which, notwithstanding the prominent knowledge gaps that remain, are underpinning major advances in understanding the region's role in the climate system. Here, we report three-dimensional imaging of waves from a moving vessel and simultaneous imaging of floe sizes, with the potential to enhance the marginal ice zone database substantially. The images give the direction--frequency wave spectrum, which we combine with concurrent measurements of wind speeds and reanalysis products to reveal the complex multi-component wind-plus-swell nature of a cyclone-driven wave field, and quantify evolution of large-amplitude waves in sea ice.


title: Positive and negative chemical pressure effects investigated in electron-doped FeSe films with an electric-double-layer structure

abstract: We investigated chemical pressure effects in electron-doped (e-doped) FeSe by fabricating an electric-double-layer structure with single crystalline FeSe films on LaAlO$_3$ with Se substituted by isovalent Te and S. Our method enables transport measurements of e-doped FeSe. Electron doping by applying gate voltage of 5 V increases $T_{\mathrm c}$ of the FeSe$_{1-x}$Te$_x$ and FeSe$_{1-y}$S$_y$ films with $0 \leq x \leq 0.4$ and $0 \leq y \leq 0.25$, while the e-doped $x=0.5$ film showed lower $T_{\mathrm c}$ than that of the undoped one. Both positive and chemical pressure suppress $T_{\mathrm c}$ of the e-doped FeSe. The obtained superconducting phase diagram in the e-doped samples is rather different from that in undoped samples. This might suggest that the superconductivity mechanism is different between undoped and e-doped systems. Alternatively, this is possibly explained by the absence of the nematic order in e-doped samples.


title: Analytical criteria for designing multiresonance filters in scattering systems, with application to microwave metasurfaces

abstract: We present general analytical criteria for the design of lossless reciprocal two-port systems, which exhibit prescribed scattering spectra $S(\omega)$ satisfying $S_{22}(\omega)=e^{i\varphi}S_{11}(\omega)$, including symmetric ($S_{22}=S_{11}$) or "antimetric" ($S_{22}=-S_{11}$) responses, such as standard filters (Butterworth, Chebyshev, elliptic, etc.). We show that the non-normalized resonant (quasi-normal) modes (QNMs) of all such two-port systems couple to the input and output ports with specific unitary ratios, whose relative signs determine the position of the scattering zeros on the real frequency axis. This allows us to obtain design criteria assigning values to the poles, background response, and QNM-to-ports coupling coefficients. Filter devices can then be designed via a well-conditioned nonlinear optimization (or root-finding) problem using a numerical eigensolver. As an application, we design multiple microwave metasurfaces configured for polarization-preserving transmission, reflective polarization conversion, or diffractive "perfect anomalous reflection", to realize filters that precisely match standard bandpass or bandstop filters of various types, orders and bandwidths, with focus on the best-performing elliptic filters.


title: Particular textures of the minimal seesaw model

abstract: Following the Occam's razor principle, we explore the particular textures (featuring texture zeros and equalities) of the Dirac neutrino mass matrix in the minimal seesaw model (where only two right-handed neutrinos $N^{}_1$ and $N^{}_2$ are responsible for the generation of the light neutrino masses), in light of current neutrino experimental results and leptogenesis. The study will be performed for two particular patterns of the Majorana mass matrix $M^{}_{\rm R}$ for $N^{}_1$ and $N^{}_2$: (A) $M^{}_{\rm R}$ being diagonal $ \left( \begin{array}{cc} M^{}_1 & 0 \cr 0 & M^{}_2 \cr \end{array} \right)$; (B) $M^{}_{\rm R}$ being of the form $\left( \begin{array}{cc} 0 & M \cr M & 0 \cr \end{array} \right)$.


title: A limit theorem for persistence diagrams of random filtered complexes built over marked point processes

abstract: We consider random filtered complexes built over marked point processes on Euclidean spaces. Examples of our filtered complexes include a filtration of $\check{\textrm{C}}$ech complexes of a family of sets with various sizes, growths, and shapes. We establish the law of large numbers for persistence diagrams as the size of the convex window observing a marked point process tends to infinity.


title: Raychaudhuri equation in scalar-tensor theory

abstract: Implications of the Raychaudhuri equation in focusing of geodesic congruences are studied in the framework of scalar--tensor theory of gravity. Specifically, we investigate the Brans--Dicke theory and Bekenstein's scalar field theory. In both of these theories, we deal with a static spherically symmetric distribution and a spatially homogeneous and isotropic cosmological model as specific examples. We find that it is possible to violate the convergence condition under reasonable physical assumptions. This leads to the possibility of avoiding a singularity.


title: Learned Gradient Compression for Distributed Deep Learning

abstract: Training deep neural networks on large datasets containing high-dimensional data requires a large amount of computation. A solution to this problem is data-parallel distributed training, where a model is replicated into several computational nodes that have access to different chunks of the data. This approach, however, entails high communication rates and latency because of the computed gradients that need to be shared among nodes at every iteration. The problem becomes more pronounced in the case that there is wireless communication between the nodes (i.e. due to the limited network bandwidth). To address this problem, various compression methods have been proposed including sparsification, quantization, and entropy encoding of the gradients. Existing methods leverage the intra-node information redundancy, that is, they compress gradients at each node independently. In contrast, we advocate that the gradients across the nodes are correlated and propose methods to leverage this inter-node redundancy to improve compression efficiency. Depending on the node communication protocol (parameter server or ring-allreduce), we propose two instances of the LGC approach that we coin Learned Gradient Compression (LGC). Our methods exploit an autoencoder (i.e. trained during the first stages of the distributed training) to capture the common information that exists in the gradients of the distributed nodes. We have tested our LGC methods on the image classification and semantic segmentation tasks using different convolutional neural networks (ResNet50, ResNet101, PSPNet) and multiple datasets (ImageNet, Cifar10, CamVid). The ResNet101 model trained for image classification on Cifar10 achieved an accuracy of 93.57%, which is lower than the baseline distributed training with uncompressed gradients only by 0.18%.


title: Reconfigurable Intelligent Surface aided Massive MIMO Systems with Low-Resolution DACs

abstract: We investigate a reconfigurable intelligent surface (RIS)-aided multi-user massive multiple-input multi-output (MIMO) system where low-resolution digital-analog converters (DACs) are configured at the base station (BS) in order to reduce the cost and power consumption. An approximate analytical expression for the downlink achievable rate is derived based on maximum ratio transmission (MRT) and additive quantization noise model (AQNM), and the rate maximization problem is solved by particle swarm optimization (PSO) method under both continuous phase shifts (CPSs) and discrete phase shifts (DPSs) at the RIS. Simulation results show that the downlink sum achievable rate tends to a constant with the increase of the number of quantization bits of DACs, and four quantization bits are enough to capture a large portion of the performance of the ideal perfect DACs case.


title: Unruh effect and angular momentum correlation of Rindler particles

abstract: It is well known that the rotational motion does not induce Unruh effect, because the Minkowski vacuum coincides with the vacuum state defined by the pure rotating observers. However, are there Rindler particles carrying orbital angular momentum (OAM), and do they produce observable effect? To answer these questions, we need an accelerated observer having a vortex structure in the transverse dimensions and carrying well-defined OAM. Here we consider the angular momentum characteristics of Unruh effect in the theory of scalar field and electromagnetic field for the first time. We find that the rotation and vortex structure of a uniformly accelerated observer lead to the definite angular momentum correlation between Rindler particles and their counterparts in Minkowski vacuum. When interacting with the Unruh thermal bath, the accelerated vortex observer carrying the OAM of l can absorb and emit Rindler particles with the same OAM, and the particle energy is determined by the angular velocity of the rotation. The absorption rate is not equal to the emission rate in general. Both the absorption and emission processes in the thermal bath are correlated with the emission process of particles with OAM of +l or -1 in Minkowski vacuum. This effect may promote a potential scheme to detect the Unruh effect. The OAM provides a potential approach to filter out the background noise so that the signal particles could be extracted sufficiently.


title: Majorana Fermion Dark Matter in Minimally Extended Left-Right Symmetric Model

abstract: We present a minimal extension of the left-right symmetric model based on the gauge group $SU(3)_{c} \times SU(2)_{L} \times SU(2)_{R} \times U(1)_{B-L} \times U(1)_{X}$, in which a vector-like fermion pair ($\zeta_L$ and $\zeta_R$) charged under the $U(1)_{B-L} \times U(1)_X$ symmetry is introduced. Associated with the symmetry breaking of the gauge group $SU(2)_{R} \times U(1)_{B-L} \times U(1)_{X}$ down to the Standard Model (SM) hypercharge $U(1)_Y$, Majorana masses for $\zeta_{L, R}$ are generated and the lightest mass eigenstate plays a role of the dark matter (DM) in our universe by its communication with the SM particles through a new neutral gauge boson "$X$". We consider various phenomenological constraints of this DM scenario, such as the observed DM relic density, the LHC Run-2 constraints from the search for a narrow resonance, and the perturbativity of the gauge couplings below the Planck scale. Combining all constraints, we identify the allowed parameter region which turns out to be very narrow. A significant portion of the currently allowed parameter region will be tested by the High-Luminosity LHC experiments.


title: Visualizing Outliers in High Dimensional Functional Data for Task fMRI data exploration

abstract: Task-based functional magnetic resonance imaging (task fMRI) is a non-invasive technique that allows identifying brain regions whose activity changes when individuals are asked to perform a given task. This contributes to the understanding of how the human brain is organized in functionally distinct subdivisions. Task fMRI experiments from high-resolution scans provide hundred of thousands of longitudinal signals for each individual, corresponding to measurements of brain activity over each voxel of the brain along the duration of the experiment. In this context, we propose some visualization techniques for high dimensional functional data relying on depth-based notions that allow for computationally efficient 2-dim representations of tfMRI data and that shed light on sample composition, outlier presence and individual variability. We believe that this step is crucial previously to any inferential approach willing to identify neuroscientific patterns across individuals, tasks and brain regions. We illustrate the proposed technique through a simulation study and demonstrate its application on a motor and language task fMRI experiment.


title: Queuing Analysis of Opportunistic Cognitive Radio IoT Network with Imperfect Sensing

abstract: In this paper, we analyze a Cognitive Radio-based Internet-of-Things (CR-IoT) network comprising a Primary Network Provider (PNP) and an IoT operator. The PNP uses its licensed spectrum to serve its users. The IoT operator identifies the white-space in the licensed band at regular intervals and opportunistically exploits them to serve the IoT nodes under its coverage. IoT nodes are battery-operated devices that require periodical energy replenishment. We employ the Microwave Power Transfer (MPT) technique for its superior energy transfer efficiency over long-distance. The white-space detection process is not always perfect and the IoT operator may jeopardize the PNP's transmissions due to misdetection. To reduce the possibility of such interferences, some of the spectrum holes must remain unutilized, even when the IoT nodes have data to transmit. The IoT operator needs to decide what percentage of the white-space to keep unutilized and how to judiciously use the rest for data transmission and energy-replenishment to maintain an optimal balance between the average interference inflicted on PNP's users and the Quality-of-Service (QoS) experienced by IoT nodes. Due to the periodic nature of the spectrum-sensing process, Discrete Time Markov Chain (DTMC) method can realistically model this framework. In literature, activities of the PNP and IoT operator are assumed to be mutually exclusive, for ease of analysis. Our model incorporates possible overlaps between these activities, making the analysis more realistic. Using our model, the sustainability region of the CR-IoT network can be obtained. The accuracy of our analysis is demonstrated via extensive simulation.


title: Large Spin-to-Charge Conversion in Ultrathin Gold-Silicon Multilayers

abstract: Investigation of the spin Hall effect in gold has triggered increasing interest over the past decade, since gold combines the properties of a large bulk spin diffusion length and strong interfacial spin-orbit coupling. However, discrepancies between the values of the spin Hall angle of gold reported in the literature have brought into question the microscopic origin of the spin Hall effect in Au. Here, we investigate the thickness dependence of the spin-charge conversion efficiency in single Au films and ultrathin Au/Si multilayers by non-local transport and spin-torque ferromagnetic resonance measurements. We show that the spin-charge conversion efficiency is strongly enhanced in ultrathin Au/Si multilayers, reaching exceedingly large values of 0.99 +/- 0.34 when the thickness of the individual Au layers is scaled down to 2 nm. These findings reveal the coexistence of a strong interfacial spin-orbit coupling effect which becomes dominant in ultrathin Au, and bulk spin Hall effect with a relatively low bulk spin Hall angle of 0.012 +/- 0.005. Our experimental results suggest the key role of the Rashba-Edelstein effect in the spin-to-charge conversion in ultrathin Au.


title: Spatial Dependency Networks: Neural Layers for Improved Generative Image Modeling

abstract: How to improve generative modeling by better exploiting spatial regularities and coherence in images? We introduce a novel neural network for building image generators (decoders) and apply it to variational autoencoders (VAEs). In our spatial dependency networks (SDNs), feature maps at each level of a deep neural net are computed in a spatially coherent way, using a sequential gating-based mechanism that distributes contextual information across 2-D space. We show that augmenting the decoder of a hierarchical VAE by spatial dependency layers considerably improves density estimation over baseline convolutional architectures and the state-of-the-art among the models within the same class. Furthermore, we demonstrate that SDN can be applied to large images by synthesizing samples of high quality and coherence. In a vanilla VAE setting, we find that a powerful SDN decoder also improves learning disentangled representations, indicating that neural architectures play an important role in this task. Our results suggest favoring spatial dependency over convolutional layers in various VAE settings. The accompanying source code is given at https://github.com/djordjemila/sdn.