title: Learning to Balance Specificity and Invariance for In and Out of Domain Generalization

abstract: We introduce Domain-specific Masks for Generalization, a model for improving both in-domain and out-of-domain generalization performance. For domain generalization, the goal is to learn from a set of source domains to produce a single model that will best generalize to an unseen target domain. As such, many prior approaches focus on learning representations which persist across all source domains with the assumption that these domain agnostic representations will generalize well. However, often individual domains contain characteristics which are unique and when leveraged can significantly aid in-domain recognition performance. To produce a model which best generalizes to both seen and unseen domains, we propose learning domain specific masks. The masks are encouraged to learn a balance of domain-invariant and domain-specific features, thus enabling a model which can benefit from the predictive power of specialized features while retaining the universal applicability of domain-invariant features. We demonstrate competitive performance compared to naive baselines and state-of-the-art methods on both PACS and DomainNet.


title: Measurements of spin-orbit interaction in epitaxially grown InAs nanosheets

abstract: We report on a low-temperature transport study of a single-gate, planar field-effect device made from a free-standing, wurtzite-crystalline InAs nanosheet. The nanosheet is grown via molecular beam epitaxy and the field-effect device is characterized by gate transfer characteristic measurements and by magnetic field orientation dependent transport measurements. The measurements show that the device exhibits excellent electrical properties and the electron transport in the nanosheet is of the two-dimensional nature. Low-field magnetoconductance measurements are performed for the device at different gate voltages and temperatures, and the characteristic transport lengths, such as phase coherent length, spin-orbit length and mean free path, in the nanosheet are extracted. It is found that the spin-orbit length in the nanosheet is short, on the order of 150 nm, demonstrating the presence of strong spin-orbit interaction in the InAs nanosheet. Our results show that epitaxially grown, free-standing, InAs nanosheets can serve as an emerging semiconductor nanostructure platform for applications in spintronics, spin qubits and planar topological quantum devices.


title: Uncoupling electrokinetic flow solutions

abstract: The continuum-scale electrokinetic porous-media flow and excess charge redistribution equations are uncoupled using eigenvalue decomposition. The uncoupling results in a pair of independent diffusion equations for "intermediate" potentials subject to modified material properties and boundary conditions. The fluid pressure and electrostatic potential are then found by recombining the solutions to the two intermediate uncoupled problems in a matrix-vector multiply. Expressions for the material properties or source terms in the intermediate uncoupled problem may require extended precision or careful re-writing to avoid numerical cancellation, but the solutions themselves can be computed in typical double precision. The approach works with analytical or gridded numerical solutions and is illustrated through two examples. The solution for flow to a pumping well is manipulated to predict streaming potential and electroosmosis, and a periodic one-dimensional analytical solution is derived and used to predict electroosmosis and streaming potential in a laboratory flow cell subjected to low frequency alternating current and pressure excitation. The examples illustrate the utility of the eigenvalue decoupling approach, repurposing existing analytical solutions and leveraging simpler-to-derive solutions or numerical models for coupled physics.


title: HeteGCN: Heterogeneous Graph Convolutional Networks for Text Classification

abstract: We consider the problem of learning efficient and inductive graph convolutional networks for text classification with a large number of examples and features. Existing state-of-the-art graph embedding based methods such as predictive text embedding (PTE) and TextGCN have shortcomings in terms of predictive performance, scalability and inductive capability. To address these limitations, we propose a heterogeneous graph convolutional network (HeteGCN) modeling approach that unites the best aspects of PTE and TextGCN together. The main idea is to learn feature embeddings and derive document embeddings using a HeteGCN architecture with different graphs used across layers. We simplify TextGCN by dissecting into several HeteGCN models which (a) helps to study the usefulness of individual models and (b) offers flexibility in fusing learned embeddings from different models. In effect, the number of model parameters is reduced significantly, enabling faster training and improving performance in small labeled training set scenario. Our detailed experimental studies demonstrate the efficacy of the proposed approach.


title: Defensive Cost-Benefit Analysis of Smart Grid Digital Functionalities

abstract: Modern smart grids offer several types of digital control and monitoring of electric power transmission and distribution that enable greater efficiency and integrative functionality than traditional power grids. These benefits, however, introduce greater complexity and greatly disrupt and expand the threat landscape. The number of vulnerabilities is increasing as grid-connected devices proliferate. The potential costs to society of these vulnerabilities are difficult to determine, as are their likelihoods of successful exploitation. In this article, we present a method for comparing the net economic benefits and costs of the various cyber-functionalities associated with smart grids from the perspective of cyberattack vulnerabilities and defending against them. The economic considerations of cyber defense spending suggest the existence of optimal levels of expenditures, which might vary among digital functionalities. We illustrate hypothetical case studies on how digital functionalities can be assessed and compared with respect to the costs of defending them from cyberattacks.


title: Unitary unfoldings of Bose-Hubbard exceptional point with and without particle number conservation

abstract: Non-Hermitian but ${\cal PT}-$symmetric quantum system of an $N-$plet of bosons described by the three-parametric Bose-Hubbard Hamiltonian $H(\gamma,v,c)$ is picked up, in its special exceptional-point limit $c \to 0$ and $\gamma \to v$, as an unperturbed part of the family of generalized Bose-Hubbard-like Hamiltonians $\mathfrak{H}(\lambda)=H(v,v,0)+\lambda\,{\cal V}$ for which the unitarity of the perturbed system is required. This leads to the construction of two different families of Hamiltonians $\mathfrak{H}(\lambda)$. In the first one the number $N$ of bosons is assumed conserved while in the second family such an assumption is relaxed. In both cases the anisotropy of the related physical Hilbert space is shown reflected by a highly counterintuitive but operationally realizable structure of admissible perturbations $\lambda\,{\cal V}$.


title: Low-Power Wide-Area Network Design

abstract: LPWAN is an enabling technology for long-range, low-power, and low-cost IoT/CPS applications. Recently, multiple LPWAN technologies have been developed that operate in the licensed (e.g., 5G) and ISM (e.g., LoRa) bands. To avoid the crowd in the ISM band and the cost of the licensed band, we propose a novel LPWAN called Sensor Network Over White Spaces (SNOW) by utilizing the TV white spaces. Specifically, we design, develop, and experiment SNOW, which is highly scalable, energy-efficient, and has a long communication range. SNOW achieves scalability and energy efficiency by enabling concurrent packets reception at a BS using a single radio from numerous sensors and concurrent packets transmission to numerous sensors from the BS using a single radio, simultaneously, which we achieve by proposing a distributed implementation of OFDM. To enable the low-cost and scalable SNOW deployment in practical applications, we implement SNOW using the low-cost and small form-factored COTS devices, where we address multiple practical challenges including the high peak-to-average power ratio, channel state estimation, and carrier offset estimation. Also, we propose an adaptive transmission power protocol to handle the near-far power problem. To enable connecting tens of thousands of nodes over hundreds of kilometers, we further propose a network architecture called SNOW-tree through a seamless integration of multiple SNOWs where they form a tree structure and are under the same management/control. We address the intra- and inter-SNOW interferences by formulating a constrained optimization problem called the scalability optimization problem (SOP) whose objective is to maximize scalability by managing the spectrum sharing across the SNOWs. By proving the NP-hardness of SOP, we then propose two polynomial-time methods to solve it: a greedy heuristic algorithm and a 1/2-approximation algorithm.


title: Formal Methods for An Iterated Volunteer's Dilemma

abstract: Game theory provides a paradigm through which we can study the evolving communication and phenomena that occur via rational agent interaction. In this work, we design a model framework and explore The Volunteer's Dilemma with the goals of 1) modeling it as a stochastic concurrent multiplayer game, 2) constructing properties to verify model correctness and reachability, 3) constructing strategy synthesis graphs to understand how the game is iteratively stepped through most optimally and, 4) analyzing a series of parameters to understand correlations with expected local and global rewards over a finite time horizon.


title: Lecture Notes on Quadratic Forms and their Arithmetic

abstract: These are the notes from my courses on the arithmetic of quadratic forms.


title: Absence of surface plasma waves on hard-wall surfaces

abstract: It seems having been firmly established that surface plasma waves (SPWs) could exist on any metal surfaces, including those of the ideal hard-wall type frequently employed in \textit{ab initio} studies of the dielectric responses of metals. Here we show that the surface waves hosted on hard-wall surface are not SPWs. Though they possess the celebrated frequency $\omega_p/\sqrt{2}$, where $\omega_p$ is the volume plasma wave frequency, these waves are shown devoid of charges in the infinite wavelength limit. In contrast, SPWs are always associated with a finite density of charges localized on the surface. This finding corrects a historical mistake and calls for a reappraisal of innumerable work that interpret experimental data (e.g. electron energy loss spectroscopy) based on the hard-wall model and related models such as the specular reflection model.


title: The Identity Fragmentation Bias

abstract: Consumers interact with firms across multiple devices, browsers, and machines; these interactions are often recorded with different identifiers for the same consumer. The failure to correctly match different identities leads to a fragmented view of exposures and behaviors. This paper studies the identity fragmentation bias, referring to the estimation bias resulted from using fragmented data. Using a formal framework, we decompose the contributing factors of the estimation bias caused by data fragmentation and discuss the direction of bias. Contrary to conventional wisdom, this bias cannot be signed or bounded under standard assumptions. Instead, upward biases and sign reversals can occur even in experimental settings. We then compare several corrective measures, and discuss their respective advantages and caveats.


title: A Newton Solver for Micromorphic Computational Homogenization Enabling Multiscale Buckling Analysis of Pattern-Transforming Metamaterials

abstract: Mechanical metamaterials feature engineered microstructures designed to exhibit exotic, and often counter-intuitive, effective behaviour. Such a behaviour is often achieved through instability-induced transformations of the underlying periodic microstructure into one or multiple patterning modes. Due to a strong kinematic coupling of individual repeating microstructural cells, non-local behaviour and size effects emerge, which cannot easily be captured by classical homogenization schemes. In addition, the individual patterning modes can mutually interact in space as well as in time, while at the engineering scale the entire structure can buckle globally. For efficient numerical macroscale predictions, a micromorphic computational homogenization scheme has recently been developed. Although this framework is in principle capable of accounting for spatial and temporal interactions between individual patterning modes, its implementation relied on a gradient-based quasi-Newton solution technique. This solver is suboptimal because (i) it has sub-quadratic convergence, and (ii) the absence of Hessians does not allow for proper bifurcation analyses. Given that mechanical metamaterials often rely on controlled instabilities, these limitations are serious. To address them, a full Newton method is provided in detail in this paper. The construction of the macroscopic tangent operator is not straightforward due to specific model assumptions on the decomposition of the underlying displacement field pertinent to the micromorphic framework, involving orthogonality constraints. Analytical expressions for the first and second variation of the total potential energy are given, and the complete algorithm is listed. The developed methodology is demonstrated with two examples in which a competition between local and global buckling exists and where multiple patterning modes emerge.


title: The evolution of the spectrum of a Frobenius Lie algebra under deformation

abstract: The category of Frobenius Lie algebras is stable under deformation, and here we examine explicit infinitesimal deformations of four and six dimensional Frobenius Lie algebras with the goal of understanding if the spectrum of a Frobenius Lie algebra can evolve under deformation. It can.


title: Symmetries, conservation laws, invariant solutions and difference schemes of the one-dimensional Green-Naghdi equations

abstract: The paper is devoted to the Lie group properties of the one-dimensional Green-Naghdi equations describing the behavior of fluid flow over uneven bottom topography. The bottom topography is incorporated into the Green-Naghdi equations in two ways: in the classical Green-Naghdi form and in the approximated form of the same order. The study is performed in Lagrangian coordinates which allows one to find Lagrangians for the analyzed equations. Complete group classification of both cases of the Green-Naghdi equations with respect to the bottom topography is presented. Applying Noether's theorem, the obtained Lagrangians and the group classification, conservation laws of the one-dimensional Green-Naghdi equations with uneven bottom topography are obtained. Difference schemes which preserve the symmetries of the original equations and the conservation laws are constructed. Analysis of the developed schemes is given. The schemes are tested numerically on the example of an exact traveling-wave solution.


title: Self-dual Maps I : antipodality

abstract: A self-dual map $G$ is said to be \emph{antipodally self-dual} if the dual map $G^*$ is antipodal embedded in $\mathbb{S}^2$ with respect to $G$. In this paper, we investigate necessary and/or sufficient conditions for a map to be antipodally self-dual. In particular, we present a combinatorial characterization for map $G$ to be antipodally self-dual in terms of certain \emph{involutive labelings}. The latter lead us to obtain necessary conditions for a map to be \emph{strongly involutive} (a notion relevant for its connection with convex geometric problems). We also investigate the relation of antipodally self-dual maps and the notion of \emph{ antipodally symmetric} maps. It turns out that the latter is a very helpful tool to study questions concerning the \emph{symmetry} as well as the \emph{amphicheirality} of \emph{links}.


title: TATL at W-NUT 2020 Task 2: A Transformer-based Baseline System for Identification of Informative COVID-19 English Tweets

abstract: As the COVID-19 outbreak continues to spread throughout the world, more and more information about the pandemic has been shared publicly on social media. For example, there are a huge number of COVID-19 English Tweets daily on Twitter. However, the majority of those Tweets are uninformative, and hence it is important to be able to automatically select only the informative ones for downstream applications. In this short paper, we present our participation in the W-NUT 2020 Shared Task 2: Identification of Informative COVID-19 English Tweets. Inspired by the recent advances in pretrained Transformer language models, we propose a simple yet effective baseline for the task. Despite its simplicity, our proposed approach shows very competitive results in the leaderboard as we ranked 8 over 56 teams participated in total.


title: Personal Food Model

abstract: Food is central to life. Food provides us with energy and foundational building blocks for our body and is also a major source of joy and new experiences. A significant part of the overall economy is related to food. Food science, distribution, processing, and consumption have been addressed by different communities using silos of computational approaches. In this paper, we adopt a person-centric multimedia and multimodal perspective on food computing and show how multimedia and food computing are synergistic and complementary. Enjoying food is a truly multimedia experience involving sight, taste, smell, and even sound, that can be captured using a multimedia food logger. The biological response to food can be captured using multimodal data streams using available wearable devices. Central to this approach is the Personal Food Model. Personal Food Model is the digitized representation of the food-related characteristics of an individual. It is designed to be used in food recommendation systems to provide eating-related recommendations that improve the user's quality of life. To model the food-related characteristics of each person, it is essential to capture their food-related enjoyment using a Preferential Personal Food Model and their biological response to food using their Biological Personal Food Model. Inspired by the power of 3-dimensional color models for visual processing, we introduce a 6-dimensional taste-space for capturing culinary characteristics as well as personal preferences. We use event mining approaches to relate food with other life and biological events to build a predictive model that could also be used effectively in emerging food recommendation systems.


title: Convergence of a Distributed Kiefer-Wolfowitz Algorithm

abstract: This paper proposes a proof of the convergence of a distributed and asynchronous version of the Kiefer-Wolfowitz algorithm.


title: Locally induced Gaussian processes for large-scale simulation experiments

abstract: Gaussian processes (GPs) serve as flexible surrogates for complex surfaces, but buckle under the cubic cost of matrix decompositions with big training data sizes. Geospatial and machine learning communities suggest pseudo-inputs, or inducing points, as one strategy to obtain an approximation easing that computational burden. However, we show how placement of inducing points and their multitude can be thwarted by pathologies, especially in large-scale dynamic response surface modeling tasks. As remedy, we suggest porting the inducing point idea, which is usually applied globally, over to a more local context where selection is both easier and faster. In this way, our proposed methodology hybridizes global inducing point and data subset-based local GP approximation. A cascade of strategies for planning the selection of local inducing points is provided, and comparisons are drawn to related methodology with emphasis on computer surrogate modeling applications. We show that local inducing points extend their global and data-subset component parts on the accuracy--computational efficiency frontier. Illustrative examples are provided on benchmark data and a large-scale real-simulation satellite drag interpolation problem.


title: Real-world Video Adaptation with Reinforcement Learning

abstract: Client-side video players employ adaptive bitrate (ABR) algorithms to optimize user quality of experience (QoE). We evaluate recently proposed RL-based ABR methods in Facebook's web-based video streaming platform. Real-world ABR contains several challenges that requires customized designs beyond off-the-shelf RL algorithms -- we implement a scalable neural network architecture that supports videos with arbitrary bitrate encodings; we design a training method to cope with the variance resulting from the stochasticity in network conditions; and we leverage constrained Bayesian optimization for reward shaping in order to optimize the conflicting QoE objectives. In a week-long worldwide deployment with more than 30 million video streaming sessions, our RL approach outperforms the existing human-engineered ABR algorithms.


title: Multi-Model Resilient Observer under False Data Injection Attacks

abstract: In this paper, we present the concept of boosting the resiliency of optimization-based observers for cyber-physical systems (CPS) using auxiliary sources of information. Due to the tight coupling of physics, communication and computation, a malicious agent can exploit multiple inherent vulnerabilities in order to inject stealthy signals into the measurement process. The problem setting considers the scenario in which an attacker strategically corrupts portions of the data in order to force wrong state estimates which could have catastrophic consequences. The goal of the proposed observer is to compute the true states in-spite of the adversarial corruption. In the formulation, we use a measurement prior distribution generated by the auxiliary model to refine the feasible region of a traditional compressive sensing-based regression problem. A constrained optimization-based observer is developed using l1-minimization scheme. Numerical experiments show that the solution of the resulting problem recovers the true states of the system. The developed algorithm is evaluated through a numerical simulation example of the IEEE 14-bus system.


title: Using Machine Learning for Particle Track Identification in the CLAS12 Detector

abstract: Particle track reconstruction is the most computationally intensive process in nuclear physics experiments. Traditional algorithms use a combinatorial approach that exhaustively tests track measurements ("hits") to identify those that form an actual particle trajectory. In this article, we describe the development of four machine learning (ML) models that assist the tracking algorithm by identifying valid track candidates from the measurements in drift chambers. Several types of machine learning models were tested, including: Convolutional Neural Networks (CNN), Multi-Layer Perceptrons (MLP), Extremely Randomized Trees (ERT) and Recurrent Neural Networks (RNN). As a result of this work, an MLP network classifier was implemented as part of the CLAS12 reconstruction software to provide the tracking code with recommended track candidates. The resulting software achieved accuracy of greater than 99\% and resulted in an end-to-end speedup of 35\% compared to existing algorithms.


title: Evaluation of scatter rejection and correction performance of 2D antiscatter grids in cone beam computed tomography

abstract: Purpose: We have been investigating 2D antiscatter grids (2D ASG) to reduce scatter fluence and improve image quality in cone beam computed tomography (CBCT). In this work, two different aspects of 2D ASGs, their scatter rejection and correction capability, were investigated in CBCT experiments. To correct residual scatter transmitted through the 2D ASG, it was used as a scatter measurement device with a novel method: grid-based scatter sampling. Methods: Three focused 2D ASG prototypes with grid ratios of 8, 12, and 16 were developed for linac-mounted CBCT geometry. In the first phase, 2D ASGs were used as a scatter rejection device, and the effect of grid ratio on CT number accuracy and contrast-to-noise ratio (CNR) evaluated in CBCT images. In the second phase, the grid-based scatter sampling method was implemented. The percent change in CT numbers was measured by changing the phantom size from head to pelvis configuration.Results: When 2D ASG was used as a scatter rejection device, CT number variation due to change in phantom dimensions was reduced from 23% to 2 - 6%. A grid ratio of 16 yielded the lowest CT number variation. All three 2D ASGs yielded improvement in CNR, up to a factor of two in pelvis-sized phantoms. When 2D ASG prototypes were used for both scatter rejection and correction, CT number variations were reduced further, to 1.3 - 2.6%. Conclusions: When 2D ASG was used solely as a scatter rejection device, substantial improvement in CT number accuracy could be achieved by increasing the grid ratio. 2D ASGs could also provide significant CNR improvement even at lower grid ratios. When 2D ASG was used in conjunction with the grid-based scatter sampling method, it provided further improvement in CT number accuracy, irrespective of the grid ratio, while preserving 2D ASG's capacity to improve CNR.


title: Particle-resolved simulation of freely evolving particle suspensions: Flow physics and modeling

abstract: The objective of this study is to understand the dynamics of freely evolving particle suspensions over a wide range of particle-to-fluid density ratios. The dynamics of particle suspensions are characterized by the average momentum equation, where the dominant contribution to the average momentum transfer between particles and fluid is the average drag force. In this study, the average drag force is quantified using particle-resolved direct numerical simulation in a canonical problem: a statistically homogeneous suspension where an imposed mean pressure gradient establishes a steady mean slip velocity between the phases. The effects of particle velocity fluctuations, particle clustering, and mobility of particles are studied separately. It is shown that the competing effects of these factors could decrease, increase, or keep constant the drag of freely evolving suspensions in comparison to fixed beds at different flow conditions. It is also shown that the effects of particle clustering and particle velocity fluctuations are not independent. Finally, a correlation for interphase drag force in terms of volume fraction, Reynolds number, and density ratio is proposed. Two different approaches (symbolic regression and predefined functional forms) are used to develop the drag correlation. Since this drag correlation has been inferred from simulations of particle suspensions, it includes the effect of the motion of the particles. This drag correlation can be used in computational fluid dynamics simulations of particle-laden flows that solve the average two-fluid equations where the accuracy of the drag law affects the prediction of overall flow behavior.


title: TriCG and TriMR: Two Iterative Methods for Symmetric Quasi-Definite Systems

abstract: We introduce iterative methods named TriCG and TriMR for solving symmetric quasi-definite systems based on the orthogonal tridiagonalization process proposed by Saunders, Simon and Yip in 1988. TriCG and TriMR are tantamount to preconditioned Block-CG and Block-MINRES with two right-hand sides in which the two approximate solutions are summed at each iteration, but require less storage and work per iteration. We evaluate the performance of TriCG and TriMR on linear systems generated from the SuiteSparse Matrix Collection and from discretized and stablized Stokes equations. We compare TriCG and TriMR with SYMMLQ and MINRES, the recommended Krylov methods for symmetric and indefinite systems. In all our experiments, TriCG and TriMR terminate earlier than SYMMLQ and MINRES on a residual-based stopping condition with an improvement of up to 50% in terms of number of iterations. They also terminate more reliably than Block-CG and Block-MINRES. Experiments in quadruple and octuple precision suggest that loss of orthogonality in the basis vectors is significantly less pronounced in TriCG and TriMR than in Block-CG and Block-MINRES.


title: Vacuum Driven Auxetic Switching Structure and Its Application on a Gripper and Quadruped

abstract: The properties and applications of auxetics have been widely explored in the past years. Through proper utilization of auxetic structures, designs with unprecedented mechanical and structural behaviors can be produced. Taking advantage of this, we present the development of novel and lowcost 3D structures inspired by a simple auxetic unit. The core part, which we call the body in this paper, is a 3D realization of 2D rotating squares. This body structure was formed by joining four similar structures through softer material at the vertices. A monolithic structure of this kind is accomplished through a custom-built multi-material 3D printer. The model works in a way that, when torque is applied along the face of the rotational squares, they tend to bend at the vertex of the softer material, and due to the connected-ness of the design, a proper opening and closing motion is achieved. To demonstrate the potential of this part as an important component for robots, two applications are presented: a soft gripper and a crawling robot. Vacuum-driven actuators move both the applications. The proposed gripper combines the benefits of two types of grippers whose fingers are placed parallel and equally spaced to each other, in a single design. This gripper is adaptable to the size of the object and can grasp objects with large and small cross-sections alike. A novel bending actuator, which is made of soft material and bends in curvature when vacuumed, provides the grasping nature of the gripper. Crawling robots, in addition to their versatile nature, provide a better interaction with humans. The designed crawling robot employs negative pressure-driven actuators to highlight linear and turning locomotion.


title: Homoclinic chaos in the R\"ossler model

abstract: We study the origin of homoclinic chaos in the classical 3D model proposed by O. R\"ossler in 1976. Of our particular interest are the convoluted bifurcations of the Shilnikov saddle-foci and how their synergy determines the global unfolding of the model, along with transformations of its chaotic attractors. We apply two computational methods proposed, 1D return maps and a symbolic approach specifically tailored to this model, to scrutinize homoclinic bifurcations, as well as to detect the regions of structurally stable and chaotic dynamics in the parameter space of the R\"ossler model.


title: Laplacian Matrices for Extremely Balanced and Unbalanced Phylogenetic Trees

abstract: Phylogenetic trees are important tools in the study of evolutionary relationships between species. Measures such as the index of Sackin, Colless, and Total Cophenetic have been extensively used to quantify tree balance, one key property of phylogenies. Recently a new proposal has been introduced, based on the spectrum of the Laplacian matrix associated with the tree. In this work, we calculate the Laplacian matrix analytically for two extreme cases, corresponding to fully balanced and fully unbalanced trees. For maximally balanced trees no closed form for the Laplacian matrix was derived, but we present an algorithm to construct it. We show that Laplacian matrices of fully balanced trees display self-similar patterns that result in highly degenerated eigenvalues. Degeneracy is the main signature of this topology, since it is totally absent in fully unbalanced trees. We also establish some analytical and numerical results about the largest eigenvalue of Laplacian matrices for these topologies.


title: Measuring Tree Balance with Normalized Tree Area

abstract: The study of species organization and their clustering by genetic or phenotypic similarity is carried out with the tools of phylogenetic trees. An important structural property of phylogenetic trees is the balance, which measures how taxa are distributed among clades. Tree balance can be measured using indices such as the Sackin ($S$) and the Total Cophenetic ($\Phi$), which are based on the distance between nodes of the tree and its root. Here, we propose a new metric for tree balance, $\bar{d}$, the Area per Pair (APP) of the tree, which is a re-scaled version of the so called tree area. We compute $\bar{d}$ for the rooted caterpillar and maximally balanced trees and we also obtain exact formulas for its expected value and variance under the Yule model. The variance of APP for Yule trees has the remarkable property of converging to an asymptotic constant value for large trees. We compare the Sackin, Total Cophenetic and APP indices for hundreds of empirical phylogenies and show that APP represents the observed distribution of tree balances better than the two other metrics.


title: On the Bochner technique for singular distributions

abstract: In this paper we continue our recent study of a manifold endowed with a singular or regular distribution, determined as the image of the tangent bundle under a smooth endomorphism, and generalize Bochner's technique to the case of a distribution with a statistical type structure. Following the theory of statistical structures on Riemannian manifolds and construction of an almost Lie algebroid on a vector bundle, we define the modified statistical connection and exterior derivative on tensors. Then we introduce the Weitzenbock type curvature operator on tensors and derive the Bochner-Weitzenbock type formula. These allow us to obtain vanishing theorems about the null space of the Hodge type Laplacian on a distribution.


title: Quantum error correction and large $N$

abstract: In recent years quantum error correction(QEC) has become an important part of AdS/CFT. Unfortunately, there are no field-theoretic arguments about why QEC holds in known holographic systems. The purpose of this paper is to fill this gap by studying the error correcting properties of the fermionic sector of various large $N$ theories. Specifically we examine $SU(N)$ matrix quantum mechanics and 3-rank tensor $O(N)^3$ theories. Both of these theories contain large gauge groups. We argue that gauge singlet states indeed form a quantum error correcting code. Our considerations are based purely on large $N$ analysis and do not appeal to a particular form of Hamiltonian or holography.


title: Tuning the convergence angle for optimum STEM performance

abstract: The achievable instrumental performance of a scanning transmission electron microscope (STEM) is determined by the size and shape of the incident electron probe. The most important optical factor in achieving the optimum probe profile is the radius of the probe-forming aperture, which determines the convergence semi-angle of the illumination. What is often overlooked however is that small deviations from this optimum can degrade both the resolution and interpretability of image contrast. A 30% error in aperture radius can lead to a factor of 2 contrast reduction in typical lattice spacings, and a 5 {\AA} error in the thickness measurement of thin layers (such as gate oxides). Theoretical calculations of the optimum convergence angles, from a wave-optical consideration of the probe forming conditions, are explained and their consequences discussed. An experimental approach to the measurement and tuning of the convergence angle is then introduced. This is intended for uncorrected electron microscopes. For corrected instruments, Cs=0, and Cc usually determines the choice of aperture - see e.g. ULTRAMICROSCOPY 108, (2008) 1454-1466


title: Uniquely optimal codes of low complexity are symmetric

abstract: We formulate explicit predictions concerning the symmetry of optimal codes in compact metric spaces. This motivates the study of optimal codes in various spaces where these predictions can be tested.


title: Isoperimetric profiles and random walks on some groups defined by piecewise actions

abstract: We study the isoperimetric and spectral profiles of certain families of finitely generated groups defined via actions on labelled Schreier graphs and simple {\em gluing} of such. In one of our simplest constructions---the {\em pocket-extension} of a group $G$---this leads to the study of certain finitely generated subgroups of the full permutation group $\mathbb S(G\cup \{*\})$. Some sharp estimates are obtained while many challenging questions remain.


title: Background Splitting: Finding Rare Classes in a Sea of Background

abstract: We focus on the real-world problem of training accurate deep models for image classification of a small number of rare categories. In these scenarios, almost all images belong to the background category in the dataset (>95% of the dataset is background). We demonstrate that both standard fine-tuning approaches and state-of-the-art approaches for training on imbalanced datasets do not produce accurate deep models in the presence of this extreme imbalance. Our key observation is that the extreme imbalance due to the background category can be drastically reduced by leveraging visual knowledge from an existing pre-trained model. Specifically, the background category is "split" into smaller and more coherent pseudo-categories during training using a pre-trained model. We incorporate background splitting into an image classification model by adding an auxiliary loss that learns to mimic the predictions of the existing, pre-trained image classification model. Note that this process is automatic and requires no additional manual labels. The auxiliary loss regularizes the feature representation of the shared network trunk by requiring it to discriminate between previously homogeneous background instances and reduces overfitting to the small number of rare category positives. We also show that BG splitting can be combined with other background imbalance methods to further improve performance. We evaluate our method on a modified version of the iNaturalist dataset where only a small subset of rare category labels are available during training (all other images are labeled as background). By jointly learning to recognize ImageNet categories and selected iNaturalist categories, our approach yields performance that is 42.3 mAP points higher than a fine-tuning baseline when 99.98% of the data is background, and 8.3 mAP points higher than SotA baselines when 98.30% of the data is background.


title: On analytical construction of observable functions in extended dynamic mode decomposition for nonlinear estimation and prediction

abstract: We propose an analytical construction of observable functions in the extended dynamic mode decomposition (EDMD) algorithm. EDMD is a numerical method for approximating the spectral properties of the Koopman operator. The choice of observable functions is fundamental for the application of EDMD to nonlinear problems arising in systems and control. Existing methods either start from a set of dictionary functions and look for the subset that best fits the underlying nonlinear dynamics or they rely on machine learning algorithms to "learn" observable functions. Conversely, in this paper, we start from the dynamical system model and lift it through the Lie derivatives, rendering it into a polynomial form. This proposed transformation into a polynomial form is exact, and it provides an adequate set of observable functions. The strength of the proposed approach is its applicability to a broader class of nonlinear dynamical systems, particularly those with nonpolynomial functions and compositions thereof. Moreover, it retains the physical interpretability of the underlying dynamical system and can be readily integrated into existing numerical libraries. The proposed approach is illustrated with an application to electric power systems. The modeled system consists of a single generator connected to an infinite bus, where nonlinear terms include sine and cosine functions. The results demonstrate the effectiveness of the proposed procedure in off-attractor nonlinear dynamics for estimation and prediction; the observable functions obtained from the proposed construction outperform methods that use dictionary functions comprising monomials or radial basis functions.


title: Perla: A Conversational Agent for Depression Screening in Digital Ecosystems. Design, Implementation and Validation

abstract: Most depression assessment tools are based on self-report questionnaires, such as the Patient Health Questionnaire (PHQ-9). These psychometric instruments can be easily adapted to an online setting by means of electronic forms. However, this approach lacks the interacting and engaging features of modern digital environments. With the aim of making depression screening more available, attractive and effective, we developed Perla, a conversational agent able to perform an interview based on the PHQ-9. We also conducted a validation study in which we compared the results obtained by the traditional self-report questionnaire with Perla's automated interview. Analyzing the results from this study we draw two significant conclusions: firstly, Perla is much preferred by Internet users, achieving more than 2.5 times more reach than a traditional form-based questionnaire; secondly, her psychometric properties (Cronbach's alpha of 0.81, sensitivity of 96% and specificity of 90%) are excellent and comparable to the traditional well-established depression screening questionnaires.


title: Alternating minimization algorithms for graph regularized tensor completion

abstract: We consider a Canonical Polyadic (CP) decomposition approach to low-rank tensor completion (LRTC) by incorporating external pairwise similarity relations through graph Laplacian regularization on the CP factor matrices. The usage of graph regularization entails benefits in the learning accuracy of LRTC, but at the same time, induces coupling graph Laplacian terms that hinder the optimization of the tensor completion model. In order to solve graph-regularized LRTC, we propose efficient alternating minimization algorithms by leveraging the block structure of the underlying CP decomposition-based model. For the subproblems of alternating minimization, a linear conjugate gradient subroutine is specifically adapted to graph-regularized LRTC. Alternatively, we circumvent the complicating coupling effects of graph Laplacian terms by using an alternating directions method of multipliers. Based on the Kurdyka-{\L}ojasiewicz property, we show that the sequence generated by the proposed algorithms globally converges to a critical point of the objective function. Moreover, the complexity and convergence rate are also derived. In addition, numerical experiments including synthetic data and real data show that the graph regularized tensor completion model has improved recovery results compared to those without graph regularization, and that the proposed algorithms achieve gains in time efficiency over existing algorithms.


title: Completion by perturbations

abstract: We prove that any non-complete orthonormal system in a Hilbert space can be transformed into a basis by small perturbations.


title: Knowledge Efficient Deep Learning for Natural Language Processing

abstract: Deep learning has become the workhorse for a wide range of natural language processing applications. But much of the success of deep learning relies on annotated examples. Annotation is time-consuming and expensive to produce at scale. Here we are interested in methods for reducing the required quantity of annotated data -- by making the learning methods more knowledge efficient so as to make them more applicable in low annotation (low resource) settings. There are various classical approaches to making the models more knowledge efficient such as multi-task learning, transfer learning, weakly supervised and unsupervised learning etc. This thesis focuses on adapting such classical methods to modern deep learning models and algorithms. This thesis describes four works aimed at making machine learning models more knowledge efficient. First, we propose a knowledge rich deep learning model (KRDL) as a unifying learning framework for incorporating prior knowledge into deep models. In particular, we apply KRDL built on Markov logic networks to denoise weak supervision. Second, we apply a KRDL model to assist the machine reading models to find the correct evidence sentences that can support their decision. Third, we investigate the knowledge transfer techniques in multilingual setting, where we proposed a method that can improve pre-trained multilingual BERT based on the bilingual dictionary. Fourth, we present an episodic memory network for language modelling, in which we encode the large external knowledge for the pre-trained GPT.


title: A Metamodel and Framework for AGI

abstract: Can artificial intelligence systems exhibit superhuman performance, but in critical ways, lack the intelligence of even a single-celled organism? The answer is clearly 'yes' for narrow AI systems. Animals, plants, and even single-celled organisms learn to reliably avoid danger and move towards food. This is accomplished via a physical knowledge preserving metamodel that autonomously generates useful models of the world. We posit that preserving the structure of knowledge is critical for higher intelligences that manage increasingly higher levels of abstraction, be they human or artificial. This is the key lesson learned from applying AGI subsystems to complex real-world problems that require continuous learning and adaptation. In this paper, we introduce the Deep Fusion Reasoning Engine (DFRE), which implements a knowledge-preserving metamodel and framework for constructing applied AGI systems. The DFRE metamodel exhibits some important fundamental knowledge preserving properties such as clear distinctions between symmetric and antisymmetric relations, and the ability to create a hierarchical knowledge representation that clearly delineates between levels of abstraction. The DFRE metamodel, which incorporates these capabilities, demonstrates how this approach benefits AGI in specific ways such as managing combinatorial explosion and enabling cumulative, distributed and federated learning. Our experiments show that the proposed framework achieves 94% accuracy on average on unsupervised object detection and recognition. This work is inspired by the state-of-the-art approaches to AGI, recent AGI-aspiring work, the granular computing community, as well as Alfred Korzybski's general semantics.


title: Improved algorithm to determine 3-colorability of graphs with the minimum degree at least 7

abstract: Let $G$ be an $n$-vertex graph with the maximum degree $\Delta$ and the minimum degree $\delta$. We give algorithms with complexity $O(1.3158^{n-0.7~\Delta(G)})$ and $O(1.32^{n-0.73~\Delta(G)})$ that determines if $G$ is 3-colorable, when $\delta(G)\geq 8$ and $\delta(G)\geq 7$, respectively.


title: Tangled: A Cooperative Anycast Testbed

abstract: Anycast routing is an area of studies that has been attracting interest of several researchers in recent years. Most anycast studies conducted in the past relied on coarse measurement data, mainly due to the lack of infrastructure where it is possible to test and collect data at same time. In this paper we present Tangled, an anycast test environment where researchers can run experiments and better understand the impacts of their proposals on a global infrastructure connected to the Internet.


title: Estimation in Tensor Ising Models

abstract: The $p$-tensor Ising model is a one-parameter discrete exponential family for modeling dependent binary data, where the sufficient statistic is a multi-linear form of degree $p \geq 2$. This is a natural generalization of the matrix Ising model, that provides a convenient mathematical framework for capturing higher-order dependencies in complex relational data. In this paper, we consider the problem of estimating the natural parameter of the $p$-tensor Ising model given a single sample from the distribution on $N$ nodes. Our estimate is based on the maximum pseudo-likelihood (MPL) method, which provides a computationally efficient algorithm for estimating the parameter that avoids computing the intractable partition function. We derive general conditions under which the MPL estimate is $\sqrt N$-consistent, that is, it converges to the true parameter at rate $1/\sqrt N$. In particular, we show the $\sqrt N$-consistency of the MPL estimate in the $p$-spin Sherrington-Kirkpatrick (SK) model, spin systems on general $p$-uniform hypergraphs, and Ising models on the hypergraph stochastic block model (HSBM). In fact, for the HSBM we pin down the exact location of the phase transition threshold, which is determined by the positivity of a certain mean-field variational problem, such that above this threshold the MPL estimate is $\sqrt N$-consistent, while below the threshold no estimator is consistent. Finally, we derive the precise fluctuations of the MPL estimate in the special case of the $p$-tensor Curie-Weiss model. An interesting consequence of our results is that the MPL estimate in the Curie-Weiss model saturates the Cramer-Rao lower bound at all points above the estimation threshold, that is, the MPL estimate incurs no loss in asymptotic efficiency, even though it is obtained by minimizing only an approximation of the true likelihood function for computational tractability.


title: The turbulent bubble break-up cascade. Part 1. Theoretical developments

abstract: Breaking waves entrain gas beneath the surface. The wave-breaking process energizes turbulent fluctuations that break bubbles in quick succession to generate a wide range of bubble sizes. Understanding this generation mechanism paves the way towards the development of predictive models for large-scale maritime and climate simulations. Garrett et al. (2000) suggested that super-Hinze-scale turbulent breakup transfers entrained gas from large to small bubble sizes in the manner of a cascade. We provide a theoretical basis for this bubble-mass cascade by appealing to how energy is transferred from large to small scales in the energy cascade central to single-phase turbulence theories. A bubble break-up cascade requires that break-up events predominantly transfer bubble mass from a certain bubble size to a slightly smaller size on average. This property is called locality. In this paper, we analytically quantify locality by extending the population balance equation in conservative form to derive the bubble-mass transfer rate from large to small sizes. Using our proposed measures of locality, we show that scalings relevant to turbulent bubbly flows, including those postulated by Garrett et al. (2000) and observed in breaking-wave experiments and simulations, are consistent with a strongly local transfer rate, where the influence of non-local contributions decays in a power-law fashion. These theoretical predictions are confirmed using numerical simulations in Part 2, revealing key physical aspects of the bubble break-up cascade phenomenology. Locality supports the universality of turbulent small-bubble break-up, which simplifies the development of subgrid-scale models to predict oceanic small-bubble statistics of practical importance.


title: New feature for Complex Network based on Ant Colony Optimization for High Level Classification

abstract: Low level classification extracts features from the elements, i.e. physical to use them to train a model for a later classification. High level classification uses high level features, the existent patterns, relationship between the data and combines low and high level features for classification. High Level features can be got from Complex Network created over the data. Local and global features are used to describe the structure of a Complex Network, i.e. Average Neighbor Degree, Average Clustering. The present work proposed a novel feature to describe the architecture of the Network following a Ant Colony System approach. The experiments shows the advantage of using this feature because the sensibility with data of different classes.


title: An autocovariance-based learning framework for high-dimensional functional time series

abstract: Many scientific and economic applications involve the statistical learning of high-dimensional functional time series, where the number of functional variables is comparable to, or even greater than, the number of serially dependent functional observations. In this paper, we model observed functional time series, which are subject to errors in the sense that each functional datum arises as the sum of two uncorrelated components, one dynamic and one white noise. Motivated from the fact that the autocovariance function of observed functional time series automatically filters out the noise term, we propose a three-step procedure by first performing autocovariance-based dimension reduction, then formulating a novel autocovariance-based block regularized minimum distance estimation framework to produce block sparse estimates, and based on which obtaining the final functional sparse estimates. We investigate theoretical properties of the proposed estimators, and illustrate the proposed estimation procedure via three sparse high-dimensional functional time series models. We demonstrate via both simulated and real datasets that our proposed estimators significantly outperform the competitors.


title: Shannon Entropy Rate of Hidden Markov Processes

abstract: Hidden Markov chains are widely applied statistical models of stochastic processes, from fundamental physics and chemistry to finance, health, and artificial intelligence. The hidden Markov processes they generate are notoriously complicated, however, even if the chain is finite state: no finite expression for their Shannon entropy rate exists, as the set of their predictive features is generically infinite. As such, to date one cannot make general statements about how random they are nor how structured. Here, we address the first part of this challenge by showing how to efficiently and accurately calculate their entropy rates. We also show how this method gives the minimal set of infinite predictive features. A sequel addresses the challenge's second part on structure.

categories: nlin.CD cond-mat.stat-mech cs.IT math.DS math.IT stat.ML


title: Design of phase III trials with long-term survival outcomes based on short-term binary results

abstract: Pathologic complete response (pCR) is a common primary endpoint for a phase II trial or even accelerated approval of neoadjuvant cancer therapy. If granted, a two-arm confirmatory trial is often required to demonstrate the efficacy with a time-to-event outcome such as overall survival. However, the design of a subsequent phase III trial based on prior information on the pCR effect is not straightforward. Aiming at designing such phase III trials with overall survival as primary endpoint using pCR information from previous trials, we consider a mixture model that incorporates both the survival and the binary endpoints. We propose to base the comparison between arms on the difference of the restricted mean survival times, and show how the effect size and sample size for overall survival rely on the probability of the binary response and the survival distribution by response status, both for each treatment arm. Moreover, we provide the sample size calculation under different scenarios and accompany them with an R package where all the computations have been implemented. We evaluate our proposal with a simulation study, and illustrate its application through a neoadjuvant breast cancer trial.


title: Development and Assessment of a Nearly Autonomous Management and Control System for Advanced Reactors

abstract: This paper develops a Nearly Autonomous Management and Control (NAMAC) system for advanced reactors. The development process of NAMAC is characterized by a three layer-layer architecture: knowledge base, the Digital Twin (DT) developmental layer, and the NAMAC operational layer. The DT is described as a knowledge acquisition system from the knowledge base for intended uses in the NAMAC system. A set of DTs with different functions is developed with acceptable performance and assembled according to the NAMAC operational workflow to furnish recommendations to operators. To demonstrate the capability of the NAMAC system, a case study is designed, where a baseline NAMAC is implemented for operating a simulator of the Experimental Breeder Reactor II during a single loss of flow accident. When NAMAC is operated in the training domain, it can provide reasonable recommendations that prevent the peak fuel centerline temperature from exceeding a safety criterion.


title: Source-Aware Neural Speech Coding for Noisy Speech Compression

abstract: This paper introduces a novel neural network-based speech coding system that can process noisy speech effectively. The proposed source-aware neural audio coding (SANAC) system harmonizes a deep autoencoder-based source separation model and a neural coding system so that it can explicitly perform source separation and coding in the latent space. An added benefit of this system is that the codec can allocate a different amount of bits to the underlying sources so that the more important source sounds better in the decoded signal. We target a new use case where the user on the receiver side cares about the quality of the non-speech components in speech communication, while the speech source still carries the most crucial information. Both objective and subjective evaluation tests show that SANAC can recover the original noisy speech better than the baseline neural audio coding system, which is with no source-aware coding mechanism, and two conventional codecs.


title: Many-Server Heavy-Traffic Limits for Queueing Systems with Perfectly Correlated Service and Patience Times

abstract: We characterize heavy-traffic process and steady-state limits for systems staffed according to the square-root safety rule, when the service requirements of the customers are perfectly correlated with their individual patience for waiting in queue. Under the usual many-server diffusion scaling, we show that the system is asymptotically equivalent to a system with no abandonment. In particular, the limit is the Halfin-Whitt diffusion for the $M/M/n$ queue when the traffic intensity approaches its critical value $1$ from below, and is otherwise a transient diffusion, despite the fact that the prelimit is positive recurrent. To obtain a refined measure of the congestion due to the correlation, we characterize a lower-order fluid (LOF) limit for the case in which the diffusion limit is transient, demonstrating that the queue in this case scales like $n^{3/4}$. Under both the diffusion and LOF scalings, we show that the stationary distributions converge weakly to the time-limiting behavior of the corresponding process limit.


title: Matter flow method for alleviating checkerboard oscillations in triangular mesh SGH Lagrangian simulation

abstract: When the SGH Lagrangian based on triangle mesh is used to simulate compressible hydrodynamics, because of the stiffness of triangular mesh, the problem of physical quantity cell-to-cell spatial oscillation (also called "checkerboard oscillation") is easy to occur. A matter flow method is proposed to alleviate the oscillation of physical quantities caused by triangular stiffness. The basic idea of this method is to attribute the stiffness of triangle to the fact that the edges of triangle mesh can not do bending motion, and to compensate the effect of triangle edge bending motion by means of matter flow. Three effects are considered in our matter flow method: (1) transport of the mass, momentum and energy carried by the moving matter; (2) the work done on the element, since the flow of matter changes the specific volume of the grid element; (3) the effect of matter flow on the strain rate in the element. Numerical experiments show that the proposed matter flow method can effectively alleviate the spatial oscillation of physical quantities.


title: Model selection for estimation of causal parameters

abstract: A popular technique for selecting and tuning machine learning estimators is cross-validation. Cross-validation evaluates overall model fit, usually in terms of predictive accuracy. In causal inference, the optimal choice of estimator depends not only on the fitted models but also on assumptions the statistician is willing to make. In this case, the performance of different (potentially biased) estimators cannot be evaluated by checking overall model fit. We propose a model selection procedure that estimates the squared l2-deviation of a finite-dimensional estimator from its target. The procedure relies on knowing an asymptotically unbiased "benchmark estimator" of the parameter of interest. Under regularity conditions, we investigate bias and variance of the proposed criterion compared to competing procedures and derive a finite-sample bound for the excess risk compared to an oracle procedure. The resulting estimator is discontinuous and does not have a Gaussian limit distribution. Thus, standard asymptotic expansions do not apply. We derive asymptotically valid confidence intervals that take into account the model selection step. The performance of the approach for estimation and inference for average treatment effects is evaluated on simulated data sets, including experimental data, instrumental variables settings, and observational data with selection on observables.


title: Deep inelastic vortex scattering: A third outcome for head-on collisions

abstract: Results are presented from numerical simulations of the flat-space nonlinear Maxwell-Klein-Gordon equations demonstrating deep inelastic scattering of $m=1$ vortices for a range of Ginzburg-Landau (or Abelian-Higgs) parameters ($\kappa$), impact parameters ($b$), and initial velocities ($v_0$). The threshold ($v_0^*$) of right-angle scattering is explored for head-on ($b=0$) collisions by varying $v_0$. Solutions obey time-scaling laws, $T\propto \alpha\ln(v_0-v_0^*) $, with $\kappa$-dependent scaling exponents, $\alpha$, and have $v_0^*$ that appear not to have the previously reported upper bound. The arbitrarily long-lived static intermediate attractor at criticality ($v_0=v_0^*$) is observed to be the $\kappa$-specific $m=2$ vortex solution. Scattering angles are observed for off-axis ($b\neq 0$) collisions for a wide range of $b$, $v_0$, and $\kappa$. It is shown that for arbitrarily small impact parameters ($b\rightarrow 0$), the unstable %but arbitrarily long-lived $\kappa$-dependent $m=2$ "critical" vortex is an intermediate attractor and decays with a $\kappa$-\emph{independent} scattering angle of $135^{\circ}$, as opposed to either of the well-known values of $180^{\circ}$ or $90^{\circ}$ for $b=0$.


title: Self-Organized Operational Neural Networks for Severe Image Restoration Problems

abstract: Discriminative learning based on convolutional neural networks (CNNs) aims to perform image restoration by learning from training examples of noisy-clean image pairs. It has become the go-to methodology for tackling image restoration and has outperformed the traditional non-local class of methods. However, the top-performing networks are generally composed of many convolutional layers and hundreds of neurons, with trainable parameters in excess of several millions. We claim that this is due to the inherent linear nature of convolution-based transformation, which is inadequate for handling severe restoration problems. Recently, a non-linear generalization of CNNs, called the operational neural networks (ONN), has been shown to outperform CNN on AWGN denoising. However, its formulation is burdened by a fixed collection of well-known nonlinear operators and an exhaustive search to find the best possible configuration for a given architecture, whose efficacy is further limited by a fixed output layer operator assignment. In this study, we leverage the Taylor series-based function approximation to propose a self-organizing variant of ONNs, Self-ONNs, for image restoration, which synthesizes novel nodal transformations onthe-fly as part of the learning process, thus eliminating the need for redundant training runs for operator search. In addition, it enables a finer level of operator heterogeneity by diversifying individual connections of the receptive fields and weights. We perform a series of extensive ablation experiments across three severe image restoration tasks. Even when a strict equivalence of learnable parameters is imposed, Self-ONNs surpass CNNs by a considerable margin across all problems, improving the generalization performance by up to 3 dB in terms of PSNR.


title: An Efficient Routing Protocol for Secured Communication in Cognitive Radio Sensor Networks

abstract: This paper introduces an efficient reactive routing protocol considering the mobility and the reliability of a node in Cognitive Radio Sensor Networks (CRSNs). The proposed protocol accommodates the dynamic behavior of the spectrum availability and selects a stable transmission path from a source node to the destination. Outlined as a weighted graph problem, the proposed protocol measures the weight for an edge the measuring the mobility patterns of the nodes and channel availability. Furthermore, the mobility pattern of a node is defined in the proposed routing protocol from the viewpoint of distance, speed, direction, and node's reliability. Besides, the spectrum awareness in the proposed protocol is measured over the number of shared common channels and the channel quality. It is anticipated that the proposed protocol shows efficient routing performance by selecting stable and secured paths from source to destination. Simulation is carried out to assess the performance of the protocol where it is witnessed that the proposed routing protocol outperforms existing ones.


title: Observation of nonreciprocal magneto-optical scattering in nonencapsulated few-layered CrI3

abstract: Magneto-optical effect refers to a rotation of polarization plane, which has been widely studied in traditional ferromagnetic metal and insulator films and scarcely in two-dimensional layered materials. Here we uncover a new nonreciprocal magneto-inelastic light scattering effect in ferromagnetic few-layer CrI3. We observed a rotation of the polarization plane of inelastic light scattering between -20o and +60o that are tunable by an out-of-plane magnetic field from -2.5 to 2.5 T. It is experimentally observed that the degree of polarization can be magnetically manipulated between -20% and 85%. This work raises a new magneto-optical phenomenon and could create opportunities of applying 2D ferromagnetic materials in Raman lasing, topological photonics, and magneto-optical modulator for information transport and storage.


title: Valence band electronic structure of the van der Waals ferromagnetic insulators: VI$_3$ and CrI$_3$

abstract: Ferromagnetic van der Waals (vdW) insulators are of great scientific interest for their promising applications in spintronics. It has been indicated that in the two materials within this class, CrI$_3$ and VI$_3$, the magnetic ground state, the band gap, and the Fermi level could be manipulated by varying the layer thickness, strain or doping. To understand how these factors impact the properties, a detailed understanding of the electronic structure would be required. However, the experimental studies of the electronic structure of these materials are still very sparse. Here, we present the detailed electronic structure of CrI$_3$ and VI$_3$ measured by angle-resolved photoemission spectroscopy (ARPES). Our results show a band-gap of the order of 1 eV, sharply contrasting some theoretical predictions such as Dirac half-metallicity and metallic phases, indicating that the intra-atomic interaction parameter (U) and spin-orbit coupling (SOC) were not properly accounted for in the calculations. We also find significant differences in the electronic properties of these two materials, in spite of similarities in their crystal structure. In CrI$_3$, the valence band maximum is dominated by the I 5{\it p}, whereas in VI$_3$ it is dominated by the V 3{\it d} derived states. Our results represent valuable input for further improvements in the theoretical modeling of these systems.


title: Riemannian manifolds with Anosov geodesic flow do not have conjugate points

abstract: In this paper, we prove that any non-compact complete Riemannian manifold with curvature bounded below and Anosov geodesic flow does not have conjugate points. In particular, we answer an open problem mentioned in [Kni02], which is related to Man\'e's statements in [Mn87] about a generalization of Klingenberg's theorem to non-compact manifolds.


title: Quasi two-dimensional magnetism in spin-$\frac{1}{2}$ square lattice compound Cu[C$_6$H$_2$(COO)$_4$][H$_3$N-(CH$_2$)$_2$-NH$_3$]$\cdot$3H$_2$O

abstract: We report the crystal growth and structural and magnetic properties of quasi two-dimensional $S=1/2$ quantum magnet Cu[C$_6$H$_2$(COO)$_4$][H$_3$N-(CH$_2$)$_2$-NH$_3$]$\cdot$3H$_2$O. It is found to crystallize in a monoclinic structure with space group $C2/m$. The CuO$_4$ plaquettes are connected into a two-dimensional framework in the $ab$-plane through the anions of [C$_6$H$_2$(COO)$_4$]$^{4-}$ (pyromellitic acid). The [H$_3$N-(CH$_2$)$_2$-NH$_3$]$^{2+}$$\cdot$3H$_2$O groups are located between the layers and provide a weak interlayer connection via hydrogen (H...O) bonds. The temperature dependent magnetic susceptibility is well described by $S=1/2$ frustrated square lattice ($J_1-J_2$) model with nearest-neighbor interaction $J_1/k_{\rm B} \simeq 5.35$ K and next-nearest-neighbor interaction $J_2/k_{\rm B} \simeq -0.01$ K. Even, our analysis using frustrated rectangular lattice ($J_{1a,b}-J_2$) model confirms almost isotropic nearest-neighbour interactions ($J_{\rm 1a}/k_{\rm B} \simeq 5.31$ K and $J_{\rm 1b}/k_{\rm B} \simeq 5.38$ K) in the $ab$-plane and $J_2/k_{\rm B}\simeq-0.24$ K. Further, the isothermal magnetization at $T=1.9$ K is also well described by a non-frustrated square lattice model with $J_1/k_{\rm B} \simeq 5.2$ K. Based on the $J_2/J_1$ ratio, the compound can be placed in the N\'{e}el antiferromagnetic state of the $J_1 - J_2$ phase diagram. No signature of magnetic long-range-order was detected down to 2 K.


title: Unveiling the polarity of the spin-to-charge current conversion in $Bi_2Se_3$

abstract: We report an investigation of the spin- to charge-current conversion in sputter-deposited films of topological insulator $Bi_2Se_{3}$ onto single crystalline layers of YIG $(Y_{3}Fe_{5}O_{12})$ and polycrystalline films of Permalloy $(Py = Ni_{81}Fe_{19})$. Pure spin current was injected into the $Bi_{2}Se_{3}$ layer by means of the spin pumping process in which the spin precession is obtained by exciting the ferromagnetic resonance of the ferromagnetic film. The spin-current to charge-current conversion, occurring at the $Bi_{2}Se_{3}/$ferromagnet interface, was attribute to the inverse Rashba-Edelstein effect (IREE). By analyzing the data as a function of the $Bi_{2}Se_{3}$ thickness we calculated the IREE length used to characterize the efficiency of the conversion process and found that 1.2 pm $\leq|{\lambda}_{IREE}|\leq$ 2.2 pm. These results support the fact that the surface states of $Bi_{2}Se_{3}$ have a dominant role in the spin-charge conversion process, and the mechanism based on the spin diffusion process plays a secondary role. We also discovered that the spin- to charge-current mechanism in $Bi_{2}Se_{3}$ has the same polarity as the one in Ta, which is the opposite to the one in Pt. The combination of the magnetic properties of YIG and Py, with strong spin-orbit coupling and dissipationless surface states topologically protected of $Bi_{2}Se_{3}$ might lead to spintronic devices with fast and efficient spin-charge conversion.


title: Coherent Optical Memory Baesd on A Laser-written On-chip Waveguide

abstract: Quantum memory is the core device for the construction of large-scale quantum networks. For scalable and convenient practical applications, integrated optical memories, especially on-chip optical memories, are crucial requirements because they can be easily integrated with other on-chip devices. Here, we report the coherent optical memory based on a type-IV waveguide fabricated on the surface of a rare-earth ion-doped crystal (i.e. $\mathrm{Eu^{3+}}$:$\mathrm{Y_2SiO_5}$). The properties of the optical transition ($\mathrm{{^7}F{_0}\rightarrow{^5}D{_0}}$) of the $\mathrm{Eu^{3+}}$ ions inside the surface waveguide are well preserved compared to those of the bulk crystal. Spin-wave atomic frequency comb storage is demonstrated inside the type-IV waveguide. The reliability of this device is confirmed by the high interference visibility of ${97\pm 1\%}$ between the retrieval pulse and the reference pulse. The developed on-chip optical memory paves the way towards integrated quantum nodes.


title: Spontaneous formation of density waves in granular matter under swirling excitation

abstract: We study here the spontaneous clustering of a submonolayer of grains under horizontal circular shaking. The clustering of grains occurs when increasing the oscillation amplitude beyond a threshold. The dense area travels in a circular fashion at the driving frequency, even exceeds the speed of driving. It turns out that the observed clustering is due to the formation of density wave. The analysis of a phenomenological model shows that the instability of the uniform density profile arises by increasing the oscillation amplitude and captures the non-monotonic dependence of the transition amplitude of the clustering on the global density of the system. Here, the key ingredient is that the velocity of individual grains increases with the local density. The interplay of dissipative particle-particle interaction and the frictional driving of the substrate results into this dependence, which is tested with discrete element method simulations.


title: Electrical Tuning of Phase Change Antennas and Metasurfaces

abstract: The success of semiconductor electronics is built on the creation of compact, low-power switching elements that offer routing, logic, and memory functions. The availability of nanoscale optical switches could have a similarly transformative impact on the development of dynamic and programmable metasurfaces, optical neural networks, and quantum information processing. Phase change materials are uniquely suited to enable their creation as they offer high-speed electrical switching between amorphous and crystalline states with notably different optical properties. Their high refractive index has also been harnessed to fashion them into compact optical antennas. Here, we take the next important step by realizing electrically-switchable phase change antennas and metasurfaces that offer strong, reversible, non-volatile, multi-phase switching and spectral tuning of light scattering in the visible and near-infrared spectral ranges. Their successful implementation relies on a careful joint thermal and optical optimization of the antenna elements that comprise an Ag strip that simultaneously serves as a plasmonic resonator and a miniature heating stage.


title: On segmentation of pectoralis muscle in digital mammograms by means of deep learning

abstract: Computer-aided diagnosis (CAD) has long become an integral part of radiological management of breast disease, facilitating a number of important clinical applications, including quantitative assessment of breast density and early detection of malignancies based on X-ray mammography. Common to such applications is the need to automatically discriminate between breast tissue and adjacent anatomy, with the latter being predominantly represented by pectoralis major (or pectoral muscle). Especially in the case of mammograms acquired in the mediolateral oblique (MLO) view, the muscle is easily confusable with some elements of breast anatomy due to their morphological and photometric similarity. As a result, the problem of automatic detection and segmentation of pectoral muscle in MLO mammograms remains a challenging task, innovative approaches to which are still required and constantly searched for. To address this problem, the present paper introduces a two-step segmentation strategy based on a combined use of data-driven prediction (deep learning) and graph-based image processing. In particular, the proposed method employs a convolutional neural network (CNN) which is designed to predict the location of breast-pectoral boundary at different levels of spatial resolution. Subsequently, the predictions are used by the second stage of the algorithm, in which the desired boundary is recovered as a solution to the shortest path problem on a specially designed graph. The proposed algorithm has been tested on three different datasets (i.e., MIAS, CBIS-DDSm and InBreast) using a range of quantitative metrics. The results of comparative analysis show considerable improvement over state-of-the-art, while offering the possibility of model-free and fully automatic processing.


title: Batching and Matching for Food Delivery in Dynamic Road Networks

abstract: Given a stream of food orders and available delivery vehicles, how should orders be assigned to vehicles so that the delivery time is minimized? Several decisions have to be made: (1) assignment of orders to vehicles, (2) grouping orders into batches to cope with limited vehicle availability, and (3) adapting to dynamic positions of delivery vehicles. We show that the minimization problem is not only NP-hard but inapproximable in polynomial time. To mitigate this computational bottleneck, we develop an algorithm called FoodMatch, which maps the vehicle assignment problem to that of minimum weight perfect matching on a bipartite graph. To further reduce the quadratic construction cost of the bipartite graph, we deploy best-first search to only compute a subgraph that is highly likely to contain the minimum matching. The solution quality is further enhanced by reducing batching to a graph clustering problem and anticipating dynamic positions of vehicles through angular distance. Extensive experiments on food-delivery data from large metropolitan cities establish that FoodMatch is substantially better than baseline strategies on a number of metrics, while being efficient enough to handle real-world workloads.


title: Nanoscale control of LaAlO3/SrTiO3 metal-insulator transition using ultra-low-voltage electron-beam lithography

abstract: We describe a method to control the insulator-metal transition at the LaAlO3/SrTiO3 interface using ultra-low-voltage electron beam lithography (ULV-EBL). Compared with previous reports that utilize conductive atomic-force-microscope lithography (c-AFM), this approach can provide comparable resolution (~10 nm) at write speeds (10 mm/s) that are up to 10,000x faster than c-AFM. The writing technique is non-destructive and the conductive state is reversible via prolonged exposure to air. Transport properties of representative devices are measured at milli-Kelvin temperatures, where superconducting behavior is observed. We also demonstrate the ability to create conducting devices on graphene/LaAlO3/SrTiO3 heterostructures. The underlying mechanism is believed to be closely related to the same mechanism regulating c-AFM-based methods.


title: High-throughput Design of Magnetic Materials

abstract: Materials design based on density functional theory (DFT) calculations is an emergent field of great potential to accelerate the development and employment of novel materials. Magnetic materials play an essential role in green energy applications as they provide efficient ways of harvesting, converting, and utilizing energy. In this review, after a brief introduction to the major functionalities of magnetic materials, we demonstrated the fundamental properties which can be tackled via high-throughput DFT calculations, with a particular focus on the current challenges and feasible solutions. Successful case studies are summarized on several classes of magnetic materials, followed by bird-view perspectives for the future.


title: Quantum dynamics under simultaneous and continuous measurement of noncommutative observables

abstract: We consider simultaneous and continuous measurement of two noncommutative observables of the system whose commutator is not necessarily a $c$-number. We revisit the Arthurs-Kelly model and generalize it to describe the simultaneous measurement of two observables of the system. Using this generalized model, we continuously measure the system by following the scheme proposed by Scott and Milburn [Scott and Milburn, Phys. Rev. A 63, 042101 (2001)]. We find that the unconditioned master equation reduces to the Lindblad form in the continuous limit. In addition, we find that the master equation does not contain a cross term of these two measurements. Finally, we propose a scheme to prepare the state of a two-level system in an external field by feedback control based on the simultaneous, continuous measurement of the two observables.


title: Nash Equilibrium Seeking in N-Coalition Games via a Gradient-Free Method

abstract: This paper studies an $N$-coalition non-cooperative game problem, where the players in the same coalition cooperatively minimize the sum of their local cost functions under a directed communication graph, while collectively acting as a virtual player to play a non-cooperative game with other coalitions. Moreover, it is assumed that the players have no access to the explicit functional form but only the function value of their local costs. To solve the problem, a discrete-time gradient-free Nash equilibrium seeking strategy, based on the gradient tracking method, is proposed. Specifically, a gradient estimator is developed locally based on Gaussian smoothing to estimate the partial gradients, and a gradient tracker is constructed locally to trace the average sum of the partial gradients among the players within the coalition. With a sufficiently small constant step-size, we show that all players' actions approximately converge to the Nash equilibrium at a geometric rate under a strongly monotone game mapping condition. Numerical simulations are conducted to verify the effectiveness of the proposed algorithm.


title: Implication of Natal Care and Maternity Leave on Child Morbidity: Evidence from Ghana

abstract: Failure to receive post-natal care within first week of delivery causes a 3% increase in the possibility of Acute Respiratory Infection in children under five. Mothers with unpaid maternity leave put their children at a risk of 3.9% increase in the possibility of ARI compared to those with paid maternity leave.


title: Travelling and rotating solutions to the generalized inviscid surface quasi-geostrophic equation

abstract: For the generalized surface quasi-geostrophic equation $$\left\{ \begin{aligned} & \partial_t \theta+u\cdot \nabla \theta=0, \quad \text{in } \mathbb{R}^2 \times (0,T), \\ & u=\nabla^\perp \psi, \quad \psi = (-\Delta)^{-s}\theta \quad \text{in } \mathbb{R}^2 \times (0,T) , \end{aligned} \right. $$ $0<s<1$, we consider for $k\ge1$ the problem of finding a family of $k$-vortex solutions $\theta_\varepsilon(x,t)$ such that as $\varepsilon\to 0$ $$ \theta_\varepsilon(x,t) \rightharpoonup \sum_{j=1}^k m_j\delta(x-\xi_j(t)) $$ for suitable trajectories for the vortices $x=\xi_j(t)$. We find such solutions in the special cases of vortices travelling with constant speed along one axis or rotating with same speed around the origin. In those cases the problem is reduced to a fractional elliptic equation which is treated with singular perturbation methods. A key element in our construction is a proof of the non-degeneracy of the radial ground state for the so-called fractional plasma problem $$(-\Delta)^sW = (W-1)^\gamma_+, \quad \text{in } \mathbb{R}^2, \quad 1<\gamma < \frac{1+s}{1-s}$$ whose existence and uniqueness have recently been proven in \cite{chan_uniqueness_2020}.


title: Multi-Attention Based Ultra Lightweight Image Super-Resolution

abstract: Lightweight image super-resolution (SR) networks have the utmost significance for real-world applications. There are several deep learning based SR methods with remarkable performance, but their memory and computational cost are hindrances in practical usage. To tackle this problem, we propose a Multi-Attentive Feature Fusion Super-Resolution Network (MAFFSRN). MAFFSRN consists of proposed feature fusion groups (FFGs) that serve as a feature extraction block. Each FFG contains a stack of proposed multi-attention blocks (MAB) that are combined in a novel feature fusion structure. Further, the MAB with a cost-efficient attention mechanism (CEA) helps us to refine and extract the features using multiple attention mechanisms. The comprehensive experiments show the superiority of our model over the existing state-of-the-art. We participated in AIM 2020 efficient SR challenge with our MAFFSRN model and won 1st, 3rd, and 4th places in memory usage, floating-point operations (FLOPs) and number of parameters, respectively.


title: $q$-Deformations and $t$-deformations of Markov triples

abstract: In this paper, we generalize the Markov triples in two different directions. One is generalization in direction of using the $q$-deformation of rational number introduced by \cite{MO} in connection with cluster algebras, quantum topology and analytic number theory. The other is direction using castling transforms of prehomogeneous vector spaces \cite{SaKi} which plays an important role in the study of representation theory and automorphic function. In addition, the present paper gives a relationship between the two generalizations. This may provide some kind of bridging between different fields.


title: Data augmentation using prosody and false starts to recognize non-native children's speech

abstract: This paper describes AaltoASR's speech recognition system for the INTERSPEECH 2020 shared task on Automatic Speech Recognition (ASR) for non-native children's speech. The task is to recognize non-native speech from children of various age groups given a limited amount of speech. Moreover, the speech being spontaneous has false starts transcribed as partial words, which in the test transcriptions leads to unseen partial words. To cope with these two challenges, we investigate a data augmentation-based approach. Firstly, we apply the prosody-based data augmentation to supplement the audio data. Secondly, we simulate false starts by introducing partial-word noise in the language modeling corpora creating new words. Acoustic models trained on prosody-based augmented data outperform the models using the baseline recipe or the SpecAugment-based augmentation. The partial-word noise also helps to improve the baseline language model. Our ASR system, a combination of these schemes, is placed third in the evaluation period and achieves the word error rate of 18.71%. Post-evaluation period, we observe that increasing the amounts of prosody-based augmented data leads to better performance. Furthermore, removing low-confidence-score words from hypotheses can lead to further gains. These two improvements lower the ASR error rate to 17.99%.


title: Mandelbrot set for fractal $n$-gons and zeros of power series

abstract: We give a framework to study the connectedness of the set of zeros of power series with coefficients in a finite subset $G\subset \mathbb{C}$. We prove that the set of zeros in the unit disk is connected and locally connected if some graph on the set $G$ of coefficients is connected. Furthermore, we apply this result to the study of the Mandelbrot set $\mathcal{M}_n$ for fractal $n$-gons. We prove that $\mathcal{M}_n$ is connected and locally connected for any $n$.


title: Random Surfing Revisited: Generalizing PageRank's Teleportation Model

abstract: We revisit the Random Surfer model, focusing on its--often overlooked--Teleportation component, and we introduce NCDawareRank; a novel ranking framework designed to exploit network meta-information as well as aspects of its higher-order structural organization in a way that preserves the mathematical structure and the attractive computational characteristics of PageRank. A rigorous theoretical exploration of the proposed model reveals a wealth of mathematical properties that entail tangible benefits in terms of robustness, computability, as well as modeling flexibility and expressiveness. A set of experiments on real-work networks verify the theoretically predicted properties of NCDawareRank, and showcase its effectiveness as a network centrality measure.


title: Stress Correlations in Frictional Granular Media

abstract: This paper investigates whether in frictional granular packings, like in Hamiltonian amorphous elastic solids, the stress autocorrelation matrix presents long range anisotropic contributions just as elastic Green's functions. We find that in a standard model of frictional granular packing this is not the case. We prove quite generally that mechanical balance and material isotropy constrain the stress auto-correlation matrix to be fully determined by two spatially isotropic functions: the pressure and torque auto-correlations. The pressure and torque fluctuations being respectively normal and hyperuniform force the stress autocorrelation to decay as the elastic Green's function. Since we find the torque fluctuations to be hyper-uniform, the culprit is the pressure whose fluctuations decay slower than normally as a function of the system's size. Investigating the reason for these abnormal pressure fluctuations we discover that anomalous correlations build up already during the compression of the dilute system before jamming. Once jammed these correlations remain frozen. Whether this is true for frictional matter in general or is it the consequence of the model properties is a question that must await experimental scrutiny and possible alternative models.


title: Zero-Resource Knowledge-Grounded Dialogue Generation

abstract: While neural conversation models have shown great potentials towards generating informative and engaging responses via introducing external knowledge, learning such a model often requires knowledge-grounded dialogues that are difficult to obtain. To overcome the data challenge and reduce the cost of building a knowledge-grounded dialogue system, we explore the problem under a zero-resource setting by assuming no context-knowledge-response triples are needed for training. To this end, we propose representing the knowledge that bridges a context and a response and the way that the knowledge is expressed as latent variables, and devise a variational approach that can effectively estimate a generation model from a dialogue corpus and a knowledge corpus that are independent with each other. Evaluation results on three benchmarks of knowledge-grounded dialogue generation indicate that our model can achieve comparable performance with state-of-the-art methods that rely on knowledge-grounded dialogues for training, and exhibits a good generalization ability over different topics and different datasets.


title: Low-Rank Covariance Function Estimation for Multidimensional Functional Data

abstract: Multidimensional function data arise from many fields nowadays. The covariance function plays an important role in the analysis of such increasingly common data. In this paper, we propose a novel nonparametric covariance function estimation approach under the framework of reproducing kernel Hilbert spaces (RKHS) that can handle both sparse and dense functional data. We extend multilinear rank structures for (finite-dimensional) tensors to functions, which allow for flexible modeling of both covariance operators and marginal structures. The proposed framework can guarantee that the resulting estimator is automatically semi-positive definite, and can incorporate various spectral regularizations. The trace-norm regularization in particular can promote low ranks for both covariance operator and marginal structures. Despite the lack of a closed form, under mild assumptions, the proposed estimator can achieve unified theoretical results that hold for any relative magnitudes between the sample size and the number of observations per sample field, and the rate of convergence reveals the "phase-transition" phenomenon from sparse to dense functional data. Based on a new representer theorem, an ADMM algorithm is developed for the trace-norm regularization. The appealing numerical performance of the proposed estimator is demonstrated by a simulation study and the analysis of a dataset from the Argo project.


title: Development and Testing of a Novel Automated Insect Capture Module for Sample Collection and Transfer

abstract: There exists an urgent need for efficient tools in disease surveillance to help model and predict the spread of disease. The transmission of insect-borne diseases poses a serious concern to public health officials and the medical and research community at large. In the modeling of this spread, we face bottlenecks in (1) the frequency at which we are able to sample insect vectors in environments that are prone to propagating disease, (2) manual labor needed to set up and retrieve surveillance devices like traps, and (3) the return time in analyzing insect samples and determining if an infectious disease is spreading in a region. To help address these bottlenecks, we present in this paper the design, fabrication, and testing of a novel automated insect capture module (ICM) or trap that aims to improve the rate of transferring samples collected from the environment via aerial robots. The ICM features an ultraviolet light attractant, passive capture mechanism, panels which can open and close for access to insects, and a small onboard computer for automated operation and data logging. At the same time, the ICM is designed to be accessible; it is small-scale, lightweight and low-cost, and can be integrated with commercially available aerial robots. Indoor and outdoor experimentation validates ICM's feasibility in insect capturing and safe transportation. The device can help bring us one step closer toward achieving fully autonomous and scalable epidemiology by leveraging autonomous robots technology to aid the medical and research community.


title: A $j_\mathrm{eff} = 1/2$ pseudospinon continuum in CaIrO$_3$

abstract: In so-called $j_\mathrm{eff} = 1/2$ systems, including some iridates and ruthenates, the coherent superposition of $t_\mathrm{2g}$ orbitals in the ground state gives rise to hopping processes that strongly depend on the bond geometry. Resonant inelastic x-ray scattering (RIXS) measurements on CaIrO$_3$ reveal a prototypical $j_\mathrm{eff} = 1/2$ pseudospinon continuum, a hallmark of one-dimensional (1D) magnetic systems despite its three-dimensional crystal structure. The experimental spectra compare very well to the calculated magnetic dynamical structure factor of weakly coupled spin-1/2 chains. We attribute the onset of such quasi-1D magnetism to the fundamental difference in the magnetic interactions between the $j_\mathrm{eff} = 1/2$ pseudospins along the corner- and edge-sharing bonds in CaIrO$_3$.


title: Modulating Scalable Gaussian Processes for Expressive Statistical Learning

abstract: For a learning task, Gaussian process (GP) is interested in learning the statistical relationship between inputs and outputs, since it offers not only the prediction mean but also the associated variability. The vanilla GP however struggles to learn complicated distribution with the property of, e.g., heteroscedastic noise, multi-modality and non-stationarity, from massive data due to the Gaussian marginal and the cubic complexity. To this end, this article studies new scalable GP paradigms including the non-stationary heteroscedastic GP, the mixture of GPs and the latent GP, which introduce additional latent variables to modulate the outputs or inputs in order to learn richer, non-Gaussian statistical representation. We further resort to different variational inference strategies to arrive at analytical or tighter evidence lower bounds (ELBOs) of the marginal likelihood for efficient and effective model training. Extensive numerical experiments against state-of-the-art GP and neural network (NN) counterparts on various tasks verify the superiority of these scalable modulated GPs, especially the scalable latent GP, for learning diverse data distributions.


title: Bending of light in axion backgrounds

abstract: In this work we examine refraction of light by computing full solutions to axion electrodynamics. We also allow for the possibility of an additional plasma component. We then specialise to wavelengths which are small compared to background scales to determine if refraction can be described by geometric optics. We also allow for the possibility of an additional plasma component. In the absence of plasma, for small incidence angles relative to the optical axis, axion electrodynamics and geometric optics are in good agreement, with refraction occurring at $\mathcal{O}(g_{a \gamma \gamma}^2)$. However, for rays which lie far from the optical axis, the agreement with geometric optics breaks down and the dominant refraction requires a full wave-optical treatment, occurring at $\mathcal{O}(g_{a \gamma \gamma})$. In the presence of sufficiently large plasma masses, the wave-like nature of light becomes suppressed and geometric optics is in good agreement with the full theory for all rays. Our results therefore suggest the necessity of a more comprehensive study of lensing and ray-tracing in axion backgrounds, including a full account of the novel $\mathcal{O}(g_{a \gamma \gamma})$ wave-optical contribution to refraction.