title: Tensor Sparse PCA and Face Recognition: A Novel Approach

abstract: Face recognition is the important field in machine learning and pattern recognition research area. It has a lot of applications in military, finance, public security, to name a few. In this paper, the combination of the tensor sparse PCA with the nearest-neighbor method (and with the kernel ridge regression method) will be proposed and applied to the face dataset. Experimental results show that the combination of the tensor sparse PCA with any classification system does not always reach the best accuracy performance measures. However, the accuracy of the combination of the sparse PCA method and one specific classification system is always better than the accuracy of the combination of the PCA method and one specific classification system and is always better than the accuracy of the classification system itself.


title: An In-Depth Study on Open-Set Camera Model Identification

abstract: Camera model identification refers to the problem of linking a picture to the camera model used to shoot it. As this might be an enabling factor in different forensic applications to single out possible suspects (e.g., detecting the author of child abuse or terrorist propaganda material), many accurate camera model attribution methods have been developed in the literature. One of their main drawbacks, however, is the typical closed-set assumption of the problem. This means that an investigated photograph is always assigned to one camera model within a set of known ones present during investigation, i.e., training time, and the fact that the picture can come from a completely unrelated camera model during actual testing is usually ignored. Under realistic conditions, it is not possible to assume that every picture under analysis belongs to one of the available camera models. To deal with this issue, in this paper, we present the first in-depth study on the possibility of solving the camera model identification problem in open-set scenarios. Given a photograph, we aim at detecting whether it comes from one of the known camera models of interest or from an unknown one. We compare different feature extraction algorithms and classifiers specially targeting open-set recognition. We also evaluate possible open-set training protocols that can be applied along with any open-set classifier, observing that a simple of those alternatives obtains best results. Thorough testing on independent datasets shows that it is possible to leverage a recently proposed convolutional neural network as feature extractor paired with a properly trained open-set classifier aiming at solving the open-set camera model attribution problem even to small-scale image patches, improving over state-of-the-art available solutions.


title: Controller Design and Implementation of a New Quadrotor Manipulation System

abstract: The previously introduced aerial manipulation systems suffer from either limited end-effector DOF or small payload capacity. In this dissertation, a quadrotor with a 2-DOF manipulator is investigated that has a unique topology to enable the end-effector to track 6-DOF trajectory with the minimum possible number of actuators/links and hence, maximize the payload and/or mission time. The proposed system is designed, modeled, and constructed. An identification process is carried out to find the system parameters. An experimental setup is proposed with a 6-DOF state measurement and estimation scheme. The system feasibility is validated via numerical and experimental results. The inverse kinematics require a solution of complicated algebraic-differential equations. Therefore, an algorithm is developed to get an approximate solution of these equations. Furthermore, the motion control of this quadrotor manipulation system is quite challenging. The system has strong nonlinearities, fast dynamics and unstable dynamics that are very susceptible to parameters variations and external disturbances. Thus, a linear Disturbance Observer (DOb)-based robust controller is utilized to address these issues. A modified DOb loop is proposed and designed to use the direct measurements. A Model Predictive Control (MPC) is used in the external loop of the DOb to save power consumption that increases the mission time and to consider of the actuators constraints. The manipulation tasks require estimating (applying) certain force at the end-effector. However, the current developed techniques have limitations because they are model-based methods, based on ignoring some dynamics, or requiring an indicator of the environment contact. Hence, a robust sensorless force estimation and impedance control scheme is proposed to overcome these limitations.


title: Co-regularized Multi-view Sparse Reconstruction Embedding for Dimension Reduction

abstract: With the development of information technology, we have witnessed an age of data explosion which produces a large variety of data filled with redundant information. Because dimension reduction is an essential tool which embeds high-dimensional data into a lower-dimensional subspace to avoid redundant information, it has attracted interests from researchers all over the world. However, facing with features from multiple views, it's difficult for most dimension reduction methods to fully comprehended multi-view features and integrate compatible and complementary information from these features to construct low-dimensional subspace directly. Furthermore, most multi-view dimension reduction methods cannot handle features from nonlinear spaces with high dimensions. Therefore, how to construct a multi-view dimension reduction methods which can deal with multi-view features from high-dimensional nonlinear space is of vital importance but challenging. In order to address this problem, we proposed a novel method named Co-regularized Multi-view Sparse Reconstruction Embedding (CMSRE) in this paper. By exploiting correlations of sparse reconstruction from multiple views, CMSRE is able to learn local sparse structures of nonlinear manifolds from multiple views and constructs significative low-dimensional representations for them. Due to the proposed co-regularized scheme, correlations of sparse reconstructions from multiple views are preserved by CMSRE as much as possible. Furthermore, sparse representation produces more meaningful correlations between features from each single view, which helps CMSRE to gain better performances. Various evaluations based on the applications of document classification, face recognition and image retrieval can demonstrate the effectiveness of the proposed approach on multi-view dimension reduction.


title: Machine Vision for Natural Gas Methane Emissions Detection Using an Infrared Camera

abstract: It is crucial to reduce natural gas methane emissions, which can potentially offset the climate benefits of replacing coal with gas. Optical gas imaging (OGI) is a widely-used method to detect methane leaks, but is labor-intensive and cannot provide leak detection results without operators' judgment. In this paper, we develop a computer vision approach to OGI-based leak detection using convolutional neural networks (CNN) trained on methane leak images to enable automatic detection. First, we collect ~1 M frames of labeled video of methane leaks from different leaking equipment for building CNN model, covering a wide range of leak sizes (5.3-2051.6 gCH4/h) and imaging distances (4.6-15.6 m). Second, we examine different background subtraction methods to extract the methane plume in the foreground. Third, we then test three CNN model variants, collectively called GasNet, to detect plumes in videos taken at other pieces of leaking equipment. We assess the ability of GasNet to perform leak detection by comparing it to a baseline method that uses optical-flow based change detection algorithm. We explore the sensitivity of results to the CNN structure, with a moderate-complexity variant performing best across distances. We find that the detection accuracy can reach as high as 99%, the overall detection accuracy can exceed 95% for a case across all leak sizes and imaging distances. Binary detection accuracy exceeds 97% for large leaks (~710 gCH4/h) imaged closely (~5-7 m). At closer imaging distances (~5-10 m), CNN-based models have greater than 94% accuracy across all leak sizes. At farthest distances (~13-16 m), performance degrades rapidly, but it can achieve above 95% accuracy to detect large leaks (>950 gCH4/h). The GasNet-based computer vision approach could be deployed in OGI surveys to allow automatic vigilance of methane leak detection with high detection accuracy in the real world.


title: A new approach for measuring semantic similarity of ontology concepts using dynamic programming

abstract: Today, with the emergence of semantic web technologies and increasing of information quantity, searching for information based on the semantic web has become a fertile area of research. For this reason, a large number of studies are performed based on the measure of semantic similarity. Therefore, in this paper, we propose a new method of semantic similarity measuring which uses the dynamic programming to compute the semantic distance between any two concepts defined in the same hierarchy of ontology. Then, we base on this result to compute the semantic similarity. Finally, we present an experimental comparison between our method and other methods of similarity measuring. Where we will show the limits of these methods and how we avoid them with our method. This one bases on a function of weight allocation, which allows finding different rate of semantic similarity between a given concept and two other sibling concepts which is impossible using the other methods.


title: Few-Shot Learning with Localization in Realistic Settings

abstract: Traditional recognition methods typically require large, artificially-balanced training classes, while few-shot learning methods are tested on artificially small ones. In contrast to both extremes, real world recognition problems exhibit heavy-tailed class distributions, with cluttered scenes and a mix of coarse and fine-grained class distinctions. We show that prior methods designed for few-shot learning do not work out of the box in these challenging conditions, based on a new "meta-iNat" benchmark. We introduce three parameter-free improvements: (a) better training procedures based on adapting cross-validation to meta-learning, (b) novel architectures that localize objects using limited bounding box annotations before classification, and (c) simple parameter-free expansions of the feature space based on bilinear pooling. Together, these improvements double the accuracy of state-of-the-art models on meta-iNat while generalizing to prior benchmarks, complex neural architectures, and settings with substantial domain shift.


title: QANet -- Quality Assurance Network for Image Segmentation

abstract: We introduce a novel Deep Learning framework, which quantitatively estimates image segmentation quality without the need for human inspection or labeling. We refer to this method as a Quality Assurance Network -- QANet. Specifically, given an image and a `proposed' corresponding segmentation, obtained by any method including manual annotation, the QANet solves a regression problem in order to estimate a predefined quality measure with respect to the unknown ground truth. The QANet is by no means yet another segmentation method. Instead, it performs a multi-level, multi-feature comparison of an image-segmentation pair based on a unique network architecture, called the RibCage. To demonstrate the strength of the QANet, we addressed the evaluation of instance segmentation using two different datasets from different domains, namely, high throughput live cell microscopy images from the Cell Segmentation Benchmark and natural images of plants from the Leaf Segmentation Challenge. While synthesized segmentations were used to train the QANet, it was tested on segmentations obtained by publicly available methods that participated in the different challenges. We show that the QANet accurately estimates the scores of the evaluated segmentations with respect to the hidden ground truth, as published by the challenges' organizers. The code is available at: TBD.


title: Exploring Uncertainty Measures for Image-Caption Embedding-and-Retrieval Task

abstract: With the wide development of black-box machine learning algorithms, particularly deep neural network (DNN), the practical demand for the reliability assessment is rapidly rising. On the basis of the concept that `Bayesian deep learning knows what it does not know,' the uncertainty of DNN outputs has been investigated as a reliability measure for the classification and regression tasks. However, in the image-caption retrieval task, well-known samples are not always easy-to-retrieve samples. This study investigates two aspects of image-caption embedding-and-retrieval systems. On one hand, we quantify feature uncertainty by considering image-caption embedding as a regression task, and use it for model averaging, which can improve the retrieval performance. On the other hand, we further quantify posterior uncertainty by considering the retrieval as a classification task, and use it as a reliability measure, which can greatly improve the retrieval performance by rejecting uncertain queries. The consistent performance of two uncertainty measures is observed with different datasets (MS COCO and Flickr30k), different deep learning architectures (dropout and batch normalization), and different similarity functions.


title: Dynamic Gesture Recognition by Using CNNs and Star RGB: a Temporal Information Condensation

abstract: Due to the advance of technologies, machines are increasingly present in people's daily lives. Thus, there has been more and more effort to develop interfaces, such as dynamic gestures, that provide an intuitive way of interaction. Currently, the most common trend is to use multimodal data, as depth and skeleton information, to enable dynamic gesture recognition. However, using only color information would be more interesting, since RGB cameras are usually available in almost every public place, and could be used for gesture recognition without the need of installing other equipment. The main problem with such approach is the difficulty of representing spatio-temporal information using just color. With this in mind, we propose a technique capable of condensing a dynamic gesture, shown in a video, in just one RGB image. We call this technique star RGB. This image is then passed to a classifier formed by two Resnet CNNs, a soft-attention ensemble, and a fully connected layer, which indicates the class of the gesture present in the input video. Experiments were carried out using both Montalbano and GRIT datasets. For Montalbano dataset, the proposed approach achieved an accuracy of 94.58%. Such result reaches the state-of-the-art when considering this dataset and only color information. Regarding the GRIT dataset, our proposal achieves more than 98% of accuracy, recall, precision, and F1-score, outperforming the reference approach by more than 6%.


title: Adaptive Hierarchical Down-Sampling for Point Cloud Classification

abstract: While several convolution-like operators have recently been proposed for extracting features out of point clouds, down-sampling an unordered point cloud in a deep neural network has not been rigorously studied. Existing methods down-sample the points regardless of their importance for the output. As a result, some important points in the point cloud may be removed, while less valuable points may be passed to the next layers. In contrast, adaptive down-sampling methods sample the points by taking into account the importance of each point, which varies based on the application, task and training data. In this paper, we propose a permutation-invariant learning-based adaptive down-sampling layer, called Critical Points Layer (CPL), which reduces the number of points in an unordered point cloud while retaining the important points. Unlike most graph-based point cloud down-sampling methods that use $k$-NN search algorithm to find the neighbouring points, CPL is a global down-sampling method, rendering it computationally very efficient. The proposed layer can be used along with any graph-based point cloud convolution layer to form a convolutional neural network, dubbed CP-Net in this paper. We introduce a CP-Net for $3$D object classification that achieves the best accuracy for the ModelNet$40$ dataset among point cloud-based methods, which validates the effectiveness of the CPL.


title: Variable Selection in Functional Linear Concurrent Regression

abstract: We propose a novel method for variable selection in functional linear concurrent regression. Our research is motivated by a fisheries footprint study where the goal is to identify important time-varying socio-structural drivers influencing patterns of seafood consumption, and hence fisheries footprint, over time, as well as estimating their dynamic effects. We develop a variable selection method in functional linear concurrent regression extending the classically used scalar on scalar variable selection methods like LASSO, SCAD, and MCP. We show in functional linear concurrent regression the variable selection problem can be addressed as a group LASSO, and their natural extension; group SCAD or a group MCP problem. Through simulations, we illustrate our method, particularly with group SCAD or group MCP penalty, can pick out the relevant variables with high accuracy and has minuscule false positive and false negative rate even when data is observed sparsely, is contaminated with noise and the error process is highly non-stationary. We also demonstrate two real data applications of our method in studies of dietary calcium absorption and fisheries footprint in the selection of influential time-varying covariates.


title: Revisiting the fragile-to-strong crossover in metallic glass-forming liquids: application to Cu$_x$Zr$_x$Al$_{100-2x}$

abstract: The fragile-to-strong crossover seems to be a general feature of metallic glass-forming liquids. Here, we study the behavior of shear viscosity, diffusion coefficient and vibrational density of states for Cu$_\text{x}$Zr$_\text{x}$Al$_{\text{100-2x}}$ alloy through molecular dynamics simulations. The results reveal that the fragile-to-strong temperature (T$_\text{fs}$) and the glass transition temperature (T$_\text{g}$) increase as the aluminum content becomes larger. The inverse of the diffusion coefficient as a function of temperature exhibits a dynamical crossover in the vicinity of T$_\text{g}$, at a much lower temperature than that predicted by nearly all previous studies. At the temperature in which the dynamical crossover occurs determined by the inverse of the diffusion coefficient, we found an excess of vibrational states at low frequencies, resembling a pronounced peak in the reduced vibrational density of states characteristic of a strong liquid. Finally, the behavior of the shear viscosity as a function of reduced temperature (T$_\text{g}$/T) also shows that, besides the fragile-to-strong crossover nearby T$_\text{g}$, another dynamical crossover is present near the onset of the supercooled regime.


title: Interface in Kerr-AdS black hole spacetime

abstract: A defect solution in the AdS5 x S5 black hole spacetime is given. This is a generalization of the previous work to another spacetime. The equation of motion for a sort of non-local operator, "an interface," is given and its numerical solution is shown. This result gives a new example of holographic relation of complexity and will be a clue for solving problems about black hole complexity.


title: A spectral deferred correction strategy for low Mach number reacting flows subject to electric fields

abstract: We propose an algorithm for low Mach number reacting flows subjected to electric field that includes the chemical production and transport of charged species. This work is an extension of a multi-implicit spectral deferred correction (MISDC) algorithm designed to advance the conservation equations in time at scales associated with advective transport. The fast and nontrivial interactions of electrons with the electric field are treated implicitly using a Jacobian-Free Newton Krylov approach for which a preconditioning strategy is developed. Within the MISDC framework, this enables a close and stable coupling of diffusion, reactions and dielectric relaxation terms with advective transport and is shown to exhibit second-order convergence in space and time. The algorithm is then applied to a series of steady and unsteady problems to demonstrate its capability and stability. Although developed in a one-dimensional case, the algorithmic ingredients are carefully designed to be amenable to multidimensional applications.


title: All-optical frequency processor for networking applications

abstract: We propose an electro-optic approach for transparent optical networking, in which frequency channels are actively transformed into any desired mapping in a wavelength-multiplexed environment. Based on electro-optic phase modulators and Fourier-transform pulse shapers, our all-optical frequency processor (AFP) is examined numerically for the specific operations of frequency channel hopping and broadcasting, and found capable of implementing these transformations with favorable component requirements. Extending our analysis via a mutual-information--based metric for system optimization, we show how to optimize transformation performance under limited resources in a classical context, contrasting the results with those found using metrics motivated by quantum information, such as fidelity and success probability. Given its compatibility with on-chip implementation, as well as elimination of optical-to-electrical conversion in frequency channel switching, the AFP looks to offer valuable potential in silicon photonic network design.


title: Increasing charge lifetime in DC polarized electron guns by offsetting the anode

abstract: Charge lifetime of strained superlattice GaAs photocathodes in DC guns is limited by ion back bombardment. It needs to be improved at least an order of magnitude to meet the requirements for future colliders such as Electron-Ion Collider (EIC). In this work, we propose and present simulation results for an offset anode scheme to increase charge lifetime in DC guns. This scheme eliminates the bombardment of high energy ions on the cathode and enables maximum usage of the available cathode area. Depending on the size of the available cathode area, this method can increase the charge lifetime by an order of magnitude compared to the current best alternative method. An anode assembly capable of in-vacuum movement is required for this method, which has been designed and fabricated at Brookhaven National Laboratory.


title: MorphIC: A 65-nm 738k-Synapse/mm$^2$ Quad-Core Binary-Weight Digital Neuromorphic Processor with Stochastic Spike-Driven Online Learning

abstract: Recent trends in the field of neural network accelerators investigate weight quantization as a means to increase the resource- and power-efficiency of hardware devices. As full on-chip weight storage is necessary to avoid the high energy cost of off-chip memory accesses, memory reduction requirements for weight storage pushed toward the use of binary weights, which were demonstrated to have a limited accuracy reduction on many applications when quantization-aware training techniques are used. In parallel, spiking neural network (SNN) architectures are explored to further reduce power when processing sparse event-based data streams, while on-chip spike-based online learning appears as a key feature for applications constrained in power and resources during the training phase. However, designing power- and area-efficient spiking neural networks still requires the development of specific techniques in order to leverage on-chip online learning on binary weights without compromising the synapse density. In this work, we demonstrate MorphIC, a quad-core binary-weight digital neuromorphic processor embedding a stochastic version of the spike-driven synaptic plasticity (S-SDSP) learning rule and a hierarchical routing fabric for large-scale chip interconnection. The MorphIC SNN processor embeds a total of 2k leaky integrate-and-fire (LIF) neurons and more than two million plastic synapses for an active silicon area of 2.86mm$^2$ in 65nm CMOS, achieving a high density of 738k synapses/mm$^2$. MorphIC demonstrates an order-of-magnitude improvement in the area-accuracy tradeoff on the MNIST classification task compared to previously-proposed SNNs, while having no penalty in the energy-accuracy tradeoff.


title: DeepNovoV2: Better de novo peptide sequencing with deep learning

abstract: Personalized cancer vaccines are envisioned as the next generation rational cancer immunotherapy. The key step in developing personalized therapeutic cancer vaccines is to identify tumor-specific neoantigens that are on the surface of tumor cells. A promising method for this is through de novo peptide sequencing from mass spectrometry data. In this paper we introduce DeepNovoV2, the state-of-the-art model for peptide sequencing. In DeepNovoV2, a spectrum is directly represented as a set of (m/z, intensity) pairs, therefore it does not suffer from the accuracy-speed/memory trade-off problem. The model combines an order invariant network structure (T-Net) and recurrent neural networks and provides a complete end-to-end training and prediction framework to sequence patterns of peptides. Our experiments on a wide variety of data from different species show that DeepNovoV2 outperforms previous state-of-the-art methods, achieving 13.01-23.95\% higher accuracy at the peptide level.


title: Clarifying causal mediation analysis for the applied researcher: Defining effects based on what we want to learn

abstract: The incorporation of causal inference in mediation analysis has led to theoretical and methodological advancements -- effect definitions with causal interpretation, clarification of assumptions required for effect identification, and an expanding array of options for effect estimation. However, the literature on these results is fast-growing and complex, which may be confusing to researchers unfamiliar with causal inference or unfamiliar with mediation. The goal of this paper is to help ease the understanding and adoption of causal mediation analysis. It starts by highlighting a key difference between the causal inference and traditional approaches to mediation analysis and making a case for the need for explicit causal thinking and the causal inference approach in mediation analysis. It then explains in as-plain-as-possible language existing effect types, paying special attention to motivating these effects with different types of research questions, and using concrete examples for illustration. This presentation differentiates two perspectives (or purposes of analysis): the explanatory perspective (aiming to explain the total effect) and the interventional perspective (asking questions about hypothetical interventions on the exposure and mediator, or hypothetically modified exposures). For the latter perspective, the paper proposes tapping into a general class of interventional effects that contains as special cases most of the usual effect types -- interventional direct and indirect effects, controlled direct effects and also a generalized interventional direct effect type, as well as the total effect and overall effect. This general class allows flexible effect definitions which better match many research questions than the standard interventional direct and indirect effects.


title: ZK-GanDef: A GAN based Zero Knowledge Adversarial Training Defense for Neural Networks

abstract: Neural Network classifiers have been used successfully in a wide range of applications. However, their underlying assumption of attack free environment has been defied by adversarial examples. Researchers tried to develop defenses; however, existing approaches are still far from providing effective solutions to this evolving problem. In this paper, we design a generative adversarial net (GAN) based zero knowledge adversarial training defense, dubbed ZK-GanDef, which does not consume adversarial examples during training. Therefore, ZK-GanDef is not only efficient in training but also adaptive to new adversarial examples. This advantage comes at the cost of small degradation in test accuracy compared to full knowledge approaches. Our experiments show that ZK-GanDef enhances test accuracy on adversarial examples by up-to 49.17% compared to zero knowledge approaches. More importantly, its test accuracy is close to that of the state-of-the-art full knowledge approaches (maximum degradation of 8.46%), while taking much less training time.


title: Low temperature saturation of phase coherence length in topological insulators

abstract: Implementing topological insulators as elementary units in quantum technologies requires a comprehensive understanding of the dephasing mechanisms governing the surface carriers in these materials, which impose a practical limit to the applicability of these materials in such technologies requiring phase coherent transport. To investigate this, we have performed magneto-resistance (MR) and conductance fluctuations\ (CF) measurements in both exfoliated and molecular beam epitaxy grown samples. The phase breaking length ($l_{\phi}$) obtained from MR shows a saturation below sample dependent characteristic temperatures, consistent with that obtained from CF measurements. We have systematically eliminated several factors that may lead to such behavior of $l_{\phi}$ in the context of TIs, such as finite size effect, thermalization, spin-orbit coupling length, spin-flip scattering, and surface-bulk coupling. Our work indicates the need to identify an alternative source of dephasing that dominates at low $T$ in topological insulators, causing saturation in the phase breaking length and time.


title: Graph based Dynamic Segmentation of Generic Objects in 3D

abstract: We propose a novel 3D segmentation method for RBGD stream data to deal with 3D object segmentation task in a generic scenario with frequent object interactions. It mainly contributes in two aspects, while being generic and not requiring initialization: firstly, a novel tree structure representation for the point cloud of the scene is proposed. Then, a dynamic manangement mechanism for connected component splits and merges exploits the tree structure representation.


title: New equivalent model of quantizer with noisy input and its application for ADC resolution determination in an uplink MIMO receiver

abstract: When a quantizer input signal is the sum of the desired signal and input white noise, the quantization error is a function of total input signal. Our new equivalent model splits the quantization error into two components: a non-linear distortion (NLD) that is a function of only the desired part of input signal (without noise), and an equivalent out-put white noise. This separation is important because these two terms affect MIMO system performance differently. This paper introduces our model, and applies it to determine the minimal Analog-to-Digital Converter (ADC) resolution necessary to operate a conventional MIMO receiver with negligible performance degradation. We also provide numerical simulations to confirm the theory. Broad ramifications of our model are further demonstrated in two companion papers presenting low-complexity suppression of the NLD arising from insufficient ADC resolution, and a digital dithering that significantly reduces the MIMO transmitter Digital-to-Analog Converters (DAC) resolution requirement.


title: Theoretical Plasma Physics

abstract: These lecture notes were presented by Allan N. Kaufman in his graduate plasma theory course and a follow-on special topics course (Physics 242A, B, C and Physics 250 at the University of California Berkeley). The notes follow the order of the lectures. The equations and derivations are as Kaufman presented, but the text is a reconstruction of Kaufman's discussion and commentary. The notes were transcribed by Bruce I. Cohen in 1971 and 1972, and word-processed, edited, and illustrations added by Cohen in 2017 and 2018. The series of lectures are divided into four major parts: (1) collisionless Vlasov plasmas (linear theory of waves and instabilities with and without an applied magnetic field, Vlasov-Poisson and Vlasov-Maxwell systems, WKBJ eikonal theory of wave propagation); (2) nonlinear Vlasov plasmas and miscellaneous topics (the plasma dispersion function, singular solutions of the Vlasov-Poisson system, pulse-response solutions for initial-value problems, Gardiner's stability theorem, gyroresonant effects, nonlinear waves, particle trapping in waves, quasi-linear theory, nonlinear three-wave interactions); (3) plasma collisional and discreteness phenomena (test-particle theory of dynamic friction and wave emission, classical resistivity, extension of test-particle theory to many-particle phenomena and the derivation of the Boltzmann and Lenard-Balescu equations, the Fokker-Planck collision operator, a general scattering theory, nonlinear Landau damping, radiation transport, and Dupree's theory of clumps); (4) nonuniform plasmas (adiabatic invariance, guiding center drifts, hydromagnetic theory, introduction to drift-wave stability theory).


title: Redshift in Finsler spacetimes

abstract: We derive and discuss a general redshift formula in Finsler spacetimes. The condition for the existence of a redshift potential is worked out. The results are illustrated with two examples, one refering to a spherically symmetric and static Finsler spacetime and the other to a cosmological Finsler spacetime.


title: Sharp Bounds for the Marginal Treatment Effect with Sample Selection

abstract: I analyze treatment effects in situations when agents endogenously select into the treatment group and into the observed sample. As a theoretical contribution, I propose pointwise sharp bounds for the marginal treatment effect (MTE) of interest within the always-observed subpopulation under monotonicity assumptions. Moreover, I impose an extra mean dominance assumption to tighten the previous bounds. I further discuss how to identify those bounds when the support of the propensity score is either continuous or discrete. Using these results, I estimate bounds for the MTE of the Job Corps Training Program on hourly wages for the always-employed subpopulation and find that it is decreasing in the likelihood of attending the program within the Non-Hispanic group. For example, the Average Treatment Effect on the Treated is between \$.33 and \$.99 while the Average Treatment Effect on the Untreated is between \$.71 and \$3.00.


title: Per-link Reliability and Rate Control: Two Facets of the SIR Meta Distribution

abstract: The meta distribution (MD) of the signal-to-interference ratio (SIR) provides fine-grained reliability performance in wireless networks modeled by point processes. In particular, for an ergodic point process, the SIR MD yields the distribution of the per-link reliability for a target SIR. Here we reveal that the SIR MD has a second important application, which is rate control. Specifically, we calculate the distribution of the SIR threshold (equivalently, the distribution of the transmission rate) that guarantees each link a target reliability and show its connection to the distribution of the per-link reliability. This connection also permits an approximate calculation of the SIR MD when only partial (local) information about the underlying point process is available.


title: Towards Open Intent Discovery for Conversational Text

abstract: Detecting and identifying user intent from text, both written and spoken, plays an important role in modelling and understand dialogs. Existing research for intent discovery model it as a classification task with a predefined set of known categories. To generailze beyond these preexisting classes, we define a new task of \textit{open intent discovery}. We investigate how intent can be generalized to those not seen during training. To this end, we propose a two-stage approach to this task - predicting whether an utterance contains an intent, and then tagging the intent in the input utterance. Our model consists of a bidirectional LSTM with a CRF on top to capture contextual semantics, subject to some constraints. Self-attention is used to learn long distance dependencies. Further, we adapt an adversarial training approach to improve robustness and perforamce across domains. We also present a dataset of 25k real-life utterances that have been labelled via crowd sourcing. Our experiments across different domains and real-world datasets show the effectiveness of our approach, with less than 100 annotated examples needed per unique domain to recognize diverse intents. The approach outperforms state-of-the-art baselines by 5-15% F1 score points.


title: Mobility profiles and calendars for food security and livelihoods analysis

abstract: Social vulnerability is defined as the capacity of individuals and social groups to respond to any external stress placed on their livelihoods and wellbeing. Mobility and migrations are relevant when assessing vulnerability since the movements of a population reflect on their livelihoods, coping strategies and social safety nets. Although in general migration characterization is complex and open to controversy, changes in mobility patterns for vulnerable population groups are likely to indicate a change in livelihoods or coping strategies. These changes can also indicate that the population groups may be exposed to new shocks; hence, monitoring of changes in mobility patterns can be a powerful early warning mechanism.


title: The time-resolved spectra of photospheric emission from a structured jet for gamma-ray bursts

abstract: The quasi-thermal components found in many Fermi gamma-ray bursts (GRBs) imply that the photosphere emission indeed contributes to the prompt emission of many GRBs. But whether the observed spectra empirically fitted by the Band function or cutoff power law, especially the spectral and peak energy ($E_{p}$) evolutions can be explained by the photosphere emission model alone needs further discussion. In this work, we investigate in detail the time-resolved spectra and $E_{p}$ evolutions of photospheric emission from a structured jet, with an inner-constant and outer-decreasing angular Lorentz factor profile. Also, a continuous wind with a time-dependent wind luminosity has been considered. We show that the photosphere spectrum near the peak luminosity is similar to the cutoff power-law spectrum. The spectrum can have the observed average low-energy spectral index $\alpha $ $ \sim -1$, and the distribution of the low-energy spectral index in our photosphere model is similar to that observed ($-2\lesssim $ $\alpha \lesssim 0$). Furthermore, the two kinds of spectral evolutions during the decay phase, separated by the width of the core ($\theta _{c}$), are consistent with the time-resolved spectral analysis results of several Fermi multi-pulse GRBs and single-pulse GRBs, respectively. Also, for this photosphere model we can reproduce the two kinds of observed $E_{p}$ evolution patterns rather well. Thus, by considering the photospheric emission from a structured jet, we reproduce the observations well for the GRBs best fitted by the cutoff power-law model for the peak-flux spectrum or the time-integrated spectrum.


title: Generalized square knots and homotopy 4-spheres

abstract: The purpose of this paper is to study geometrically simply-connected homotopy 4-spheres by analyzing $n$-component links with a Dehn surgery realizing $\#^n(S^1\times S^2)$. We call such links $n$R-links. Our main result is that a homotopy 4-sphere that can be built without 1-handles and with only two 2-handles is diffeomorphic to the standard 4-sphere in the special case that one of the 2-handles is attached along a knot of the form $Q_{p,q} = T_{p,q}\#T_{-p,q}$, which we call a generalized square knot. This theorem subsumes prior results of Akbulut and Gompf. Along the way, we use thin position techniques from Heegaard theory to give a characterization of 2R-links in which one component is a fibered knot, showing that the second component can be converted via trivial handle additions and handleslides to a derivative link contained in the fiber surface. We invoke a theorem of Casson and Gordon and the Equivariant Loop Theorem to classify handlebody-extensions for the closed monodromy of a generalized square knot $Q_{p,q}$. As a consequence, we produce large families, for all even $n$, of $n$R-links that are potential counterexamples to the Generalized Property R Conjecture. We also obtain related classification statements for fibered, homotopy-ribbon disks bounded by generalized square knots.


title: Robust Exploration with Tight Bayesian Plausibility Sets

abstract: Optimism about the poorly understood states and actions is the main driving force of exploration for many provably-efficient reinforcement learning algorithms. We propose optimism in the face of sensible value functions (OFVF)- a novel data-driven Bayesian algorithm to constructing Plausibility sets for MDPs to explore robustly minimizing the worst case exploration cost. The method computes policies with tighter optimistic estimates for exploration by introducing two new ideas. First, it is based on Bayesian posterior distributions rather than distribution-free bounds. Second, OFVF does not construct plausibility sets as simple confidence intervals. Confidence intervals as plausibility sets are a sufficient but not a necessary condition. OFVF uses the structure of the value function to optimize the location and shape of the plausibility set to guarantee upper bounds directly without necessarily enforcing the requirement for the set to be a confidence interval. OFVF proceeds in an episodic manner, where the duration of the episode is fixed and known. Our algorithm is inherently Bayesian and can leverage prior information. Our theoretical analysis shows the robustness of OFVF, and the empirical results demonstrate its practical promise.


title: Power narrowing: Counteracting Doppler broadening in two-color transitions

abstract: Doppler broadening in thermal ensembles degrades the absorption cross-section and the coherence time of collective excitations. In two photon transitions, it is common to assume that this problem becomes worse with larger wavelength mismatch. Here we identify an opposite mechanism, where such wavelength mismatch leads to cancellation of Doppler broadening via the counteracting effects of velocity-dependent light-shifts and Doppler shifts. We show that this effect is general, common to both absorption and transparency resonances, and favorably scales with wavelength mismatch. We experimentally confirm the enhancement of transitions for different low-lying orbitals in rubidium atoms and use calculations to extrapolate to high-lying Rydberg orbitals. These calculations predict a dramatic enhancement of up to 20-fold increase in absorption, even in the presence of large homogeneous broadening. More general configurations, where an auxiliary dressing field is used to counteract Doppler broadening, are also discussed and experimentally demonstrated. The mechanism we study can be applied as well for rephasing of spin waves and increasing the coherence time of quantum memories.


title: Distinguishing Elliptic Fibrations with AI

abstract: We use the latest techniques in machine-learning to study whether from the landscape of Calabi-Yau manifolds one can distinguish elliptically fibred ones. Using the dataset of complete intersections in products of projective spaces (CICY3 and CICY4, totalling about a million manifolds) as a concrete playground, we find that a relatively simple neural network with forward-feeding multi-layers can very efficiently distinguish the elliptic fibrations, much more so than using the traditional methods of manipulating the defining equations. We cross-check with control cases to ensure that the AI is not randomly guessing and is indeed identifying an inherent structure. Our result should prove useful in F-theory and string model building as well as in pure algebraic geometry.


title: Direct Measurement of Quantum Efficiency of Single Photon Emitters in Hexagonal Boron Nitride

abstract: Single photon emitters in two-dimensional materials are promising candidates for future generation of quantum photonic technologies. In this work, we experimentally determine the quantum efficiency (QE) of single photon emitters (SPE) in few-layer hexagonal boron nitride (hBN). We employ a metal hemisphere that is attached to the tip of an atomic force microscope to directly measure the lifetime variation of the SPEs as the tip approaches the hBN. This technique enables non-destructive, yet direct and absolute measurement of the QE of SPEs. We find that the emitters exhibit very high QEs approaching $(87 \pm 7)\,\%$ at wavelengths of $\approx\,580\,\mathrm{nm}$, which is amongst the highest QEs recorded for a solid state single photon emitter.


title: Stable recovery and the coordinate small-ball behaviour of random vectors

abstract: Recovery procedures in various application in Data Science are based on \emph{stable point separation}. In its simplest form, stable point separation implies that if $f$ is "far away" from $0$, and one is given a random sample $(f(Z_i))_{i=1}^m$ where a proportional number of the sample points may be corrupted by noise, that information is still enough to exhibit that $f$ is far from $0$. Stable point separation is well understood in the context of iid sampling, and to explore it for general sampling methods we introduce a new notion---the \emph{coordinate small-ball} of a random vector $X$. Roughly put, this feature captures the number of "relatively large coordinates" of $(|<TX,u_i>|)_{i=1}^m$, where $T:\mathbb{R}^n \to \mathbb{R}^m$ is an arbitrary linear operator and $(u_i)_{i=1}^m$ is any fixed orthonormal basis of $\mathbb{R}^m$. We show that under the bare-minimum assumptions on $X$, and with high probability, many of the values $|<TX,u_i>|$ are at least of the order $\|T\|_{S_2}/\sqrt{m}$. As a result, the "coordinate structure" of $TX$ exhibits the typical Euclidean norm of $TX$ and does so in a stable way. One outcome of our analysis is that random sub-sampled convolutions satisfy stable point separation under minimal assumptions on the generating random vector---a fact that was known previously only in a highly restrictive setup, namely, for random vectors with iid subgaussian coordinates.


title: One Homonym per Translation

abstract: The study of homonymy is vital to resolving fundamental problems in lexical semantics. In this paper, we propose four hypotheses that characterize the unique behavior of homonyms in the context of translations, discourses, collocations, and sense clusters. We present a new annotated homonym resource that allows us to test our hypotheses on existing WSD resources. The results of the experiments provide strong empirical evidence for the hypotheses. This study represents a step towards a computational method for distinguishing between homonymy and polysemy, and constructing a definitive inventory of coarse-grained senses.


title: Do Lateral Views Help Automated Chest X-ray Predictions?

abstract: Most convolutional neural networks in chest radiology use only the frontal posteroanterior (PA) view to make a prediction. However the lateral view is known to help the diagnosis of certain diseases and conditions. The recently released PadChest dataset contains paired PA and lateral views, allowing us to study for which diseases and conditions the performance of a neural network improves when provided a lateral x-ray view as opposed to a frontal posteroanterior (PA) view. Using a simple DenseNet model, we find that using the lateral view increases the AUC of 8 of the 56 labels in our data and achieves the same performance as the PA view for 21 of the labels. We find that using the PA and lateral views jointly doesn't trivially lead to an increase in performance but suggest further investigation.


title: Neural Constituency Parsing of Speech Transcripts

abstract: This paper studies the performance of a neural self-attentive parser on transcribed speech. Speech presents parsing challenges that do not appear in written text, such as the lack of punctuation and the presence of speech disfluencies (including filled pauses, repetitions, corrections, etc.). Disfluencies are especially problematic for conventional syntactic parsers, which typically fail to find any EDITED disfluency nodes at all. This motivated the development of special disfluency detection systems, and special mechanisms added to parsers specifically to handle disfluencies. However, we show here that neural parsers can find EDITED disfluency nodes, and the best neural parsers find them with an accuracy surpassing that of specialized disfluency detection systems, thus making these specialized mechanisms unnecessary. This paper also investigates a modified loss function that puts more weight on EDITED nodes. It also describes tree-transformations that simplify the disfluency detection task by providing alternative encodings of disfluencies and syntactic information.


title: A Scintillator Attenuation Spectrometer For Intense Gamma-Rays

abstract: A new type of compact high resolution high sensitivity gamma ray spectrometer for short pulse intense 250 keV to 50 MeV gamma rays has been developed by combining the principles of scintillators and attenuation spectrometers. The first prototype of this scintillator attenuation spectrometer or SAS was tested successfully in Trident laser experiments at LANL. Later versions have been used extensively in the Texas Petawatt laser experiments in Austin TX, and more recently in OMEGAEP laser experiments at LLE, Rochester, NY. The SAS is particularly useful for high repetition rate laser applications. Here we give a concise description of the design principles, capabilities and sample preliminary results of the SAS.


title: Material Segmentation of Multi-View Satellite Imagery

abstract: Material recognition methods use image context and local cues for pixel-wise classification. In many cases only a single image is available to make a material prediction. Image sequences, routinely acquired in applications such as mutliview stereo, can provide a sampling of the underlying reflectance functions that reveal pixel-level material attributes. We investigate multi-view material segmentation using two datasets generated for building material segmentation and scene material segmentation from the SpaceNet Challenge satellite image dataset. In this paper, we explore the impact of multi-angle reflectance information by introducing the \textit{reflectance residual encoding}, which captures both the multi-angle and multispectral information present in our datasets. The residuals are computed by differencing the sparse-sampled reflectance function with a dictionary of pre-defined dense-sampled reflectance functions. Our proposed reflectance residual features improves material segmentation performance when integrated into pixel-wise and semantic segmentation architectures. At test time, predictions from individual segmentations are combined through softmax fusion and refined by building segment voting. We demonstrate robust and accurate pixelwise segmentation results using the proposed material segmentation pipeline.


title: A Decomposition Analysis of Diffusion Over a Large Network

abstract: Diffusion over a network refers to the phenomenon of a change of state of a cross-sectional unit in one period leading to a change of state of its neighbors in the network in the next period. One may estimate or test for diffusion by estimating a cross-sectionally aggregated correlation between neighbors over time from data. However, the estimated diffusion can be misleading if the diffusion is confounded by omitted covariates. This paper focuses on the measure of diffusion proposed by He and Song (2022), provides a method of decomposition analysis to measure the role of the covariates on the estimated diffusion, and develops an asymptotic inference procedure for the decomposition analysis in such a situation. This paper also presents results from a Monte Carlo study on the small sample performance of the inference procedure.


title: Free Triplets versus Bound Triplet-Triplet Biexciton in Intramolecular Singlet Fission Materials: Structure-Property Correlations

abstract: Recent advances in singlet-fission research make it imperative that structure-property correlations that determine optical signatures of the triplet-triplet spin biexciton as well as its binding energy be understood precisely. We report many-body calculations of excited state absorptions from the triplet exciton and the triplet-triplet biexciton from two transversally linked dimers of pentacene derivatives. Comparison of experiment against theory leads to new interpretations of experiments performed earlier. We show that in the para-linked isomer the triplet-triplet does not dissociate to free triplets through the duration of the measurements. In contrast, even as calculated and experimental transient absorptions agree in the meta-isomer, the experimental observations here are more difficult to interpret, indicating the strong role structural variations can play in determining the rate and yield of free triplets. We also report many-body calculations of the spin gap, the energy difference between the spin quintet versus spin singlet triplet-triplet, as well as the binding energy of the spin singlet triplet-triplet, defined as the energy difference between two free triplets and the bound biexciton. The spin gap and the binding energy of the spin singlet triplet-triplet are different quantities in all but coupled two-level systems. The experimental behavior in the transversally linked dimers as well as previously studied longitudinally linked dimers agree with the trends that would be predicted from the computed biexciton binding energies.


title: Matrix Completion With Selective Sampling

abstract: Matrix completion is a classical problem in data science wherein one attempts to reconstruct a low-rank matrix while only observing some subset of the entries. Previous authors have phrased this problem as a nuclear norm minimization problem. Almost all previous work assumes no explicit structure of the matrix and uses uniform sampling to decide the observed entries. We suggest methods for selective sampling in the case where we have some knowledge about the structure of the matrix and are allowed to design the observation set.


title: A unified framework for notions of algebraic theory

abstract: Universal algebra uniformly captures various algebraic structures, by expressing them as equational theories or abstract clones. The ubiquity of algebraic structures in mathematics and related fields has given rise to several variants of universal algebra, such as theories of symmetric operads, non-symmetric operads, generalised operads, PROPs, PROs, and monads. These variants of universal algebra are called notions of algebraic theory. In this paper, we develop a unified framework for them. The key observation is that each notion of algebraic theory can be identified with a monoidal category, in such a way that algebraic theories correspond to monoid objects therein. To incorporate semantics, we introduce a categorical structure called metamodel, which formalises a definition of models of algebraic theories. We also define morphisms between notions of algebraic theory, which are a monoidal version of profunctors. Every strong monoidal functor gives rise to an adjoint pair of such morphisms, and provides a uniform method to establish isomorphisms between categories of models in different notions of algebraic theory. A general structure-semantics adjointness result and a double categorical universal property of categories of models are also shown.


title: Generative Model for Zero-Shot Sketch-Based Image Retrieval

abstract: We present a probabilistic model for Sketch-Based Image Retrieval (SBIR) where, at retrieval time, we are given sketches from novel classes, that were not present at training time. Existing SBIR methods, most of which rely on learning class-wise correspondences between sketches and images, typically work well only for previously seen sketch classes, and result in poor retrieval performance on novel classes. To address this, we propose a generative model that learns to generate images, conditioned on a given novel class sketch. This enables us to reduce the SBIR problem to a standard image-to-image search problem. Our model is based on an inverse auto-regressive flow based variational autoencoder, with a feedback mechanism to ensure robust image generation. We evaluate our model on two very challenging datasets, Sketchy, and TU Berlin, with novel train-test split. The proposed approach significantly outperforms various baselines on both the datasets.


title: Geometric limits of Julia sets for sums of power maps and polynomials

abstract: For maps of one complex variable, $f$, given as the sum of a degree $n$ power map and a degree $d$ polynomial, we provide necessary and sufficient conditions that the geometric limit as $n$ approaches infinity of the set of points that remain bounded under iteration by $f$ is the closed unit disk or the unit circle. We also provide a general description, for many cases, of the limiting set.


title: Memory-Sample Tradeoffs for Linear Regression with Small Error

abstract: We consider the problem of performing linear regression over a stream of $d$-dimensional examples, and show that any algorithm that uses a subquadratic amount of memory exhibits a slower rate of convergence than can be achieved without memory constraints. Specifically, consider a sequence of labeled examples $(a_1,b_1), (a_2,b_2)\ldots,$ with $a_i$ drawn independently from a $d$-dimensional isotropic Gaussian, and where $b_i = \langle a_i, x\rangle + \eta_i,$ for a fixed $x \in \mathbb{R}^d$ with $\|x\|_2 = 1$ and with independent noise $\eta_i$ drawn uniformly from the interval $[-2^{-d/5},2^{-d/5}].$ We show that any algorithm with at most $d^2/4$ bits of memory requires at least $\Omega(d \log \log \frac{1}{\epsilon})$ samples to approximate $x$ to $\ell_2$ error $\epsilon$ with probability of success at least $2/3$, for $\epsilon$ sufficiently small as a function of $d$. In contrast, for such $\epsilon$, $x$ can be recovered to error $\epsilon$ with probability $1-o(1)$ with memory $O\left(d^2 \log(1/\epsilon)\right)$ using $d$ examples. This represents the first nontrivial lower bounds for regression with super-linear memory, and may open the door for strong memory/sample tradeoffs for continuous optimization.


title: Scaling-up atomically thin coplanar semiconductor-metal circuitry via phase engineered chemical assembly

abstract: Two-dimensional (2D) layered semiconductors, with their ultimate atomic thickness, have shown promise to scale down transistors for modern integrated circuitry. However, the electrical contacts that connect these materials with external bulky metals are usually unsatisfactory, which limits the transistor performance. Recently, contacting 2D semiconductors using coplanar 2D conductors has shown promise in reducing the problematic high resistance contacts. However, many of these methods are not ideal for scaled production. Here, we report on the large-scale, spatially controlled chemical assembly of the integrated 2H-MoTe2 field-effect transistors (FETs) with coplanar metallic 1T' MoTe2 contacts via phase engineered approaches. We demonstrate that the heterophase FETs exhibit ohmic contact behavior with low contact resistance, resulting from the coplanar seamless contact between 2H and 1T' MoTe2 confirmed by transmission electron microscopy characterizations. The average mobility of the heterophase FETs was measured to be as high as 23 cm2 V-1 s-1 (comparable with those of exfoliated single crystals), due to the large 2H MoTe2 single-crystalline domain (486{\mu}m). By developing a patterned growth method, we realize the 1T' MoTe2 gated heterophase FET array whose components of channel, gate, and contacts are all 2D materials. Finally, we transfer the heterophase device array onto a flexible substrate and demonstrate the near-infrared photoresponse with high photoresponsivity (~1.02 A/W). Our study provides a basis for the large-scale application of phase-engineered coplanar MoTe2 semiconductors-meter structure in advanced electronics and optoelectronics.


title: Exploration of the bright and dark exciton landscape and fine structure of MoS$_2$ (using G$_0$W$_0$-BSE)

abstract: Spectral ordering between dark and bright excitons in transition metal dichalcogenides is of increasing interest for optoelectronic applications. However, little is known about dark exciton energies and their binding energies. We report the exciton landscape including momentum-forbidden dark excitons of MoS$_{2}$ monolayer using single shot GW-Bethe Salpeter equation (G$_{0}$W$_{0}$-BSE) calculations. We find the lowest-energy exciton to be indirect at ($\textrm K'_{v} \rightarrow \textrm K_{c}$) in agreement with recent GdW-BSE calculations [2D Mater. 6, 035003 (2019)]. We also find that by large, dark exciton binding energies ($E_b$) scale with the quasiparticle energies ($E_g$) according to the $E_b/E_g=0.25$ rule. Differences in exciton binding energies are explained using an orbital theory.


title: Deep Representation Learning for Social Network Analysis

abstract: Social network analysis is an important problem in data mining. A fundamental step for analyzing social networks is to encode network data into low-dimensional representations, i.e., network embeddings, so that the network topology structure and other attribute information can be effectively preserved. Network representation leaning facilitates further applications such as classification, link prediction, anomaly detection and clustering. In addition, techniques based on deep neural networks have attracted great interests over the past a few years. In this survey, we conduct a comprehensive review of current literature in network representation learning utilizing neural network models. First, we introduce the basic models for learning node representations in homogeneous networks. Meanwhile, we will also introduce some extensions of the base models in tackling more complex scenarios, such as analyzing attributed networks, heterogeneous networks and dynamic networks. Then, we introduce the techniques for embedding subgraphs. After that, we present the applications of network representation learning. At the end, we discuss some promising research directions for future work.


title: A New Class of Time Dependent Latent Factor Models with Applications

abstract: In many applications, observed data are influenced by some combination of latent causes. For example, suppose sensors are placed inside a building to record responses such as temperature, humidity, power consumption and noise levels. These random, observed responses are typically affected by many unobserved, latent factors (or features) within the building such as the number of individuals, the turning on and off of electrical devices, power surges, etc. These latent factors are usually present for a contiguous period of time before disappearing; further, multiple factors could be present at a time. This paper develops new probabilistic methodology and inference methods for random object generation influenced by latent features exhibiting temporal persistence. Every datum is associated with subsets of a potentially infinite number of hidden, persistent features that account for temporal dynamics in an observation. The ensuing class of dynamic models constructed by adapting the Indian Buffet Process --- a probability measure on the space of random, unbounded binary matrices --- finds use in a variety of applications arising in operations, signal processing, biomedicine, marketing, image analysis, etc. Illustrations using synthetic and real data are provided.


title: Portraying Double Higgs at the Large Hadron Collider

abstract: We examine the discovery potential for double Higgs production at the high luminosity LHC in the final state with two $b$-tagged jets, two leptons and missing transverse momentum. Although this dilepton final state has been considered a difficult channel due to the large backgrounds, we argue that it is possible to obtain sizable signal significance, by adopting a deep learning framework making full use of the relevant kinematics along with the jet images from the Higgs decay. For the relevant number of signal events we obtain a substantial increase in signal sensitivity over existing analyses. We discuss relative improvements at each stage and the correlations among the different input variables for the neutral network. The proposed method can be easily generalized to the semi-leptonic channel of double Higgs production, as well as to other processes with similar final states.


title: Improving solution accuracy and convergence for stochastic physics parameterizations with colored noise

abstract: Stochastic parameterizations are used in numerical weather prediction and climate modeling to help capture the uncertainty in the simulations and improve their statistical properties. Convergence issues can arise when time integration methods originally developed for deterministic differential equations are applied naively to stochastic problems. (Hodyss et al 2013, 2014) demonstrated that a correction term to various deterministic numerical schemes, known in stochastic analysis as the It\^o correction, can help improve solution accuracy and ensure convergence to the physically relevant solution without substantial computational overhead. The usual formulation of the It\^o correction is valid only when the stochasticity is represented by {\it white} noise. In this study, a generalized formulation of the It\^o correction is derived for noises of any color. The formulation is applied to a test problem described by an advection-diffusion equation forced with a spectrum of fast processes. We present numerical results for cases with both constant and spatially varying advection velocities to show that, for the same time step sizes, the introduction of the generalized It\^o correction helps to substantially reduce time integration error and significantly improve the convergence rate of the numerical solutions when the forcing term in the governing equation is rough (fast varying); alternatively, for the same target accuracy, the generalized It\^o correction allows for the use of significantly longer time steps and hence helps to reduce the computational cost of the numerical simulation.


title: Asymptotic Behavior of Bayesian Learners with Misspecified Models

abstract: We consider an agent who represents uncertainty about the environment via a possibly misspecified model. Each period, the agent takes an action, observes a consequence, and uses Bayes' rule to update her belief about the environment. This framework has become increasingly popular in economics to study behavior driven by incorrect or biased beliefs. Current literature has characterized asymptotic behavior under fairly specific assumptions. By first showing that the key element to predict the agent's behavior is the frequency of her past actions, we are able to characterize asymptotic behavior in general settings in terms of the solutions of a generalization of a differential equation that describes the evolution of the frequency of actions. We then present a series of implications that can be readily applied to economic applications, thus providing off-the-shelf tools that can be used to characterize behavior under misspecified learning.


title: Spin image of an atomic vapor cell with a resolution smaller than the diffusion crosstalk free distance

abstract: The diffusion crosstalk free distance is an important parameter for spin images in atomic vapor cells and is also regarded as a limit on the spatial resolution. However, by modulating the pumping light both spatially and temporally using a digital micromirror device, a spin image of a vapor cell has been obtained with a distinguishable stripe width of 13.7~$\mu$m, which is much smaller than the corresponding diffusion crosstalk free distance of $\sim$138~$\mu$m. The fundamental limit on the spatial resolution as determined by diffusion and the uncertainty principle is analyzed.


title: A Fast and Efficient Incremental Approach toward Dynamic Community Detection

abstract: Community detection is a discovery tool used by network scientists to analyze the structure of real-world networks. It seeks to identify natural divisions that may exist in the input networks that partition the vertices into coherent modules (or communities). While this problem space is rich with efficient algorithms and software, most of this literature caters to the static use-case where the underlying network does not change. However, many emerging real-world use-cases give rise to a need to incorporate dynamic graphs as inputs. In this paper, we present a fast and efficient incremental approach toward dynamic community detection. The key contribution is a generic technique called $\Delta-screening$, which examines the most recent batch of changes made to an input graph and selects a subset of vertices to reevaluate for potential community (re)assignment. This technique can be incorporated into any of the community detection methods that use modularity as its objective function for clustering. For demonstration purposes, we incorporated the technique into two well-known community detection tools. Our experiments demonstrate that our new incremental approach is able to generate performance speedups without compromising on the output quality (despite its heuristic nature). For instance, on a real-world network with 63M temporal edges (over 12 time steps), our approach was able to complete in 1056 seconds, yielding a 3x speedup over a baseline implementation. In addition to demonstrating the performance benefits, we also show how to use our approach to delineate appropriate intervals of temporal resolutions at which to analyze an input network.


title: Gotta Catch 'Em All: Using Honeypots to Catch Adversarial Attacks on Neural Networks

abstract: Deep neural networks (DNN) are known to be vulnerable to adversarial attacks. Numerous efforts either try to patch weaknesses in trained models, or try to make it difficult or costly to compute adversarial examples that exploit them. In our work, we explore a new "honeypot" approach to protect DNN models. We intentionally inject trapdoors, honeypot weaknesses in the classification manifold that attract attackers searching for adversarial examples. Attackers' optimization algorithms gravitate towards trapdoors, leading them to produce attacks similar to trapdoors in the feature space. Our defense then identifies attacks by comparing neuron activation signatures of inputs to those of trapdoors. In this paper, we introduce trapdoors and describe an implementation of a trapdoor-enabled defense. First, we analytically prove that trapdoors shape the computation of adversarial attacks so that attack inputs will have feature representations very similar to those of trapdoors. Second, we experimentally show that trapdoor-protected models can detect, with high accuracy, adversarial examples generated by state-of-the-art attacks (PGD, optimization-based CW, Elastic Net, BPDA), with negligible impact on normal classification. These results generalize across classification domains, including image, facial, and traffic-sign recognition. We also present significant results measuring trapdoors' robustness against customized adaptive attacks (countermeasures).


title: ClangJIT: Enhancing C++ with Just-in-Time Compilation

abstract: The C++ programming language is not only a keystone of the high-performance-computing ecosystem but has proven to be a successful base for portable parallel-programming frameworks. As is well known, C++ programmers use templates to specialize algorithms, thus allowing the compiler to generate highly-efficient code for specific parameters, data structures, and so on. This capability has been limited to those specializations that can be identified when the application is compiled, and in many critical cases, compiling all potentially-relevant specializations is not practical. ClangJIT provides a well-integrated C++ language extension allowing template-based specialization to occur during program execution. This capability has been implemented for use in large-scale applications, and we demonstrate that just-in-time-compilation-based dynamic specialization can be integrated into applications, often requiring minimal changes (or no changes) to the applications themselves, providing significant performance improvements, programmer-productivity improvements, and decreased compilation time.


title: Dual-polarized all-angle cloaking of a dielectric nanowire by helical graphene ribbons

abstract: Scattering from a dielectric nanowire coated by helical graphene strips (nanoribbons) is investigated for dual-polarized wave at oblique incidence. In the long-wavelength approximation, the helical strips are treated as a homogeneous layer with averaged tensor conductivity. It is shown that performance of well-known surface cloaks in the form of graphene monolayer, axial and azimuthal graphene strips can be deteriorated in a wide range of incidence angles. To overcome this problem, helical graphene strips are proposed as an advanced metasurface for dual-polarized all-angle cloaking of dielectric nanowire in the terahertz band. It is found that such metasurface suppresses scattering from nanowire more effectively as compared to graphene monolayer, regardless of the angle of wave incidence. Moreover, dual-polarized all-angle cloaking of dielectric nanowire can be broadly tuned in frequency with parameters of helical graphene strips.


title: Balancing Safety and Traffic Throughput in Cooperative Vehicle Platooning

abstract: In this paper we propose a distributed model predictive control architecture to coordinate the longitudinal motion of a vehicle platoon at a signalized intersection. Our control approach is cooperative; we use vehicle-to-vehicle (V2V) communication in order to maintain small inter-vehicle distances and correspondingly achieve large vehicle throughput at an intersection. We study the trade-off between safety and road throughput for this problem. In particular, we present the link between traffic efficiency gains in terms of throughput, and safety of the connected platoon measured as trust on the predicted speed profile of other vehicles in the network.


title: Inpatient2Vec: Medical Representation Learning for Inpatients

abstract: Representation learning (RL) plays an important role in extracting proper representations from complex medical data for various analyzing tasks, such as patient grouping, clinical endpoint prediction and medication recommendation. Medical data can be divided into two typical categories, outpatient and inpatient, that have different data characteristics. However, few of existing RL methods are specially designed for inpatients data, which have strong temporal relations and consistent diagnosis. In addition, for unordered medical activity set, existing medical RL methods utilize a simple pooling strategy, which would result in indistinguishable contributions among the activities for learning. In this work, weproposeInpatient2Vec, anovelmodel for learning three kinds of representations for inpatient, including medical activity, hospital day and diagnosis. A multi-layer self-attention mechanism with two training tasks is designed to capture the inpatient data characteristics and process the unordered set. Using a real-world dataset, we demonstrate that the proposed approach outperforms the competitive baselines on semantic similarity measurement and clinical events prediction tasks.


title: Design of Communication Systems using Deep Learning: A Variational Inference Perspective

abstract: Recent research in the design of end to end communication system using deep learning has produced models which can outperform traditional communication schemes. Most of these architectures leveraged autoencoders to design the encoder at the transmitter and decoder at the receiver and train them jointly by modeling transmit symbols as latent codes from the encoder. However, in communication systems, the receiver has to work with noise corrupted versions of transmit symbols. Traditional autoencoders are not designed to work with latent codes corrupted with noise. In this work, we provide a framework to design end to end communication systems which accounts for the existence of noise corrupted transmit symbols. The proposed method uses deep neural architecture. An objective function for optimizing these models is derived based on the concepts of variational inference. Further, domain knowledge such as channel type can be systematically integrated into the objective. Through numerical simulation, the proposed method is shown to consistently produce models with better packing density and achieving it faster in multiple popular channel models as compared to the previous works leveraging deep learning models.


title: Comment on "Orientational Distribution of Free O-H Groups of Interfacial Water is Exponential"

abstract: In a recent letter (PRL,121,246101,2018), Sun et al. reported that combined MD simulation and sum frequency generation vibrational spectroscopy (SFG-VS) measurements led to conclusions of a broad and exponentially decaying orientational distribution, and the presence of the free O-H group pointing down to the bulk at the air/water interface. In this comment, we show that their main conclusions are based on questionable interpretation of the SFG-VS data presented in the letter [1], and are also contrary to the established data analysis and interpretations in the literature [2-5].


title: The heredity and bimeromorphic invariance of the $\partial\overline{\partial}$-lemma property

abstract: We give a simple proof of a result on the $\partial\bar{\partial}$-lemma property under a blow-up transformation by Deligne--Griffiths--Morgan--Sullivan's criterion. Here, we use an explicit blow-up formula for Dolbeault cohomology given in our previous work, which can be induced by a morphism expressed on the level of spaces of forms and currents. At last, we discuss the heredity and bimeromorphic invariance of the $\partial\bar{\partial}$-lemma property.


title: Cubical Syntax for Reflection-Free Extensional Equality

abstract: We contribute XTT, a cubical reconstruction of Observational Type Theory which extends Martin-L\"of's intensional type theory with a dependent equality type that enjoys function extensionality and a judgmental version of the unicity of identity types principle (UIP): any two elements of the same equality type are judgmentally equal. Moreover, we conjecture that the typing relation can be decided in a practical way. In this paper, we establish an algebraic canonicity theorem using a novel cubical extension (independently proposed by Awodey) of the logical families or categorical gluing argument inspired by Coquand and Shulman: every closed element of boolean type is derivably equal to either 'true' or 'false'.


title: Two-electron-spin ratchets as a platform for microwave-free dynamic nuclear polarization of arbitrary material targets

abstract: Optically-pumped color centers in semiconductor powders can potentially induce high levels of nuclear spin polarization in surrounding solids or fluids at or near ambient conditions, but complications stemming from the random orientation of the particles and the presence of unpolarized paramagnetic defects hinder the flow of polarization beyond the defect's host material. Here, we theoretically study the spin dynamics of interacting nitrogen-vacancy (NV) and substitutional nitrogen (P1) centers in diamond to show that outside protons spin-polarize efficiently upon a magnetic field sweep across the NV-P1 level anti-crossing. The process can be interpreted in terms of an NV-P1 spin ratchet, whose handedness - and hence the sign of the resulting nuclear polarization - depends on the relative timing of the optical excitation pulse. Further, we find that the polarization transfer mechanism is robust to NV misalignment relative to the external magnetic field, and efficient over a broad range of electron-electron and electron-nuclear spin couplings, even if proxy spins feature short coherence or spin-lattice relaxation times. Therefore, these results pave the route towards the dynamic nuclear polarization of arbitrary spin targets brought in proximity with a diamond powder under ambient conditions.


title: Kinematics of the OVI Circumgalactic Medium: Halo Mass Dependence and Outflow Signatures

abstract: We probe the high-ionization circumgalactic medium by examining absorber kinematics, absorber-galaxy kinematics, and average absorption profiles of 31 OVI absorbers from the "Multiphase Galaxy Halos" Survey as a function of halo mass, redshift, inclination, and azimuthal angle. The galaxies are isolated at $0.12<z_{\rm gal}<0.66$ and are probed by a background quasar within $D\approx 200$ kpc. Each absorber-galaxy pair has Hubble Space Telescope images and COS quasar spectra, and most galaxy redshifts have been accurately measured from Keck/ESI spectra. Using the pixel-velocity two-point correlation function (TPCF) method, we find that OVI absorber kinematics have a strong halo mass dependence. Absorbers hosted by $\sim L^{\ast}$ galaxies have the largest velocity dispersions, which we interpret to be that the halo virial temperature closely matches the temperature at which the collisionally ionized OVI fraction peaks. Lower mass galaxies and group environments have smaller velocity dispersions. Total column densities follow the same behavior, consistent with theoretical findings. After normalizing out the observed mass dependence, we studied absorber-galaxy kinematics with a modified TPCF and found non-virialized motions due to outflowing gas. Edge-on minor axis gas has large optical depths concentrated near the galaxy systemic velocity as expected for bipolar outflows, while face-on minor axis gas has a smoothly decreasing optical depth distribution out to large normalized absorber-galaxy velocities, suggestive of decelerating outflowing gas. Accreting gas signatures are not observed due to "kinematic blurring" in which multiple line-of-sight structures are observed. These results indicate that galaxy mass dominates OVI properties over baryon cycle processes.


title: Vacuum Decay in Real Time and Imaginary Time Formalisms

abstract: We analyze vacuum tunneling in quantum field theory in a general formalism by using the Wigner representation. In the standard instanton formalism, one usually approximates the initial false vacuum state by an eigenstate of the field operator, imposes Dirichlet boundary conditions on the initial field value, and evolves in imaginary time. This approach does not have an obvious physical interpretation. However, an alternative approach does have a physical interpretation: in quantum field theory, tunneling can happen via classical dynamics, seeded by initial quantum fluctuations in both the field and its momentum conjugate, which was recently implemented in Ref. [1]. We show that the Wigner representation is a useful framework to calculate and understand the relationship between these two approaches. We find there are two, related, saddle point approximations for the path integral of the tunneling process: one corresponds to the instanton solution in imaginary time and the other one corresponds to classical dynamics from initial quantum fluctuations in real time. The classical approximation for the dynamics of the latter process is justified only in a system with many degrees of freedom, as can appear in field theory due to high occupancy of nucleated bubbles, while it is not justified in single particle quantum mechanics, as we explain. We mention possible applications of the real time formalism, including tunneling when the instanton vanishes, or when the imaginary time contour deformation is not possible, which may occur in cosmological settings.

categories: hep-th astro-ph.CO gr-qc hep-ph quant-ph


title: Subspace Variational Quantum Simulator

abstract: Quantum simulation is one of the key applications of quantum computing, which accelerates research and development in the fields such as chemistry and material science. The recent development of noisy intermediate-scale quantum (NISQ) devices urges the exploration of applications without the necessity of quantum error correction. In this paper, we propose an efficient method to simulate quantum dynamics driven by a static Hamiltonian on NISQ devices, named subspace variational quantum simulator (SVQS). SVQS employs the subspace-search variational quantum eigensolver (SSVQE) to find a low-lying eigensubspace and extends it to simulate dynamics within the subspace with lower overhead compared to the existing schemes. We experimentally simulate the time-evolution operator in a low-lying eigensubspace of a hydrogen molecule. We also define the subspace process fidelity as a measure between two quantum processes in a subspace. The subspace time evolution mimicked by SVQS shows the subspace process fidelity of $0.88$-$0.98$.


title: Search for nearby Earth analogs I. 15 planet candidates found in PFS data

abstract: The radial velocity method plays a major role in the discovery of nearby exoplanets. To efficiently find planet candidates from the data obtained in high precision radial velocity surveys, we apply a signal diagnostic framework to detect radial velocity signals that are statistically significant, consistent in time, robust to the choice of noise models, and not correlated with stellar activity. Based on the application of this approach to the survey data of the Planet Finder Spectrograph (PFS), we report fifteen planet candidates located in fourteen stellar systems. We find that the orbits of the planet candidates around HD 210193, 103949, 8326, and 71135 are consistent with temperate zones around these stars (where liquid water could exist on the surface). With periods of 7.76 and 15.14 days respectively, the planet candidates around star HIP 54373 form a 1:2 resonance system. These discoveries demonstate the feasibility of automated detection of exoplanets from large radial velocity surveys, which may provide a complete sample of nearby Earth analogs.


title: The subelliptic heat kernel of the octonionic Hopf fibration

abstract: We study the sub-Laplacian of the $15$-dimensional unit sphere which is obtained by lifting with respect to the Hopf fibration the Laplacian of the octonionic projective space. We obtain in particular explicit formulas for its heat kernel and deduce an expression for the Green function of a related sub-Laplacian. As a byproduct we also obtain the spectrum of the sub-Laplacian, the small-time asymptotics of the heat kernel and explicitly compute the sub-Riemannian distance.


title: The $\phi(2170)$ production in the process $\gamma p\to \eta \phi p$

abstract: We have studied the $\gamma p\to \eta \phi p$ reaction within the effective Lagrangian approach, by considering the contribution of the intermediate state $\phi(2170)$ production, and the background contributions of $t$-channel $\pi^0$ and $\eta$ mesons exchanges with the intermediate states $N$ and $N(1535)$. Our calculations show that there may be a peak, at least a bump structure around 2180 MeV associated to the resonance $\phi(2170)$ in the $\eta\phi$ mass distribution. We suggest to search for the resonance $\phi(2170)$ in this reaction, which would be helpful to shed light on its nature.


title: Effective gauge theories of superfluidity with topological order

abstract: We discuss the low-energy dynamics of superfluidity with topological order in $(3+1)$ spacetime dimensions. We generalize a topological $BF$ theory by introducing a non-square $K$ matrix, and this generalized $BF$ theory can describe massless Nambu-Goldstone bosons and anyonic statistics between vortices and quasiparticles. We discuss the general structure of discrete and continuous higher-form symmetries in this theory, which can be used to classify quantum phases. We describe how to identify the appearance of topological order in such systems and discuss its relation to a mixed 't Hooft anomaly between discrete higher-form symmetries. We apply this framework to the color-flavor locked phase of dense QCD, which shows anyonic particle-vortex statistics while no topological order appears. An explicit example of superfluidity with topological order is discussed.


title: Anomalous correlators, "ghost" waves and nonlinear standing waves in the $\beta$-FPUT system

abstract: We show that Hamiltonian nonlinear dispersive wave systems with cubic nonlinearity and random initial data develop, during their evolution, anomalous correlators. These are responsible for the appearance of "ghost" excitations, i.e. those characterized by negative frequencies, in addition to the positive ones predicted by the linear dispersion relation. We use generalization of the Wick's decomposition and the wave turbulence theory to explain theoretically the existence of anomalous correlators. We test our theory on the celebrated $\beta$-Fermi-Pasta-Ulam-Tsingou chain and show that numerically measured values of the anomalous correlators agree, in the weakly nonlinear regime, with our analytical predictions. We also predict that similar phenomena will occur in other nonlinear systems dominated by nonlinear interactions, including surface gravity waves. Our results pave the road to study phase correlations in the Fourier space for weakly nonlinear dispersive wave systems.


title: node2bits: Compact Time- and Attribute-aware Node Representations for User Stitching

abstract: Identity stitching, the task of identifying and matching various online references (e.g., sessions over different devices and timespans) to the same user in real-world web services, is crucial for personalization and recommendations. However, traditional user stitching approaches, such as grouping or blocking, require quadratic pairwise comparisons between a massive number of user activities, thus posing both computational and storage challenges. Recent works, which are often application-specific, heuristically seek to reduce the amount of comparisons, but they suffer from low precision and recall. To solve the problem in an application-independent way, we take a heterogeneous network-based approach in which users (nodes) interact with content (e.g., sessions, websites), and may have attributes (e.g., location). We propose node2bits, an efficient framework that represents multi-dimensional features of node contexts with binary hashcodes. node2bits leverages feature-based temporal walks to encapsulate short- and long-term interactions between nodes in heterogeneous web networks, and adopts SimHash to obtain compact, binary representations and avoid the quadratic complexity for similarity search. Extensive experiments on large-scale real networks show that node2bits outperforms traditional techniques and existing works that generate real-valued embeddings by up to 5.16% in F1 score on user stitching, while taking only up to 1.56% as much storage.


title: Fast Single Image Dehazing via Multilevel Wavelet Transform based Optimization

abstract: The quality of images captured in outdoor environments can be affected by poor weather conditions such as fog, dust, and atmospheric scattering of other particles. This problem can bring extra challenges to high-level computer vision tasks like image segmentation and object detection. However, previous studies on image dehazing suffer from a huge computational workload and corruption of the original image, such as over-saturation and halos. In this paper, we present a novel image dehazing approach based on the optical model for haze images and regularized optimization. Specifically, we convert the non-convex, bilinear problem concerning the unknown haze-free image and light transmission distribution to a convex, linear optimization problem by estimating the atmosphere light constant. Our method is further accelerated by introducing a multilevel Haar wavelet transform. The optimization, instead, is applied to the low frequency sub-band decomposition of the original image. This dimension reduction significantly improves the processing speed of our method and exhibits the potential for real-time applications. Experimental results show that our approach outperforms state-of-the-art dehazing algorithms in terms of both image reconstruction quality and computational efficiency. For implementation details, source code can be publicly accessed via http://github.com/JiaxiHe/Image-and-Video-Dehazing.


title: Anomalous conduction band fluctuation in silicon carbide metal-oxide-semiconductor structures revealed by electrical characterization of field effect transistors combined with self-consistent numerical calculations

abstract: We determined the interface state density ($D_{\rm it}$) distributions in the vicinity of the conduction band edge in silicon carbide (SiC) metal-oxide-semiconductor (MOS) structures by reproducing the experimental current-voltage characteristics of MOS field effect transistors (MOSFETs) with numerical calculations. In the calculation, potential distributions and energy sub-bands in the inversion layer were calculated by solving Poisson and Schr\"{o}dinger equations, respectively. We demonstrate that gate characteristics of the MOSFETs are well described by considering that the interface states are caused by fluctuation of free-electron density of states in a two-dimensional system. The $D_{\rm it}$ distributions are almost uniquely determined by the oxide formation process (as oxidation or interface nitridation) and independent of the acceptor concentration ($3\times10^{15}-1\times10^{18}\ {\rm cm^{-3}}$).


title: SPONGE: A generalized eigenproblem for clustering signed networks

abstract: We introduce a principled and theoretically sound spectral method for $k$-way clustering in signed graphs, where the affinity measure between nodes takes either positive or negative values. Our approach is motivated by social balance theory, where the task of clustering aims to decompose the network into disjoint groups, such that individuals within the same group are connected by as many positive edges as possible, while individuals from different groups are connected by as many negative edges as possible. Our algorithm relies on a generalized eigenproblem formulation inspired by recent work on constrained clustering. We provide theoretical guarantees for our approach in the setting of a signed stochastic block model, by leveraging tools from matrix perturbation theory and random matrix theory. An extensive set of numerical experiments on both synthetic and real data shows that our approach compares favorably with state-of-the-art methods for signed clustering, especially for large number of clusters and sparse measurement graphs.


title: On Low-rank Trace Regression under General Sampling Distribution

abstract: In this paper, we study the trace regression when a matrix of parameters B* is estimated via the convex relaxation of a rank-regularized regression or via regularized non-convex optimization. It is known that these estimators satisfy near-optimal error bounds under assumptions on the rank, coherence, and spikiness of B*. We start by introducing a general notion of spikiness for B* that provides a generic recipe to prove the restricted strong convexity of the sampling operator of the trace regression and obtain near-optimal and non-asymptotic error bounds for the estimation error. Similar to the existing literature, these results require the regularization parameter to be above a certain theory-inspired threshold that depends on observation noise that may be unknown in practice. Next, we extend the error bounds to cases where the regularization parameter is chosen via cross-validation. This result is significant in that existing theoretical results on cross-validated estimators (Kale et al., 2011; Kumar et al., 2013; Abou-Moustafa and Szepesvari, 2017) do not apply to our setting since the estimators we study are not known to satisfy their required notion of stability. Finally, using simulations on synthetic and real data, we show that the cross-validated estimator selects a near-optimal penalty parameter and outperforms the theory-inspired approach of selecting the parameter.


title: Semantic variation operators for multidimensional genetic programming

abstract: Multidimensional genetic programming represents candidate solutions as sets of programs, and thereby provides an interesting framework for exploiting building block identification. Towards this goal, we investigate the use of machine learning as a way to bias which components of programs are promoted, and propose two semantic operators to choose where useful building blocks are placed during crossover. A forward stagewise crossover operator we propose leads to significant improvements on a set of regression problems, and produces state-of-the-art results in a large benchmark study. We discuss this architecture and others in terms of their propensity for allowing heuristic search to utilize information during the evolutionary process. Finally, we look at the collinearity and complexity of the data representations that result from these architectures, with a view towards disentangling factors of variation in application.


title: Classification of simple modules with finite-dimensional weight spaces for the N = 2 Ramond algebra

abstract: In this paper, we classify all simple weight modules with finite-dimensional weight spaces over the $N=2$ Ramond algebra. Any such module $V$ is either a simple highest weight module or a simple lowest weight module, or a simple cuspidal module with ${\rm b}(V)\le 2$.