title: Random Vector Functional Link Networks for Function Approximation on Manifolds

abstract: The learning speed of feed-forward neural networks is notoriously slow and has presented a bottleneck in deep learning applications for several decades. For instance, gradient-based learning algorithms, which are used extensively to train neural networks, tend to work slowly when all of the network parameters must be iteratively tuned. To counter this, both researchers and practitioners have tried introducing randomness to reduce the learning requirement. Based on the original construction of Igelnik and Pao, single layer neural-networks with random input-to-hidden layer weights and biases have seen success in practice, but the necessary theoretical justification is lacking. In this paper, we begin to fill this theoretical gap. We provide a (corrected) rigorous proof that the Igelnik and Pao construction is a universal approximator for continuous functions on compact domains, with approximation error decaying asymptotically like $O(1/\sqrt{n})$ for the number $n$ of network nodes. We then extend this result to the non-asymptotic setting, proving that one can achieve any desired approximation error with high probability provided $n$ is sufficiently large. We further adapt this randomized neural network architecture to approximate functions on smooth, compact submanifolds of Euclidean space, providing theoretical guarantees in both the asymptotic and non-asymptotic forms. Finally, we illustrate our results on manifolds with numerical experiments.


title: Origin of micron-scale propagation lengths of heat-carrying acoustic excitations in amorphous silicon

abstract: The heat-carrying acoustic excitations of amorphous silicon are of interest because their mean free paths may approach micron scales at room temperature. Despite extensive investigation, the origin of the weak acoustic damping in the heat-carrying frequencies remains a topic of debate. Here, we report measurements of the thermal conductivity mean free path accumulation function in amorphous silicon thin films from 60 - 315 K using transient grating spectroscopy. With additional picosecond acoustics measurements and considering the known frequency-dependencies of damping mechanisms in glasses, we reconstruct the mean free paths from $\sim 0.1-3$ THz. The mean free paths are independent of temperature and exhibit a Rayleigh scattering trend over most of this frequency range. The observed trend is inconsistent with the predictions of numerical studies based on normal mode analysis but agrees with diverse measurements on other glasses. The micron-scale MFPs in amorphous Si arise from the absence of anharmonic or two-level system damping in the sub-THz frequencies, leading to heat-carrying acoustic excitations with room-temperature damping comparable to that of other glasses at cryogenic temperatures.


title: Weakly supervised one-stage vision and language disease detection using large scale pneumonia and pneumothorax studies

abstract: Detecting clinically relevant objects in medical images is a challenge despite large datasets due to the lack of detailed labels. To address the label issue, we utilize the scene-level labels with a detection architecture that incorporates natural language information. We present a challenging new set of radiologist paired bounding box and natural language annotations on the publicly available MIMIC-CXR dataset especially focussed on pneumonia and pneumothorax. Along with the dataset, we present a joint vision language weakly supervised transformer layer-selected one-stage dual head detection architecture (LITERATI) alongside strong baseline comparisons with class activation mapping (CAM), gradient CAM, and relevant implementations on the NIH ChestXray-14 and MIMIC-CXR dataset. Borrowing from advances in vision language architectures, the LITERATI method demonstrates joint image and referring expression (objects localized in the image using natural language) input for detection that scales in a purely weakly supervised fashion. The architectural modifications address three obstacles -- implementing a supervised vision and language detection method in a weakly supervised fashion, incorporating clinical referring expression natural language information, and generating high fidelity detections with map probabilities. Nevertheless, the challenging clinical nature of the radiologist annotations including subtle references, multi-instance specifications, and relatively verbose underlying medical reports, ensures the vision language detection task at scale remains stimulating for future investigation.


title: Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing

abstract: Pretraining large neural language models, such as BERT, has led to impressive gains on many natural language processing (NLP) tasks. However, most pretraining efforts focus on general domain corpora, such as newswire and Web. A prevailing assumption is that even domain-specific pretraining can benefit by starting from general-domain language models. In this paper, we challenge this assumption by showing that for domains with abundant unlabeled text, such as biomedicine, pretraining language models from scratch results in substantial gains over continual pretraining of general-domain language models. To facilitate this investigation, we compile a comprehensive biomedical NLP benchmark from publicly-available datasets. Our experiments show that domain-specific pretraining serves as a solid foundation for a wide range of biomedical NLP tasks, leading to new state-of-the-art results across the board. Further, in conducting a thorough evaluation of modeling choices, both for pretraining and task-specific fine-tuning, we discover that some common practices are unnecessary with BERT models, such as using complex tagging schemes in named entity recognition (NER). To help accelerate research in biomedical NLP, we have released our state-of-the-art pretrained and task-specific models for the community, and created a leaderboard featuring our BLURB benchmark (short for Biomedical Language Understanding & Reasoning Benchmark) at https://aka.ms/BLURB.


title: Neural Language Generation: Formulation, Methods, and Evaluation

abstract: Recent advances in neural network-based generative modeling have reignited the hopes in having computer systems capable of seamlessly conversing with humans and able to understand natural language. Neural architectures have been employed to generate text excerpts to various degrees of success, in a multitude of contexts and tasks that fulfil various user needs. Notably, high capacity deep learning models trained on large scale datasets demonstrate unparalleled abilities to learn patterns in the data even in the lack of explicit supervision signals, opening up a plethora of new possibilities regarding producing realistic and coherent texts. While the field of natural language generation is evolving rapidly, there are still many open challenges to address. In this survey we formally define and categorize the problem of natural language generation. We review particular application tasks that are instantiations of these general formulations, in which generating natural language is of practical importance. Next we include a comprehensive outline of methods and neural architectures employed for generating diverse texts. Nevertheless, there is no standard way to assess the quality of text produced by these generative models, which constitutes a serious bottleneck towards the progress of the field. To this end, we also review current approaches to evaluating natural language generation systems. We hope this survey will provide an informative overview of formulations, methods, and assessments of neural natural language generation.


title: LEMMA: A Multi-view Dataset for Learning Multi-agent Multi-task Activities

abstract: Understanding and interpreting human actions is a long-standing challenge and a critical indicator of perception in artificial intelligence. However, a few imperative components of daily human activities are largely missed in prior literature, including the goal-directed actions, concurrent multi-tasks, and collaborations among multi-agents. We introduce the LEMMA dataset to provide a single home to address these missing dimensions with meticulously designed settings, wherein the number of tasks and agents varies to highlight different learning objectives. We densely annotate the atomic-actions with human-object interactions to provide ground-truths of the compositionality, scheduling, and assignment of daily activities. We further devise challenging compositional action recognition and action/task anticipation benchmarks with baseline models to measure the capability of compositional action understanding and temporal reasoning. We hope this effort would drive the machine vision community to examine goal-directed human activities and further study the task scheduling and assignment in the real world.


title: Diffusive hydrogenation reactions of CO embedded in amorphous solid water at elevated temperatures ~70 K

abstract: The surface processes on interstellar dust grains have an important role in the chemical evolution in molecular clouds. Hydrogenation reactions on ice surfaces have been extensively investigated and are known to proceed at low temperatures mostly below 20 K. In contrast, information about the chemical processes of molecules within an ice mantle is lacking. In this work, we investigated diffusive hydrogenation reactions of carbon monoxide (CO) embedded in amorphous solid water (ASW) as a model case and discovered that the hydrogenation of CO efficiently proceeds to yield H2CO and CH3OH even above 20 K when CO is buried beneath ASW. The experimental results suggest that hydrogen atoms diffuse through the cracks of ASW and have a sufficient residence time to react with embedded CO. The hydrogenation reactions occurred even at temperatures up to ~70 K. Cracks collapse at elevated temperatures but the occurrence of hydrogenation reactions means that the cracks would not completely disappear and remain large enough for penetration by hydrogen atoms. Considering the hydrogen-atom fluence in the laboratory and molecular clouds, we suggest that the penetration of hydrogen and its reactions within the ice mantle occur in astrophysical environments. Unified Astronomy


title: Suppression of Three-Body Loss Near a p-Wave Resonance Due to Quasi-1D Confinement

abstract: We investigate the three-body recombination rate of a Fermi gas of $^6$Li atoms confined in quasi-1D near a $p$-wave Feshbach resonance. We confirm that the quasi-1D loss rate constant $K_3$ follows the predicted threshold scaling law that $K_3$ is energy independent on resonance, and find consistency with the scaling law $K_3 \propto (k \, a_{1D})^6$ far from resonance [Mehta et al. Phys. Rev. A 76, 022711 (2007)]. Further we develop a theory based on Breit-Wigner analysis that describes the loss feature for intermediate fields. Lastly we measure how the loss rate constant scales with transverse confinement and find that $K_3 \propto V_L^{-1}$, where $V_L$ is the lattice depth. Importantly, at our attainable transverse confinements and temperatures, we see a 74-fold suppression of the on-resonant three-body loss rate constant in quasi-1D compared to 3D. With significant further enhancement of the transverse confinement, this suppression may pave the way for realizing stable $p$-wave superfluids.


title: New Results in Sona Drawing: Hardness and TSP Separation

abstract: Given a set of point sites, a sona drawing is a single closed curve, disjoint from the sites and intersecting itself only in simple crossings, so that each bounded region of its complement contains exactly one of the sites. We prove that it is NP-hard to find a minimum-length sona drawing for $n$ given points, and that such a curve can be longer than the TSP tour of the same points by a factor $> 1.5487875$. When restricted to tours that lie on the edges of a square grid, with points in the grid cells, we prove that it is NP-hard even to decide whether such a tour exists. These results answer questions posed at CCCG 2006.


title: Spatially-dependent modeling and simulation of runaway electron mitigation in DIII-D

abstract: New simulations with the Kinetic Orbit Runaway electron (RE) Code KORC show RE deconfinement losses to the wall during plasma scrape off are the primary current dissipation mechanism in DIII-D experiments with high-Z impurity injection, and not collisional slowing down. The majority of simulations also exhibit an increase in the RE beam energy due to acceleration by the induced toroidal electric field, even while the RE beam current is decreasing. In this study, KORC integrates RE orbits using the relativistic guiding center equations of motion, and incorporates time-sequenced, experimental reconstructions of the magnetic and electric fields and line integrated electron density to construct spatiotemporal models of electron and partially-ionized impurity transport in the companion plasma. Comparisons of experimental current evolution and KORC results demonstrate the importance of including Coulomb collisions with partially-ionized impurity physics, initial RE energy, pitch angle, and spatial distributions, and spatiotemporal electron and partially-ionized impurity transport. This research provides an initial quantification of the efficacy of RE mitigation via injected impurities, and identification of the critical role played by loss of confinement due to plasma scrape off on the inner wall as compared to the relatively slow collisional damping.


title: Quasi-entropy by log-determinant covariance matrix and application to liquid crystals

abstract: A quasi-entropy is constructed for tensors averaged by a density function on $SO(3)$ using the log-determinant of a covariance matrix. It serves as a substitution of the entropy for tensors derived from a constrained minimization that involves integrals. The quasi-entropy is an elementary function that possesses the essential properties of the original entropy. It constrains the covariance matrix to be positive definite, is strictly convex, and is invariant under rotations. Moreover, when reduced by symmetries, it keeps the vanishing tensors of the symmetry zero. Explicit expressions are provided for axial symmetries up to four-fold, as well as tetrahedral and octahedral symmetries. The quasi-entropy is utilized to discuss phase transitions in several systems. The results are consistent with using the original entropy. Besides, some novel results are presented.


title: Topologically Nontrivial Interband Plasmons in Type-II Weyl Semimetal MoTe$_2$

abstract: In many realistic topological materials, more than one kind of fermions contribute to the electronic bands crossing the Fermi level, leading to various novel phenomena. Here, using momentum-resolved inelastic electron scattering, we investigate the plasmons and their evolution across the phase transition in a type-II Weyl Semimetal MoTe$_2$, in which both Weyl fermions and trivial nonrelativistic fermions contribute to the Fermi surface in the Td phase. One plasmon mode in the 1T' phase at high temperature and two plasmon modes in the topological T$_d$ phase at low temperature are observed. Combining with first-priciples calculations, we show that all the plasmon modes are dominated by the interband correlations between the inverted bands of MoTe$_2$. Especially in the T$_d$ phase, since the electronic bands split due to inversion symmetry breaking and spin-orbit coupling, the plasmon modes manifest the interband correlation between the topological Weyl fermions and the trivial nonrelativistic electrons. Our work emphasizes the significance of the interplay between different kinds of carriers in plasmons of topological materials.


title: Stochastic Low-rank Tensor Bandits for Multi-dimensional Online Decision Making

abstract: Multi-dimensional online decision making plays a crucial role in many real applications such as online recommendation and digital marketing. In these problems, a decision at each time is a combination of choices from different types of entities. To solve it, we introduce stochastic low-rank tensor bandits, a class of bandits whose mean rewards can be represented as a low-rank tensor. We consider two settings, tensor bandits without context and tensor bandits with context. In the first setting, the platform aims to find the optimal decision with the highest expected reward, a.k.a, the largest entry of true reward tensor. In the second setting, some modes of the tensor are contexts and the rest modes are decisions, and the goal is to find the optimal decision given the contextual information. We propose two learning algorithms tensor elimination and tensor epoch-greedy for tensor bandits without context, and derive finite-time regret bounds for them. Comparing with existing competitive methods, tensor elimination has the best overall regret bound and tensor epoch-greedy has a sharper dependency on dimensions of the reward tensor. Furthermore, we develop a practically effective Bayesian algorithm called tensor ensemble sampling for tensor bandits with context. Extensive simulations and real analysis in online advertising data back up our theoretical findings and show that our algorithms outperform various state-of-the-art approaches that ignore the tensor low-rank structure.


title: LDP-FL: Practical Private Aggregation in Federated Learning with Local Differential Privacy

abstract: Train machine learning models on sensitive user data has raised increasing privacy concerns in many areas. Federated learning is a popular approach for privacy protection that collects the local gradient information instead of real data. One way to achieve a strict privacy guarantee is to apply local differential privacy into federated learning. However, previous works do not give a practical solution due to three issues. First, the noisy data is close to its original value with high probability, increasing the risk of information exposure. Second, a large variance is introduced to the estimated average, causing poor accuracy. Last, the privacy budget explodes due to the high dimensionality of weights in deep learning models. In this paper, we proposed a novel design of local differential privacy mechanism for federated learning to address the abovementioned issues. It is capable of making the data more distinct from its original value and introducing lower variance. Moreover, the proposed mechanism bypasses the curse of dimensionality by splitting and shuffling model updates. A series of empirical evaluations on three commonly used datasets, MNIST, Fashion-MNIST and CIFAR-10, demonstrate that our solution can not only achieve superior deep learning performance but also provide a strong privacy guarantee at the same time.


title: Storage and release of electromagnetic waves using a Fabry-Perot resonator that includes an optically tunable metamirror

abstract: We evaluate the transient response of an optically tunable meta-atom composed of an electric inductor-capacitor resonator that is loaded with a piece of high-resistivity silicon and perform a proof-of-concept experiment to demonstrate the storage and release of electromagnetic waves using this meta-atom in the microwave region. The transient time of the meta-atom immediately after commencing laser light illumination of the silicon in the meta-atom is found to be inversely proportional to the incident laser power. The transmittance of the meta-atom at the resonance frequency increases to ten times that obtained without laser illumination at 5.2 ns after the start of laser illumination for a laser power of 1600 mW, a laser spot size of 2 mm $\times$ 1 mm, and a laser wavelength of 447 nm. In contrast, the transient time after turning the laser light off is dependent on the carrier lifetime of silicon and is measured to be several tens of microseconds. Based on the results of evaluation of the transient response of the meta-atom, we propose a method for the storage and release of electromagnetic waves using a Fabry-Perot resonator that includes the meta-atom as one of its mirrors. The electromagnetic wave that is stored in the Fabry-Perot resonator for a few tens of nanoseconds is then successfully released by illuminating the silicon in the meta-atom with the laser light. It is also possible to use this method in the higher frequency region because metamaterials with semiconductor elements can even be used as active metamaterials in the optical region as long as their bandgap energy is higher than the signal photon energy.


title: Level $-1/2$ realization of quantum N-toroidal algebras in type $C_n$

abstract: We construct a level $-\frac{1}{2}$ vertex representation of the quantum N-toroidal algebra for type $C_n$, which is a natural generalization of the usual quantum toroidal algebra. The construction also provides a vertex representation of the quantum toroidal algebra for type $C_n$ as a by-product.


title: Inverse NN Modelling of a Piezoelectric Stage with Dominant Variable

abstract: This paper presents an approach for developing a neural network inverse model of a piezoelectric positioning stage, which exhibits rate-dependent, asymmetric hysteresis. It is shown that using both the velocity and the acceleration as inputs results in over-fitting. To overcome this, a rough analytical model of the actuator is derived and by measuring its response to excitation, the velocity signal is identified as the dominant variable. By setting the input space of the neural network to only the dominant variable, an inverse model with good predictive ability is obtained. Training of the network is accomplished using the Levenberg-Marquardt algorithm. Finally, the effectiveness of the proposed approach is experimentally demonstrated.


title: App-Aware Response Synthesis for User Reviews

abstract: Responding to user reviews promptly and satisfactorily improves application ratings, which is key to application popularity and success. The proliferation of such reviews makes it virtually impossible for developers to keep up with responding manually. To address this challenge, recent work has shown the possibility of automatic response generation. However, because the training review-response pairs are aggregated from many different apps, it remains challenging for such models to generate app-specific responses, which, on the other hand, are often desirable as apps have different features and concerns. Solving the challenge by simply building a model per app (i.e., training with review-response pairs of a single app) may be insufficient because individual apps have limited review-response pairs, and such pairs typically lack the relevant information needed to respond to a new review. To enable app-specific response generation, this work proposes AARSynth: an app-aware response synthesis system. The key idea behind AARSynth is to augment the seq2seq model with information specific to a given app. Given a new user review, it first retrieves the top-K most relevant app reviews and the most relevant snippet from the app description. The retrieved information and the new user review are then fed into a fused machine learning model that integrates the seq2seq model with a machine reading comprehension model. The latter helps digest the retrieved reviews and app description. Finally, the fused model generates a response that is customized to the given app. We evaluated AARSynth using a large corpus of reviews and responses from Google Play. The results show that AARSynth outperforms the state-of-the-art system by 22.2% on BLEU-4 score. Furthermore, our human study shows that AARSynth produces a statistically significant improvement in response quality compared to the state-of-the-art system.


title: Discovering the Sky at the Longest wavelengths with a lunar orbit array

abstract: Due to ionosphere absorption and the interference by natural and artificial radio emissions, astronomical observation from the ground becomes very difficult at the wavelengths of decametre or longer, which we shall refer as the ultralong wavelengths. This unexplored part of electromagnetic spectrum has the potential of great discoveries, notably in the study of cosmic dark ages and dawn, but also in heliophysics and space weather, planets and exoplanets, cosmic ray and neutrinos, pulsar and interstellar medium (ISM), extragalactic radio sources, and so on. The difficulty of the ionosphere can be overcome by space observation, and the Moon can shield the radio frequency interferences (RFIs) from the Earth. A lunar orbit array can be a practical first step of opening up the ultralong wave band. Compared with a lunar surface observatory on the far side, the lunar orbit array is simpler and more economical, as it does not need to make the risky and expensive landing, can be easily powered with solar energy, and the data can be transmitted back to the Earth when it is on the near-side part of the orbit. Here I describe the Discovering Sky at the Longest wavelength (DSL) project, which will consist of a mother satellite and 6~9 daughter satellites, flying on the same circular orbit around the Moon, and forming a linear interferometer array. The data are collected by the mother satellite which computes the interferometric cross-correlations (visibilities) and transmits the data back to the Earth. The whole array can be deployed on the lunar orbit with a single rocket launch. The project is under intensive study in China.


title: Applications of Quantum Computing for Investigations of Electronic Transitions in Phenylsulfonyl-carbazole TADF Emitters

abstract: A quantum chemistry study of the first singlet (S1) and triplet (T1) excited states of phenylsulfonyl-carbazole compounds, proposed as useful thermally activated delayed fluorescence (TADF) emitters for organic light emitting diode (OLED) applications, was performed with the quantum Equation-Of-Motion Variational Quantum Eigensolver (qEOM-VQE) and Variational Quantum Deflation (VQD) algorithms on quantum simulators and devices. These quantum simulations were performed with double zeta quality basis sets on an active space comprising the highest occupied and lowest unoccupied molecular orbitals (HOMO, LUMO) of the TADF molecules. The differences in energy separations between S1 and T1 ($\Delta E_{st}$) predicted by calculations on quantum simulators were found to be in excellent agreement with experimental data. Differences of 16 and 88 mHa with respect to exact energies were found for excited states by using the qEOM-VQE and VQD algorithms, respectively, to perform simulations on quantum devices without error mitigation. By utilizing error mitigation by state tomography to purify the quantum states and correct energy values, the large errors found for unmitigated results could be improved to differences of, at most, 3 mHa with respect to exact values. Consequently, excellent agreement could be found between values of $\Delta E_{st}$ predicted by quantum simulations and those found in experiments.


title: AR-Net: Adaptive Frame Resolution for Efficient Action Recognition

abstract: Action recognition is an open and challenging problem in computer vision. While current state-of-the-art models offer excellent recognition results, their computational expense limits their impact for many real-world applications. In this paper, we propose a novel approach, called AR-Net (Adaptive Resolution Network), that selects on-the-fly the optimal resolution for each frame conditioned on the input for efficient action recognition in long untrimmed videos. Specifically, given a video frame, a policy network is used to decide what input resolution should be used for processing by the action recognition model, with the goal of improving both accuracy and efficiency. We efficiently train the policy network jointly with the recognition model using standard back-propagation. Extensive experiments on several challenging action recognition benchmark datasets well demonstrate the efficacy of our proposed approach over state-of-the-art methods. The project page can be found at https://mengyuest.github.io/AR-Net


title: A Pyramid Recurrent Network for Predicting Crowdsourced Speech-Quality Ratings of Real-World Signals

abstract: The real-world capabilities of objective speech quality measures are limited since current measures (1) are developed from simulated data that does not adequately model real environments; or they (2) predict objective scores that are not always strongly correlated with subjective ratings. Additionally, a large dataset of real-world signals with listener quality ratings does not currently exist, which would help facilitate real-world assessment. In this paper, we collect and predict the perceptual quality of real-world speech signals that are evaluated by human listeners. We first collect a large quality rating dataset by conducting crowdsourced listening studies on two real-world corpora. We further develop a novel approach that predicts human quality ratings using a pyramid bidirectional long short term memory (pBLSTM) network with an attention mechanism. The results show that the proposed model achieves statistically lower estimation errors than prior assessment approaches, where the predicted scores strongly correlate with human judgments.


title: Electrically tuned hyperfine spectrum in neutral Tb(II)(Cp$^{\rm{iPr5}}$)$_2$ single-molecule magnet

abstract: Molecular spin qubits with long spin coherence time as well as non-invasive operation methods on such qubits are in high demand. It was shown that both molecular electronic and nuclear spin levels can be used as qubits. In solid state systems with dopants, an electric field was shown to effectively change the spacing between the nuclear spin qubit levels when the electron spin density is high at the nucleus of the dopant. Inspired by such solid-state systems, we propose that divalent lanthanide (Ln) complexes with an unusual electronic configuration of Ln$^{2+}$ have a strong interaction between the Ln nuclear spin and the electronic degrees of freedom, which renders electrical tuning of the interaction. As an example, we study electronic structure and hyperfine interaction of the $^{159}$Tb nucleus in a neutral Tb(II)(Cp$^{\rm{iPr5}}$)$_2$ single-molecule magnet (SMM) using the complete active space self-consistent field method with spin-orbit interaction included within the restricted active space state interaction. Our calculations show that the low-energy states arise from $4f^8(6s,5d_{z^2})^1$, 4$f^8$(5$d_{x^2-y^2}$)$^1$, and $4f^8(5d_{xy})^1$ configurations. We compute the hyperfine interaction parameters and the electronic-nuclear spectrum within our multiconfigurational approach. We find that the hyperfine interaction is about one order of magnitude greater than that for Tb(III)Pc$_2$ SMMs. This stems from the strong Fermi contact interaction between the Tb nuclear spin and the electron spin density at the nucleus that originates from the occupation of the $(6s,5d)$ orbitals. We also uncover that the response of the Fermi contact term to electric field results in electrical tuning of the electronic-nuclear level separations. This hyperfine Stark effect may be useful for applications of molecular nuclear spins for quantum computing.


title: ACRONYM IV: Three New, Young, Low-mass Spectroscopic Binaries

abstract: As part of our search for new low-mass members of nearby young moving groups (YMG), we discovered three low-mass, spectroscopic binaries, two of which are not kinematically associated with any known YMG. Using high-resolution optical spectroscopy, we measure the component and systemic radial velocities of the systems, as well as their lithium absorption and H$\alpha$ emission, both spectroscopic indicators of youth. One system (2MASS J02543316-5108313, M2.0+M3.0) we confirm as a member of the 40 Myr old Tuc-Hor moving group, but whose binarity was previously undetected. The second young binary (2MASS J08355977-3042306, K5.5+M1.5) is not a kinematic match to any known YMG, but each component exhibits lithium absorption and strong and wide H$\alpha$ emission indicative of active accretion, setting an upper age limit of 15 Myr. The third system (2MASS J10260210-4105537, M1.0+M3.0) has been hypothesized in the literature to be a member of the 10 Myr old TW Hya Association (TWA), but with our measured systemic velocity, shows the binary is in fact not part of any known YMG. This last system also has lithium absorption in each component, and has strong and variable H$\alpha$ emission, setting an upper age limit of 15 Myr based on the lithium detection.


title: DeepVA: Bridging Cognition and Computation through Semantic Interaction and Deep Learning

abstract: This paper examines how deep learning (DL) representations, in contrast to traditional engineered features, can support semantic interaction (SI) in visual analytics. SI attempts to model user's cognitive reasoning via their interaction with data items, based on the data features. We hypothesize that DL representations contain meaningful high-level abstractions that can better capture users' high-level cognitive intent. To bridge the gap between cognition and computation in visual analytics, we propose DeepVA (Deep Visual Analytics), which uses high-level deep learning representations for semantic interaction instead of low-level hand-crafted data features. To evaluate DeepVA and compare to SI models with lower-level features, we design and implement a system that extends a traditional SI pipeline with features at three different levels of abstraction. To test the relationship between task abstraction and feature abstraction in SI, we perform visual concept learning tasks at three different task abstraction levels, using semantic interaction with three different feature abstraction levels. DeepVA effectively hastened interactive convergence between cognitive understanding and computational modeling of the data, especially in high abstraction tasks.


title: Finite Versus Infinite Neural Networks: an Empirical Study

abstract: We perform a careful, thorough, and large scale empirical study of the correspondence between wide neural networks and kernel methods. By doing so, we resolve a variety of open questions related to the study of infinitely wide neural networks. Our experimental results include: kernel methods outperform fully-connected finite-width networks, but underperform convolutional finite width networks; neural network Gaussian process (NNGP) kernels frequently outperform neural tangent (NT) kernels; centered and ensembled finite networks have reduced posterior variance and behave more similarly to infinite networks; weight decay and the use of a large learning rate break the correspondence between finite and infinite networks; the NTK parameterization outperforms the standard parameterization for finite width networks; diagonal regularization of kernels acts similarly to early stopping; floating point precision limits kernel performance beyond a critical dataset size; regularized ZCA whitening improves accuracy; finite network performance depends non-monotonically on width in ways not captured by double descent phenomena; equivariance of CNNs is only beneficial for narrow networks far from the kernel regime. Our experiments additionally motivate an improved layer-wise scaling for weight decay which improves generalization in finite-width networks. Finally, we develop improved best practices for using NNGP and NT kernels for prediction, including a novel ensembling technique. Using these best practices we achieve state-of-the-art results on CIFAR-10 classification for kernels corresponding to each architecture class we consider.


title: Practical Detection of Trojan Neural Networks: Data-Limited and Data-Free Cases

abstract: When the training data are maliciously tampered, the predictions of the acquired deep neural network (DNN) can be manipulated by an adversary known as the Trojan attack (or poisoning backdoor attack). The lack of robustness of DNNs against Trojan attacks could significantly harm real-life machine learning (ML) systems in downstream applications, therefore posing widespread concern to their trustworthiness. In this paper, we study the problem of the Trojan network (TrojanNet) detection in the data-scarce regime, where only the weights of a trained DNN are accessed by the detector. We first propose a data-limited TrojanNet detector (TND), when only a few data samples are available for TrojanNet detection. We show that an effective data-limited TND can be established by exploring connections between Trojan attack and prediction-evasion adversarial attacks including per-sample attack as well as all-sample universal attack. In addition, we propose a data-free TND, which can detect a TrojanNet without accessing any data samples. We show that such a TND can be built by leveraging the internal response of hidden neurons, which exhibits the Trojan behavior even at random noise inputs. The effectiveness of our proposals is evaluated by extensive experiments under different model architectures and datasets including CIFAR-10, GTSRB, and ImageNet.


title: The role of elevated terrain and the Gulf of Mexico in the production of severe local storm environments over North America

abstract: The prevailing conceptual model for the production of severe local storm (SLS) environments over North America asserts that upstream elevated terrain and the Gulf of Mexico are both essential to their formation. This work tests this hypothesis using two prescribed-ocean climate model experiments with North American topography removed or the Gulf of Mexico converted to land and analyzes how SLS environments and associated synoptic-scale drivers (southerly Great Plains low-level jets, drylines, elevated mixed layers, and extratropical cyclones) change relative to a control historical run. Overall, SLS environments depend strongly on upstream elevated terrain but weakly on the Gulf of Mexico. Removing elevated terrain substantially reduces SLS environments especially over the continental interior due to broad reductions in both thermodynamic and kinematic parameters, leaving a more zonally-uniform residual distribution that is maximized near the Gulf coast and decays toward the continental interior. This response is associated with a strong reduction in synoptic-scale drivers and a cooler and drier mean-state atmosphere. Replacing the Gulf of Mexico with land modestly reduces SLS environments thermodynamically over the Great Plains and increases them kinematically over the eastern U.S, shifting the primary local maximum eastward into Illinois; it also eliminates the secondary, smaller local maximum over southern Texas. This response is associated with modest changes in synoptic-scale drivers and a warmer and drier lower-tropospheric mean state. These experiments provide insight into the role of elevated terrain and the Gulf of Mexico in modifying the spatial distribution and seasonality of SLS environments.


title: Model of the dynamics of an interface between a smectic phase and an isotropic phase of different density

abstract: Soft modulated phases have been shown to undergo complex morphological transitions, in which layer remodeling induced by mean and Gaussian curvatures plays a major role. This is the case in smectic films under thermal treatment, where focal conics can be reshaped into conical pyramids and concentric ring structures. We build on earlier research on a smectic-isotropic, two phase configuration in which diffusive evolution of the interface was driven by curvature, while mass transport was neglected. Here, we explicitly consider evaporation-condensation processes in a smectic phase with mass transport through a coexisting isotropic fluid phase, as well as the hydrodynamic stresses at the interface and the resulting flows. By employing the Coleman-Noll procedure, we derive a phase-field model that accounts for a varying density field coupled to smectic layering of the order parameter. The resulting equations govern the evolution of an interface between a modulated phase and an isotropic fluid phase with distinct densities, and they capture compressibility effects in the interfacial region and topological transitions. We first verify a numerical implementation of the governing equations by examining the dispersion relation for interfacial transverse modes. The inverse decay rate is shown to scale as $Q^{2}$ ($Q$ is the wavenumber of the perturbation) due to hydrodynamic effects, instead of the $Q^{4}$ expected for diffusive decay. Then, by integrating the equations forward in time, we investigate fluid flow on distorted layers and focal conics, and show how interfacial stresses and density contrast significantly determine the structure of the flow and the evolution of the configuration.


title: vWitness: Certifying Web Page Interactions with Computer Vision

abstract: Web servers service client requests, some of which might cause the web server to perform security-sensitive operations (e.g. money transfer, voting). An attacker may thus forge or maliciously manipulate such requests by compromising a web client. Unfortunately, a web server has no way of knowing whether the client from which it receives a request has been compromised or not -- current "best practice" defenses such as user authentication or network encryption cannot aid a server as they all assume web client integrity. To address this shortcoming, we propose vWitness, which "witnesses" the interactions of a user with a web page and certifies whether they match a specification provided by the web server, enabling the web server to know that the web request is user-intended. The main challenge that vWitness overcomes is that even benign clients introduce unpredictable variations in the way they render web pages. vWitness differentiates between these benign variations and malicious manipulation using computer vision, allowing it to certify to the web server that 1) the web page user interface is properly displayed 2) observed user interactions are used to construct the web request. Our vWitness prototype achieves compatibility with modern web pages, is resilient to adversarial example attacks and is accurate and performant -- vWitness achieves 99.97% accuracy and adds 197ms of overhead to the entire interaction session in the average case.


title: Abelian quotients arising from extriangulated categories via morphism categories

abstract: We investigate abelian quotients arising from extriangulated categories via morphism categories, which is a unified treatment for both exact categories and triangulated categories. Let $(\mathcal{C},\mathbb{E},\mathfrak{s})$ be an extriangulated category with enough projectives $\mathcal{P}$ and $\mathcal{M}$ be a full subcategory of $\mathcal{C}$ containing $\mathcal{P}$. We show that certain quotient category of $\mathfrak{s}\textup{-def}(\mathcal{M})$, the category of $\mathfrak{s}$-deflations $f:M_{1}\rightarrow M_2$ with $M_1,M_2\in\mathcal{M}$, is abelian. Our main theorem has two applications. If $\mathcal{M}=\mathcal{C}$, we obtain that certain ideal quotient category $\mathfrak{s}\textup{-tri}(\mathcal{C})/\mathcal{R}_2$ is equivalent to the category of finitely presented modules $\textup{mod-}\mathcal{C}/[\mathcal{P}]$, where $\mathfrak{s}$-tri$(\mathcal{C})$ is the category of all $\mathfrak{s}$-triangles. If $\mathcal{M}$ is a rigid subcategory, we show that $\mathcal{M}_{L}/[\mathcal{M}]\cong\textup{mod-}(\mathcal{M}/[\mathcal{P}])$ and $\mathcal{M}_{L}/[\Omega\mathcal{M}]\cong(\textup{mod-}(\mathcal{M}/[\mathcal{P}])^{\textup{op}})^{\textup{op}}$, where $\mathcal{M}_L$ (resp. $\Omega\mathcal{M}$) is the full subcategory of $\mathcal{C}$ of objects $X$ admitting an $\mathfrak{s}$-triangle $\xymatrixrowsep{0.1pc}\xymatrix{X\ar[r]&M_1\ar[r] & M_2\ar@{-->}[r]&} (\textup{resp.} \xymatrixrowsep{0.1pc}\xymatrix{X\ar[r]&P\ar[r] & M\ar@{-->}[r]&})$ with $M_1, M_2\in\mathcal{M}$ (resp. $M\in\mathcal{M}$ and $P\in\mathcal{P}$). In particular, we have $\mathcal{C}/[\mathcal{M}]\cong\textup{mod-}(\mathcal{M}/[\mathcal{P}])$ and $\mathcal{C}/[\Omega\mathcal{M}]\cong(\textup{mod-}(\mathcal{M}/[\mathcal{P}])^{\textup{op}})^{\textup{op}}$ provided that $\mathcal{M}$ is a cluster-tilting subcategory.


title: Seating preference analysis for hybrid workplaces

abstract: Due to the increasing nature of flexible work and the recent requirements from COVID-19 restrictions, workplaces are becoming more hybrid (i.e. allowing workers to work between traditional office spaces and elsewhere including from home). Since workplaces are different in design, layout and available facilities, many workers find it difficult to adjust accordingly. Eventually, this impacts negatively towards work productivity and other related parameters including concentration, stress, and mood while at work. One of the key factors that causes this negative work experience is directly linked to the available seating arrangements. In this paper, we conduct an analysis to understand various seating preferences of 37 workers with varying demographics, using the data collected pre-COVID-19, and analyse the findings in the context of hybrid workplace settings. We also discuss a list of implications illustrating how our findings can be adapted across wider hybrid work settings.


title: Breaking simple quantum position verification protocols with little entanglement

abstract: Instantaneous nonlocal quantum computation (INQC) evades apparent quantum and relativistic constraints and allows to attack generic quantum position verification (QPV) protocols (aiming at securely certifying the location of a distant prover) at an exponential entanglement cost. We consider adversaries sharing maximally entangled pairs of qudits and find low-dimensional INQC attacks against the simple practical family of QPV protocols based on single photons polarized at an angle $\theta$. We find exact attacks against some rational angles, including some sitting outside of the Clifford hierarchy (e.g. $\pi/6$), and show no $\theta$ allows to tolerate errors higher than $\simeq 5\cdot 10^{-3}$ against adversaries holding two ebits per protocol's qubit.


title: Numerical integrators for continuous disordered nonlinear Schr\"odinger equation

abstract: In this paper, we consider the numerical solution of the continuous disordered nonlinear Schr\"odinger equation, which contains a spatial random potential. We address the finite time accuracy order reduction issue of the usual numerical integrators on this problem, which is due to the presence of the random/rough potential. By using the recently proposed low-regularity integrator (LRI) from (33, SIAM J. Numer. Anal., 2019), we show how to integrate the potential term by losing two spatial derivatives. Convergence analysis is done to show that LRI has the second order accuracy in $L^2$-norm for potentials in $H^2$. Numerical experiments are done to verify this theoretical result. More numerical results are presented to investigate the accuracy of LRI compared with classical methods under rougher random potentials from applications.


title: Creating topological polar structure in a nonpolar matter

abstract: Nontrivial topological structures offer rich playground in condensed matter physics including fluid dynamics, superconductivity, and ferromagnetism, and they promise alternative device configurations for post-Moore spintronics and electronics. Indeed, magnetic skyrmions are actively pursued for high-density data storage, while polar vortices with exotic negative capacitance may enable ultralow power consumption in microelectronics. Following extensive investigations on a variety of magnetic textures including vortices, domain walls and skyrmions in the past decades, studies on polar topologies have taken off in recent years, resulting in discoveries of closure domains, vortices, and skyrmions in ferroelectric materials. Nevertheless, the atomic-scale creation of topological polar structures is largely confined in a single ferroelectric system, PbTiO3 (PTO) with large polarization, casting doubt on the generality of polar topologies and limiting their potential applications. In this work, we successfully create previously unrealized atomic-scale polar antivortices in the nominally nonpolar SrTiO3 (STO), expanding the reaches of topological structures and completing an important missing link in polar topologies. The work shed considerable new insight into the formation of topological polar structures, and offers guidance in searching for new polar textures.


title: Non-Adiabatic Effects of Nuclear Motion in Quantum Transport of Electrons: A Self-Consistent Keldysh-Langevin Study

abstract: The molecular junction geometry is modelled in terms of nuclear degrees of freedom that are embedded in a stochastic quantum environment of non-equilibrium electrons. Time-evolution of the molecular geometry is governed via a mean force, a frictional force and a stochastic force, forces arising from many electrons tunnelling across the junction for a given nuclear vibration. Conversely, the current-driven nuclear dynamics feed back to the electronic current, which can be captured according extended expressions for the current that have explicit dependencies on classical nuclear velocities and accelerations. Current-induced nuclear forces and the non-adiabatic electric current are computed using non-equilibrium Green's functions via a time-scale separation solution of Keldysh-Kadanoff-Baym equations in Wigner space. Applying the theory to molecular junctions demonstrated that non-adiabatic corrections play an important role when nuclear motion is considered non-equilibrium and, in particular, showed that non-equilibrium and equilibrium descriptions of nuclear motion produce significantly different current characteristics. It is observed that non-equilibrium descriptions generally produce heightened conductance profiles relative to the equilibrium descriptions and provide evidence that the effective temperature is an effective measure of the steady-state characteristics. Finally, we observe that non-equilibrium descriptions of nuclear motion can give rise to the Landauer blowtorch effect via the emergence of multi-minima potential energy surfaces in conjunction with non-uniform temperature profiles. The Landauer blowtorch effect and its impact on the current characteristics, waiting times and the Fano factor are explored for an effective adiabatic potential that morphs between a single, double and triple potential as a function of voltage.


title: Sparse tree-based clustering of microbiome data to characterize microbiome heterogeneity in pancreatic cancer

abstract: There is a keen interest in characterizing variation in the microbiome across cancer patients, given increasing evidence of its important role in determining treatment outcomes. Here our goal is to discover subgroups of patients with similar microbiome profiles. We propose a novel unsupervised clustering approach in the Bayesian framework that innovates over existing model-based clustering approaches, such as the Dirichlet multinomial mixture model, in three key respects: we incorporate feature selection, learn the appropriate number of clusters from the data, and integrate information on the tree structure relating the observed features. We compare the performance of our proposed method to existing methods on simulated data designed to mimic real microbiome data. We then illustrate results obtained for our motivating data set, a clinical study aimed at characterizing the tumor microbiome of pancreatic cancer patients.


title: Language Modelling for Source Code with Transformer-XL

abstract: It has been found that software, like natural language texts, exhibits "naturalness", which can be captured by statistical language models. In recent years, neural language models have been proposed to represent the naturalness of software through deep learning. In this paper, we conduct an experimental evaluation of state-of-the-art neural language models for source code, including RNN-based models and Transformer-XL based models. Through experiments on a large-scale Python code corpus, we find that the Transformer-XL model outperforms RNN-based models (including LSTM and GRU models) in capturing the naturalness of software, with far less computational cost.


title: Performance of Multi-group DIF Methods in Assessing Cross-Country Score Comparability of International Large-Scale Assessments

abstract: Standardized large-scale testing can be a debatable topic, in which test fairness sits at its very core. This study found that two out of five recent multi-group DIF detection methods are capable of capturing both the uniform and nonuniform DIF that affects test fairness. Still, no prior research has demonstrated the relative performance of these two methods when they are compared with each other. These two methods are the improved Wald test and the generalized logistic regression procedure. This study assessed the commonalities and differences between two sets of empirical results from these two methods with the latest TIMSS math score data. The primary conclusion was that the improved Wald test is relatively more established than the generalized logistic regression procedure for multi-group DIF analysis. Empirical results from this study may inform the selection of a multi-group DIF method in the ILSA score analysis.


title: Looking At The Body: Automatic Analysis of Body Gestures and Self-Adaptors in Psychological Distress

abstract: Psychological distress is a significant and growing issue in society. Automatic detection, assessment, and analysis of such distress is an active area of research. Compared to modalities such as face, head, and vocal, research investigating the use of the body modality for these tasks is relatively sparse. This is, in part, due to the limited available datasets and difficulty in automatically extracting useful body features. Recent advances in pose estimation and deep learning have enabled new approaches to this modality and domain. To enable this research, we have collected and analyzed a new dataset containing full body videos for short interviews and self-reported distress labels. We propose a novel method to automatically detect self-adaptors and fidgeting, a subset of self-adaptors that has been shown to be correlated with psychological distress. We perform analysis on statistical body gestures and fidgeting features to explore how distress levels affect participants' behaviors. We then propose a multi-modal approach that combines different feature representations using Multi-modal Deep Denoising Auto-Encoders and Improved Fisher Vector Encoding. We demonstrate that our proposed model, combining audio-visual features with automatically detected fidgeting behavioral cues, can successfully predict distress levels in a dataset labeled with self-reported anxiety and depression levels.


title: Denoising individual bias for a fairer binary submatrix detection

abstract: Low rank representation of binary matrix is powerful in disentangling sparse individual-attribute associations, and has received wide applications. Existing binary matrix factorization (BMF) or co-clustering (CC) methods often assume i.i.d background noise. However, this assumption could be easily violated in real data, where heterogeneous row- or column-wise probability of binary entries results in disparate element-wise background distribution, and paralyzes the rationality of existing methods. We propose a binary data denoising framework, namely BIND, which optimizes the detection of true patterns by estimating the row- or column-wise mixture distribution of patterns and disparate background, and eliminating the binary attributes that are more likely from the background. BIND is supported by thoroughly derived mathematical property of the row- and column-wise mixture distributions. Our experiment on synthetic and real-world data demonstrated BIND effectively removes background noise and drastically increases the fairness and accuracy of state-of-the arts BMF and CC methods.


title: Robust Template Matching via Hierarchical Convolutional Features from a Shape Biased CNN

abstract: Finding a template in a search image is an important task underlying many computer vision applications. Recent approaches perform template matching in a deep feature-space, produced by a convolutional neural network (CNN), which is found to provide more tolerance to changes in appearance. In this article we investigate if enhancing the CNN's encoding of shape information can produce more distinguishable features that improve the performance of template matching. This investigation results in a new template matching method that produces state-of-the-art results on a standard benchmark. To confirm these results we also create a new benchmark and show that the proposed method also outperforms existing techniques on this new dataset. Our code and dataset is available at: https://github.com/iminfine/Deep-DIM.


title: Neural Compression and Filtering for Edge-assisted Real-time Object Detection in Challenged Networks

abstract: The edge computing paradigm places compute-capable devices - edge servers - at the network edge to assist mobile devices in executing data analysis tasks. Intuitively, offloading compute-intense tasks to edge servers can reduce their execution time. However, poor conditions of the wireless channel connecting the mobile devices to the edge servers may degrade the overall capture-to-output delay achieved by edge offloading. Herein, we focus on edge computing supporting remote object detection by means of Deep Neural Networks (DNNs), and develop a framework to reduce the amount of data transmitted over the wireless link. The core idea we propose builds on recent approaches splitting DNNs into sections - namely head and tail models - executed by the mobile device and edge server, respectively. The wireless link, then, is used to transport the output of the last layer of the head model to the edge server, instead of the DNN input. Most prior work focuses on classification tasks and leaves the DNN structure unaltered. Herein, our focus is on DNNs for three different object detection tasks, which present a much more convoluted structure, and modify the architecture of the network to: (i) achieve in-network compression by introducing a bottleneck layer in the early layers on the head model, and (ii) prefilter pictures that do not contain objects of interest using a convolutional neural network. Results show that the proposed technique represents an effective intermediate option between local and edge computing in a parameter region where these extreme point solutions fail to provide satisfactory performance. The code and trained models are available at https://github.com/yoshitomo-matsubara/hnd-ghnd-object-detectors .


title: m-weak group inverses in a ring with involution

abstract: In a unitary ring with involution, we prove that each element has at most one weak group inverse if and only if each idempotent element has a unique weak group inverse. Furthermore, we define the $m$-weak group inverse and show some properties of $m$-weak group inverse.


title: Photorealism in Driving Simulations: Blending Generative Adversarial Image Synthesis with Rendering

abstract: Driving simulators play a large role in developing and testing new intelligent vehicle systems. The visual fidelity of the simulation is critical for building vision-based algorithms and conducting human driver experiments. Low visual fidelity breaks immersion for human-in-the-loop driving experiments. Conventional computer graphics pipelines use detailed 3D models, meshes, textures, and rendering engines to generate 2D images from 3D scenes. These processes are labor-intensive, and they do not generate photorealistic imagery. Here we introduce a hybrid generative neural graphics pipeline for improving the visual fidelity of driving simulations. Given a 3D scene, we partially render only important objects of interest, such as vehicles, and use generative adversarial processes to synthesize the background and the rest of the image. To this end, we propose a novel image formation strategy to form 2D semantic images from 3D scenery consisting of simple object models without textures. These semantic images are then converted into photorealistic RGB images with a state-of-the-art Generative Adversarial Network (GAN) trained on real-world driving scenes. This replaces repetitiveness with randomly generated but photorealistic surfaces. Finally, the partially-rendered and GAN synthesized images are blended with a blending GAN. We show that the photorealism of images generated with the proposed method is more similar to real-world driving datasets such as Cityscapes and KITTI than conventional approaches. This comparison is made using semantic retention analysis and Frechet Inception Distance (FID) measurements.


title: Geometric All-Way Boolean Tensor Decomposition

abstract: Boolean tensor has been broadly utilized in representing high dimensional logical data collected on spatial, temporal and/or other relational domains. Boolean Tensor Decomposition (BTD) factorizes a binary tensor into the Boolean sum of multiple rank-1 tensors, which is an NP-hard problem. Existing BTD methods have been limited by their high computational cost, in applications to large scale or higher order tensors. In this work, we presented a computationally efficient BTD algorithm, namely \textit{Geometric Expansion for all-order Tensor Factorization} (GETF), that sequentially identifies the rank-1 basis components for a tensor from a geometric perspective. We conducted rigorous theoretical analysis on the validity as well as algorithemic efficiency of GETF in decomposing all-order tensor. Experiments on both synthetic and real-world data demonstrated that GETF has significantly improved performance in reconstruction accuracy, extraction of latent structures and it is an order of magnitude faster than other state-of-the-art methods.


title: Well-quasi-ordering digraphs with no long alternating paths by the strong immersion relation

abstract: Nash-Williams' Strong Immersion Conjecture states that graphs are well-quasi-ordered by the strong immersion relation. That is, given infinitely many graphs, one graph contains another graph as a strong immersion. In this paper we study the analogous problem for directed graphs. It is known that digraphs are not well-quasi-ordered by the strong immersion relation, but for all known such infinite antichains, paths that change direction arbitrarily many times can be found. This paper proves that the converse statement is true: for every positive integer $k$, the digraphs that do not contain a path that changes direction $k$ times are well-quasi-ordered by the strong immersion relation, even when vertices are labelled by a well-quasi-order. This result is optimal for classes of digraphs closed under taking subgraphs since paths that change direction arbitrarily many times with vertex-labels form an infinite antichain with respect to the strong immersion relation.


title: Explainable Prediction of Text Complexity: The Missing Preliminaries for Text Simplification

abstract: Text simplification reduces the language complexity of professional content for accessibility purposes. End-to-end neural network models have been widely adopted to directly generate the simplified version of input text, usually functioning as a blackbox. We show that text simplification can be decomposed into a compact pipeline of tasks to ensure the transparency and explainability of the process. The first two steps in this pipeline are often neglected: 1) to predict whether a given piece of text needs to be simplified, and 2) if yes, to identify complex parts of the text. The two tasks can be solved separately using either lexical or deep learning methods, or solved jointly. Simply applying explainable complexity prediction as a preliminary step, the out-of-sample text simplification performance of the state-of-the-art, black-box simplification models can be improved by a large margin.


title: Evaluating Semantic Interaction on Word Embeddings via Simulation

abstract: Semantic interaction (SI) attempts to learn the user's cognitive intents as they directly manipulate data projections during sensemaking activity. For text analysis, prior implementations of SI have used common data features, such as bag-of-words representations, for machine learning from user interactions. Instead, we hypothesize that features derived from deep learning word embeddings will enable SI to better capture the user's subtle intents. However, evaluating these effects is difficult. SI systems are usually evaluated by a human-centred qualitative approach, by observing the utility and effectiveness of the application for end-users. This approach has drawbacks in terms of replicability, scalability, and objectiveness, which makes it hard to perform convincing contrast experiments between different SI models. To tackle this problem, we explore a quantitative algorithm-centered analysis as a complementary evaluation approach, by simulating users' interactions and calculating the accuracy of the learned model. We use these methods to compare word-embeddings to bag-of-words features for SI.


title: Large quotients of group actions with a contracting element

abstract: For any proper action of a non-elementary group $G$ on a proper geodesic metric space, we show that if $G$ contains a contracting element, then there exists a sequence of proper quotient groups whose growth rate tends to the growth rate of $G$. Similar statements are obtained for a product of proper actions with contracting elements. The tools involved in this paper include the extension lemma for the construction of large tree, the theory of rotating families developed by F. Dahmani, V. Guirardel and D. Osin, and the construction of a quasi-tree of metric spaces introduced by M. Bestvina, K. Bromberg and K. Fujiwara. Several applications are given to CAT(0) groups and mapping class groups.


title: The Impact of Distance on Performance and Scalability of Distributed Database Systems in Hybrid Clouds

abstract: The increasing need for managing big data has led the emergence of advanced database management systems. There has been increased efforts aimed at evaluating the performance and scalability of NoSQL and Relational databases hosted by either private or public cloud datacenters. However, there has been little work on evaluating the performance and scalability of these databases in hybrid clouds, where the distance between private and public cloud datacenters can be one of the key factors that can affect their performance. Hence, in this paper, we present a detailed evaluation of throughput, scalability, and VMs size vs. VMs number for six modern databases in a hybrid cloud, consisting of a private cloud in Adelaide and Azure based datacenter in Sydney, Mumbai, and Virginia regions. Based on results, as the distance between private and public clouds increases, the throughput performance of most databases reduces. Second, MongoDB obtains the best throughput performance, followed by MySQL C luster, whilst Cassandra exposes the most fluctuation in through performance. Third, vertical scalability improves the throughput of databases more than the horizontal scalability. Forth, exploiting bigger VMs rather than more VMs with less cores can increase throughput performance for Cassandra, Riak, and Redis.


title: A regularity method for lower bounds on the Lyapunov exponent for stochastic differential equations

abstract: We put forward a new method for obtaining quantitative lower bounds on the top Lyapunov exponent of stochastic differential equations (SDEs). Our method combines (i) an (apparently new) identity connecting the top Lyapunov exponent to a Fisher information-like functional of the stationary density of the Markov process tracking tangent directions with (ii) a novel, quantitative version of H\"ormander's hypoelliptic regularity theory in an $L^1$ framework which estimates this (degenerate) Fisher information from below by a $W^{s,1}_{\mathrm{loc}}$ Sobolev norm. This method is applicable to a wide range of systems beyond the reach of currently existing mathematically rigorous methods. As an initial application, we prove the positivity of the top Lyapunov exponent for a class of weakly-dissipative, weakly forced SDE; in this paper we prove that this class includes the Lorenz 96 model in any dimension, provided the additive stochastic driving is applied to any consecutive pair of modes.


title: Topology Density Map for Urban Data Visualization and Analysis

abstract: Density map is an effective visualization technique for depicting the scalar field distribution in 2D space. Conventional methods for constructing density maps are mainly based on Euclidean distance, limiting their applicability in urban analysis that shall consider road network and urban traffic. In this work, we propose a new method named Topology Density Map, targeting for accurate and intuitive density maps in the context of urban environment. Based on the various constraints of road connections and traffic conditions, the method first constructs a directed acyclic graph (DAG) that propagates nonlinear scalar fields along 1D road networks. Next, the method extends the scalar fields to a 2D space by identifying key intersecting points in the DAG, dividing the underlying territory into planar regions using a weighted Voronoi diagram, and calculating the scalar fields for every point. Two case studies demonstrate that the Topology Density Map supplies accurate information to users and provides an intuitive visualization for decision making. An interview with domain experts demonstrates the feasibility, usability, and effectiveness of our method.


title: Adversarial Bipartite Graph Learning for Video Domain Adaptation

abstract: Domain adaptation techniques, which focus on adapting models between distributionally different domains, are rarely explored in the video recognition area due to the significant spatial and temporal shifts across the source (i.e. training) and target (i.e. test) domains. As such, recent works on visual domain adaptation which leverage adversarial learning to unify the source and target video representations and strengthen the feature transferability are not highly effective on the videos. To overcome this limitation, in this paper, we learn a domain-agnostic video classifier instead of learning domain-invariant representations, and propose an Adversarial Bipartite Graph (ABG) learning framework which directly models the source-target interactions with a network topology of the bipartite graph. Specifically, the source and target frames are sampled as heterogeneous vertexes while the edges connecting two types of nodes measure the affinity among them. Through message-passing, each vertex aggregates the features from its heterogeneous neighbors, forcing the features coming from the same class to be mixed evenly. Explicitly exposing the video classifier to such cross-domain representations at the training and test stages makes our model less biased to the labeled source data, which in-turn results in achieving a better generalization on the target domain. To further enhance the model capacity and testify the robustness of the proposed architecture on difficult transfer tasks, we extend our model to work in a semi-supervised setting using an additional video-level bipartite graph. Extensive experiments conducted on four benchmarks evidence the effectiveness of the proposed approach over the SOTA methods on the task of video recognition.


title: Unsupervised Outlier Detection in Heavy-Ion Collisions

abstract: We present different methods of unsupervised learning which can be used for outlier detection in high energy nuclear collisions. The UrQMD model is used to generate the bulk background of events as well as different variants of outlier events which may result from misidentified centrality or detector malfunctions. The methods presented here can be generalized to different and novel physics effects. To detect the outliers, dimensional reduction algorithms are implemented, specifically the Principle Component Analysis (PCA) and Autoencoders (AEN). We find that mainly the reconstruction error is a good measure to distinguish outliers from background. The performance of the algorithms is compared using a ROC curve. It is shown that the number of reduced (encoded) dimensions to describe a single event contributes significantly to the performance of the outlier detection task. We find that the model which is best suited to separate outlier events requires a good performance in reconstructing events and at the same time a small number of parameters.


title: OREBA: A Dataset for Objectively Recognizing Eating Behaviour and Associated Intake

abstract: Automatic detection of intake gestures is a key element of automatic dietary monitoring. Several types of sensors, including inertial measurement units (IMU) and video cameras, have been used for this purpose. The common machine learning approaches make use of the labeled sensor data to automatically learn how to make detections. One characteristic, especially for deep learning models, is the need for large datasets. To meet this need, we collected the Objectively Recognizing Eating Behavior and Associated Intake (OREBA) dataset. The OREBA dataset aims to provide comprehensive multi-sensor data recorded during the course of communal meals for researchers interested in intake gesture detection. Two scenarios are included, with 100 participants for a discrete dish and 102 participants for a shared dish, totalling 9069 intake gestures. Available sensor data consists of synchronized frontal video and IMU with accelerometer and gyroscope for both hands. We report the details of data collection and annotation, as well as details of sensor processing. The results of studies on IMU and video data involving deep learning models are reported to provide a baseline for future research. Specifically, the best baseline models achieve performances of $F_1$ = 0.853 for the discrete dish using video and $F_1$ = 0.852 for the shared dish using inertial data.


title: SafetyLens: Visual Data Analysis of Functional Safety of Vehicles

abstract: Modern automobiles have evolved from just being mechanical machines to having full-fledged electronics systems that enhance vehicle dynamics and driver experience. However, these complex hardware and software systems, if not properly designed, can experience failures that can compromise the safety of the vehicle, its occupants, and the surrounding environment. For example, a system to activate the brakes to avoid a collision saves lives when it functions properly, but could lead to tragic outcomes if the brakes were applied in a way that's inconsistent with the design. Broadly speaking, the analysis performed to minimize such risks falls into a systems engineering domain called Functional Safety. In this paper, we present SafetyLens, a visual data analysis tool to assist engineers and analysts in analyzing automotive Functional Safety datasets. SafetyLens combines techniques including network exploration and visual comparison to help analysts perform domain-specific tasks. This paper presents the design study with domain experts that resulted in the design guidelines, the tool, and user feedback.


title: Ergodicity Bounds for the Markovian Queue With Time-Varying Transition Intensities, Batch Arrivals and One Queue Skipping Policy

abstract: In this paper we revisit the Markovian queueing system with a single server, infinite capacity queue and the special queue skipping policy. Customers arrive in batches, but are served one by one according to any conservative discipline. The size of the arriving batch becomes known upon its arrival and at any time instant the total number of customers in the system is also known. According to the adopted queue skipping policy if a batch, which size is greater than the current system size, arrives to the system, all current customers in the system are removed from it and the new batch is placed in the queue. Otherwise the new batch is lost. The distribution of the total number of customers in the system is under consideration under assumption that the arrival intensity $\lambda(t)$ and/or the service intensity $\mu(t)$ are non-random functions of time. We provide the method for the computation of the upper bounds for the rate of convergence of system size to the limiting regime, whenever it exists, for any bounded $\lambda(t)$ and $\mu(t)$ (not necessarily periodic) and any distribution of the batch size. For periodic intensities $\lambda(t)$ and/or $\mu(t)$ and light-tailed distribution of the batch size it is shown how the obtained bounds can be used to numerically compute the limiting distribution of the queue size with the given error. Illustrating numerical examples are provided.


title: Geometric analysis on manifolds with ends

abstract: In this survey article, we discuss some recent progress on geometric analysis on manifold with ends. In the final section, we construct manifolds with ends with oscillating volume functions which may turn out to have a different heat kernel estimates from those provided by known results.


title: Deep Direct Likelihood Knockoffs

abstract: Predictive modeling often uses black box machine learning methods, such as deep neural networks, to achieve state-of-the-art performance. In scientific domains, the scientist often wishes to discover which features are actually important for making the predictions. These discoveries may lead to costly follow-up experiments and as such it is important that the error rate on discoveries is not too high. Model-X knockoffs enable important features to be discovered with control of the FDR. However, knockoffs require rich generative models capable of accurately modeling the knockoff features while ensuring they obey the so-called "swap" property. We develop Deep Direct Likelihood Knockoffs (DDLK), which directly minimizes the KL divergence implied by the knockoff swap property. DDLK consists of two stages: it first maximizes the explicit likelihood of the features, then minimizes the KL divergence between the joint distribution of features and knockoffs and any swap between them. To ensure that the generated knockoffs are valid under any possible swap, DDLK uses the Gumbel-Softmax trick to optimize the knockoff generator under the worst-case swap. We find DDLK has higher power than baselines while controlling the false discovery rate on a variety of synthetic and real benchmarks including a task involving a large dataset from one of the epicenters of COVID-19.


title: TEAM: We Need More Powerful Adversarial Examples for DNNs

abstract: Although deep neural networks (DNNs) have achieved success in many application fields, it is still vulnerable to imperceptible adversarial examples that can lead to misclassification of DNNs easily. To overcome this challenge, many defensive methods are proposed. Indeed, a powerful adversarial example is a key benchmark to measure these defensive mechanisms. In this paper, we propose a novel method (TEAM, Taylor Expansion-Based Adversarial Methods) to generate more powerful adversarial examples than previous methods. The main idea is to craft adversarial examples by minimizing the confidence of the ground-truth class under untargeted attacks or maximizing the confidence of the target class under targeted attacks. Specifically, we define the new objective functions that approximate DNNs by using the second-order Taylor expansion within a tiny neighborhood of the input. Then the Lagrangian multiplier method is used to obtain the optimize perturbations for these objective functions. To decrease the amount of computation, we further introduce the Gauss-Newton (GN) method to speed it up. Finally, the experimental result shows that our method can reliably produce adversarial examples with 100% attack success rate (ASR) while only by smaller perturbations. In addition, the adversarial example generated with our method can defeat defensive distillation based on gradient masking.


title: ETH-XGaze: A Large Scale Dataset for Gaze Estimation under Extreme Head Pose and Gaze Variation

abstract: Gaze estimation is a fundamental task in many applications of computer vision, human computer interaction and robotics. Many state-of-the-art methods are trained and tested on custom datasets, making comparison across methods challenging. Furthermore, existing gaze estimation datasets have limited head pose and gaze variations, and the evaluations are conducted using different protocols and metrics. In this paper, we propose a new gaze estimation dataset called ETH-XGaze, consisting of over one million high-resolution images of varying gaze under extreme head poses. We collect this dataset from 110 participants with a custom hardware setup including 18 digital SLR cameras and adjustable illumination conditions, and a calibrated system to record ground truth gaze targets. We show that our dataset can significantly improve the robustness of gaze estimation methods across different head poses and gaze angles. Additionally, we define a standardized experimental protocol and evaluation metric on ETH-XGaze, to better unify gaze estimation research going forward. The dataset and benchmark website are available at https://ait.ethz.ch/projects/2020/ETH-XGaze


title: Representation Learning of Graphs Using Graph Convolutional Multilayer Networks Based on Motifs

abstract: The graph structure is a commonly used data storage mode, and it turns out that the low-dimensional embedded representation of nodes in the graph is extremely useful in various typical tasks, such as node classification, link prediction , etc. However, most of the existing approaches start from the binary relationship (i.e., edges) in the graph and have not leveraged the higher order local structure (i.e., motifs) of the graph. Here, we propose mGCMN -- a novel framework which utilizes node feature information and the higher order local structure of the graph to effectively generate node embeddings for previously unseen data. Through research we have found that different types of networks have different key motifs. And the advantages of our method over the baseline methods have been demonstrated in a large number of experiments on citation network and social network datasets. At the same time, a positive correlation between increase of the classification accuracy and the clustering coefficient is revealed. It is believed that using high order structural information can truly manifest the potential of the network, which will greatly improve the learning efficiency of the graph neural network and promote a brand-new learning mode establishment.


title: Robust and Heavy-Tailed Mean Estimation Made Simple, via Regret Minimization

abstract: We study the problem of estimating the mean of a distribution in high dimensions when either the samples are adversarially corrupted or the distribution is heavy-tailed. Recent developments in robust statistics have established efficient and (near) optimal procedures for both settings. However, the algorithms developed on each side tend to be sophisticated and do not directly transfer to the other, with many of them having ad-hoc or complicated analyses. In this paper, we provide a meta-problem and a duality theorem that lead to a new unified view on robust and heavy-tailed mean estimation in high dimensions. We show that the meta-problem can be solved either by a variant of the Filter algorithm from the recent literature on robust estimation or by the quantum entropy scoring scheme (QUE), due to Dong, Hopkins and Li (NeurIPS '19). By leveraging our duality theorem, these results translate into simple and efficient algorithms for both robust and heavy-tailed settings. Furthermore, the QUE-based procedure has run-time that matches the fastest known algorithms on both fronts. Our analysis of Filter is through the classic regret bound of the multiplicative weights update method. This connection allows us to avoid the technical complications in previous works and improve upon the run-time analysis of a gradient-descent-based algorithm for robust mean estimation by Cheng, Diakonikolas, Ge and Soltanolkotabi (ICML '20).


title: A Survey on Concept Factorization: From Shallow to Deep Representation Learning

abstract: The quality of learned features by representation learning determines the performance of learning algorithms and the related application tasks (such as high-dimensional data clustering). As a relatively new paradigm for representation learning, Concept Factorization (CF) has attracted a great deal of interests in the areas of machine learning and data mining for over a decade. Lots of effective CF based methods have been proposed based on different perspectives and properties, but note that it still remains not easy to grasp the essential connections and figure out the underlying explanatory factors from exiting studies. In this paper, we therefore survey the recent advances on CF methodologies and the potential benchmarks by categorizing and summarizing the current methods. Specifically, we first re-view the root CF method, and then explore the advancement of CF-based representation learning ranging from shallow to deep/multilayer cases. We also introduce the potential application areas of CF-based methods. Finally, we point out some future directions for studying the CF-based representation learning. Overall, this survey provides an insightful overview of both theoretical basis and current developments in the field of CF, which can also help the interested researchers to understand the current trends of CF and find the most appropriate CF techniques to deal with particular applications.


title: Estimating Motion Codes from Demonstration Videos

abstract: A motion taxonomy can encode manipulations as a binary-encoded representation, which we refer to as motion codes. These motion codes innately represent a manipulation action in an embedded space that describes the motion's mechanical features, including contact and trajectory type. The key advantage of using motion codes for embedding is that motions can be more appropriately defined with robotic-relevant features, and their distances can be more reasonably measured using these motion features. In this paper, we develop a deep learning pipeline to extract motion codes from demonstration videos in an unsupervised manner so that knowledge from these videos can be properly represented and used for robots. Our evaluations show that motion codes can be extracted from demonstrations of action in the EPIC-KITCHENS dataset.


title: Scheme for sub-shot-noise transmission measurement using a time multiplexed single-photon source

abstract: A promising result from optical quantum metrology is the ability to achieve sub-shot-noise performance in transmission or absorption measurements. This is due to the significantly lower uncertainty in light intensity of quantum beams with respect to their classical counterparts. In this work, we simulate the outcome of an experiment that uses a multiplexed single-photon source based on pair generation by continuous spontaneous parametric down conversion (SPDC) followed by a time multiplexing set-up with a binary temporal division strategy, considering several types of experimental losses. With such source, the sub-Poissonian statistics of the output signal is the key for achieving sub-shot-noise performance. We compare the numerical results with two paradigmatic limits: the shot-noise limit (achieved using coherent sources) and the quantum limit (obtained with an ideal photon-number Fock state as the input source). We also investigate conditions in which threshold detectors can be used, and the effect of input light fluctuations on the measurement error. Results show that sub-shot-noise performance can be achieved, even without using number-resolving detectors, with improvement factors that range from 1.5 to 2. This technique would allow measurements of optical absorption of a sample with reasonable uncertainty using ultra-low light intensity and minimum disruption of biological or other fragile specimens.


title: Artificial Intelligence in Music and Performance: A Subjective Art-Research Inquiry

abstract: This article presents a five-year collaboration situated at the intersection of Art practice and Scientific research in Human-Computer Interaction (HCI). At the core of our collaborative work is a hybrid, Art and Science methodology that combines computational learning technology -- Machine Learning (ML) and Artificial Intelligence (AI) -- with interactive music performance and choreography. This article first exposes our thoughts on combining art, science, movement and sound research. We then describe two of our artistic works \textit{Corpus Nil} and \textit{Humane Methods} -- created five years apart from each other -- that crystallize our collaborative research process. We present the scientific and artistic motivations, framed through our research interests and cultural environment of the time. We conclude by reflecting on the methodology we developed during the collaboration and on the conceptual shift of computational learning technologies, from ML to AI, and its impact on Music performance.


title: Product systems associated to compound Poisson Processes

abstract: In this paper, we consider a simple test case of multiparameter product systems that arise out of random measures. We associate a product system to a stationary Poisson process and a stationary compound Poisson process. We show that the resulting $E_0$-semigroups are CCR flows.


title: A Method with Convergence Rates for Optimization Problems with Variational Inequality Constraints

abstract: We consider a class of optimization problems with Cartesian variational inequality (CVI) constraints, where the objective function is convex and the CVI is associated with a monotone mapping and a convex Cartesian product set. This mathematical formulation captures a wide range of optimization problems including those complicated by the presence of equilibrium constraints, complementarity constraints, or an inner-level large scale optimization problem. In particular, an important motivating application arises from the notion of efficiency estimation of equilibria in multi-agent networks, e.g., communication networks and power systems. In the literature, the iteration complexity of the existing solution methods for optimization problems with CVI constraints appears to be unknown. To address this shortcoming, we develop a first-order method called averaging randomized block iteratively regularized gradient (aRB-IRG). The main contributions include: (i) In the case where the associated set of the CVI is bounded and the objective function is nondifferentiable and convex, we derive new non-asymptotic suboptimality and infeasibility convergence rate statements in a mean sense. We also obtain deterministic variants of the convergence rates when we suppress the randomized block-coordinate scheme. Importantly, this paper appears to be the first work to provide these rate guarantees for this class of problems. (ii) In the case where the CVI set is unbounded and the objective function is smooth and strongly convex, utilizing the properties of the Tikhonov trajectory, we establish the global convergence of aRB-IRG in an almost sure and a mean sense. We provide the numerical experiments for computing the best Nash equilibrium in a networked Cournot competition model.


title: Strong Stability of Sampled-data Riesz-spectral Systems

abstract: Suppose that a continuous-time linear infinite-dimensional system with a static state-feedback controller is strongly stable. We address the following question: If we convert the continuous-time controller to a sampled-data controller by applying an idealized sampler and a zero-order hold, will the resulting sampled-data system be strongly stable for all sufficiently small sampling periods? In this paper, we restrict our attention to the situation where the generator of the open-loop system is a Riesz-spectral operator and its point spectrum has a limit point at the origin. We present conditions under which the answer to the above question is affirmative. In the robustness analysis, we show that the sufficient condition for strong stability obtained in the Arendt-Batty-Lyubich-V\~u theorem is preserved between the original continuous-time system and the sampled-data system under fast sampling.


title: A Functional Model for Structure Learning and Parameter Estimation in Continuous Time Bayesian Network: An Application in Identifying Patterns of Multiple Chronic Conditions

abstract: Bayesian networks are powerful statistical models to study the probabilistic relationships among set random variables with major applications in disease modeling and prediction. Here, we propose a continuous time Bayesian network with conditional dependencies, represented as Poisson regression, to model the impact of exogenous variables on the conditional dependencies of the network. We also propose an adaptive regularization method with an intuitive early stopping feature based on density based clustering for efficient learning of the structure and parameters of the proposed network. Using a dataset of patients with multiple chronic conditions extracted from electronic health records of the Department of Veterans Affairs we compare the performance of the proposed approach with some of the existing methods in the literature for both short-term (one-year ahead) and long-term (multi-year ahead) predictions. The proposed approach provides a sparse intuitive representation of the complex functional relationships between multiple chronic conditions. It also provides the capability of analyzing multiple disease trajectories over time given any combination of prior conditions.


title: Possible Time Correlation Between Jet Ejection and Mass Accretion for RW Aur A

abstract: For the active T-Taur star RW Aur A we have performed long-term (~10 yr) monitoring observations of (1) jet imaging in the [Fe II] 1.644-micron emission line using Gemini-NIFS and VLT-SINFONI; (2) optical high-resolution spectroscopy using CFHT-ESPaDOnS; and (3) V-band photometry using the CrAO 1.25-m telescope and AAVSO. The latter two observations confirm the correlation of time variabilities between (A) the Ca II 8542 A and O I 7772 A line profiles associated with magnetospheric accretion, and (B) optical continuum fluxes. The jet images and their proper motions show that four knot ejections occurred at the star over the past ~15 years with an irregular interval of 2-6 years. The time scale and irregularity of these intervals are similar to those of the dimming events seen in the optical photometry data. Our observations show a possible link between remarkable (Delta_V < -1 mag.) photometric rises and jet knot ejections. Observations over another few years may confirm or reject this trend. If confirmed, this would imply that the location of the jet launching region is very close to the star (r <<0.1 au) as predicted by some jet launching models. Such a conclusion would be crucial for understanding disk evolution within a few au of the star, and therefore possible ongoing planet formation at these radii.


title: Solving inverse problems using conditional invertible neural networks

abstract: Inverse modeling for computing a high-dimensional spatially-varying property field from indirect sparse and noisy observations is a challenging problem. This is due to the complex physical system of interest often expressed in the form of multiscale PDEs, the high-dimensionality of the spatial property of interest, and the incomplete and noisy nature of observations. To address these challenges, we develop a model that maps the given observations to the unknown input field in the form of a surrogate model. This inverse surrogate model will then allow us to estimate the unknown input field for any given sparse and noisy output observations. Here, the inverse mapping is limited to a broad prior distribution of the input field with which the surrogate model is trained. In this work, we construct a two- and three-dimensional inverse surrogate models consisting of an invertible and a conditional neural network trained in an end-to-end fashion with limited training data. The invertible network is developed using a flow-based generative model. The developed inverse surrogate model is then applied for an inversion task of a multiphase flow problem where given the pressure and saturation observations the aim is to recover a high-dimensional non-Gaussian permeability field where the two facies consist of heterogeneous permeability and varying length-scales. For both the two- and three-dimensional surrogate models, the predicted sample realizations of the non-Gaussian permeability field are diverse with the predictive mean being close to the ground truth even when the model is trained with limited data.


title: Resist : Reconstruction of irises from templates

abstract: Iris recognition systems transform an iris image into a feature vector. The seminal pipeline segments an image into iris and non-iris pixels, normalizes this region into a fixed-dimension rectangle, and extracts features which are stored and called a template (Daugman, 2009). This template is stored on a system. A future reading of an iris can be transformed and compared against template vectors to determine or verify the identity of an individual. As templates are often stored together, they are a valuable target to an attacker. We show how to invert templates across a variety of iris recognition systems. That is, we show how to transform templates into realistic looking iris images that are also deemed as the same iris by the corresponding recognition system. Our inversion is based on a convolutional neural network architecture we call RESIST (REconStructing IriSes from Templates). We apply RESIST to a traditional Gabor filter pipeline, to a DenseNet (Huang et al., CVPR 2017) feature extractor, and to a DenseNet architecture that works without normalization. Both DenseNet feature extractors are based on the recent ThirdEye recognition system (Ahmad and Fuller, BTAS 2019). When training and testing using the ND-0405 dataset, reconstructed images demonstrate a rank-1 accuracy of 100%, 76%, and 96% respectively for the three pipelines. The core of our approach is similar to an autoencoder. However, standalone training the core produced low accuracy. The final architecture integrates into an generative adversarial network (Goodfellow et al., NeurIPS, 2014) producing higher accuracy.