title: BioFLAIR: Pretrained Pooled Contextualized Embeddings for Biomedical Sequence Labeling Tasks

abstract: Biomedical Named Entity Recognition (NER) is a challenging problem in biomedical information processing due to the widespread ambiguity of out of context terms and extensive lexical variations. Performance on bioNER benchmarks continues to improve due to advances like BERT, GPT, and XLNet. FLAIR (1) is an alternative embedding model which is less computationally intensive than the others mentioned. We test FLAIR and its pretrained PubMed embeddings (which we term BioFLAIR) on a variety of bio NER tasks and compare those with results from BERT-type networks. We also investigate the effects of a small amount of additional pretraining on PubMed content, and of combining FLAIR and ELMO models. We find that with the provided embeddings, FLAIR performs on-par with the BERT networks - even establishing a new state of the art on one benchmark. Additional pretraining did not provide a clear benefit, although this might change with even more pretraining being done. Stacking the FLAIR embeddings with others typically does provide a boost in the benchmark results.


title: Ptychographic modulation engine (PME): a low-cost DIY microscope add-on for coherent super-resolution imaging

abstract: Imaging of biological cells and tissues often relies on fluorescent labels, which offer high contrast with molecular specificity. The use of exogenous labeling agents, however, may alter the normal physiology of the bio-specimens. Complementary to the established fluorescence microscopy, label-free quantitative phase imaging provides an objective morphological measurement tool for bio-specimens and is free of variability introduced by contrast agents. Here we report a simple and low-cost microscope add-on, termed Ptychographic Modulation Engine (PME), for super-resolution quantitative phase imaging. In this microscope add-on module, we attach a diffuser to a 3D-printed holder that can be mechanically moved to different x-y positions. We then use two vibrational motors to introduce random positional shifts to the diffuser. The add-on module can be placed between the objective lens and the specimen in most existing microscope platforms. Thanks to the diffuser modulation process, the otherwise inaccessible high-resolution object information can now be encoded into the captured images. In the ptychographic phase retrieval process, we jointly recover the complex object wavefront, the complex diffuser profile, and the unknown positional shifts of the diffuser. We demonstrate a 4-fold resolution gain over the diffraction limit of the employed 2X objective lens. We also test our approach for in-vivo cell imaging, where we are able to adjust the focus after the data has been captured. The reported microscope add-on provides a turnkey solution for super-resolution quantitative phase imaging. It may find applications in label-free bio-imaging where both large field-of-view and high resolution are needed.


title: Entity-aware ELMo: Learning Contextual Entity Representation for Entity Disambiguation

abstract: We present a new local entity disambiguation system. The key to our system is a novel approach for learning entity representations. In our approach we learn an entity aware extension of Embedding for Language Model (ELMo) which we call Entity-ELMo (E-ELMo). Given a paragraph containing one or more named entity mentions, each mention is first defined as a function of the entire paragraph (including other mentions), then they predict the referent entities. Utilizing E-ELMo for local entity disambiguation, we outperform all of the state-of-the-art local and global models on the popular benchmarks by improving about 0.5\% on micro average accuracy for AIDA test-b with Yago candidate set. The evaluation setup of the training data and candidate set are the same as our baselines for fair comparison.


title: On-Device Text Representations Robust To Misspellings via Projections

abstract: Recently, there has been a strong interest in developing natural language applications that live on personal devices such as mobile phones, watches and IoT with the objective to preserve user privacy and have low memory. Advances in Locality-Sensitive Hashing (LSH)-based projection networks have demonstrated state-of-the-art performance in various classification tasks without explicit word (or word-piece) embedding lookup tables by computing on-the-fly text representations. In this paper, we show that the projection based neural classifiers are inherently robust to misspellings and perturbations of the input text. We empirically demonstrate that the LSH projection based classifiers are more robust to common misspellings compared to BiLSTMs (with both word-piece & word-only tokenization) and fine-tuned BERT based methods. When subject to misspelling attacks, LSH projection based classifiers had a small average accuracy drop of 2.94% across multiple classifications tasks, while the fine-tuned BERT model accuracy had a significant drop of 11.44%.


title: Learning Sub-Sampling and Signal Recovery with Applications in Ultrasound Imaging

abstract: Limitations on bandwidth and power consumption impose strict bounds on data rates of diagnostic imaging systems. Consequently, the design of suitable (i.e. task- and data-aware) compression and reconstruction techniques has attracted considerable attention in recent years. Compressed sensing emerged as a popular framework for sparse signal reconstruction from a small set of compressed measurements. However, typical compressed sensing designs measure a (non)linearly weighted combination of all input signal elements, which poses practical challenges. These designs are also not necessarily task-optimal. In addition, real-time recovery is hampered by the iterative and time-consuming nature of sparse recovery algorithms. Recently, deep learning methods have shown promise for fast recovery from compressed measurements, but the design of adequate and practical sensing strategies remains a challenge. Here, we propose a deep learning solution termed Deep Probabilistic Sub-sampling (DPS), that learns a task-driven sub-sampling pattern, while jointly training a subsequent task model. Once learned, the task-based sub-sampling patterns are fixed and straightforwardly implementable, e.g. by non-uniform analog-to-digital conversion, sparse array design, or slow-time ultrasound pulsing schemes. The effectiveness of our framework is demonstrated in-silico for sparse signal recovery from partial Fourier measurements, and in-vivo for both anatomical image and tissue-motion (Doppler) reconstruction from sub-sampled medical ultrasound imaging data.


title: The impact of the observed baryon distribution in haloes on the total matter power spectrum

abstract: The interpretation of upcoming weak gravitational lensing surveys depends critically on our understanding of the matter power spectrum on scales $k < 10 h/\mathrm{Mpc}$, where baryonic processes are important. We study the impact of galaxy formation processes on the matter power spectrum using a halo model that treats the stars and gas separately from the dark matter distribution. We use empirical constraints from X-ray observations (hot gas) and halo occupation distribution modelling (stars) for the baryons. Since X-ray observations cannot generally measure the hot gas content outside $r_\mathrm{500c}$, we vary the gas density profiles beyond this radius. Compared with dark matter only models, we find a total power suppression of $1 \%$ ($5 \%$) on scales $0.2-1 h/\mathrm{Mpc}$ ($0.5-2h/\mathrm{Mpc}$), where lower baryon fractions result in stronger suppression. We show that groups of galaxies ($10^{13} < m_\mathrm{500c} / (\mathrm{M_\odot}/h) < 10^{14}$) dominate the total power at all scales $k \lesssim 10 h/\mathrm{Mpc}$. We find that a halo mass bias of $30 \%$ (similar to what is expected from the hydrostatic equilibrium assumption) results in an underestimation of the power suppression of up to $4 \%$ at $k = 1 h/\mathrm{Mpc}$, illustrating the importance of measuring accurate halo masses. Contrary to work based on hydrodynamical simulations, our conclusion that baryonic effects can no longer be neglected is not subject to uncertainties associated with our poor understanding of feedback processes. Observationally, probing the outskirts of groups and clusters will provide the tightest constraints on the power suppression for $k \lesssim 1 h/\mathrm{Mpc}$.


title: Blow-up solutions to 3D Euler are hydrodynamically unstable

abstract: We study the interaction between the stability, and the propagation of regularity, for solutions to the incompressible 3D Euler equation. It is still unknown whether a solution with smooth initial data can develop a singularity in finite time. This article explains why the prediction of such a blow-up, via direct numerical experiments, is so difficult. It is described how, in such a scenario, the solution becomes unstable as time approaches the blow-up time.


title: Experimental performance of graph neural networks on random instances of max-cut

abstract: This note explores the applicability of unsupervised machine learning techniques towards hard optimization problems on random inputs. In particular we consider Graph Neural Networks (GNNs) -- a class of neural networks designed to learn functions on graphs -- and we apply them to the max-cut problem on random regular graphs. We focus on the max-cut problem on random regular graphs because it is a fundamental problem that has been widely studied. In particular, even though there is no known explicit solution to compare the output of our algorithm to, we can leverage the known asymptotics of the optimal max-cut value in order to evaluate the performance of the GNNs. In order to put the performance of the GNNs in context, we compare it with the classical semidefinite relaxation approach by Goemans and Williamson~(SDP), and with extremal optimization, which is a local optimization heuristic from the statistical physics literature. The numerical results we obtain indicate that, surprisingly, Graph Neural Networks attain comparable performance to the Goemans and Williamson SDP. We also observe that extremal optimization consistently outperforms the other two methods. Furthermore, the performances of the three methods present similar patterns, that is, for sparser, and for larger graphs, the size of the found cuts are closer to the asymptotic optimal max-cut value.


title: The fourth law of thermodynamics: steepest entropy ascent

abstract: When thermodynamics is understood as the science (or art) of constructing effective models of natural phenomena by choosing a minimal level of description capable of capturing the essential features of the physical reality of interest, the scientific community has identified a set of general rules that the model must incorporate if it aspires to be consistent with the body of known experimental evidence. Some of these rules are believed to be so general that we think of them as laws of Nature, such as the great conservation principles, whose "greatness" derives from their generality, as masterfully explained by Feynman in one of his legendary lectures. The second law of thermodynamics is universally contemplated among the great laws of Nature. In this paper we show that, in the past four decades, an enormous body of scientific research devoted to modeling the essential features of nonequilibrium natural phenomena has converged from many different directions and frameworks towards the general recognition (albeit still expressed in different but equivalent forms and language) that another rule is also indispensable and reveals another great law of Nature that we propose to call the \caporali{fourth law of thermodynamics}. We state it as follows: every nonequilibrium state of a system or local subsystem for which entropy is well-defined must be equipped with a metric in state space with respect to which the irreversible component of its time evolution is in the direction of steepest entropy ascent compatible with the conservation constraints. To illustrate the power of the fourth law, we derive (nonlinear) extensions of Onsager reciprocity and fluctuation-dissipation relations to the far-nonequilibrium realm within the framework of the rate-controlled constrained-equilibrium (RCCE) approximation (also known as the quasi-equilibrium approximation).


title: Constraining the vertical distribution of coastal dust aerosol using OCO-2 O2 A-band measurements

abstract: Quantifying the vertical distribution of atmospheric aerosols is crucial for estimating their impact on the Earth energy budget and climate, improving forecast of air pollution in cities, and reducing biases in the retrieval of greenhouse gases (GHGs) from space. However, to date, passive remote sensing measurements have provided limited information about aerosol extinction profiles. In this study, we propose the use of a spectral sorting approach to constrain the aerosol vertical structure using spectra of reflected sunlight absorption within the molecular oxygen (O2) A-band collected by the Orbiting Carbon Observatory-2 (OCO-2). The effectiveness of the approach is evaluated using spectra acquired over the western Sahara coast by comparing the aerosol profile retrievals with lidar measurements from the Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observation (CALIPSO) Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP). Using a radiative transfer model to simulate OCO-2 measurements, we found that high-resolution O2 A-band measurements have high sensitivity to aerosol optical depth (AOD) and aerosol layer height (ALH). Retrieved estimates of AOD and ALH based on a look up table technique show good agreement with CALIPSO measurements, with correlation coefficients of 0.65 and 0.53, respectively. The strength of the proposed spectral sorting technique lies in its ability to identify spectral channels with high sensitivity to AOD and ALH and extract the associated information from the observed radiance in a straightforward manner. The proposed approach has the potential to enable future passive remote sensing missions to map the aerosol vertical distribution on a global scale.


title: Discretely-constrained deep network for weakly supervised segmentation

abstract: An efficient strategy for weakly-supervised segmentation is to impose constraints or regularization priors on target regions. Recent efforts have focused on incorporating such constraints in the training of convolutional neural networks (CNN), however this has so far been done within a continuous optimization framework. Yet, various segmentation constraints and regularization can be modeled and optimized more efficiently in a discrete formulation. This paper proposes a method, based on the alternating direction method of multipliers (ADMM) algorithm, to train a CNN with discrete constraints and regularization priors. This method is applied to the segmentation of medical images with weak annotations, where both size constraints and boundary length regularization are enforced. Experiments on a benchmark cardiac segmentation dataset show our method to yield a performance near to full supervision.


title: On boundedness and growth of unsteady solutions under the double porosity/permeability model

abstract: There is a recent surge in research activities on modeling the flow of fluids in porous media with complex pore-networks. A prominent mathematical model, which describes the flow of incompressible fluids in porous media with two dominant pore-networks allowing mass transfer across them, is the double porosity/permeability (DPP) model. However, we currently do not have a complete understanding of unsteady solutions under the DPP model. Also, because of the complex nature of the mathematical model, it is not possible to find analytical solutions, and one has to resort to numerical solutions. It is therefore desirable to have a procedure that can serve as a measure to assess the veracity of numerical solutions. In this paper, we establish that unsteady solutions under the transient DPP model are stable in the sense of Lyapunov. We also show that the unsteady solutions grow at most linear with time. These results not only have a theoretical value but also serve as valuable a posteriori measures to verify numerical solutions in the transient setting and under anisotropic medium properties, as analytical solutions are scarce for these scenarios under the DPP model.


title: Unconventional topological Hall effect in high-topological-number skyrmion crystals

abstract: Skyrmions with the topological number $Q$ equal an integer larger than 1 are called high-topological-number skyrmions or high-$Q$ skyrmions. In this work, we theoretically study the topological Hall effect in square-lattice high-$Q$ skyrmion crystals (SkX) with $Q=2$ and $Q=3$. As a result of the emergent magnetic field, Landau-level-like electronic band structure gives rise to quantized Hall conductivity when the Fermi energy is within the gaps between adjacent single band or multiple bands intertwined. We found that different from conventional ($Q=1$) SkX the Hall quantization number increases by $1/Q$ in average when the elevating Fermi energy crosses each band. We attribute the result to the fact that the Berry phase ${\cal{C}}$ is measured in the momentum space and the topological number of a single skyrmion $Q$ is measured in the real space. The reciprocality does not affect the conventional SkX because $Q=1=1/Q$.


title: Arctic curve of the free-fermion six-vertex model with reflecting end boundary condition

abstract: We consider the six-vertex model with reflecting end boundary condition. We study the asymptotic behavior of the boundary correlations. This asymptotic behavior is used as an input into the Tangent Method in order to derive analytically the arctic curve at the free fermion point. The obtained curve is a semicircle, which is in agreement with previous Monte Carlo simulations.


title: Quantum-Optical set-up for the Monty Hall problem

abstract: A quantum version of the Monty Hall problem is proposed inspired by an experimentally-feasible, quantum-optical set-up that resembles the classical game. The expected payoff of the player is studied by analyzing the classical expectation values of the obtained quantum probabilities. Results are examined by considering both entanglement and non-entanglement between player and host, and using two different approaches: random and strategy-based. We also discuss the influence of noise on the game outcome when the parties play through a noisy quantum channel. The experimental set-up can be used to quickly verify the counter-intuitive result of the Monty Hall problem, adding pedagogic value to the proposal.


title: Lower and Upper Bounds for Positive Bases of Skein Algebras

abstract: We show that the if a sequence of normalized polynomials gives rise to a positive basis of the skein algebra of a surface, then it is sandwiched between the two types of Chebyshev polynomials. For the closed torus, we show that the normalized sequence of Chebyshev polynomials of type one $(\hat{T}_n)$ is the only one which gives a positive basis.


title: Cardinal invariants of Haar null and Haar meager sets

abstract: A subset $X$ of a Polish group $G$ is \emph{Haar null} if there exists a Borel probability measure $\mu$ and a Borel set $B$ containing $X$ such that $\mu(gBh)=0$ for every $g,h \in G$. A set $X$ is \emph{Haar meager} if there exists a compact metric space $K$, a continuous function $f : K \to G$ and a Borel set $B$ containing $X$ such that $f^{-1}(gBh)$ is meager in $K$ for every $g,h \in G$. We calculate (in $ZFC$) the four cardinal invariants ($\rm add$, $\rm cov$, $\rm non$, $\rm cof$) of these two $\sigma$-ideals for the simplest non-locally compact Polish group, namely in the case $G = \mathbb{Z}^\omega$. In fact, most results work for separable Banach spaces as well, and many results work for Polish groups admitting a two-sided invariant metric. This answers a question of the first named author and Z. Vidny\'anszky.


title: Saddle-Node Bifurcation and Homoclinic Persistence in AFM with Periodic Forcing

abstract: We study the dynamics of an Atomic Force Microscope (AFM) model, under the Lennard-Jones force with non-linear damping, and harmonic forcing. We establish the bifurcation diagrams for equilibria in a conservative system. Particularly, we present conditions that guarantee the local existence of saddle-node bifurcations. By using the Melnikov method, the region in the space parameters where the persistence of homoclinic orbits is determined in a non-conservative system.


title: Evaluation of 3D gold nanodendrite layers obtained by templated galvanic displacement reactions for SERS sensing and heterogeneous catalysis

abstract: Dense layers of overlapping three-dimensional (3D) gold nanodendrites characterized by high specific surfaces as well as by abundance of sharp edges and vertices creating high densities of SERS hotspots are promising substrates for SERS-based sensing and catalysis. We have evaluated to what extent structural features of 3D gold nanodendrite layers can be optimized by the initiation of 3D gold nanodendrite growth at gold particles rationally positioned on silicon wafers. For this purpose, galvanic displacement reactions yielding 3D gold nanodendrites were guided by hexagonal arrays of parent gold particles with a lattice constant of 1.5 micrometers obtained by solid-state dewetting of gold on topographically patterned silicon wafers. Initiation of the growth of dendritic features at edges of the gold particles resulted in the formation of 3D gold nanodendrites while limitation of dendritic growth to the substrate plane was prevented. The regular arrangement of the parent gold particles supported the formation of dense layers of overlapping 3D gold nanodendrites that were sufficiently homogeneous within the resolution limits of Raman microscopes. Consequently, SERS mapping experiments revealed a reasonable degree of uniformity. The proposed preparation algorithm comprises only bottom-up process steps that can be carried out without use of costly instrumentation.


title: Probing Massive Black Hole Binary Populations with LISA

abstract: ESA and NASA are moving forward with plans to launch LISA around 2034. With data from the Illustris cosmological simulation, we provide analysis of LISA detection rates accompanied by characterization of the merging massive black hole population. Massive black holes of total mass $\sim10^5-10^{10} M_\odot$ are the focus of this study. We evolve Illustris massive black hole mergers, which form at separations on the order of the simulation resolution ($\sim$kpc scales), through coalescence with two different treatments for the binary massive black hole evolutionary process. The coalescence times of the population, as well as physical properties of the black holes, form a statistical basis for each evolutionary treatment. From these bases, we Monte Carlo synthesize many realizations of the merging massive black hole population to build mock LISA detection catalogs. We analyze how our massive black hole binary evolutionary models affect detection rates and the associated parameter distributions measured by LISA. With our models, we find massive black hole binary detection rates with LISA of $\sim0.5-1$ yr$^{-1}$ for massive black holes with masses greater than $10^5M_\odot$. This should be treated as a lower limit primarily because our massive black hole sample does not include masses below $10^5M_\odot$, which may significantly add to the observed rate. We suggest reasons why we predict lower detection rates compared to much of the literature.


title: Natural Language Processing of Clinical Notes on Chronic Diseases: Systematic Review

abstract: Of the 2652 articles considered, 106 met the inclusion criteria. Review of the included papers resulted in identification of 43 chronic diseases, which were then further classified into 10 disease categories using ICD-10. The majority of studies focused on diseases of the circulatory system (n=38) while endocrine and metabolic diseases were fewest (n=14). This was due to the structure of clinical records related to metabolic diseases, which typically contain much more structured data, compared with medical records for diseases of the circulatory system, which focus more on unstructured data and consequently have seen a stronger focus of NLP. The review has shown that there is a significant increase in the use of machine learning methods compared to rule-based approaches; however, deep learning methods remain emergent (n=3). Consequently, the majority of works focus on classification of disease phenotype with only a handful of papers addressing extraction of comorbidities from the free text or integration of clinical notes with structured data. There is a notable use of relatively simple methods, such as shallow classifiers (or combination with rule-based methods), due to the interpretability of predictions, which still represents a significant issue for more complex methods. Finally, scarcity of publicly available data may also have contributed to insufficient development of more advanced methods, such as extraction of word embeddings from clinical notes. Further efforts are still required to improve (1) progression of clinical NLP methods from extraction toward understanding; (2) recognition of relations among entities rather than entities in isolation; (3) temporal extraction to understand past, current, and future clinical events; (4) exploitation of alternative sources of clinical knowledge; and (5) availability of large-scale, de-identified clinical corpora.


title: Tripartite realism-based quantum nonlocality

abstract: From an operational criterion of physical reality, a quantifier of realism-based nonlocality was recently introduced for two-part quantum states. This measure has shown to capture aspects that are rather different from Bell nonlocality. Here we take a step further and introduce a tripartite realism-based nonlocality quantifier. We show that this measure reduces to genuine tripartite entanglement for a certain class of pure tripartite states and manifests itself in correlated mixed states even in the absence of quantum correlations. A case study for noisy GHZ and W states points out the existence of scenarios where the realism-based nonlocality is monogamous.


title: MimickNet, Matching Clinical Post-Processing Under Realistic Black-Box Constraints

abstract: Image post-processing is used in clinical-grade ultrasound scanners to improve image quality (e.g., reduce speckle noise and enhance contrast). These post-processing techniques vary across manufacturers and are generally kept proprietary, which presents a challenge for researchers looking to match current clinical-grade workflows. We introduce a deep learning framework, MimickNet, that transforms raw conventional delay-and-summed (DAS) beams into the approximate post-processed images found on clinical-grade scanners. Training MimickNet only requires post-processed image samples from a scanner of interest without the need for explicit pairing to raw DAS data. This flexibility allows it to hypothetically approximate any manufacturer's post-processing without access to the pre-processed data. MimickNet generates images with an average similarity index measurement (SSIM) of 0.930$\pm$0.0892 on a 300 cineloop test set, and it generalizes to cardiac cineloops outside of our train-test distribution achieving an SSIM of 0.967$\pm$0.002. We also explore the theoretical SSIM achievable by evaluating MimickNet performance when trained under gray-box constraints (i.e., when both pre-processed and post-processed images are available). To our knowledge, this is the first work to establish deep learning models that closely approximate current clinical-grade ultrasound post-processing under realistic black-box constraints where before and after post-processing data is unavailable. MimickNet serves as a clinical post-processing baseline for future works in ultrasound image formation to compare against. To this end, we have made the MimickNet software open source.


title: Tackling Algorithmic Bias in Neural-Network Classifiers using Wasserstein-2 Regularization

abstract: The increasingly common use of neural network classifiers in industrial and social applications of image analysis has allowed impressive progress these last years. Such methods are however sensitive to algorithmic bias, i.e. to an under- or an over-representation of positive predictions or to higher prediction errors in specific subgroups of images. We then introduce in this paper a new method to temper the algorithmic bias in Neural-Network based classifiers. Our method is Neural-Network architecture agnostic and scales well to massive training sets of images. It indeed only overloads the loss function with a Wasserstein-2 based regularization term for which we back-propagate the impact of specific output predictions using a new model, based on the Gateaux derivatives of the predictions distribution. This model is algorithmically reasonable and makes it possible to use our regularized loss with standard stochastic gradient-descent strategies. Its good behavior is assessed on the reference Adult census, MNIST, CelebA datasets.


title: Dusty clumps in circumbinary discs

abstract: Recent observations have revealed that protoplanetary discs often exhibit cavities and azimuthal asymmetries such as dust traps and clumps. The presence of a stellar binary system in the inner disc regions has been proposed to explain the formation of these structures. Here, we study the dust and gas dynamics in circumbinary discs around eccentric and inclined binaries. This is done through two-fluid simulations of circumbinary discs, considering different values of the binary eccentricity and inclination. We find that two kinds of dust structures can form in the disc: a single horseshoe-shaped clump, on top of a similar gaseous over-density; or numerous clumps, distributed along the inner disc rim. The latter features form through the complex interplay between the dust particles and the gaseous spirals caused by the binary. All these clumps survive between one and several tens of orbital periods at the feature location. We show that their evolution strongly depends on the gas-dust coupling and the binary parameters. Interestingly, these asymmetric features could in principle be used to infer or constrain the orbital parameters of a stellar companion - potentially unseen - inside the inner disc cavity. Finally, we apply our findings to the disc around AB Aurigae.


title: OPTICAM: A triple-camera optical system designed to explore the fastest timescales in Astronomy

abstract: We report the development of a high-time resolution, 3-colour, simultaneous optical imaging system for the 2.1 m telescope in San Pedro M\'artir Observatory, M\'exico. OPTICAM will be equipped with three Andor Zyla 4.2-Plus sCMOS cameras and a set of SDSS filters allowing optical coverage in the 320-1,100 nm range. OPTICAM will nominally allow sub-second exposures. Given its instrumental design, a wide range of fast-variability astrophysical sources can be targeted with OPTICAM including X-ray binaries, pulsating white dwarfs, accreting compact objects, eclipsing binaries and exoplanets. OPTICAM observations will be proprietary for only six months and will then be made publicly available for the astronomical community.


title: TASED-Net: Temporally-Aggregating Spatial Encoder-Decoder Network for Video Saliency Detection

abstract: TASED-Net is a 3D fully-convolutional network architecture for video saliency detection. It consists of two building blocks: first, the encoder network extracts low-resolution spatiotemporal features from an input clip of several consecutive frames, and then the following prediction network decodes the encoded features spatially while aggregating all the temporal information. As a result, a single prediction map is produced from an input clip of multiple frames. Frame-wise saliency maps can be predicted by applying TASED-Net in a sliding-window fashion to a video. The proposed approach assumes that the saliency map of any frame can be predicted by considering a limited number of past frames. The results of our extensive experiments on video saliency detection validate this assumption and demonstrate that our fully-convolutional model with temporal aggregation method is effective. TASED-Net significantly outperforms previous state-of-the-art approaches on all three major large-scale datasets of video saliency detection: DHF1K, Hollywood2, and UCFSports. After analyzing the results qualitatively, we observe that our model is especially better at attending to salient moving objects.


title: Integrating Multimodal Information in Large Pretrained Transformers

abstract: Recent Transformer-based contextual word representations, including BERT and XLNet, have shown state-of-the-art performance in multiple disciplines within NLP. Fine-tuning the trained contextual models on task-specific datasets has been the key to achieving superior performance downstream. While fine-tuning these pre-trained models is straightforward for lexical applications (applications with only language modality), it is not trivial for multimodal language (a growing area in NLP focused on modeling face-to-face communication). Pre-trained models don't have the necessary components to accept two extra modalities of vision and acoustic. In this paper, we proposed an attachment to BERT and XLNet called Multimodal Adaptation Gate (MAG). MAG allows BERT and XLNet to accept multimodal nonverbal data during fine-tuning. It does so by generating a shift to internal representation of BERT and XLNet; a shift that is conditioned on the visual and acoustic modalities. In our experiments, we study the commonly used CMU-MOSI and CMU-MOSEI datasets for multimodal sentiment analysis. Fine-tuning MAG-BERT and MAG-XLNet significantly boosts the sentiment analysis performance over previous baselines as well as language-only fine-tuning of BERT and XLNet. On the CMU-MOSI dataset, MAG-XLNet achieves human-level multimodal sentiment analysis performance for the first time in the NLP community.


title: Analysis of the spectral symbol function for spectral approximation of a differential operator

abstract: Given a differential operator $\mathcal{L}$ along with its own eigenvalue problem $\mathcal{L}u = \lambda u$ and an associated algebraic equation $\mathcal{L}^{(n)} \mathbf{u}_n = \lambda\mathbf{u}_n$ obtained by means of a discretization scheme (like Finite Differences, Finite Elements, Galerkin Isogeometric Analysis, etc.), the theory of Generalized Locally Toeplitz (GLT) sequences serves the purpose to compute the spectral symbol function $\omega$ associated to the discrete operator $\mathcal{L}^{(n)}$ We prove that the spectral symbol $\omega$ provides a necessary condition for a discretization scheme in order to uniformly approximate the spectrum of the original differential operator $\mathcal{L}$. The condition measures how far the method is from a uniform relative approximation of the spectrum of $\mathcal{L}$. Moreover, the condition seems to become sufficient if the discretization method is paired with a suitable (non-uniform) grid and an increasing refinement of the order of approximation of the method. On the other hand, despite the numerical experiments in many recent literature, we disprove that in general a uniform sampling of the spectral symbol $\omega$ can provide an accurate relative approximation of the spectrum, neither of $\mathcal{L}$ nor of the discrete operator $\mathcal{L}^{(n)}$.


title: Phase diagrams of polymer-containing liquid mixtures with a theory-embedded neural network

abstract: We develop a deep neural network (DNN) that accounts for the phase behaviors of polymer-containing liquid mixtures. The key component in the DNN consists of a theory-embedded layer that captures the characteristic features of the phase behavior via coarse-grained mean-field theory and scaling laws and substantially enhances the accuracy of the DNN. Moreover, this layer enables us to reduce the size of the DNN for the phase diagrams of the mixtures. This study also presents the predictive power of the DNN for the phase behaviors of polymer solutions and salt-free and salt-doped diblock copolymer melts.


title: Task Bench: A Parameterized Benchmark for Evaluating Parallel Runtime Performance

abstract: We present Task Bench, a parameterized benchmark designed to explore the performance of parallel and distributed programming systems under a variety of application scenarios. Task Bench lowers the barrier to benchmarking multiple programming systems by making the implementation for a given system orthogonal to the benchmarks themselves: every benchmark constructed with Task Bench runs on every Task Bench implementation. Furthermore, Task Bench's parameterization enables a wide variety of benchmark scenarios that distill the key characteristics of larger applications. We conduct a comprehensive study with implementations of Task Bench in 15 programming systems on up to 256 Haswell nodes of the Cori supercomputer. We introduce a novel metric, minimum effective task granularity to study the baseline runtime overhead of each system. We show that when running at scale, 100 {\mu}s is the smallest granularity that even the most efficient systems can reliably support with current technologies. We also study each system's scalability, ability to hide communication and mitigate load imbalance.


title: Poisson vertex algebras in supersymmetric field theories

abstract: A large class of supersymmetric quantum field theories, including all theories with $\mathcal{N} = 2$ supersymmetry in three dimensions and theories with $\mathcal{N} = 2$ supersymmetry in four dimensions, possess topological-holomorphic sectors. We formulate Poisson vertex algebras in such topological-holomorphic sectors and discuss some examples. For a four-dimensional $\mathcal{N} = 2$ superconformal field theory, the associated Poisson vertex algebra is the classical limit of a vertex algebra generated by a subset of local operators of the theory.


title: Multitask and Transfer Learning for Autotuning Exascale Applications

abstract: Multitask learning and transfer learning have proven to be useful in the field of machine learning when additional knowledge is available to help a prediction task. We aim at deriving methods following these paradigms for use in autotuning, where the goal is to find the optimal performance parameters of an application treated as a black-box function. We show comparative results with state-of-the-art autotuning techniques. For instance, we observe an average $1.5x$ improvement of the application runtime compared to the OpenTuner and HpBandSter autotuners. We explain how our approaches can be more suitable than some state-of-the-art autotuners for the tuning of any application in general and of expensive exascale applications in particular.


title: Deep inelastic scattering from string/gauge duality with soft IR cutoff and exponentially small Bjorken parameter

abstract: In this work we use the string/gauge duality within the Softwall Model (SW). In this model a dilaton field is introduced in the action for the fields playing the role of a soft infrared (IR) cutoff. The SW model is very useful as it provides linear Regge trajectories for mesons. Here, using a $10-$dimensional SW model, we calculate the corresponding structure functions for deep inelastic scattering (DIS) in which electrons are scattered off hadrons in a kinematical regime where the hadrons are broken apart, with high virtuality $q$, in the exponentially small $x$ (Bjorken parameter) regime. Our results for this regime are consistent with those achieved using other holographic and non-holographic approaches.


title: Structured Coupled Generative Adversarial Networks for Unsupervised Monocular Depth Estimation

abstract: Inspired by the success of adversarial learning, we propose a new end-to-end unsupervised deep learning framework for monocular depth estimation consisting of two Generative Adversarial Networks (GAN), deeply coupled with a structured Conditional Random Field (CRF) model. The two GANs aim at generating distinct and complementary disparity maps and at improving the generation quality via exploiting the adversarial learning strategy. The deep CRF coupling model is proposed to fuse the generative and discriminative outputs from the dual GAN nets. As such, the model implicitly constructs mutual constraints on the two network branches and between the generator and discriminator. This facilitates the optimization of the whole network for better disparity generation. Extensive experiments on the KITTI, Cityscapes, and Make3D datasets clearly demonstrate the effectiveness of the proposed approach and show superior performance compared to state of the art methods. The code and models are available at https://github.com/mihaipuscas/ 3dv---coupled-crf-disparity.


title: Immobilization of water drops on hydrophobic surfaces by contact line pinning at non-lithographically generated polymer microfiber rings

abstract: Water drops used as reaction compartments are commonly immobilized on hydrophilic areas bordered by hydrophobic areas. For many applications, such as the trapping of non-adherent cells, it is desirable to exploit the inertness and the anti-fouling behavior of hydrophobic surfaces as well as their repulsive behavior towards adsorbates in lab-on-chip configurations. However, the immobilization of water drops on hydrophobic surfaces has remained challenging. We report a nonlithographic approach to arrest water drops on hydrophobically modified macroporous silicon (mSi) with per uorinated surface. Contact line pinning at rings of polystyrene-block-poly(2-vinylpyridine) (PS-b-P2VP) fibers protruding from the mSi macropores immobilizes water drops when the hydrophobically modified mSi is moved or tilted and prevents dewetting within the PS-b-P2VP fiber rings. Without PS-b-P2VP fiber rings, water drops readily roll off. The PS-b-P2VP fiber rings were prepared by dropping PS-b-P2VP solution onto hydrophobically modified mSi. Selective swelling of the P2VP in the thus-formed circular PS-b-P2VP films with hot ethanol followed by detachment of the latter yielded hydrophobically modified mSi exhibiting annular areas, in which ruptured PS-b-P2VP fibers protruded from the mSi macropores. For example, PS-b-P2VP fiber rings with diameters of 6.5 mm and widths of about 0.2 mm immobilize water drops with a volume of 50 microliters.


title: Laplacian algebras, manifold submetries and the Inverse Invariant Theory Problem

abstract: Manifold submetries of the round sphere are a class of partitions of the round sphere that generalizes both singular Riemannian foliations, and the orbit decompositions by the orthogonal representations of compact groups. We exhibit a one-to-one correspondence between such manifold submetries and maximal Laplacian algebras, thus solving the Inverse Invariant Theory problem for this class of partitions. Moreover, a solution to the analogous problem is provided for two smaller classes, namely orthogonal representations of finite groups, and transnormal systems with closed leaves.


title: Invariant synchrony subspaces of sets of matrices

abstract: A synchrony subspace of R^n is defined by setting certain components of the vectors equal according to an equivalence relation. Synchrony subspaces invariant under a given set of square matrices form a lattice. Applications of these invariant synchrony subspaces include equitable and almost equitable partitions of the vertices of a graph used in many areas of graph theory, balanced and exo-balanced partitions of coupled cell networks, and coset partitions of Cayley graphs. We study the basic properties of invariant synchrony subspaces and provide many examples of the applications. We also present what we call the split and cir algorithm for finding the lattice of invariant synchrony subspaces. Our theory and algorithm is further generalized for non-square matrices. This leads to the notion of tactical decompositions studied for its application in design theory.


title: Efficient Flicker-Free FEC Codes using Knuth's Balancing Algorithm for VLC

abstract: Visible light communication (VLC) provides a short-range optical wireless communication through light-emitting diode (LED) lighting. Light beam flickering and dimming are among the challenges to be addressed in VLC. Conventional methods for generating flicker-free codes in VLC are based on run-length limited codes that have poor error correction performance, use lookup tables which are memory consuming, and have low transmission rates. In this paper, we propose an efficient construction of flicker-free forward error correction codes to tackle the issue of flickering in VLC. Our simulation results show that by using polar codes and at a dimming ratio of 50%, the proposed system generates flicker-free codes without using lookup tables, while having lower complexity and higher transmission rates than the standard VLC methods. For an information block length of 256, the error correction performance of the proposed scheme is $1.8$ dB and $0.9$ dB better than that of the regular schemes at the bit error rate of $10^{-6}$ for a rate of 0.44 and 0.23, respectively.


title: Modular Verification of Heap Reachability Properties in Separation Logic

abstract: The correctness of many algorithms and data structures depends on reachability properties, that is, on the existence of chains of references between objects in the heap. Reasoning about reachability is difficult for two main reasons. First, any heap modification may affect an unbounded number of reference chains, which complicates modular verification, in particular, framing. Second, general graph reachability is not supported by SMT solvers, which impedes automatic verification. In this paper, we present a modular specification and verification technique for reachability properties in separation logic. For each method, we specify reachability only locally within the fragment of the heap on which the method operates. A novel form of reachability framing for relatively convex subheaps allows one to extend reachability properties from the heap fragment of a callee to the larger fragment of its caller, enabling precise procedure-modular reasoning. Our technique supports practically important heap structures, namely acyclic graphs with a bounded outdegree as well as (potentially cyclic) graphs with at most one path (modulo cycles) between each pair of nodes. The integration into separation logic allows us to reason about reachability and other properties in a uniform way, to verify concurrent programs, and to automate our technique via existing separation logic verifiers. We demonstrate that our verification technique is amenable to SMT-based verification by encoding a number of benchmark examples into the Viper verification infrastructure.


title: Orthogonality Sampling Method for the Electromagnetic Inverse Scattering Problem

abstract: This paper is concerned with the electromagnetic inverse scattering problem that aims to determine the location and shape of anisotropic scatterers from far field data (at a fixed frequency). We study the orthogonality sampling method which is a simple, fast and robust imaging method for solving the electromagnetic inverse shape problem. We first provide a theoretical foundation for the sampling method and a resolution analysis of its imaging functional. We then establish an equivalent relation between the orthogonality sampling method and direct sampling method as well as resolution analysis for the latter. The analysis used to justify the Factorization method for the far field operator plays an important role in the justifications. Finally, we present some numerical examples to validate the performance of the sampling methods for anisotropic scatterers in three dimensions.


title: On the inverse scattering from anisotropic periodic layers and transmission eigenvalues

abstract: This paper is concerned with the inverse scattering and the transmission eigenvalues for anisotropic periodic layers. For the inverse scattering problem, we study the Factorization method for shape reconstruction of the periodic layers from near field scattering data. This method provides a fast numerical algorithm as well as a unique determination for the shape reconstruction of the scatterer. We present a rigorous justification and numerical examples for the factorization method. The transmission eigenvalue problem in scattering have recently attracted a lot of attentions. Transmission eigenvalues can be determined from scattering data and they can provide information about the material parameters of the scatterers. In this paper we formulate the interior transmission eigenvalue problem and prove the existence of infinitely many transmission eigenvalues for the scattering from anisotropic periodic layers.


title: Stimulated X-ray Raman and Absorption Spectroscopy of Iron-Sulfur Dimers

abstract: Iron-sulfur complexes play an important role in biological processes such as metabolic electron transport. A detailed understanding of the mechanism of long range electron transfer requires knowledge of the electronic structure of the complexes, which has traditionally been challenging to obtain, either by theory or by experiment, but the situation has begun to change with advances in quantum chemical methods and intense free electron laser light sources. We compute the signals from stimulated X-ray Raman spectroscopy (SXRS) and absorption spectroscopy of homovalent and mixed-valence [2Fe-2S] complexes, using the {\it ab initio} density matrix renormalization group (DMRG) algorithm. The simulated spectra show clear signatures of the theoretically predicted dense low-lying excited states within the d-d manifold. Furthermore, the difference in signal intensity between the absorption-active and Raman-active states provides a potential mechanism to selectively excite states by a proper tuning of the excitation pump, to access the electronic dynamics within this manifold.


title: Quoref: A Reading Comprehension Dataset with Questions Requiring Coreferential Reasoning

abstract: Machine comprehension of texts longer than a single sentence often requires coreference resolution. However, most current reading comprehension benchmarks do not contain complex coreferential phenomena and hence fail to evaluate the ability of models to resolve coreference. We present a new crowdsourced dataset containing more than 24K span-selection questions that require resolving coreference among entities in over 4.7K English paragraphs from Wikipedia. Obtaining questions focused on such phenomena is challenging, because it is hard to avoid lexical cues that shortcut complex reasoning. We deal with this issue by using a strong baseline model as an adversary in the crowdsourcing loop, which helps crowdworkers avoid writing questions with exploitable surface cues. We show that state-of-the-art reading comprehension models perform significantly worse than humans on this benchmark---the best model performance is 70.5 F1, while the estimated human performance is 93.4 F1.


title: Reinforcement Learning-Enabled Reliable Wireless Sensor Networks in Dynamic Underground Environments

abstract: Wireless underground sensor networks play an important role in underground sensing such as climate-smart agriculture and underground infrastructure monitoring. Existing works consider a static underground environment, which is not practical since the dielectric parameters of soil change frequently due to precipitation and harsh weather. This challenge cannot be ignored in real implementation due to the drastic change of wireless underground channel. In this paper, we study the effect of dynamic underground environment on wireless communications for sensor networks. We use the real data collected by in-situ sensors to train a Hidden Markov Model. Then, by using reinforcement learning, we derive the optimal transmission policies for underground sensors to efficiently use their energy and reduce the number of dropped and unsuccessfully transmitted packets. Through simulations using real data, we find that the developed algorithm can reduce the packet loss and transmit the sensed data in a timely manner.


title: Products of Ideals in Leavitt Path Algebras

abstract: Ideals in Leavitt path algebras have been shown to share many properties with those of integral domains. Since studying factorizations of ideals in integral domains into special types of ideals (particularly, prime, prime-power, primary, irreducible, semiprime, and quasi-primary ones) has proved fruitful, we conduct an analogous investigation in the context of Leavitt path algebras. Specifically, we classify the proper ideals in these rings that admit factorizations into products of each of the above types of ideals. We also classify the Leavitt path algebras where every proper ideal admits a factorization of each of these sorts, as well as those Leavitt path algebras where every proper ideal is of one of those types.


title: Cross-Domain Adaptation for Animal Pose Estimation

abstract: In this paper, we are interested in pose estimation of animals. Animals usually exhibit a wide range of variations on poses and there is no available animal pose dataset for training and testing. To address this problem, we build an animal pose dataset to facilitate training and evaluation. Considering the heavy labor needed to label dataset and it is impossible to label data for all concerned animal species, we, therefore, proposed a novel cross-domain adaptation method to transform the animal pose knowledge from labeled animal classes to unlabeled animal classes. We use the modest animal pose dataset to adapt learned knowledge to multiple animals species. Moreover, humans also share skeleton similarities with some animals (especially four-footed mammals). Therefore, the easily available human pose dataset, which is of a much larger scale than our labeled animal dataset, provides important prior knowledge to boost up the performance on animal pose estimation. Experiments show that our proposed method leverages these pieces of prior knowledge well and achieves convincing results on animal pose estimation.


title: Spin Seebeck effect in the layered ferromagnetic insulators CrSiTe$_3$ and CrGeTe$_3$

abstract: We have studied the longitudinal spin Seebeck effect (LSSE) in the layered ferromagnetic insulators CrSiTe$_3$ and CrGeTe$_3$ covered by Pt films in the measurement configuration where spin current traverses the ferromagnetic Cr layers. The LSSE response is clearly observed in the ferromagnetic phase and, in contrast to a standard LSSE magnet Y$_3$Fe$_5$O$_{12}$, persists above the critical temperatures in both CrSiTe$_3$/Pt and CrGeTe$_3$/Pt samples. With the help of a numerical calculation, we attribute the LSSE signals observed in the paramagnetic regime to exchange-dominated interlayer transport of in-plane paramagnetic moments reinforced by short-range ferromagnetic correlations and strong Zeeman effects.


title: Autonomous navigation of shape-shifting microswimmers

abstract: We describe a method for programming the autonomous navigation of active colloidal particles in response to spatial gradients in a scalar stimulus. Functional behaviors such as positive or negative chemotaxis are encoded in the particle shape, which responds to the local stimulus and directs self-propelled particle motions. We demonstrate this approach using a physical model of stimuli-responsive clusters of self-phoretic spheres. We show how multiple autonomous behaviors can be achieved by designing the particle geometry and its stimulus response.


title: Dynamics of Hot Bose-Einstein Condensates: stochastic Ehrenfest relations for number and energy damping

abstract: Describing partially-condensed Bose gases poses a long-standing theoretical challenge. We present exact stochastic Ehrenfest relations for the stochastic projected Gross-Pitaevskii equation, including both number and energy damping mechanisms, and all projector terms that arise from the energy cutoff separating system from reservoir. We test the theory by applying it to the centre of mass fluctuations of a harmonically trapped prolate system, finding close agreement between c-field simulations and analytical results. The formalism lays the foundation to analytically explore experimentally accessible hot Bose-Einstein condensates.


title: A Model of a Randomized Experiment with an Application to the PROWESS Clinical Trial

abstract: I develop a model of a randomized experiment with a binary intervention and a binary outcome. Potential outcomes in the intervention and control groups give rise to four types of participants. Fixing ideas such that the outcome is mortality, some participants would live regardless, others would be saved, others would be killed, and others would die regardless. These potential outcome types are not observable. However, I use the model to develop estimators of the number of participants of each type. The model relies on the randomization within the experiment and on deductive reasoning. I apply the model to an important clinical trial, the PROWESS trial, and I perform a Monte Carlo simulation calibrated to estimates from the trial. The reduced form from the trial shows a reduction in mortality, which provided a rationale for FDA approval. However, I find that the intervention killed two participants for every three it saved.


title: Counting Defiers

abstract: The LATE monotonicity assumption of Imbens and Angrist (1994) precludes "defiers," individuals whose treatment always runs counter to the instrument, in the terminology of Balke and Pearl (1993) and Angrist et al. (1996). I allow for defiers in a model with a binary instrument and a binary treatment. The model is explicit about the randomization process that gives rise to the instrument. I use the model to develop estimators of the counts of defiers, always takers, compliers, and never takers. I propose separate versions of the estimators for contexts in which the parameter of the randomization process is unspecified, which I intend for use with natural experiments with virtual random assignment. I present an empirical application that revisits Angrist and Evans (1998), which examines the impact of virtual random assignment of the sex of the first two children on subsequent fertility. I find that subsequent fertility is much more responsive to the sex mix of the first two children when defiers are allowed.


title: A Novel Scheme for Dark Matter Annihilation Feedback in Cosmological Simulations

abstract: We present a new self-consistent method for incorporating dark matter annihilation feedback (DMAF) in cosmological N-body simulations. The power generated by DMAF is evaluated at each dark matter (DM) particle which allows for flexible energy injection into the surrounding gas based on the specific DM annihilation model under consideration. Adaptive, individual time steps for gas and DM particles are supported and a new time-step limiter, derived from the propagation of a Sedov--Taylor blast wave, is introduced. We compare this donor-based approach with a receiver-based approach used in recent studies and illustrate the differences by means of a toy example. Furthermore, we consider an isolated halo and a cosmological simulation and show that for these realistic cases, both methods agree well with each other. The extension of our implementation to scenarios such as non-local energy injection, velocity-dependent annihilation cross-sections, and DM decay is straightforward.


title: Univalent Polynomials and Hubbard Trees

abstract: We study rational functions $f$ of degree $d+1$ such that $f$ is univalent in the exterior unit disc, and the image of the unit circle under $f$ has the maximal number of cusps ($d+1$) and double points $(d-2)$. We introduce a bi-angled tree associated to any such $f$. It is proven that any bi-angled tree is realizable by such an $f$, and moreover, $f$ is essentially uniquely determined by its associated bi-angled tree. This combinatorial classification is used to show that such $f$ are in natural 1:1 correspondence with anti-holomorphic polynomials of degree $d$ with $d-1$ distinct, fixed critical points (classified by their Hubbard trees).


title: Linear Stochastic Bandits Under Safety Constraints

abstract: Bandit algorithms have various application in safety-critical systems, where it is important to respect the system constraints that rely on the bandit's unknown parameters at every round. In this paper, we formulate a linear stochastic multi-armed bandit problem with safety constraints that depend (linearly) on an unknown parameter vector. As such, the learner is unable to identify all safe actions and must act conservatively in ensuring that her actions satisfy the safety constraint at all rounds (at least with high probability). For these bandits, we propose a new UCB-based algorithm called Safe-LUCB, which includes necessary modifications to respect safety constraints. The algorithm has two phases. During the pure exploration phase the learner chooses her actions at random from a restricted set of safe actions with the goal of learning a good approximation of the entire unknown safe set. Once this goal is achieved, the algorithm begins a safe exploration-exploitation phase where the learner gradually expands their estimate of the set of safe actions while controlling the growth of regret. We provide a general regret bound for the algorithm, as well as a problem dependent bound that is connected to the location of the optimal action within the safe set. We then propose a modified heuristic that exploits our problem dependent analysis to improve the regret.


title: Diversity of kilonova light curves

abstract: We perform radiative transfer simulations for kilonova in various situations, including the cases of prompt collapse to a black hole from neutron-star mergers, high-velocity ejecta possibly accelerated by magnetars, and a black hole-neutron star merger. Our calculations are done employing ejecta profiles predicted by numerical-relativity simulations and a new line list for all the r-process elements. We found that (i) the optical emission for binary neutron stars promptly collapsing to a black hole would be fainter by $\gtrsim1$-$2\,{\rm mag}$ than that found in GW170817, while the infrared emission could be as bright as that in GW170817 if the post-merger ejecta is as massive as $\approx0.01\,M_\odot$; (ii) the kilonova would be brighter than that observed in GW170817 for the case that the ejecta is highly accelerated by the electromagnetic energy injection from the remnant, but it would decline rapidly and the magnitude would become fainter than in GW170817 within a few days; (iii) the optical emission from a black hole-neutron star merger ejecta could be as bright as that observed in GW170817 for the case that sufficiently large amount of matter is ejected ($\gtrsim0.02\,M_\odot$), while the infrared brightness would be brighter by $1$-$2\,{\rm mag}$ at the same time. We show that the difference in the ejecta properties would be imprinted in the differences in the peak brightness and time of peak. This indicates that we may be able to infer the type of the central engine for kilonovae by observation of the peak in the multiple band.


title: A toolkit for twisted chiral superfields

abstract: We calculate the most general terms for arbitrary Lagrangians of twisted chiral superfields in 2D (2,2) supersymmetric theories [1]. The scalar and fermion kinetic terms and interactions are given explicitly. We define a set of twisted superspace coordinates, which allows to obtain Lagrangian terms for generic K\"ahler potential and generic twisted superpotential; this is done in analogy to the corresponding chiral superfields calculations [2]. As examples we obtain the Lagrangian of a single twisted superfield, i.e. the Abelian-dual of the gauged linear sigma model (GLSM) of a single chiral superfield, and the Lagrangian for the non-Abelian SU(2) dual of the $\mathbb{CP}^1$ GLSM model. Generic Lagrangians contain both twisted-chiral and chiral superfields, with distinct representations. We write down the kinetic terms for all bosons and fermions as well as their interactions for these generic cases. As twisted superfields play a central role for T-dualities and Mirror Symmetry in GLSMs, we expect the pedagogical exposition of this techniques to be useful in those studies.


title: An Analytical Probabilistic Expression for Modeling Sum of Spatial-dependent Wind Power Output

abstract: Applying probability-related knowledge to accurately explore and exploit the inherent uncertainty of wind power output is one of the key issues that need to be solved urgently in the development of smart grid. This letter develops an analytical probabilistic expression for modeling sum of spatial-dependent wind farm power output through introducing unit impulse function, copulas, and Gaussian mixture model. A comparative Monte Carlo sampling study is given to illustrate the validity of the proposed model.


title: Gaussian Sketching yields a J-L Lemma in RKHS

abstract: The main contribution of the paper is to show that Gaussian sketching of a kernel-Gram matrix $\boldsymbol K$ yields an operator whose counterpart in an RKHS $\mathcal H$, is a \emph{random projection} operator---in the spirit of Johnson-Lindenstrauss (J-L) lemma. To be precise, given a random matrix $Z$ with i.i.d. Gaussian entries, we show that a sketch $Z\boldsymbol{K}$ corresponds to a particular random operator in (infinite-dimensional) Hilbert space $\mathcal H$ that maps functions $f \in \mathcal H$ to a low-dimensional space $\mathbb R^d$, while preserving a weighted RKHS inner-product of the form $\langle f, g \rangle_{\Sigma} \doteq \langle f, \Sigma^3 g \rangle_{\mathcal H}$, where $\Sigma$ is the \emph{covariance} operator induced by the data distribution. In particular, under similar assumptions as in kernel PCA (KPCA), or kernel $k$-means (K-$k$-means), well-separated subsets of feature-space $\{K(\cdot, x): x \in \cal X\}$ remain well-separated after such operation, which suggests similar benefits as in KPCA and/or K-$k$-means, albeit at the much cheaper cost of a random projection. In particular, our convergence rates suggest that, given a large dataset $\{X_i\}_{i=1}^N$ of size $N$, we can build the Gram matrix $\boldsymbol K$ on a much smaller subsample of size $n\ll N$, so that the sketch $Z\boldsymbol K$ is very cheap to obtain and subsequently apply as a projection operator on the original data $\{X_i\}_{i=1}^N$. We verify these insights empirically on synthetic data, and on real-world clustering applications.


title: Mixed High-Order Attention Network for Person Re-Identification

abstract: Attention has become more attractive in person reidentification (ReID) as it is capable of biasing the allocation of available resources towards the most informative parts of an input signal. However, state-of-the-art works concentrate only on coarse or first-order attention design, e.g. spatial and channels attention, while rarely exploring higher-order attention mechanism. We take a step towards addressing this problem. In this paper, we first propose the High-Order Attention (HOA) module to model and utilize the complex and high-order statistics information in attention mechanism, so as to capture the subtle differences among pedestrians and to produce the discriminative attention proposals. Then, rethinking person ReID as a zero-shot learning problem, we propose the Mixed High-Order Attention Network (MHN) to further enhance the discrimination and richness of attention knowledge in an explicit manner. Extensive experiments have been conducted to validate the superiority of our MHN for person ReID over a wide variety of state-of-the-art methods on three large-scale datasets, including Market-1501, DukeMTMC-ReID and CUHK03-NP. Code is available at http://www.bhchen.cn/.


title: Partial generalized crossed products and a seven-term exact sequence

abstract: For a partial Galois extension of commutative rings we give a seven term exact sequence which generalize the Chase-Harrison-Rosenberg sequence.


title: Metallic liquid H3O in a thin-shell zone inside Uranus and Neptune

abstract: The Solar System harbors deep unresolved mysteries despite centuries-long study. A highly intriguing case concerns anomalous non-dipolar and non-axisymmetric magnetic fields of Uranus and Neptune that have long eluded explanation by the prevailing theory. A thin-shell dynamo conjecture captures observed phenomena but leaves unexplained fundamental material basis and underlying mechanism. Here, we report the discovery of trihydrogen oxide (H3O) in metallic liquid state stabilized at extreme pressure and temperature conditions inside these icy planets. Calculated stability pressure field compared to known pressure-radius relation for Uranus and Neptune places metallic liquid H3O in a thin-shell zone near planetary cores. These findings from accurate quantum mechanical calculations rationalize the empirically conjectured thin-shell dynamo model and establish key physical benchmarks that are essential to elucidating the enigmatic magnetic-field anomaly of Uranus and Neptune, resolving a major mystery in planetary science.


title: Decentralized Multi-Floor Exploration by a Swarm of Miniature Robots Teaming with Wall-Climbing Units

abstract: In this paper, we consider the problem of collectively exploring unknown and dynamic environments with a decentralized heterogeneous multi-robot system consisting of multiple units of two variants of a miniature robot. The first variant-a wheeled ground unit-is at the core of a swarm of floor-mapping robots exhibiting scalability, robustness and flexibility. These properties are systematically tested and quantitatively evaluated in unstructured and dynamic environments, in the absence of any supporting infrastructure. The results of repeated sets of experiments show a consistent performance for all three features, as well as the possibility to inject units into the system while it is operating. Several units of the second variant-a wheg-based wall-climbing unit-are used to support the swarm of mapping robots when simultaneously exploring multiple floors by expanding the distributed communication channel necessary for the coordinated behavior among platforms. Although the occupancy-grid maps obtained can be large, they are fully distributed. Not a single robotic unit possesses the overall map, which is not required by our cooperative path-planning strategy.


title: A deep-learning-based surrogate model for data assimilation in dynamic subsurface flow problems

abstract: A deep-learning-based surrogate model is developed and applied for predicting dynamic subsurface flow in channelized geological models. The surrogate model is based on deep convolutional and recurrent neural network architectures, specifically a residual U-Net and a convolutional long short term memory recurrent network. Training samples entail global pressure and saturation maps, at a series of time steps, generated by simulating oil-water flow in many (1500 in our case) realizations of a 2D channelized system. After training, the `recurrent R-U-Net' surrogate model is shown to be capable of accurately predicting dynamic pressure and saturation maps and well rates (e.g., time-varying oil and water rates at production wells) for new geological realizations. Assessments demonstrating high surrogate-model accuracy are presented for an individual geological realization and for an ensemble of 500 test geomodels. The surrogate model is then used for the challenging problem of data assimilation (history matching) in a channelized system. For this study, posterior reservoir models are generated using the randomized maximum likelihood method, with the permeability field represented using the recently developed CNN-PCA parameterization. The flow responses required during the data assimilation procedure are provided by the recurrent R-U-Net. The overall approach is shown to lead to substantial reduction in prediction uncertainty. High-fidelity numerical simulation results for the posterior geomodels (generated by the surrogate-based data assimilation procedure) are shown to be in essential agreement with the recurrent R-U-Net predictions. The accuracy and dramatic speedup provided by the surrogate model suggest that it may eventually enable the application of more formal posterior sampling methods in realistic problems.


title: Testing the Drift-Diffusion Model

abstract: The drift diffusion model (DDM) is a model of sequential sampling with diffusion (Brownian) signals, where the decision maker accumulates evidence until the process hits a stopping boundary, and then stops and chooses the alternative that corresponds to that boundary. This model has been widely used in psychology, neuroeconomics, and neuroscience to explain the observed patterns of choice and response times in a range of binary choice decision problems. This paper provides a statistical test for DDM's with general boundaries. We first prove a characterization theorem: we find a condition on choice probabilities that is satisfied if and only if the choice probabilities are generated by some DDM. Moreover, we show that the drift and the boundary are uniquely identified. We then use our condition to nonparametrically estimate the drift and the boundary and construct a test statistic.


title: A Cooperative Autoencoder for Population-Based Regularization of CNN Image Registration

abstract: Spatial transformations are enablers in a variety of medical image analysis applications that entail aligning images to a common coordinate systems. Population analysis of such transformations is expected to capture the underlying image and shape variations, and hence these transformations are required to produce anatomically feasible correspondences. This is usually enforced through some smoothness-based generic regularization on deformation field. Alternatively, population-based regularization has been shown to produce anatomically accurate correspondences in cases where anatomically unaware (i.e., data independent) fail. Recently, deep networks have been for unsupervised image registration, these methods are computationally faster and maintains the accuracy of state of the art methods. However, these networks use smoothness penalty on deformation fields and ignores population-level statistics of the transformations. We propose a novel neural network architecture that simultaneously learns and uses the population-level statistics of the spatial transformations to regularize the neural networks for unsupervised image registration. This regularization is in the form of a bottleneck autoencoder, which encodes the population level information of the deformation fields in a low-dimensional manifold. The proposed architecture produces deformation fields that describe the population-level features and associated correspondences in an anatomically relevant manner and are statistically compact relative to the state-of-the-art approaches while maintaining computational efficiency. We demonstrate the efficacy of the proposed architecture on synthetic data sets, as well as 2D and 3D medical data.


title: Holonomy Lie algebra of a geometric lattice

abstract: Motivated by Kohno's result on the holonomy Lie algebra of a hyperplane arrangement, we define the holonomy Lie algebra of a finite geometric lattice in a combinatorial way. For a solvable pair of lattices, we show that the holonomy Lie algebra is an almost-direct product of the holonomy Lie algebra of the sublattice and a free Lie subalgebra. This yields the structure of the holonomy Lie algebra of a finite hypersolvable (including supersolvable) lattice. As applications, we obtain the structure of the holonomy Lie algebra of (the Salvetti complex of) a supersolvable oriented matroid, and that of a hypersolvable arrangement.


title: Finite irreducible conformal modules over the extended Block type Lie conformal algebra $\mathfrak{B}(\alpha,\beta,p)$

abstract: In this paper, we introduce a class of infinite Lie conformal algebras $\mathfrak{B}(\alpha,\beta,p)$, which are the semi-direct sums of Block type Lie conformal algebra $\mathfrak{B}(p)$ and its non-trivial conformal modules of $\Z$-graded free intermediate series. The annihilation algebras are a class of infinite-dimensional Lie algebras, which include a lot of interesting subalgebras: Virasoro algebra, Block type Lie algebra, twisted Heisenberg-Virasoro algebra and so on. We give a complete classification of all finite non-trivial irreducible conformal modules of $\mathfrak{B}(\alpha,\beta,p)$ for $\alpha,\beta\in\C, p\in\C^*$. As an application, the classifications of finite irreducible conformal modules over a series of finite Lie conformal algebras $\mathfrak{b}(n)$ for $n\geq1$ are given.


title: Named Entity Recognition for Nepali Language

abstract: Named Entity Recognition have been studied for different languages like English, German, Spanish and many others but no study have focused on Nepali language. In this paper we propose a neural based Nepali NER using latest state-of-the-art architecture based on grapheme-level which doesn't require any hand-crafted features and no data pre-processing. Our novel neural based model gained relative improvement of 33% to 50% compared to feature based SVM model and up to 10% improvement over state-of-the-art neural based model developed for languages beside Nepali.


title: Machine learning magnetic parameters from spin configurations

abstract: Hamiltonian parameter estimation is crucial in condensed matter physics, but time and cost consuming in terms of resources used. With advances in observation techniques, high-resolution images with more detailed information are obtained, which can serve as an input to machine learning (ML) algorithms to extract Hamiltonian parameters. However, the number of labeled images is rather limited. Here, we provide a protocol for Hamiltonian parameter estimation based on a machine learning architecture, which is trained on a small amount of simulated images and applied to experimental spin configuration images. Sliding windows on the input images enlarges the number of training images; therefore we can train well a neural network on a small dataset of simulated images which are generated adaptively using the same external conditions such as temperature and magnetic field as the experiment. The neural network is applied to the experimental image and estimates magnetic parameters efficiently. We demonstrate the success of the estimation by reproducing the same configuration from simulation and predict a hysteresis loop accurately. Our approach paves a way to a stable and general parameter estimation.


title: Optimizing phonon scattering by tuning surface-interdiffusion-driven intermixing to break the random-alloy limit of thermal conductivity

abstract: We investigate the evolution of the cross-plane thermal conductivity $\kappa$ of superlattices (SLs) as interfaces change from perfectly abrupt to totally intermixed, by using non-equilibrium molecular dynamics simulations in combination with the spectral heat current calculations. We highlight the role of surface-interdiffusion-driven intermixing by calculating the $\kappa$ of SLs with changing interface roughness, whose tuning allows for the $\kappa$ values much lower than the "alloy limit" and the abrupt interface limit in same cases. The interplay between alloy and interface scattering in different frequency ranges provides a physical basis to predict a minimum of thermal conductivity. More specifically, we also explore how the interface roughness affects the thermal conductivities for SLs materials with a broad span of atomic mass and bond strength. In particular, we find that (i) only when the "spacer" thickness of SLs increases up to a critical value the $\kappa$ of rough SLs can break the corresponding "alloy limit". (ii) Whether the $\kappa$ changes monotonically as interface roughness strongly depends on the period length and intrinsic behavior of phonon transport for SLs materials. Especially, for the SL with large period length, there exists an optimal interface roughness which can minimize the thermal conductivity. (iii) Surface-interdiffusion-driven intermixing is more effective in achieving the low $\kappa$ below the alloy limit for SL materials with large mass mismatch than with small one. (iv) It's possible for SLs materials with large lattice mismatch (i.e., bond strength) to design an ideally abrupt interface structure with $\kappa$ much below the "alloy limit". These results have a clear implications for optimization of thermal transport for heat management and for the development of thermoelectric materials.


title: Flag-transitive block designs and finite exceptional simple groups of Lie type

abstract: In this article, we study $2$-designs with $\gcd(r,\lambda)=1$ admitting a flag-transitive almost simple automorphism group with socle a finite simple exceptional group of Lie type. We obtain four infinite families of such designs and provide some examples in each of these families.


title: Transferable Contrastive Network for Generalized Zero-Shot Learning

abstract: Zero-shot learning (ZSL) is a challenging problem that aims to recognize the target categories without seen data, where semantic information is leveraged to transfer knowledge from some source classes. Although ZSL has made great progress in recent years, most existing approaches are easy to overfit the sources classes in generalized zero-shot learning (GZSL) task, which indicates that they learn little knowledge about target classes. To tackle such problem, we propose a novel Transferable Contrastive Network (TCN) that explicitly transfers knowledge from the source classes to the target classes. It automatically contrasts one image with different classes to judge whether they are consistent or not. By exploiting the class similarities to make knowledge transfer from source images to similar target classes, our approach is more robust to recognize the target images. Experiments on five benchmark datasets show the superiority of our approach for GZSL.


title: The Kepler Peas in a Pod Pattern is Astrophysical

abstract: \Kepler\ planets around a given star have similar sizes to each other and regular orbital spacing, like "peas in a pod." Several studies have tested whether detection bias could produce this apparent pattern by resampling planet radii at random and applying a sensitivity function analogous to that of the Kepler spacecraft. However, \citet{Zhu2019} argues that this pattern is not astrophysical but an artifact of Kepler's discovery efficiency at the detection threshold. To support this claim, their new analysis samples the transit signal-to-noise ratio (SNR) to derive a synthetic population of bootstrapped planet radii. Here, we examine the procedure of sampling transit SNR and demonstrate it is not applicable. Sampling transit SNR does not set up random, independent planet radii, and so it is unsuitable for corroborating (or falsifying) detection bias as the origin of apparent patterns in planet radius. By sampling the planet radii directly and using a simple model for Kepler's sensitivity, we rule out detection bias as the source of the peas-in-a-pod pattern with $>10$-$\sigma$ confidence.


title: An efficient implementation of mass conserving characteristic-based schemes in 2D and 3D

abstract: In this paper, we develop the ball-approximated characteristics (B-char) method, which is an algorithm for efficiently implementing characteristic-based schemes in 2D and 3D. Core to the implementation of numerical schemes is the evaluation of integrals, which in the context of characteristic-based schemes with piecewise constant approximations boils down to computing the intersections between two regions. In the literature, these regions are approximated by polytopes (polygons in 2D and polyhedra in 3D) and, due to this, the implementation in 3D is nontrivial. The main novelty in this paper is the approximation of the regions by balls, whose intersections are much cheaper to compute than those of polytopes. Of course, balls cannot fully tessellate a region, and hence some mass may be lost. We perform some adjustments, and also solve an optimisation problem, in order to yield a scheme that is both locally and globally mass conserving. This algorithm can achieve results that are similar to those obtained from an implementation which uses polytopal intersections, with a much cheaper computational cost.


title: Bayesian Spatial Field Reconstruction with Unknown Distortions in Sensor Networks

abstract: Spatial regression of random fields based on potentially biased sensing information is proposed in this paper. One major concern in such applications is that since it is not known a-priori what the accuracy of the collected data from each sensor is, the performance can be negatively affected if the collected information is not fused appropriately. For example, the data collector may measure the phenomenon inappropriately, or alternatively, the sensors could be out of calibration, thus introducing random gain and bias to the measurement process. Such readings would be systematically distorted, leading to incorrect estimation of the spatial field. To combat this detrimental effect, we develop a robust version of the spatial field model based on a mixture of Gaussian process experts. We then develop two different approaches for Bayesian spatial field reconstruction: the first algorithm is the Spatial Best Linear Unbiased Estimator (S-BLUE), in which one considers the quadratic loss function and restricts the estimator to the linear family of transformations; the second algorithm is based on empirical Bayes, which utilises a two-stage estimation procedure to produce accurate predictive inference in the presence of "misbehaving" sensors. In addition, we develop the distributed version of these two approaches to drastically improve the computational efficiency in large-scale settings. We present extensive simulation results using both synthetic datasets and semi-synthetic datasets with real temperature measurements and simulated distortions to draw useful conclusions regarding the performance of each of the algorithms.


title: Two-dimensional magnetic semiconductors with room Curie temperatures

abstract: We propose two-dimensional (2D) Ising-type ferromagnetic semiconductors TcSiTe3, TcGeSe3, and TcGeTe3 with high Curie temperatures around 200-0500 K. Owing to large spin-orbit couplings, the large magnetocrystalline anisotropy energy (MAE), large anomalous Hall conductivity, and large magneto-optical Kerr effect were discovered in these intriguing 2D materials. By comparing all possible 2D MGeTe3 materials (M = 3d, 4d, 5d transition metals), we found a large orbital moment around 0.5 $\mu$B per atom and a large MAE for TcGeTe3. The large orbital moments are revealed to be from the comparable crystal fields and electron correlations in these Tc-based 2D materials. The microscopic mechanism of the high Curie temperature is also addressed. Our findings reveal the unique magnetic behaviors of 2D Tc-based materials and present a family of 2D ferromagnetic semiconductors with large MAE and Kerr rotation angles that would have wide applications in designing spintronic devices.


title: Universal fluctuations in the bulk of Rayleigh-B\'enard turbulence

abstract: We present an investigation of the root-mean-square (rms) temperature $\sigma_T$ and the rms velocity $\sigma_w$ in the bulk of Rayleigh-B\'enard turbulence, using new experimental data from the current study and experimental and numerical data from previous studies. We find that, once scaled by the convective temperature $\theta_*$, the value of $\sigma_T$ at the cell centre is a constant, i.e. $\sigma_{T,c}/\theta_* \approx 0.85$, over a wide range of the Rayleigh number ($10^{8}\leq Ra\leq 10^{15}$) and the Prandtl number ($0.7\leq Pr \leq 23.34$), and is independent of the surface topographies of the top and bottom plates of the convection cell. A constant close to unity suggests that $\theta_*$ is a proper measure of the temperature fluctuation in the core region. On the other hand, $\sigma_{w,c}/w_*$, the vertical rms velocity at the cell centre scaled by the convective velocity $w_*$, shows a weak $Ra$-dependence ($\sim Ra^{0.07\pm0.02}$) over $10^8\leq Ra\leq 10^{10}$ at $Pr\sim4.3$ and is independent of plate topography. Similar to a previous finding by He \& Xia ({\it Phys. Rev. Lett.,} vol. 122, 2019, 014503), we find that the rms temperature profile $\sigma_T(z)/\theta_*$ in the region of the mixing zone with a mean horizontal shear exhibits a power-law dependence on the distance $z$ from the plate, but now the universal profile applies to both smooth and rough surface topographies and over a wider range of $Ra$. The vertical rms velocity profile $\sigma_w(z)/w_*$ obey a logarithmic dependence on $z$. The study thus demonstrates that the typical scales for the temperature and the velocity are the convective temperature $\theta_*$ and the the convective velocity $w_*$, respectively. Finally, we note that $\theta_*$ may be utilised to study the flow regime transitions in the ultra-high-$Ra$-number turbulent convection.


title: Pushing the Limits of Low-Resource Morphological Inflection

abstract: Recent years have seen exceptional strides in the task of automatic morphological inflection generation. However, for a long tail of languages the necessary resources are hard to come by, and state-of-the-art neural methods that work well under higher resource settings perform poorly in the face of a paucity of data. In response, we propose a battery of improvements that greatly improve performance under such low-resource conditions. First, we present a novel two-step attention architecture for the inflection decoder. In addition, we investigate the effects of cross-lingual transfer from single and multiple languages, as well as monolingual data hallucination. The macro-averaged accuracy of our models outperforms the state-of-the-art by 15 percentage points. Also, we identify the crucial factors for success with cross-lingual transfer for morphological inflection: typological similarity and a common representation across languages.


title: Bidirectional Typing

abstract: Bidirectional typing combines two modes of typing: type checking, which checks that a program satisfies a known type, and type synthesis, which determines a type from the program. Using checking enables bidirectional typing to support features for which inference is undecidable; using synthesis enables bidirectional typing to avoid the large annotation burden of explicitly typed languages. In addition, bidirectional typing improves error locality. We highlight the design principles that underlie bidirectional type systems, survey the development of bidirectional typing from the prehistoric period before Pierce and Turner's local type inference to the present day, and provide guidance for future investigations.


title: Tag2Pix: Line Art Colorization Using Text Tag With SECat and Changing Loss

abstract: Line art colorization is expensive and challenging to automate. A GAN approach is proposed, called Tag2Pix, of line art colorization which takes as input a grayscale line art and color tag information and produces a quality colored image. First, we present the Tag2Pix line art colorization dataset. A generator network is proposed which consists of convolutional layers to transform the input line art, a pre-trained semantic extraction network, and an encoder for input color information. The discriminator is based on an auxiliary classifier GAN to classify the tag information as well as genuineness. In addition, we propose a novel network structure called SECat, which makes the generator properly colorize even small features such as eyes, and also suggest a novel two-step training method where the generator and discriminator first learn the notion of object and shape and then, based on the learned notion, learn colorization, such as where and how to place which color. We present both quantitative and qualitative evaluations which prove the effectiveness of the proposed method.


title: Recurrent U-net: Deep learning to predict daily summertime ozone in the United States

abstract: We use a hybrid deep learning model to predict June-July-August (JJA) daily maximum 8-h average (MDA8) surface ozone concentrations in the US. A set of meteorological fields from the ERA-Interim reanalysis as well as monthly mean NO$_x$ emissions from the Community Emissions Data System (CEDS) inventory are selected as predictors. Ozone measurements from the US Environmental Protection Agency (EPA) Air Quality System (AQS) from 1980 to 2009 are used to train the model, whereas data from 2010 to 2014 are used to evaluate the performance of the model. The model captures well daily, seasonal and interannual variability in MDA8 ozone across the US. Feature maps show that the model captures teleconnections between MDA8 ozone and the meteorological fields, which are responsible for driving the ozone dynamics. We used the model to evaluate recent trends in NO$_x$ emissions in the US and found that the trend in the EPA emission inventory produced the largest negative bias in MDA8 ozone between 2010-2016. The top-down emission trends from the Tropospheric Chemistry Reanalysis (TCR-2), which is based on satellite observations, produced predictions in best agreement with observations. In urban regions, the trend in AQS NO$_2$ observations provided ozone predictions in agreement with observations, whereas in rural regions the satellite-derived trends produced the best agreement. In both rural and urban regions the EPA trend resulted in the largest negative bias in predicted ozone. Our results suggest that the EPA inventory is overestimating the reductions in NO$_x$ emissions and that the satellite-derived trend reflects the influence of reductions in NO$_x$ emissions as well as changes in background NO$_x$. Our results demonstrate the significantly greater predictive capability that the deep learning model provides over conventional atmospheric chemical transport models for air quality analyses.

categories: physics.ao-ph cs.CV cs.LG physics.chem-ph physics.geo-ph


title: Holomorphic family of strongly pseudoconvex domains in a K\"ahler manifold

abstract: Let $p:X\rightarrow Y$ be a surjective holomorphic mapping between K\"ahler manifolds. Let $D$ be a bounded smooth domain in $X$ such that every generic fiber $D_y:=D\cap p^{-1}(y)$ for $y\in Y$ is a strongly pseudoconvex domain in $X_y:=p^{-1}(y)$, which admits the complete K\"ahler-Einstein metric. This family of K\"ahler-Einstein metrics induces a smooth $(1,1)$-form $\rho$ on $D$. In this paper, we prove that $\rho$ is positive-definite on $D$ if $D$ is strongly pseudoconvex. We also discuss the extensioin of $\rho$ as a positive current across singular fibers.


title: Secure State Estimation and Control for Cyber Security of AC Microgrids

abstract: A timely, accurate, and secure dynamic state estimation is needed for reliable monitoring and efficient control of microgrids. The synchrophasor technology enables us to obtain synchronized measurements in real-time and to develop dynamic state estimators for real-time monitoring and control of microgrids. In this study, we consider an AC microgrid comprising several synchronous generators and inverter-interface power supplies, and focus on securely estimating the dynamic states of the microgrid from a set of corrupted data. We propose a dynamic state estimator which enables the microgrid operator to reconstruct the dynamic states of the microgrid from a set of corrupted data. Finally, we consider an AC microgrid with the same topology as the IEEE 33-bus distribution system, and numerically show that the proposed secure estimation algorithm can accurately reconstruct the attack signals.


title: Second main theorem for holomorphic curves into algebraic varieties intersecting moving hypersurfaces targets

abstract: Since the great work on holomorphic curves into algebraic varieties intersecting hypersurfaces in general position established by Ru in 2009, recently there has been some developments on the second main theorem into algebraic varieties intersecting moving hypersurfaces targets. The main purpose of this paper is to give some interesting improvements of Ru's second main theorem for moving hypersurfaces targets located in subgeneral position with index.


title: Memory-Efficient Object-Oriented Programming on GPUs

abstract: Object-oriented programming is often regarded as too inefficient for high-performance computing (HPC), despite the fact that many important HPC problems have an inherent object structure. Our goal is to bring efficient, object-oriented programming to massively parallel SIMD architectures, especially GPUs. In this thesis, we develop various techniques for optimizing object-oriented GPU code. Most notably, we identify the object-oriented Single-Method Multiple-Objects (SMMO) programming model. We first develop an embedded C++ Structure of Arrays (SOA) data layout DSL for SMMO applications. We then design a lock-free, dynamic memory allocator that stores allocations in SOA layout. Finally, we show how to further optimize the memory access of SMMO applications with memory defragmentation.