title: The impact of classical and General Relativistic obliquity precessions on the habitability of circumstellar neutron stars' planets

abstract: Recently, it has been shown that rocky planets orbiting neutron stars can be habitable under non unrealistic circumstances. If a distant, pointlike source of visible light such as a Sun-like main sequence star or the gravitationally lensed accretion disk of a supermassive black hole is present as well, possible temporal variations $\Delta\varepsilon_\mathrm{p}(t)$ of the planet's axial tilt $\varepsilon_\mathrm{p}$ to the ecliptic plane should be included in the overall habitability budget since the obliquity determines the insolation at a given latitude on a body' s surface. I point out that, for rather generic initial spin-orbit initial configurations, general relativistic and classical spin variations induced by the post-Newtonian de Sitter and Lense-Thirring components of the field of the host neutron star and by its pull to the planetary oblateness $J_2^\mathrm{p}$ may induce huge and very fast variations of $\varepsilon_\mathrm{p}$ which would likely have an impact on the habitability of such worlds. In particular, for a planet's distance of, say, $0.005\,\mathrm{au}$ from a $1.4\,M_\odot$ neutron star corresponding to an orbital period $P_\mathrm{b}=0.109\,\mathrm{d}$, obliquity shifts $\Delta\varepsilon_\mathrm{p}$ as large as $\varepsilon^\mathrm{max}_\mathrm{p}-\varepsilon_\mathrm{p}^\mathrm{min}\simeq 50^\circ-100^\circ$ over characteristic timescales as short as $10\,\mathrm{d}$ ($J_2^\mathrm{p}$) to $3\,\mathrm{Myr}$ (Lense-Thirring) may occur for arbitrary orientations of the orbital and spin angular momenta $\boldsymbol{L},\,{\boldsymbol{S}}_\mathrm{ns},\,{\boldsymbol{S}}_\mathrm{p}$ of the planet-neutron star system. In view of this feature of their spins, I dub such hypothetical planets as ``nethotrons".


title: A Convex Approximation for the Tertiary Control of Unbalanced Microgrids

abstract: This article presents an optimization model for tertiary control in three-phase unbalanced microgrids. This model considers 24h operation and includes renewable energy sources, energy storage devices, and grid code limitations. Power flow equations are simplified using a recently developed approximation based on Wirtinger's calculus. The proposed model is evaluated both theoretically and practically. From the theoretical point of view, the model is suitable for tertiary control since it is convex; hence, global optimum, uniqueness of the solution, and convergence of the interior point method are guaranteed. From the practical point of view, the model is simple enough to be implemented in a small single-board computer with low time calculation. The latter is evaluated by implementing the model in a Raspberry-Pi board with the CIGRE low voltage benchmark; the model is also evaluated in the IEEE 123-nodes test system for power distribution networks.


title: Hardness of Approximate Diameter: Now for Undirected Graphs

abstract: Approximating the graph diameter is a basic task of both theoretical and practical interest. A simple folklore algorithm can output a 2-approximation to the diameter in linear time by running BFS from an arbitrary vertex. It has been open whether a better approximation is possible in near-linear time. A series of papers on fine-grained complexity have led to strong hardness results for diameter in directed graphs, culminating in a recent tradeoff curve independently discovered by [Li, STOC'21] and [Dalirrooyfard and Wein, STOC'21], showing that under the Strong Exponential Time Hypothesis (SETH), for any integer $k\ge 2$ and $\delta>0$, a $2-\frac{1}{k}-\delta$ approximation for diameter in directed $m$-edge graphs requires $mn^{1+1/(k-1)-o(1)}$ time. In particular, the simple linear time $2$-approximation algorithm is optimal for directed graphs. In this paper we prove that the same tradeoff lower bound curve is possible for undirected graphs as well, extending results of [Roditty and Vassilevska W., STOC'13], [Li'20] and [Bonnet, ICALP'21] who proved the first few cases of the curve, $k=2,3$ and $4$, respectively. Our result shows in particular that the simple linear time $2$-approximation algorithm is also optimal for undirected graphs. To obtain our result we develop new tools for fine-grained reductions that could be useful for proving SETH-based hardness for other problems in undirected graphs related to distance computation.


title: Sparse and Imperceptible Adversarial Attack via a Homotopy Algorithm

abstract: Sparse adversarial attacks can fool deep neural networks (DNNs) by only perturbing a few pixels (regularized by l_0 norm). Recent efforts combine it with another l_infty imperceptible on the perturbation magnitudes. The resultant sparse and imperceptible attacks are practically relevant, and indicate an even higher vulnerability of DNNs that we usually imagined. However, such attacks are more challenging to generate due to the optimization difficulty by coupling the l_0 regularizer and box constraints with a non-convex objective. In this paper, we address this challenge by proposing a homotopy algorithm, to jointly tackle the sparsity and the perturbation bound in one unified framework. Each iteration, the main step of our algorithm is to optimize an l_0-regularized adversarial loss, by leveraging the nonmonotone Accelerated Proximal Gradient Method (nmAPG) for nonconvex programming; it is followed by an l_0 change control step, and an optional post-attack step designed to escape bad local minima. We also extend the algorithm to handling the structural sparsity regularizer. We extensively examine the effectiveness of our proposed homotopy attack for both targeted and non-targeted attack scenarios, on CIFAR-10 and ImageNet datasets. Compared to state-of-the-art methods, our homotopy attack leads to significantly fewer perturbations, e.g., reducing 42.91% on CIFAR-10 and 75.03% on ImageNet (average case, targeted attack), at similar maximal perturbation magnitudes, when still achieving 100% attack success rates. Our codes are available at: https://github.com/VITA-Group/SparseADV_Homotopy.


title: Sample Recycling Method -- A New Approach to Efficient Nested Monte Carlo Simulations

abstract: Nested stochastic modeling has been on the rise in many fields of the financial industry. Such modeling arises whenever certain components of a stochastic model are stochastically determined by other models. There are at least two main areas of applications, including (1) portfolio risk management in the banking sector and (2) principle-based reserving and capital requirements in the insurance sector. As financial instrument values often change with economic fundamentals, the risk management of a portfolio (outer loop) often requires the assessment of financial positions subject to changes in risk factors in the immediate future. The valuation of financial position (inner loop) is based on projections of cashflows and risk factors into the distant future. The nesting of such stochastic modeling can be computationally challenging. Most of existing techniques to speed up nested simulations are based on curve fitting. The main idea is to establish a functional relationship between inner loop estimator and risk factors by running a limited set of economic scenarios, and, instead of running inner loop simulations, inner loop estimations are made by feeding other scenarios into the fitted curve. This paper presents a non-conventional approach based on the concept of sample recycling. Its essence is to run inner loop estimation for a small set of outer loop scenarios and to find inner loop estimates under other outer loop scenarios by recycling those known inner loop paths. This new approach can be much more efficient when traditional techniques are difficult to implement in practice.


title: Neuroadaptive electroencephalography: a proof-of-principle study in infants

abstract: A core goal of functional neuroimaging is to study how the environment is processed in the brain. The mainstream paradigm involves concurrently measuring a broad spectrum of brain responses to a small set of environmental features preselected with reference to previous studies or a theoretical framework. As a complement, we invert this approach by allowing the investigator to record the modulation of a preselected brain response by a broad spectrum of environmental features. Our approach is optimal when theoretical frameworks or previous empirical data are impoverished. By using a prespecified closed-loop design, the approach addresses fundamental challenges of reproducibility and generalisability in brain research. These conditions are particularly acute when studying the developing brain, where our theories based on adult brain function may fundamentally misrepresent the topography of infant cognition and where there are substantial practical challenges to data acquisition. Our methodology employs machine learning to map modulation of a neural feature across a space of experimental stimuli. Our method collects, processes and analyses EEG brain data in real-time; and uses a neuro-adaptive Bayesian optimisation algorithm to adjust the stimulus presented depending on the prior samples of a given participant. Unsampled stimuli can be interpolated by fitting a Gaussian process regression along the dataset. We show that our method can automatically identify the face of the infant's mother through online recording of their Nc brain response to a face continuum. We can retrieve model statistics of individualised responses for each participant, opening the door for early identification of atypical development. This approach has substantial potential in infancy research and beyond for improving power and generalisability of mapping the individual cognitive topography of brain function.


title: Pricing methods for $\alpha$-quantile and perpetual early exercise options based on Spitzer identities

abstract: We present new numerical schemes for pricing perpetual Bermudan and American options as well as $\alpha$-quantile options. This includes a new direct calculation of the optimal exercise barrier for early-exercise options. Our approach is based on the Spitzer identities for general L\'evy processes and on the Wiener-Hopf method. Our direct calculation of the price of $\alpha$-quantile options combines for the first time the Dassios-Port-Wendel identity and the Spitzer identities for the extrema of processes. Our results show that the new pricing methods provide excellent error convergence with respect to computational time when implemented with a range of L\'evy processes.


title: The nonlocal Kelvin principle and the dual approach to nonlocal control in the conduction coefficients

abstract: We explore the dual approach to nonlocal optimal design, specifically for a classical min-max problem which in this study is associated with a nonlocal scalar diffusion equation. We reformulate the optimal design problem utilizing a dual variational principle, which is expressed in terms of nonlocal two-point fluxes. We introduce the proper functional space framework to deal with this formulation, and establish its well-posedness. The key ingredient is the inf-sup (Ladyzhenskaya--Babuska--Brezzi) condition, which holds uniformly with respect to small nonlocal horizons. As a byproduct of this, we are able to prove convergence of nonlocal to local optimal design problems in a straightforward fashion.


title: Inverse limit slender groups

abstract: Classically, an abelian group $G$ is said to be slender if every homomorphism from the countable product $\mathbb Z^{\mathbb N}$ to $G$ factors through the projection to some finite product $\mathbb Z^n$. Various authors have proposed generalizations to non-commutative groups, resulting in a plethora of similar but not completely equivalent concepts. In the first part of this work we present a unified treatment of these concepts and examine how are they related. In the second part of the paper we study slender groups in the context of co-small objects in certain categories, and give several new applications including the proof that certain homology groups of Barratt-Milnor spaces are cotorsion groups and a universal coefficients theorem for \v{C}ech cohomology with coefficients in a slender group.


title: Deep Probabilistic Koopman: Long-term time-series forecasting under periodic uncertainties

abstract: Probabilistic forecasting of complex phenomena is paramount to various scientific disciplines and applications. Despite the generality and importance of the problem, general mathematical techniques that allow for stable long-term forecasts with calibrated uncertainty measures are lacking. For most time series models, the difficulty of obtaining accurate probabilistic future time step predictions increases with the prediction horizon. In this paper, we introduce a surprisingly simple approach that characterizes time-varying distributions and enables reasonably accurate predictions thousands of timesteps into the future. This technique, which we call Deep Probabilistic Koopman (DPK), is based on recent advances in linear Koopman operator theory, and does not require time stepping for future time predictions. Koopman models also tend to have a small parameter footprint (often less than 10,000 parameters). We demonstrate the long-term forecasting performance of these models on a diversity of domains, including electricity demand forecasting, atmospheric chemistry, and neuroscience. For electricity demand modeling, our domain-agnostic technique outperforms all of 177 domain-specific competitors in the most recent Global Energy Forecasting Competition.


title: Spin-Orbit Coupled Exciton-Polariton Condensates in Lead Halide Perovskites

abstract: Spin-orbit coupling (SOC) is responsible for a range of spintronic and topological processes in condensed matter. Here we show photonic analogs of SOCs in exciton-polaritons and their condensates in microcavities composed of birefringent lead halide perovskite single crystals. The presence of crystalline anisotropy coupled with splitting in the optical cavity of the transverse electric (TE) and transverse magnetic (TM) modes gives rise to a non-Abelian gauge field, which can be described by the Rashba-Dresselhaus Hamiltonian near the degenerate points of the two polarization modes. With increasing density, the exciton polaritons with pseudospin textures undergo phase transitions to competing condensates with orthogonal polarizations. Unlike their pure photonic counterparts, these exciton polaritons and condensates inherit nonlinearity from their excitonic components and may serve as quantum simulators of many-body SOC processes.


title: Extended search for supernova-like neutrinos in NOvA coincident with LIGO/Virgo detections

abstract: A search is performed for supernova-like neutrino interactions coincident with 76 gravitational wave events detected by the LIGO/Virgo Collaboration. For 40 of these events, full readout of the time around the gravitational wave is available from the NOvA Far Detector. For these events, we set limits on the fluence of the sum of all neutrino flavors of $F < 7(4)\times 10^{10}\mathrm{cm}^{-2}$ at 90% C.L. assuming energy and time distributions corresponding to the Garching supernova models with masses 9.6(27)$\mathrm{M}_\odot$. Under the hypothesis that any given gravitational wave event was caused by a supernova, this corresponds to a distance of $r > 29(50)$kpc at 90% C.L. Weaker limits are set for other gravitational wave events with partial Far Detector data and/or Near Detector data.


title: Leavitt path algebras of labelled graphs

abstract: A Leavitt labelled path algebra over a commutative unital ring is associated with a labelled space, generalizing Leavitt path algebras associated with graphs and ultragraphs as well as torsion-free commutative algebras generated by idempotents. We show that Leavitt labelled path algebras can be realized as partial skew group rings, Steinberg algebras, and Cuntz-Pimsner algebras. Via these realizations we obtain generalized uniqueness theorems, a description of diagonal preserving isomorphisms and we characterize simplicity of Leavitt labelled path algebras. In addition, we prove that a large class of partial skew group rings can be realized as Leavitt labelled path algebras.


title: Small space and streaming pattern matching with k edits

abstract: In this work, we revisit the fundamental and well-studied problem of approximate pattern matching under edit distance. Given an integer $k$, a pattern $P$ of length $m$, and a text $T$ of length $n \ge m$, the task is to find substrings of $T$ that are within edit distance $k$ from $P$. Our main result is a streaming algorithm that solves the problem in $\tilde{O}(k^5)$ space and $\tilde{O}(k^8)$ amortised time per character of the text, providing answers correct with high probability. (Hereafter, $\tilde{O}(\cdot)$ hides a $\mathrm{poly}(\log n)$ factor.) This answers a decade-old question: since the discovery of a $\mathrm{poly}(k\log n)$-space streaming algorithm for pattern matching under Hamming distance by Porat and Porat [FOCS 2009], the existence of an analogous result for edit distance remained open. Up to this work, no $\mathrm{poly}(k\log n)$-space algorithm was known even in the simpler semi-streaming model, where $T$ comes as a stream but $P$ is available for read-only access. In this model, we give a deterministic algorithm that achieves slightly better complexity. In order to develop the fully streaming algorithm, we introduce a new edit distance sketch parametrised by integers $n\ge k$. For any string of length at most $n$, the sketch is of size $\tilde{O}(k^2)$ and it can be computed with an $\tilde{O}(k^2)$-space streaming algorithm. Given the sketches of two strings, in $\tilde{O}(k^3)$ time we can compute their edit distance or certify that it is larger than $k$. This result improves upon $\tilde{O}(k^8)$-size sketches of Belazzougui and Zhu [FOCS 2016] and very recent $\tilde{O}(k^3)$-size sketches of Jin, Nelson, and Wu [STACS 2021].


title: Modeling Hierarchical Structures with Continuous Recursive Neural Networks

abstract: Recursive Neural Networks (RvNNs), which compose sequences according to their underlying hierarchical syntactic structure, have performed well in several natural language processing tasks compared to similar models without structural biases. However, traditional RvNNs are incapable of inducing the latent structure in a plain text sequence on their own. Several extensions have been proposed to overcome this limitation. Nevertheless, these extensions tend to rely on surrogate gradients or reinforcement learning at the cost of higher bias or variance. In this work, we propose Continuous Recursive Neural Network (CRvNN) as a backpropagation-friendly alternative to address the aforementioned limitations. This is done by incorporating a continuous relaxation to the induced structure. We demonstrate that CRvNN achieves strong performance in challenging synthetic tasks such as logical inference and ListOps. We also show that CRvNN performs comparably or better than prior latent structure models on real-world tasks such as sentiment analysis and natural language inference.


title: Neural Predicting Higher-order Patterns in Temporal Networks

abstract: Dynamic systems that consist of a set of interacting elements can be abstracted as temporal networks. Recently, higher-order patterns that involve multiple interacting nodes have been found crucial to indicate domain-specific laws of different temporal networks. This posts us the challenge of designing more sophisticated hypergraph models for these higher-order patterns and the associated new learning algorithms. Here, we propose the first model, named HIT, for full-spectrum higher-order pattern prediction in temporal hypergraphs. Particularly, we focus on predicting three types of common but important interaction patterns involving three interacting elements in temporal networks, which could be extended to even higher-order patterns. HIT extracts the structural representation of a node triplet of interest on the temporal hypergraph and uses it to tell what type of, when, and why the interaction expansion could happen in this triplet. HIT could achieve significant improvement (averaged 20% AUC gain to identify the interaction type, uniformly more accurate time estimation) compared to both heuristic and other neural-network-based baselines on 5 real-world large temporal hypergraphs. Moreover, HIT provides a certain degree of interpretability by identifying the most discriminatory structural features on the temporal hypergraphs for predicting different higher-order patterns.


title: Array Placement in Distributed Massive MIMO for power saving considering Radiation Pattern

abstract: A distributed antenna system (DAS) consists of several interconnected access points (APs) which are distributed over an area. Each AP has an antenna array. In previous studies, the DAS has been demonstrated great potential to improve capacity and power efficiency compared to a centralized antenna system (CAS) which has all the antennas located in one place. The existing research also has shown that the placement of the APs is essential for the performance of the DAS. However, most research on AP placement does not take into account realistic constraints. For instance, they assume that APs can be placed at any location in a region or the array radiation pattern of each AP is isotropic. This paper focuses on optimizing the AP placement for the DAS with massive MIMO (D-mMIMO) in order to reduce the transmit power. A square topology for the AP placement is applied, which is reasonable for deploying the D-mMIMO in urban areas while also offering theoretically interesting insights. We investigate the impact of the radiation pattern, signal coherence, and region size on the D-mMIMO's performance. Our results suggest that i) among the three factors, the array radiation pattern of each AP is the most important one in determining the optimal AP placement for the D-mMIMO; ii) the performance of the D-mMIMO is highly impacted by the placement and array radiation pattern of each AP, the D-mMIMO with unoptimized placement may perform even worse than the CAS with massive MIMO (C-mMIMO); iii) with the consideration of patch antennas and the mutual coupling effect, the optimized D-mMIMO can potentially save more than 7 dB transmit power compared to the C-mMIMO. Furthermore, our analytical results also provide an intuition for determining an adequate AP placement for the D-mMIMO in practice.


title: Adversarial purification with Score-based generative models

abstract: While adversarial training is considered as a standard defense method against adversarial attacks for image classifiers, adversarial purification, which purifies attacked images into clean images with a standalone purification model, has shown promises as an alternative defense method. Recently, an Energy-Based Model (EBM) trained with Markov-Chain Monte-Carlo (MCMC) has been highlighted as a purification model, where an attacked image is purified by running a long Markov-chain using the gradients of the EBM. Yet, the practicality of the adversarial purification using an EBM remains questionable because the number of MCMC steps required for such purification is too large. In this paper, we propose a novel adversarial purification method based on an EBM trained with Denoising Score-Matching (DSM). We show that an EBM trained with DSM can quickly purify attacked images within a few steps. We further introduce a simple yet effective randomized purification scheme that injects random noises into images before purification. This process screens the adversarial perturbations imposed on images by the random noises and brings the images to the regime where the EBM can denoise well. We show that our purification method is robust against various attacks and demonstrate its state-of-the-art performances.


title: FedBABU: Towards Enhanced Representation for Federated Image Classification

abstract: Federated learning has evolved to improve a single global model under data heterogeneity (as a curse) or to develop multiple personalized models using data heterogeneity (as a blessing). However, little research has considered both directions simultaneously. In this paper, we first investigate the relationship between them by analyzing Federated Averaging at the client level and determine that a better federated global model performance does not constantly improve personalization. To elucidate the cause of this personalization performance degradation problem, we decompose the entire network into the body (extractor), which is related to universality, and the head (classifier), which is related to personalization. We then point out that this problem stems from training the head. Based on this observation, we propose a novel federated learning algorithm, coined FedBABU, which only updates the body of the model during federated training (i.e., the head is randomly initialized and never updated), and the head is fine-tuned for personalization during the evaluation process. Extensive experiments show consistent performance improvements and an efficient personalization of FedBABU. The code is available at https://github.com/jhoon-oh/FedBABU.


title: Backreaction in Cosmology

abstract: In this review, we investigate the question of backreaction in different approaches to cosmological perturbation theory, and with a special focus on quantum theoretical aspects. By backreaction, we refer here to the effects of matter field or cosmological inhomogeneities on the homogeneous dynamical background degrees of freedom of cosmology. We begin with an overview of classical cosmological backreaction which is ideally suited for physical situations in the late time Universe. We then proceed backwards in time, considering semiclassical approaches such as semiclassical or stochastic (semiclassical) gravity which take quantum effects of the perturbations into account. Finally, we review approaches to backreaction in quantum cosmology that should apply to the very early Universe where classical and semiclassical approximations break down. The main focus is on a recently proposed implementation of backreaction in quantum cosmology using a Born-Oppenheimer inspired method.


title: Convergence and Alignment of Gradient Descent with Random Backpropagation Weights

abstract: Stochastic gradient descent with backpropagation is the workhorse of artificial neural networks. It has long been recognized that backpropagation fails to be a biologically plausible algorithm. Fundamentally, it is a non-local procedure -- updating one neuron's synaptic weights requires knowledge of synaptic weights or receptive fields of downstream neurons. This limits the use of artificial neural networks as a tool for understanding the biological principles of information processing in the brain. Lillicrap et al. (2016) propose a more biologically plausible "feedback alignment" algorithm that uses random and fixed backpropagation weights, and show promising simulations. In this paper we study the mathematical properties of the feedback alignment procedure by analyzing convergence and alignment for two-layer networks under squared error loss. In the overparameterized setting, we prove that the error converges to zero exponentially fast, and also that regularization is necessary in order for the parameters to become aligned with the random backpropagation weights. Simulations are given that are consistent with this analysis and suggest further generalizations. These results contribute to our understanding of how biologically plausible algorithms might carry out weight learning in a manner different from Hebbian learning, with performance that is comparable with the full non-local backpropagation algorithm.


title: Leptons and other forces of Nature

abstract: Assuming that neutrinos are not Majorana fermions and the right handed Dirac neutrino does not exist, we propose a model in which the second and the third generations of the leptons are composites, while the first generation is fundamental. The composite states are formed by the fundamental leptons and two new fundamental hidden scalar particles. In addition, there exist two hidden forces besides the SM interactions. The gauge symmetry $SU(2)_L\otimes U(1)_{Y}\otimes U(1)_h\otimes SU(2)_h$ of the electroweak and the hidden forces breaks down to $U(1)_{Y}\otimes U(1)_h$ after the spontaneous symmetry breaking (SSB). We explain the neutrino masses in terms of the binding dynamics of a hidden force. The phenomenon of neutrino oscillation can also be explained by our model in a dynamical framework of the hidden forces


title: Information Theoretic Evaluation of Privacy-Leakage, Interpretability, and Transferability for Trustworthy AI

abstract: In order to develop machine learning and deep learning models that take into account the guidelines and principles of trustworthy AI, a novel information theoretic trustworthy AI framework is introduced. A unified approach to "privacy-preserving interpretable and transferable learning" is considered for studying and optimizing the tradeoffs between privacy, interpretability, and transferability aspects. A variational membership-mapping Bayesian model is used for the analytical approximations of the defined information theoretic measures for privacy-leakage, interpretability, and transferability. The approach consists of approximating the information theoretic measures via maximizing a lower-bound using variational optimization. The study presents a unified information theoretic approach to study different aspects of trustworthy AI in a rigorous analytical manner. The approach is demonstrated through numerous experiments on benchmark datasets and a real-world biomedical application concerned with the detection of mental stress on individuals using heart rate variability analysis.


title: Rethinking Architecture Design for Tackling Data Heterogeneity in Federated Learning

abstract: Federated learning is an emerging research paradigm enabling collaborative training of machine learning models among different organizations while keeping data private at each institution. Despite recent progress, there remain fundamental challenges such as the lack of convergence and the potential for catastrophic forgetting across real-world heterogeneous devices. In this paper, we demonstrate that self-attention-based architectures (e.g., Transformers) are more robust to distribution shifts and hence improve federated learning over heterogeneous data. Concretely, we conduct the first rigorous empirical investigation of different neural architectures across a range of federated algorithms, real-world benchmarks, and heterogeneous data splits. Our experiments show that simply replacing convolutional networks with Transformers can greatly reduce catastrophic forgetting of previous devices, accelerate convergence, and reach a better global model, especially when dealing with heterogeneous data. We release our code and pretrained models at https://github.com/Liangqiong/ViT-FL-main to encourage future exploration in robust architectures as an alternative to current research efforts on the optimization front.


title: Optimizing Bayesian Recurrent Neural Networks on an FPGA-based Accelerator

abstract: Neural networks have demonstrated their outstanding performance in a wide range of tasks. Specifically recurrent architectures based on long-short term memory (LSTM) cells have manifested excellent capability to model time dependencies in real-world data. However, standard recurrent architectures cannot estimate their uncertainty which is essential for safety-critical applications such as in medicine. In contrast, Bayesian recurrent neural networks (RNNs) are able to provide uncertainty estimation with improved accuracy. Nonetheless, Bayesian RNNs are computationally and memory demanding, which limits their practicality despite their advantages. To address this issue, we propose an FPGA-based hardware design to accelerate Bayesian LSTM-based RNNs. To further improve the overall algorithmic-hardware performance, a co-design framework is proposed to explore the most fitting algorithmic-hardware configurations for Bayesian RNNs. We conduct extensive experiments on healthcare applications to demonstrate the improvement of our design and the effectiveness of our framework. Compared with GPU implementation, our FPGA-based design can achieve up to 10 times speedup with nearly 106 times higher energy efficiency. To the best of our knowledge, this is the first work targeting acceleration of Bayesian RNNs on FPGAs.


title: FiSH: Fair Spatial Hotspots

abstract: Pervasiveness of tracking devices and enhanced availability of spatially located data has deepened interest in using them for various policy interventions, through computational data analysis tasks such as spatial hot spot detection. In this paper, we consider, for the first time to our best knowledge, fairness in detecting spatial hot spots. We motivate the need for ensuring fairness through statistical parity over the collective population covered across chosen hot spots. We then characterize the task of identifying a diverse set of solutions in the noteworthiness-fairness trade-off spectrum, to empower the user to choose a trade-off justified by the policy domain. Being a novel task formulation, we also develop a suite of evaluation metrics for fair hot spots, motivated by the need to evaluate pertinent aspects of the task. We illustrate the computational infeasibility of identifying fair hot spots using naive and/or direct approaches and devise a method, codenamed {\it FiSH}, for efficiently identifying high-quality, fair and diverse sets of spatial hot spots. FiSH traverses the tree-structured search space using heuristics that guide it towards identifying effective and fair sets of spatial hot spots. Through an extensive empirical analysis over a real-world dataset from the domain of human development, we illustrate that FiSH generates high-quality solutions at fast response times.


title: HVSRweb: An Open-Source, Web-Based Application for Horizontal-to-Vertical Spectral Ratio Processing

abstract: The horizontal-to-vertical spectral ratio (HVSR) method has become an increasingly popular tool for developing a quick and reliable estimate of a site's fundamental natural frequency ($f_0$). This paper presents HVSRweb, an open-source, web-based application for performing HVSR calculations in a convenient, reliable, and statistically-consistent manner. HVSRweb allows the user to upload three-component ambient noise records and perform the HVSR calculation in the cloud, with no installation required. The HVSR calculation can be performed using a single combined horizontal component (e.g., geometric-mean, squared-average) or multiple rotated horizontal components to investigate azimuthal variability. HVSRweb can reject spurious time windows using an automated frequency-domain window-rejection algorithm, removing the need for subjective and time-consuming user interaction. It also facilitates the use of lognormal statistics for $f_0$, allowing for a consistent statistical framework capable of quantifying measurement uncertainty in terms of either frequency or its reciprocal, period. In addition, HVSRweb presents the opportunity to rapidly incorporate new developments in processing and quantification of uncertainty as they emerge, and encourages standardization of HVSR processing across users while avoiding the challenges associated with traditional approaches that require the user to perform regular updates to keep pace with new developments.


title: The Power of Two Choices in Graphical Allocation

abstract: The graphical balls-into-bins process is a generalization of the classical 2-choice balls-into-bins process, where the bins correspond to vertices of an arbitrary underlying graph $G$. At each time step an edge of $G$ is chosen uniformly at random, and a ball must be assigned to either of the two endpoints of this edge. The standard 2-choice process corresponds to the case of $G=K_n$. For any $k(n)$-edge-connected, $d(n)$-regular graph on $n$ vertices, and any number of balls, we give an allocation strategy that, with high probability, ensures a gap of $O((d/k) \log^4\hspace{-1pt}n \log \log n)$, between the load of any two bins. In particular, this implies polylogarithmic bounds for natural graphs such as cycles and tori, for which the classical greedy allocation strategy is conjectured to have a polynomial gap between the bin loads. For every graph $G$, we also show an $\Omega((d/k) + \log n)$ lower bound on the gap achievable by any allocation strategy. This implies that our strategy achieves the optimal gap, up to polylogarithmic factors, for every graph $G$. Our allocation algorithm is simple to implement and requires only $O(\log(n))$ time per allocation. It can be viewed as a more global version of the greedy strategy that compares average load on certain fixed sets of vertices, rather than on individual vertices. A key idea is to relate the problem of designing a good allocation strategy to that of finding suitable multi-commodity flows. To this end, we consider R\"{a}cke's cut-based decomposition tree and define certain orthogonal flows on it.


title: Dynaboard: An Evaluation-As-A-Service Platform for Holistic Next-Generation Benchmarking

abstract: We introduce Dynaboard, an evaluation-as-a-service framework for hosting benchmarks and conducting holistic model comparison, integrated with the Dynabench platform. Our platform evaluates NLP models directly instead of relying on self-reported metrics or predictions on a single dataset. Under this paradigm, models are submitted to be evaluated in the cloud, circumventing the issues of reproducibility, accessibility, and backwards compatibility that often hinder benchmarking in NLP. This allows users to interact with uploaded models in real time to assess their quality, and permits the collection of additional metrics such as memory use, throughput, and robustness, which -- despite their importance to practitioners -- have traditionally been absent from leaderboards. On each task, models are ranked according to the Dynascore, a novel utility-based aggregation of these statistics, which users can customize to better reflect their preferences, placing more/less weight on a particular axis of evaluation or dataset. As state-of-the-art NLP models push the limits of traditional benchmarks, Dynaboard offers a standardized solution for a more diverse and comprehensive evaluation of model quality.


title: Identifying and Supporting Financially Vulnerable Consumers in a Privacy-Preserving Manner: A Use Case Using Decentralised Identifiers and Verifiable Credentials

abstract: Vulnerable individuals have a limited ability to make reasonable financial decisions and choices and, thus, the level of care that is appropriate to be provided to them by financial institutions may be different from that required for other consumers. Therefore, identifying vulnerability is of central importance for the design and effective provision of financial services and products. However, validating the information that customers share and respecting their privacy are both particularly important in finance and this poses a challenge for identifying and caring for vulnerable populations. This position paper examines the potential of the combination of two emerging technologies, Decentralized Identifiers (DIDs) and Verifiable Credentials (VCs), for the identification of vulnerable consumers in finance in an efficient and privacy-preserving manner.


title: Fair Preprocessing: Towards Understanding Compositional Fairness of Data Transformers in Machine Learning Pipeline

abstract: In recent years, many incidents have been reported where machine learning models exhibited discrimination among people based on race, sex, age, etc. Research has been conducted to measure and mitigate unfairness in machine learning models. For a machine learning task, it is a common practice to build a pipeline that includes an ordered set of data preprocessing stages followed by a classifier. However, most of the research on fairness has considered a single classifier based prediction task. What are the fairness impacts of the preprocessing stages in machine learning pipeline? Furthermore, studies showed that often the root cause of unfairness is ingrained in the data itself, rather than the model. But no research has been conducted to measure the unfairness caused by a specific transformation made in the data preprocessing stage. In this paper, we introduced the causal method of fairness to reason about the fairness impact of data preprocessing stages in ML pipeline. We leveraged existing metrics to define the fairness measures of the stages. Then we conducted a detailed fairness evaluation of the preprocessing stages in 37 pipelines collected from three different sources. Our results show that certain data transformers are causing the model to exhibit unfairness. We identified a number of fairness patterns in several categories of data transformers. Finally, we showed how the local fairness of a preprocessing stage composes in the global fairness of the pipeline. We used the fairness composition to choose appropriate downstream transformer that mitigates unfairness in the machine learning pipeline.


title: Sharp Hardy-Sobolev-Maz'ya, Adams and Hardy-Adams inequalities on quaternionic hyperbolic spaces and the Cayley hyperbolic plane

abstract: Though Adams and Hardy-Adams inequalities can be extended to general symmetric spaces of noncompact type fairly straightforwardly by following closely the systematic approach developed in our early works on real and complex hyperbolic spaces, higher order Poincar\'e-Sobolev and Hardy-Sobolev-Maz'ya inequalities are more difficult to establish. The main purpose of this goal is to establish the Poincar\'e-Sobolev and Hardy-Sobolev-Maz'ya inequalities on quaternionic hyperbolic spaces and the Cayley hyperbolic plane. A crucial part of our work is to establish appropriate factorization theorems on these spaces which are of their independent interests. To this end, we need to identify and introduce the ``Quaternionic Geller's operators" and ``Octonionic Geller's operators" which have been absent on these spaces. Combining the factorization theorems and the Geller type operators with the Helgason-Fourier analysis on symmetric spaces, the precise heat and Bessel-Green-Riesz kernel estimates and the Kunze-Stein phenomenon for connected real simple groups of real rank one with finite center, we succeed to establish the higher order Poincar\'e-Sobolev and Hardy-Sobolev-Maz'ya inequalities on quaternionic hyperbolic spaces and the Cayley hyperbolic plane. The kernel estimates required to prove these inequalities are also sufficient for us to establish, as a byproduct, the Adams and Hardy-Adams inequalities on these spaces. This paper, together with our earlier works, completes our study of the factorization theorems, higher order Poincar\'e-Sobolev, Hardy-Sobolev-Maz'ya, Adams and Hardy-Adams inequalities on all rank one symmetric spaces of noncompact type.


title: Progressive-Scale Boundary Blackbox Attack via Projective Gradient Estimation

abstract: Boundary based blackbox attack has been recognized as practical and effective, given that an attacker only needs to access the final model prediction. However, the query efficiency of it is in general high especially for high dimensional image data. In this paper, we show that such efficiency highly depends on the scale at which the attack is applied, and attacking at the optimal scale significantly improves the efficiency. In particular, we propose a theoretical framework to analyze and show three key characteristics to improve the query efficiency. We prove that there exists an optimal scale for projective gradient estimation. Our framework also explains the satisfactory performance achieved by existing boundary black-box attacks. Based on our theoretical framework, we propose Progressive-Scale enabled projective Boundary Attack (PSBA) to improve the query efficiency via progressive scaling techniques. In particular, we employ Progressive-GAN to optimize the scale of projections, which we call PSBA-PGAN. We evaluate our approach on both spatial and frequency scales. Extensive experiments on MNIST, CIFAR-10, CelebA, and ImageNet against different models including a real-world face recognition API show that PSBA-PGAN significantly outperforms existing baseline attacks in terms of query efficiency and attack success rate. We also observe relatively stable optimal scales for different models and datasets. The code is publicly available at https://github.com/AI-secure/PSBA.


title: Domain Transformer: Predicting Samples of Unseen, Future Domains

abstract: The data distribution commonly evolves over time leading to problems such as concept drift that often decrease classifier performance. Current techniques are not adequate for this problem because they either require detailed knowledge of the transformation or are not suited for anticipating unseen domains but can only adapt to domains, where data samples are available. We seek to predict unseen data (and their labels) allowing us to tackle challenges s a non-constant data distribution in a proactive manner rather than detecting and reacting to already existing changes that might already have led to errors. To this end, we learn a domain transformer in an unsupervised manner that allows generating data of unseen domains. Our approach first matches independently learned latent representations of two given domains obtained from an auto-encoder using a Cycle-GAN. In turn, a transformation of the original samples can be learned that can be applied iteratively to extrapolate to unseen domains. Our evaluation of CNNs on image data confirms the usefulness of the approach. It also achieves very good results on the well-known problem of unsupervised domain adaption, where only labels but no samples have to be predicted. Code is available at https://github.com/JohnTailor/DoTra.


title: Multifaceted moir\'e superlattice physics in twisted WSe$_2$ bilayers

abstract: Lattice reconstruction in twisted transition-metal dichalcogenide (TMD) bilayers gives rise to piezo- and ferroelectric moir\'e potentials for electrons and holes, as well as a modulation of the hybridisation across the bilayer. Here, we develop hybrid $\mathbf{k}\cdot \mathbf{p}$ tight-binding models to describe electrons and holes in the relevant valleys of twisted TMD homobilayers with parallel (P) and anti-parallel (AP) orientations of the monolayer unit cells. We apply these models to describe moir\'e superlattice effects in twisted WSe${}_2$ bilayers, in conjunction with microscopic \emph{ab initio} calculations, and considering the influence of encapsulation, pressure and an electric displacement field. Our analysis takes into account mesoscale lattice relaxation, interlayer hybridisation, piezopotentials, and a weak ferroelectric charge transfer between the layers, and describes a multitude of possibilities offered by this system, depending on the choices of P or AP orientation, twist angle magnitude, and electron/hole valley.


title: Predicting Next Local Appearance for Video Anomaly Detection

abstract: We present a local anomaly detection method in videos. As opposed to most existing methods that are computationally expensive and are not very generalizable across different video scenes, we propose an adversarial framework that learns the temporal local appearance variations by predicting the appearance of a normally behaving object in the next frame of a scene by only relying on its current and past appearances. In the presence of an abnormally behaving object, the reconstruction error between the real and the predicted next appearance of that object indicates the likelihood of an anomaly. Our method is competitive with the existing state-of-the-art while being significantly faster for both training and inference and being better at generalizing to unseen video scenes.


title: AI-driven Prices for Externalities and Sustainability in Production Markets

abstract: Traditional competitive markets do not account for negative externalities; indirect costs that some participants impose on others, such as the cost of over-appropriating a common-pool resource (which diminishes future stock, and thus harvest, for everyone). Quantifying appropriate interventions to market prices has proven to be quite challenging. We propose a practical approach to computing market prices and allocations via a deep reinforcement learning policymaker agent, operating in an environment of other learning agents. Our policymaker allows us to tune the prices with regard to diverse objectives such as sustainability and resource wastefulness, fairness, buyers' and sellers' welfare, etc. As a highlight of our findings, our policymaker is significantly more successful in maintaining resource sustainability, compared to the market equilibrium outcome, in scarce resource environments.


title: Data-driven battery operation for energy arbitrage using rainbow deep reinforcement learning

abstract: As the world seeks to become more sustainable, intelligent solutions are needed to increase the penetration of renewable energy. In this paper, the model-free deep reinforcement learning algorithm Rainbow Deep Q-Networks is used to control a battery in a small microgrid to perform energy arbitrage and more efficiently utilise solar and wind energy sources. The grid operates with its own demand and renewable generation based on a dataset collected at Keele University, as well as using dynamic energy pricing from a real wholesale energy market. Four scenarios are tested including using demand and price forecasting produced with local weather data. The algorithm and its subcomponents are evaluated against two continuous control benchmarks with Rainbow able to outperform all other method. This research shows the importance of using the distributional approach for reinforcement learning when working with complex environments and reward functions, as well as how it can be used to visualise and contextualise the agent's behaviour for real-world applications.


title: Detection of relativistic fermions in Weyl semimetal TaAs by magnetostriction measurements

abstract: Thus far, a detection of the Dirac or Weyl fermions in topological semimetals remains often elusive, since in these materials conventional charge carriers exist as well. Here, measuring a field-induced length change of the prototype Weyl semimetal TaAs at low temperatures, we find that its $c$-axis magnetostriction amounts to relatively large values whereas the $a$-axis magnetostriction exhibits strong variations with changing the orientation of the applied magnetic field. It is discovered that at magnetic fields above the ultra-quantum limit, the magnetostriction of TaAs contains a linear-in-field term, which, as we show, is a hallmark of the Weyl fermions in a material. Developing a theory for the magnetostriction of noncentrosymmetric topological semimetals and applying it to TaAs, we additionally find several parameters characterizing the interaction between the relativistic fermions and elastic degrees of freedom in this semimetal. Our study shows how dilatometry can be used to unveil Weyl fermions in candidate topological semimetals.


title: Measurement of material isotopics and atom number ratio with alpha-particle spectroscopy for the NIFFTE fission Time Projection Chamber actinide target

abstract: We present the results of a measurement of isotopic concentrations and atomic number ratio of a double-sided actinide target with alpha-spectroscopy and mass spectrometry. The double-sided actinide target, with primarily Pu-239 on one side and U-235 on the other, was used in the fission Time Projection Chamber (fissionTPC) for a measurement of the neutron-induced fission cross-section ratio between the two isotopes. The measured atomic number ratio is intended to provide an absolute normalization of the measured fission cross-section ratio. The Pu-239/U-235 atom number ratio was measured with a combination of mass spectrometry and alpha-spectroscopy with a planar silicon detector with uncertainties of less than 1%.


title: RNN with Particle Flow for Probabilistic Spatio-temporal Forecasting

abstract: Spatio-temporal forecasting has numerous applications in analyzing wireless, traffic, and financial networks. Many classical statistical models often fall short in handling the complexity and high non-linearity present in time-series data. Recent advances in deep learning allow for better modelling of spatial and temporal dependencies. While most of these models focus on obtaining accurate point forecasts, they do not characterize the prediction uncertainty. In this work, we consider the time-series data as a random realization from a nonlinear state-space model and target Bayesian inference of the hidden states for probabilistic forecasting. We use particle flow as the tool for approximating the posterior distribution of the states, as it is shown to be highly effective in complex, high-dimensional settings. Thorough experimentation on several real world time-series datasets demonstrates that our approach provides better characterization of uncertainty while maintaining comparable accuracy to the state-of-the art point forecasting methods.


title: Windows Kernel Hijacking Is Not an Option: MemoryRanger Comes to the Rescue Again

abstract: The security of a computer system depends on OS kernel protection. It is crucial to reveal and inspect new attacks on kernel data, as these are used by hackers. The purpose of this paper is to continue research into attacks on dynamically allocated data in the Windows OS kernel and demonstrate the capacity of MemoryRanger to prevent these attacks. This paper discusses three new hijacking attacks on kernel data, which are based on bypassing OS security mechanisms. The first two hijacking attacks result in illegal access to files open in exclusive access. The third attack escalates process privileges, without applying token swapping. Although Windows security experts have issued new protection features, access attempts to the dynamically allocated data in the kernel are not fully controlled. MemoryRanger hypervisor is designed to fill this security gap. The updated MemoryRanger prevents these new attacks as well as supporting the Windows 10 1903 x64.


title: A FRB in a Globular Cluster: Why Is This Neutron Star Different From (Almost) All Other Neutron Stars?

abstract: Most Fast Radio Burst (FRB) models are built from comparatively common astronomical objects: neutron stars, black holes and supernova remnants. Yet FRB sources are rare, and most of these objects, found in the Galaxy, do not make FRB. Special and rare circumstances may be required for these common objects to be sources of FRB. The recent discovery of a repeating FRB in a globular cluster belonging to the galaxy M81 suggests a model involving a neutron star and a close binary companion, likely a white dwarf; both neutron stars and close binaries are superabundant in globular clusters. Magnetic interaction is a plausible, though unproven, mechanism of acceleration of relativistic particles that may radiate coherently as FRB. Double neutron star binaries cannot be the observed long-lived repeating FRB sources, but might make much shorter lived sources, and perhaps non-repeating FRB.


title: Bayesian Optimisation with Formal Guarantees

abstract: Application domains of Bayesian optimization include optimizing black-box functions or very complex functions. The functions we are interested in describe complex real-world systems applied in industrial settings. Even though they do have explicit representations, standard optimization techniques fail to provide validated solutions and correctness guarantees for them. In this paper we present a combination of Bayesian optimisation and SMT-based constraint solving to achieve safe and stable solutions with optimality guarantees.


title: Subgame solving without common knowledge

abstract: In imperfect-information games, subgame solving is significantly more challenging than in perfect-information games, but in the last few years, such techniques have been developed. They were the key ingredient to the milestone of superhuman play in no-limit Texas hold'em poker. Current subgame-solving techniques analyze the entire common-knowledge closure of the player's current information set, that is, the smallest set of nodes within which it is common knowledge that the current node lies. While this is acceptable in games like poker where the common-knowledge closure is relatively small, many practical games have more complex information structure, which renders the common-knowledge closure impractically large to enumerate or even reasonably approximate. We introduce an approach that overcomes this obstacle, by instead working with only low-order knowledge. Our approach allows an agent, upon arriving at an infoset, to basically prune any node that is no longer reachable, thereby massively reducing the game tree size relative to the common-knowledge subgame. We prove that, as is, our approach can increase exploitability compared to the blueprint strategy. However, we develop three avenues by which safety can be guaranteed. Even without the safety-guaranteeing additions, experiments on medium-sized games show that our approach always reduced exploitability in practical games even when applied at every infoset, and a depth-limited version of it led to -- to our knowledge -- the first strong AI for the challenge problem dark chess.


title: Concurrent multi-parameter learning demonstrated on the Kuramoto-Sivashinsky equation

abstract: We develop an algorithm based on the nudging data assimilation scheme for the concurrent (on-the-fly) estimation of scalar parameters for a system of evolutionary dissipative partial differential equations in which the state is partially observed. The algorithm takes advantage of the error that results from nudging a system with incorrect parameters with data from the true system. The intuitive nature of the algorithm makes its extension to several different systems immediate, and it allows for recovery of multiple parameters simultaneously. We test the method on the Kuramoto-Sivashinsky equation in one dimension and demonstrate its efficacy in this context.


title: Allee effect in models of interacting species

abstract: The search for more realistic models for interacting species has produced many adaptations of the original Lotka-Volterra equations, such as the inclusion of the Allee effect and the different Holling's types of functional response. In the present work we show that a correct implementation of both ideas together requires a careful formulation. We focus our work in the fact that a density dependent carrying capacity, combined with the Allee effect, can lead to meaningless effects. We illustrate the difficulties in predator-prey and two-species competition models, together with our proposed solution of the careful inclusion of the corresponding cubic terms.


title: Density functional study of the variants of inter-Coulombic decay resonances in the photoionization of Cl@C60

abstract: Inter-Coulombic decay (ICD) resonances in the photoionization of Cl@C60 endofullerene molecule are calculated using a perturbative density functional theory (DFT) method. This is the first ICD study of an open shell atom in a fullerene cage. Three classes of resonances are probed: (i) Cl inner vacancies decaying through C60 outer continua, (ii) C60 inner vacancies decaying through Cl outer continua, and (iii) inner vacancies of either system decaying through the continua of Cl-C60 hybrid levels, the hybrid Auger-ICD resonances. Comparisons with Ar@C60 results reveal that the properties of hybrid Auger-ICD resonances are affected by the extent of level hybridization.


title: Gaussian Bounding Boxes and Probabilistic Intersection-over-Union for Object Detection

abstract: Most object detection methods use bounding boxes to encode and represent the object shape and location. In this work, we explore a fuzzy representation of object regions using Gaussian distributions, which provides an implicit binary representation as (potentially rotated) ellipses. We also present a similarity measure for the Gaussian distributions based on the Hellinger Distance, which can be viewed as a Probabilistic Intersection-over-Union (ProbIoU). Our experimental results show that the proposed Gaussian representations are closer to annotated segmentation masks in publicly available datasets, and that loss functions based on ProbIoU can be successfully used to regress the parameters of the Gaussian representation. Furthermore, we present a simple mapping scheme from traditional (or rotated) bounding boxes to Gaussian representations, allowing the proposed ProbIoU-based losses to be seamlessly integrated into any object detector.


title: A modular framework for object-based saccadic decisions in dynamic scenes

abstract: Visually exploring the world around us is not a passive process. Instead, we actively explore the world and acquire visual information over time. Here, we present a new model for simulating human eye-movement behavior in dynamic real-world scenes. We model this active scene exploration as a sequential decision making process. We adapt the popular drift-diffusion model (DDM) for perceptual decision making and extend it towards multiple options, defined by objects present in the scene. For each possible choice, the model integrates evidence over time and a decision (saccadic eye movement) is triggered as soon as evidence crosses a decision threshold. Drawing this explicit connection between decision making and object-based scene perception is highly relevant in the context of active viewing, where decisions are made continuously while interacting with an external environment. We validate our model with a carefully designed ablation study and explore influences of our model parameters. A comparison on the VidCom dataset supports the plausibility of the proposed approach.


title: Concurrent goal-oriented materials-by-design

abstract: The development of new materials and structures for extreme conditions including impact remains a continuing challenge despite steady advances. Design is currently accomplished using a sequential approach: an optimal material is first developed using the process-structure-properties paradigm, where performance is measured against a blended measure. Then, the structure is optimized while holding the material properties fixed. In this paper, we propose an alternative concurrent and goal-oriented optimization approach where both the material properties and the structure are optimized simultaneously against an overall system-wide performance measure. We develop a non-intrusive, high-performance computational framework based on DAKOTA and GMSH and use it to study the ballistic impact of a double-layer plate of strong AZ31B magnesium alloy and soft polyurea. We show that the proposed concurrent and goal-oriented optimization strategy can provide significant advantage over the traditional sequential optimization approach.


title: A Decentralized Adaptive Momentum Method for Solving a Class of Min-Max Optimization Problems

abstract: Min-max saddle point games have recently been intensely studied, due to their wide range of applications, including training Generative Adversarial Networks (GANs). However, most of the recent efforts for solving them are limited to special regimes such as convex-concave games. Further, it is customarily assumed that the underlying optimization problem is solved either by a single machine or in the case of multiple machines connected in centralized fashion, wherein each one communicates with a central node. The latter approach becomes challenging, when the underlying communications network has low bandwidth. In addition, privacy considerations may dictate that certain nodes can communicate with a subset of other nodes. Hence, it is of interest to develop methods that solve min-max games in a decentralized manner. To that end, we develop a decentralized adaptive momentum (ADAM)-type algorithm for solving min-max optimization problem under the condition that the objective function satisfies a Minty Variational Inequality condition, which is a generalization to convex-concave case. The proposed method overcomes shortcomings of recent non-adaptive gradient-based decentralized algorithms for min-max optimization problems that do not perform well in practice and require careful tuning. In this paper, we obtain non-asymptotic rates of convergence of the proposed algorithm (coined DADAM$^3$) for finding a (stochastic) first-order Nash equilibrium point and subsequently evaluate its performance on training GANs. The extensive empirical evaluation shows that DADAM$^3$ outperforms recently developed methods, including decentralized optimistic stochastic gradient for solving such min-max problems.


title: Spatially high-resolved solar-wind-induced magnetic field on Venus

abstract: The current work investigates the Venusian solar-wind-induced magnetosphere at a high spatial resolution using all Venus Express (VEX) magnetic observations through an unbiased statistical method. We first evaluate the predictability of the interplanetary magnetic field (IMF) during VEX's magnetospheric transits, and then map the induced field in a cylindrical coordinate system under different IMF conditions. Our high-resolution mapping enables resolving structures on various scales, ranging from the thin ionopause and the associated electric currents to the classical global-scale draped IMF. Our mapping also resolves two recently-reported structures, a low ionospheric magnetization over the terminator and a global "looping" structure in the near magnetotail, both of which are not depicted in the classical draping configuration. In contrast to the reported IMF-independent cylindrical magnetic field of both structures, our results illustrate their IMF dependence. In both structures, the cylindrical magnetic component is stronger in the hemisphere with an upward solar wind electric field ($E^{SW}$) than in the opposite hemisphere. Under downward $E^{SW}$, the "looping" structure even breaks, which is attributable to an additional draped magnetic field structure wrapping toward $-E^{SW}$. In addition, our results suggest that these two structures are spatially not overlapping with each other. The low ionospheric structure occurs in a very narrow region, at about 87--95$^\circ$ solar zenith angle and 190--210~km altitude, implying that future simulation to reproduce the structure entails at least a spatial resolution of about 10 km. We discuss this narrow structure in terms of a Cowling channel.


title: Uniform regularity for the compressible Navier-Stokes system with low Mach number in bounded domains

abstract: We establish uniform with respect to the Mach number regularity estimates for the isentropic compressible Navier-Stokes system in smooth domains with Navier-slip condition on the boundary in the general case of ill-prepared initial data. To match the boundary layer effects due to the fast oscillations and the ill-prepared initial data assumption, we prove uniform estimates in an anisotropic functional framework with only one normal derivative close to the boundary. This allows to prove the local existence of a strong solution on a time interval independent of the Mach number and to justify the incompressible limit through a simple compactness argument.


title: Conserving Local Magnetic Helicity in Numerical Simulations

abstract: Magnetic helicity is robustly conserved in systems with very large magnetic Reynolds numbers, including most systems of astrophysical interest, and unlike kinetic and magnetic energy is not dissipated at small scales. This plays a major role in suppressing the kinematic large-scale dynamo and may also be responsible for driving the large-scale dynamo through the magnetic helicity flux. Numerical simulations of astrophysical systems typically lack sufficient resolution to enforce global magnetic helicity over several dynamical times. In these simulations, magnetic helicity is lost either through numerical errors or through the action of an unrealistically large resistivity. Errors in the internal distribution of magnetic helicity are equally important and typically larger. Here we propose an algorithm for enforcing strict local conservation of magnetic helicity in the Coulomb gauge in numerical simulations so that their evolution more closely approximates that of real systems.


title: A Nonmyopic Approach to Cost-Constrained Bayesian Optimization

abstract: Bayesian optimization (BO) is a popular method for optimizing expensive-to-evaluate black-box functions. BO budgets are typically given in iterations, which implicitly assumes each evaluation has the same cost. In fact, in many BO applications, evaluation costs vary significantly in different regions of the search space. In hyperparameter optimization, the time spent on neural network training increases with layer size; in clinical trials, the monetary cost of drug compounds vary; and in optimal control, control actions have differing complexities. Cost-constrained BO measures convergence with alternative cost metrics such as time, money, or energy, for which the sample efficiency of standard BO methods is ill-suited. For cost-constrained BO, cost efficiency is far more important than sample efficiency. In this paper, we formulate cost-constrained BO as a constrained Markov decision process (CMDP), and develop an efficient rollout approximation to the optimal CMDP policy that takes both the cost and future iterations into account. We validate our method on a collection of hyperparameter optimization problems as well as a sensor set selection application.


title: Gradual Domain Adaptation in the Wild:When Intermediate Distributions are Absent

abstract: We focus on the problem of domain adaptation when the goal is shifting the model towards the target distribution, rather than learning domain invariant representations. It has been shown that under the following two assumptions: (a) access to samples from intermediate distributions, and (b) samples being annotated with the amount of change from the source distribution, self-training can be successfully applied on gradually shifted samples to adapt the model toward the target distribution. We hypothesize having (a) is enough to enable iterative self-training to slowly adapt the model to the target distribution, by making use of an implicit curriculum. In the case where (a) does not hold, we observe that iterative self-training falls short. We propose GIFT, a method that creates virtual samples from intermediate distributions by interpolating representations of examples from source and target domains. We evaluate an iterative-self-training method on datasets with natural distribution shifts, and show that when applied on top of other domain adaptation methods, it improves the performance of the model on the target dataset. We run an analysis on a synthetic dataset to show that in the presence of (a) iterative-self-training naturally forms a curriculum of samples. Furthermore, we show that when (a) does not hold, GIFT performs better than iterative self-training.


title: A Survey and Tutorial on Security and Resilience of Quantum Computing

abstract: Present-day quantum computers suffer from various noises or errors such as gate error, relaxation, dephasing, readout error, and crosstalk. Besides, they offer a limited number of qubits with restrictive connectivity. Therefore, quantum programs running these computers face resilience issues and low output fidelities. The noise in the cloud-based access of quantum computers also introduces new modes of security and privacy issues. Furthermore, quantum computers face several threat models from insider and outsider adversaries including input tampering, program misallocation, fault injection, Reverse Engineering (RE), and Cloning. This paper provides an overview of various assets embedded in quantum computers and programs, vulnerabilities and attack models, and the relation between resilience and security. We also cover countermeasures against the reliability and security issues and present a future outlook for the security of quantum computing.


title: One Sense per Translation

abstract: Word sense disambiguation (WSD) is the task of determining the sense of a word in context. Translations have been used in WSD as a source of knowledge, and even as a means of delimiting word senses. In this paper, we define three theoretical properties of the relationship between senses and translations, and argue that they constitute necessary conditions for using translations as sense inventories. The key property of One Sense per Translation (OSPT) provides a foundation for a translation-based WSD method. The results of an intrinsic evaluation experiment indicate that our method achieves a precision of approximately 93% compared to manual corpus annotations. Our extrinsic evaluation experiments demonstrate WSD improvements of up to 4.6% F1-score on difficult WSD datasets.


title: Analyzing Neural Jacobian Methods in Applications of Visual Servoing and Kinematic Control

abstract: Designing adaptable control laws that can transfer between different robots is a challenge because of kinematic and dynamic differences, as well as in scenarios where external sensors are used. In this work, we empirically investigate a neural networks ability to approximate the Jacobian matrix for an application in Cartesian control schemes. Specifically, we are interested in approximating the kinematic Jacobian, which arises from kinematic equations mapping a manipulator's joint angles to the end-effector's location. We propose two different approaches to learn the kinematic Jacobian. The first method arises from visual servoing where we learn the kinematic Jacobian as an approximate linear system of equations from the k-nearest neighbors for a desired joint configuration. The second, motivated by forward models in machine learning, learns the kinematic behavior directly and calculates the Jacobian by differentiating the learned neural kinematics model. Simulation experimental results show that both methods achieve better performance than alternative data-driven methods for control, provide closer approximations to the proper kinematics Jacobian matrix, and on average produce better-conditioned Jacobian matrices. Real-world experiments were conducted on a Kinova Gen-3 lightweight robotic manipulator, which includes an uncalibrated visual servoing experiment, a practical application of our methods, as well as a 7-DOF point-to-point task highlighting that our methods are applicable on real robotic manipulators.


title: A determinant of the Artin-Hasse exponential coefficients

abstract: We present a new determinant identity involving the coefficients of the Artin-Hasse exponential. In particular, if $E(x) = \exp(\sum_{k=0}^\infty \frac{x^{p^k}}{p^k}) = \sum_{n=0}^\infty u_nx^n$ is the Artin-Hasse exponential, we give, for any $\ell\geq 1$, a closed-form formula for the determinant $|u_{pi-j}|_{1\leq i,j\leq \ell}$ and show it is a $p$-adic unit.


title: Problem-solving benefits of down-sampled lexicase selection

abstract: In genetic programming, an evolutionary method for producing computer programs that solve specified computational problems, parent selection is ordinarily based on aggregate measures of performance across an entire training set. Lexicase selection, by contrast, selects on the basis of performance on random sequences of training cases; this has been shown to enhance problem-solving power in many circumstances. Lexicase selection can also be seen as better reflecting biological evolution, by modeling sequences of challenges that organisms face over their lifetimes. Recent work has demonstrated that the advantages of lexicase selection can be amplified by down-sampling, meaning that only a random subsample of the training cases is used each generation. This can be seen as modeling the fact that individual organisms encounter only subsets of the possible environments, and that environments change over time. Here we provide the most extensive benchmarking of down-sampled lexicase selection to date, showing that its benefits hold up to increased scrutiny. The reasons that down-sampling helps, however, are not yet fully understood. Hypotheses include that down-sampling allows for more generations to be processed with the same budget of program evaluations; that the variation of training data across generations acts as a changing environment, encouraging adaptation; or that it reduces overfitting, leading to more general solutions. We systematically evaluate these hypotheses, finding evidence against all three, and instead draw the conclusion that down-sampled lexicase selection's main benefit stems from the fact that it allows the evolutionary process to examine more individuals within the same computational budget, even though each individual is examined less completely.


title: PSB2: The Second Program Synthesis Benchmark Suite

abstract: For the past six years, researchers in genetic programming and other program synthesis disciplines have used the General Program Synthesis Benchmark Suite to benchmark many aspects of automatic program synthesis systems. These problems have been used to make notable progress toward the goal of general program synthesis: automatically creating the types of software that human programmers code. Many of the systems that have attempted the problems in the original benchmark suite have used it to demonstrate performance improvements granted through new techniques. Over time, the suite has gradually become outdated, hindering the accurate measurement of further improvements. The field needs a new set of more difficult benchmark problems to move beyond what was previously possible. In this paper, we describe the 25 new general program synthesis benchmark problems that make up PSB2, a new benchmark suite. These problems are curated from a variety of sources, including programming katas and college courses. We selected these problems to be more difficult than those in the original suite, and give results using PushGP showing this increase in difficulty. These new problems give plenty of room for improvement, pointing the way for the next six or more years of general program synthesis research.


title: Causal Analysis of Syntactic Agreement Mechanisms in Neural Language Models

abstract: Targeted syntactic evaluations have demonstrated the ability of language models to perform subject-verb agreement given difficult contexts. To elucidate the mechanisms by which the models accomplish this behavior, this study applies causal mediation analysis to pre-trained neural language models. We investigate the magnitude of models' preferences for grammatical inflections, as well as whether neurons process subject-verb agreement similarly across sentences with different syntactic structures. We uncover similarities and differences across architectures and model sizes -- notably, that larger models do not necessarily learn stronger preferences. We also observe two distinct mechanisms for producing subject-verb agreement depending on the syntactic structure of the input sentence. Finally, we find that language models rely on similar sets of neurons when given sentences with similar syntactic structure.


title: Relative semiampleness in mixed characteristic

abstract: We show that a nef line bundle on a proper scheme over an excellent base is semiample if and only if it is semiample after restricting to characteristic zero and to positive characteristic. In the process of the proof, we provide a generalisation to mixed characteristic of the fact that the perfection of the Picard functor in positive characteristic is a stack in groupoids for the h-topology.


title: Gradient Disaggregation: Breaking Privacy in Federated Learning by Reconstructing the User Participant Matrix

abstract: We show that aggregated model updates in federated learning may be insecure. An untrusted central server may disaggregate user updates from sums of updates across participants given repeated observations, enabling the server to recover privileged information about individual users' private training data via traditional gradient inference attacks. Our method revolves around reconstructing participant information (e.g: which rounds of training users participated in) from aggregated model updates by leveraging summary information from device analytics commonly used to monitor, debug, and manage federated learning systems. Our attack is parallelizable and we successfully disaggregate user updates on settings with up to thousands of participants. We quantitatively and qualitatively demonstrate significant improvements in the capability of various inference attacks on the disaggregated updates. Our attack enables the attribution of learned properties to individual users, violating anonymity, and shows that a determined central server may undermine the secure aggregation protocol to break individual users' data privacy in federated learning.


title: Graph Neural Networks for Natural Language Processing: A Survey

abstract: Deep learning has become the dominant approach in coping with various tasks in Natural LanguageProcessing (NLP). Although text inputs are typically represented as a sequence of tokens, there isa rich variety of NLP problems that can be best expressed with a graph structure. As a result, thereis a surge of interests in developing new deep learning techniques on graphs for a large numberof NLP tasks. In this survey, we present a comprehensive overview onGraph Neural Networks(GNNs) for Natural Language Processing. We propose a new taxonomy of GNNs for NLP, whichsystematically organizes existing research of GNNs for NLP along three axes: graph construction,graph representation learning, and graph based encoder-decoder models. We further introducea large number of NLP applications that are exploiting the power of GNNs and summarize thecorresponding benchmark datasets, evaluation metrics, and open-source codes. Finally, we discussvarious outstanding challenges for making the full use of GNNs for NLP as well as future researchdirections. To the best of our knowledge, this is the first comprehensive overview of Graph NeuralNetworks for Natural Language Processing.


title: DECORE: Deep Compression with Reinforcement Learning

abstract: Deep learning has become an increasingly popular and powerful methodology for modern pattern recognition systems. However, many deep neural networks have millions or billions of parameters, making them untenable for real-world applications due to constraints on memory size or latency requirements. As a result, efficient network compression techniques are often required for the widespread adoption of deep learning methods. We present DECORE, a reinforcement learning-based approach to automate the network compression process. DECORE assigns an agent to each channel in the network along with a light policy gradient method to learn which neurons or channels to be kept or removed. Each agent in the network has just one parameter (keep or drop) to learn, which leads to a much faster training process compared to existing approaches. DECORE provides state-of-the-art compression results on various network architectures and various datasets. For example, on the ResNet-110 architecture, it achieves a 64.8% compression and 61.8% FLOPs reduction as compared to the baseline model without any accuracy loss on the CIFAR-10 dataset. It can reduce the size of regular architectures like the VGG network by up to 99% with just a small accuracy drop of 2.28%. For a larger dataset like ImageNet with just 30 epochs of training, it can compress the ResNet-50 architecture by 44.7% and reduce FLOPs by 42.3%, with just a 0.69% drop on Top-5 accuracy of the uncompressed model. We also demonstrate that DECORE can be used to search for compressed network architectures based on various constraints, such as memory and FLOPs.


title: Collaborative Multidisciplinary Design Optimization with Neural Networks

abstract: The design of complex engineering systems leads to solving very large optimization problems involving different disciplines. Strategies allowing disciplines to optimize in parallel by providing sub-objectives and splitting the problem into smaller parts, such as Collaborative Optimization, are promising solutions.However, most of them have slow convergence which reduces their practical use. Earlier efforts to fasten convergence by learning surrogate models have not yet succeeded at sufficiently improving the competitiveness of these strategies.This paper shows that, in the case of Collaborative Optimization, faster and more reliable convergence can be obtained by solving an interesting instance of binary classification: on top of the target label, the training data of one of the two classes contains the distance to the decision boundary and its derivative. Leveraging this information, we propose to train a neural network with an asymmetric loss function, a structure that guarantees Lipshitz continuity, and a regularization towards respecting basic distance function properties. The approach is demonstrated on a toy learning example, and then applied to a multidisciplinary aircraft design problem.


title: Dynamics and Nonmonotonic Drag for Individually Driven Skyrmions

abstract: We examine the motion of an individual skyrmion driven through an assembly of other skyrmions by a constant or increasing force in the absence of quenched disorder. The skyrmion behavior is determined by the ratio of the damping and Magnus terms, as expressed in terms of the intrinsic skyrmion Hall angle. For a fixed driving force in the damping dominated regime, the effective viscosity decreases monotonically with increasing skyrmion density, similar to what is observed in overdamped systems where it becomes difficult for the driven particle to traverse the surrounding medium at high densities. In contrast, in the Magnus dominated regime the velocity dependence on the density is nonmonotonic, and there is a regime in which the skyrmion moves faster with increasing density, as well as a pronounced speed-up effect in which a skyrmion traveling through a dense medium moves more rapidly than it would at low densities or in the single particle limit. At higher densities, the effective damping increases and the velocity decreases. The velocity-force curves in the Magnus-dominated regime show marked differences from those in the damping-dominated regimes. Under an increasing drive we find that there is a threshold force for skyrmion motion which increases with density. Additionally, the skyrmion Hall angle is drive dependent, starting near zero at the threshold for motion and increasing with increasing drive before reaching a saturation value, similar to the behavior found for skyrmions driven over quenched disorder. We map dynamic phase diagrams showing the threshold for motion, nonlinear flow, speed-up, and saturation regimes. We also find that in some cases, increasing the density can reduce the skyrmion Hall angle while producing a velocity boost, which could be valuable for applications.


title: Indistinguishability Obfuscation of Null Quantum Circuits and Applications

abstract: We study the notion of indistinguishability obfuscation for null quantum circuits (quantum null-iO). We present a construction assuming: - The quantum hardness of learning with errors (LWE). - Post-quantum indistinguishability obfuscation for classical circuits. - A notion of ''dual-mode'' classical verification of quantum computation (CVQC). We give evidence that our notion of dual-mode CVQC exists by proposing a scheme that is secure assuming LWE in the quantum random oracle model (QROM). Then we show how quantum null-iO enables a series of new cryptographic primitives that, prior to our work, were unknown to exist even making heuristic assumptions. Among others, we obtain the first witness encryption scheme for QMA, the first publicly verifiable non-interactive zero-knowledge (NIZK) scheme for QMA, and the first attribute-based encryption (ABE) scheme for BQP.


title: Sparse Bayesian Learning via Stepwise Regression

abstract: Sparse Bayesian Learning (SBL) is a powerful framework for attaining sparsity in probabilistic models. Herein, we propose a coordinate ascent algorithm for SBL termed Relevance Matching Pursuit (RMP) and show that, as its noise variance parameter goes to zero, RMP exhibits a surprising connection to Stepwise Regression. Further, we derive novel guarantees for Stepwise Regression algorithms, which also shed light on RMP. Our guarantees for Forward Regression improve on deterministic and probabilistic results for Orthogonal Matching Pursuit with noise. Our analysis of Backward Regression on determined systems culminates in a bound on the residual of the optimal solution to the subset selection problem that, if satisfied, guarantees the optimality of the result. To our knowledge, this bound is the first that can be computed in polynomial time and depends chiefly on the smallest singular value of the matrix. We report numerical experiments using a variety of feature selection algorithms. Notably, RMP and its limiting variant are both efficient and maintain strong performance with correlated features.

categories: cs.LG cs.IT math.IT math.OC stat.CO stat.ML


title: Universality of nodal count distribution in large metric graphs

abstract: An eigenfunction of the Laplacian on a metric (quantum) graph has an excess number of zeros due to the graph's non-trivial topology. This number, called the nodal surplus, is an integer between 0 and the graph's first Betti number $\beta$. We study the distribution of the nodal surplus values in the countably infinite set of the graph's eigenfunctions. We conjecture that this distribution converges to Gaussian for any sequence of graphs of growing $\beta$. We prove this conjecture for several special graph sequences and test it numerically for a variety of well-known graph families. Accurate computation of the distribution is made possible by a formula expressing the nodal surplus distribution as an integral over a high-dimensional torus.


title: Neural Optimization Kernel: Towards Robust Deep Learning

abstract: Deep neural networks (NN) have achieved great success in many applications. However, why do deep neural networks obtain good generalization at an over-parameterization regime is still unclear. To better understand deep NN, we establish the connection between deep NN and a novel kernel family, i.e., Neural Optimization Kernel (NOK). The architecture of structured approximation of NOK performs monotonic descent updates of implicit regularization problems. We can implicitly choose the regularization problems by employing different activation functions, e.g., ReLU, max pooling, and soft-thresholding. We further establish a new generalization bound of our deep structured approximated NOK architecture. Our unsupervised structured approximated NOK block can serve as a simple plug-in of popular backbones for a good generalization against input noise.


title: Meta-Adaptive Nonlinear Control: Theory and Algorithms

abstract: We present an online multi-task learning approach for adaptive nonlinear control, which we call Online Meta-Adaptive Control (OMAC). The goal is to control a nonlinear system subject to adversarial disturbance and unknown $\textit{environment-dependent}$ nonlinear dynamics, under the assumption that the environment-dependent dynamics can be well captured with some shared representation. Our approach is motivated by robot control, where a robotic system encounters a sequence of new environmental conditions that it must quickly adapt to. A key emphasis is to integrate online representation learning with established methods from control theory, in order to arrive at a unified framework that yields both control-theoretic and learning-theoretic guarantees. We provide instantiations of our approach under varying conditions, leading to the first non-asymptotic end-to-end convergence guarantee for multi-task nonlinear control. OMAC can also be integrated with deep representation learning. Experiments show that OMAC significantly outperforms conventional adaptive control approaches which do not learn the shared representation, in inverted pendulum and 6-DoF drone control tasks under varying wind conditions.


title: The atomic ionization, capture, and stopping cross sections by multicharged ions satisfy the Benford law

abstract: The applicability of the Benford law for different data sets of atomic cross sections by ion impact is studied. We find that the data sets corresponding to theoretical ionization and capture cross sections of neutral targets by multicharged ions satisfy quite well the Benford law, not only for the first digits but also within a given order of magnitude. Experimental stopping power values from the International Atomic Energy Agency database were also scrutinized, but in this case the Benford conformity was not so satisfactory due to its small rank width. In all cases, errors, densities of prime numbers, and theorems of Nigrini and Pinkham are evaluated and discussed.


title: Dynamics of a generalized Rayleigh system

abstract: Consider the first order differential system given by \begin{equation*} \begin{array}{l} \dot{x}= y, \qquad \dot{y}= -x+a(1-y^{2n})y, \end{array} \end{equation*} where $a$ is a real parameter and the dots denote derivatives with respect to the time $t$. Such system is known as the generalized Rayleigh system and it appears, for instance, in the modeling of diabetic chemical processes through a constant area duct, where the effect of adding or rejecting heat is considered. In this paper we characterize the global dynamics of this generalized Rayleigh system. In particular we prove the existence of a unique limit cycle when the parameter $a\ne 0$.


title: Using HPC infrastructures for deep learning applications in fusion research

abstract: In the fusion community, the use of high performance computing (HPC) has been mostly dominated by heavy-duty plasma simulations, such as those based on particle-in-cell and gyrokinetic codes. However, there has been a growing interest in applying machine learning for knowledge discovery on top of large amounts of experimental data collected from fusion devices. In particular, deep learning models are especially hungry for accelerated hardware, such as graphics processing units (GPUs), and it is becoming more common to find those models competing for the same resources that are used by simulation codes, which can be either CPU- or GPU-bound. In this paper, we give examples of deep learning models -- such as convolutional neural networks, recurrent neural networks, and variational autoencoders -- that can be used for a variety of tasks, including image processing, disruption prediction, and anomaly detection on diagnostics data. In this context, we discuss how deep learning can go from using a single GPU on a single node to using multiple GPUs across multiple nodes in a large-scale HPC infrastructure.


title: Spin current at a magnetic junction as a probe of the Kondo state

abstract: We investigate the spin Seebeck effect and spin pumping in a junction between a ferromagnetic insulator and a magnetic impurity deposited on a normal metal. By the numerical renormalization group calculation, we show that spin current is enhanced by the Kondo effect. This spin current is suppressed by increase of the temperature or the magnetic field which is comparable with the Kondo temperature. Our results indicate that spin transport can be a direct probe of spin excitation in strongly correlated systems.


title: Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speech

abstract: Several recent end-to-end text-to-speech (TTS) models enabling single-stage training and parallel sampling have been proposed, but their sample quality does not match that of two-stage TTS systems. In this work, we present a parallel end-to-end TTS method that generates more natural sounding audio than current two-stage models. Our method adopts variational inference augmented with normalizing flows and an adversarial training process, which improves the expressive power of generative modeling. We also propose a stochastic duration predictor to synthesize speech with diverse rhythms from input text. With the uncertainty modeling over latent variables and the stochastic duration predictor, our method expresses the natural one-to-many relationship in which a text input can be spoken in multiple ways with different pitches and rhythms. A subjective human evaluation (mean opinion score, or MOS) on the LJ Speech, a single speaker dataset, shows that our method outperforms the best publicly available TTS systems and achieves a MOS comparable to ground truth.


title: Interior point search for nonparametric image segmentation

abstract: Precise object boundary detection for automatic image segmentation is critical for image analysis, including that used in computer-aided diagnosis. However, such detection traditionally uses active contour or snake models requiring accurate initialization and parameter optimization. Identifying optimal parameter values requires time-consuming multiple runs and provides results that vary by user expertise, limiting the use of these models in high-throughput or real-time situations. Thus, we developed a nonparametric snake model using an interior point search method applied in iterations to find and improve the set of snake points forming the edge of a shape. At each iteration, one or more snake points are replaced by others in the edge map. We validated the model using binary and continuous edge images of single and multiple objects, and noisy and real images, comparing the results to those obtained using traditional snake models. The proposed model not only provides better results on all image types tested but is more robust than traditional snake models. Unlike traditional snake models, the proposed model requires no user interaction for initializing snakes and no pre-processing of noisy images. Thus, our method offers robust automatic image segmentation that is simpler to use and less time-consuming than traditional snake models