title: Towards Generalized Speech Enhancement with Generative Adversarial Networks

abstract: The speech enhancement task usually consists of removing additive noise or reverberation that partially mask spoken utterances, affecting their intelligibility. However, little attention is drawn to other, perhaps more aggressive signal distortions like clipping, chunk elimination, or frequency-band removal. Such distortions can have a large impact not only on intelligibility, but also on naturalness or even speaker identity, and require of careful signal reconstruction. In this work, we give full consideration to this generalized speech enhancement task, and show it can be tackled with a time-domain generative adversarial network (GAN). In particular, we extend a previous GAN-based speech enhancement system to deal with mixtures of four types of aggressive distortions. Firstly, we propose the addition of an adversarial acoustic regression loss that promotes a richer feature extraction at the discriminator. Secondly, we also make use of a two-step adversarial training schedule, acting as a warm up-and-fine-tune sequence. Both objective and subjective evaluations show that these two additions bring improved speech reconstructions that better match the original speaker identity and naturalness.


title: Context-aware Human Motion Prediction

abstract: The problem of predicting human motion given a sequence of past observations is at the core of many applications in robotics and computer vision. Current state-of-the-art formulate this problem as a sequence-to-sequence task, in which a historical of 3D skeletons feeds a Recurrent Neural Network (RNN) that predicts future movements, typically in the order of 1 to 2 seconds. However, one aspect that has been obviated so far, is the fact that human motion is inherently driven by interactions with objects and/or other humans in the environment. In this paper, we explore this scenario using a novel context-aware motion prediction architecture. We use a semantic-graph model where the nodes parameterize the human and objects in the scene and the edges their mutual interactions. These interactions are iteratively learned through a graph attention layer, fed with the past observations, which now include both object and human body motions. Once this semantic graph is learned, we inject it to a standard RNN to predict future movements of the human/s and object/s. We consider two variants of our architecture, either freezing the contextual interactions in the future of updating them. A thorough evaluation in the "Whole-Body Human Motion Database" shows that in both cases, our context-aware networks clearly outperform baselines in which the context information is not considered.


title: Dust temperature and time-dependent effects in the chemistry of photodissociation regions

abstract: When studying the chemistry of PDRs, time dependence becomes important as visual extinction increases, since certain chemical timescales are comparable to the cloud lifetime. Dust temperature is also a key factor, since it significantly influences gas temperature and mobility on dust grains, determining the chemistry occurring on grain surfaces. We present a study of the dust temperature impact and time effects on the chemistry of different PDRs, using an updated version of the Meijerink PDR code and combining it with the time-dependent code Nahoon. We find the largest temperature effects in the inner regions of high $G$$_{\mathrm{0}}$ PDRs, where high dust temperatures favour the formation of simple oxygen-bearing molecules (especially that of O$_2$), while the formation of complex organic molecules is much more efficient at low dust temperatures. We also find that time-dependent effects strongly depend on the PDR type, since long timescales promote the destruction of oxygen-bearing molecules in the inner parts of low $G$$_{\mathrm{0}}$ PDRs, while favouring their formation and that of carbon-bearing molecules in high $G$$_{\mathrm{0}}$ PDRs. From the chemical evolution, we also conclude that, in dense PDRs, CO$_2$ is a late-forming ice compared to water ice, and confirm a layered ice structure on dust grains, with H$_2$O in lower layers than CO$_2$. Regarding steady state, the PDR edge reaches chemical equilibrium at early times ($\lesssim$10$^5$ yr). This time is even shorter ($<$10$^4$ yr) for high $G$$_{\mathrm{0}}$ PDRs. By contrast, inner regions reach equilibrium much later, especially low $G$$_{\mathrm{0}}$ PDRs, where steady state is reached at $\sim$10$^6$-10$^7$ yr.


title: Online Trajectory Generation of a MAV for Chasing a Moving Target in 3D Dense Environments

abstract: This work deals with a moving target chasing mission of an aerial vehicle equipped with a vision sensor in a cluttered environment. In contrast to obstacle-free or sparse environments, the chaser should be able to handle collision and occlusion simultaneously with flight efficiency. In order to tackle these challenges with real-time replanning, we introduce a metric for target visibility and propose a cascaded chasing planner. By means of the graph-search methods, we first generate a sequence of chasing corridors and waypoints which ensure safety and optimize visibility. In the following phase, the corridors and waypoints are utilized as constraints and objective in quadratic programming from which we complete a dynamically feasible trajectory for chasing. The proposed algorithm is tested in multiple dense environments. The simulator AutoChaser with full code implementation and GUI can be found in https://github.com/icsl-Jeon/traj_gen_vis


title: A criterion for normality of analytic mappings

abstract: In this paper we give a generalization and improvement of the Pavlovi\'{c} result on the characterization of continuously differentiable functions in the Bloch space on the unit ball in $\mathbb{R}^m$. Then we derive a Holland--Walsh type theorem for analytic normal mappings on the unit disk.


title: FILDNE: A Framework for Incremental Learning of Dynamic Networks Embeddings

abstract: Representation learning on graphs has emerged as a powerful mechanism to automate feature vector generation for downstream machine learning tasks. The advances in representation on graphs have centered on both homogeneous and heterogeneous graphs, where the latter presenting the challenges associated with multi-typed nodes and/or edges. In this paper, we consider the additional challenge of evolving graphs. We ask the question of whether the advances in representation learning for static graphs can be leveraged for dynamic graphs and how? It is important to be able to incorporate those advances to maximize the utility and generalization of methods. To that end, we propose the Framework for Incremental Learning of Dynamic Networks Embedding (FILDNE), which can utilize any existing static representation learning method for learning node embeddings, while keeping the computational costs low. FILDNE integrates the feature vectors computed using the standard methods over different timesteps into a single representation by developing a convex combination function and alignment mechanism. Experimental results on several downstream tasks, over seven real-world data sets, show that FILDNE is able to reduce memory and computational time costs while providing competitive quality measure gains with respect to the contemporary methods for representation learning on dynamic graphs.


title: Emergence via non-existence of averages

abstract: Inspired by a recent work by Berger, we introduce the concept of pointwise emergence. This concept provides with a new quantitative perspective into the study of non-existence of averages for dynamical systems. We show that high pointwise emergence on a large set appears for abundant dynamical systems: Any continuous maps on a compact metric space with the specification property have super-polynomial pointwise emergence on a residual subset of the state space. Furthermore, there is a dense subset of any Newhouse open set each element of which has super-polynomial pointwise emergence on a positive Lebesgue measure subset of the state space.


title: A Novel Unsupervised Camera-aware Domain Adaptation Framework for Person Re-identification

abstract: Unsupervised cross-domain person re-identification (Re-ID) faces two key issues. One is the data distribution discrepancy between source and target domains, and the other is the lack of labelling information in target domain. They are addressed in this paper from the perspective of representation learning. For the first issue, we highlight the presence of camera-level sub-domains as a unique characteristic of person Re-ID, and develop camera-aware domain adaptation to reduce the discrepancy not only between source and target domains but also across these sub-domains. For the second issue, we exploit the temporal continuity in each camera of target domain to create discriminative information. This is implemented by dynamically generating online triplets within each batch, in order to maximally take advantage of the steadily improved feature representation in training process. Together, the above two methods give rise to a novel unsupervised deep domain adaptation framework for person Re-ID. Experiments and ablation studies on benchmark datasets demonstrate its superiority and interesting properties.


title: On equivalence of singularities of linear second order ordinary differential equations by point transformations

abstract: The article provides a local classification of singularities of meromorphic second order linear differential equation with respect to analytic/meromorphic linear point transformations. It also addresses the problem of determining the Lie algebra of analytic linear infinitesimal symmetries of the singularities.


title: On relatively compact sets in quasi-Banach function spaces

abstract: This paper is devoted to the study of the relatively compact sets in Quasi-Banach function spaces, providing an important improvement of the known results. As an application, we take the final step in establishing a relative compactness criteria for function spaces with any weight without any assumption.


title: Ring-Mesh: A Scalable and High-Performance Approach for Manycore Accelerators

abstract: There are increasing number of works addressing the design challenges of fast, scalable solutions for the growing number of new type of applications. Recently, many of the solutions aimed at improving processing element capabilities to speed up the execution of machine learning application domain. However, only a few works focused on the interconnection subsystem as a potential source of performance improvement. Wrapping many cores together offer excellent parallelism, but it brings other challenges (e.g., adequate interconnections). Scalable, power-aware interconnects are required to support such a growing number of processing elements, as well as modern applications. In this paper, we propose a scalable and energy efficient Network-on-Chip architecture fusing the advantages of rings as well as the 2D-mesh without using any bridge router to provide high-performance. A dynamic adaptation mechanism allows to better adapt to the application requirements. Simulation results show efficient power consumption (up to 141.3% saving for connecting 1024 cores), 2x (on average) throughput growth with better scalability (up to 1024 processing elements) compared to popular 2D-mesh while tested in multiple statistical traffic pattern scenarios.


title: Landau theory of crystal plasticity

abstract: We show that nonlinear continuum elasticity can be effective in modeling plastic flows in crystals if it is viewed as Landau theory with an infinite number of equivalent energy wells whose configuration is dictated by the symmetry group GL(3,Z). Quasi-static loading can be then handled by athermal dynamics, while lattice based discretization can play the role of regularization. As a proof of principle, we study in this Letter dislocation nucleation in a homogeneously sheared 2D crystal and show that the global tensorial invariance of the elastic energy foments the development of complexity in the configuration of collectively nucleating defects. A crucial role in this process is played by the unstable higher symmetry crystallographic phases, traditionally thought to be unrelated to plastic flow in lower symmetry lattices.


title: Baryon acoustic oscillations from the cross-correlation of Ly$\alpha$ absorption and quasars in eBOSS DR14

abstract: We present a measurement of the baryon acoustic oscillation (BAO) scale at redshift $z=2.35$ from the three-dimensional correlation of Lyman-$\alpha$ (Ly$\alpha$) forest absorption and quasars. The study uses 266,590 quasars in the redshift range $1.77<z<3.5$ from the Sloan Digital Sky Survey (SDSS) Data Release 14 (DR14). The sample includes the first two years of observations by the SDSS-IV extended Baryon Oscillation Spectroscopic Survey (eBOSS), providing new quasars and re-observations of BOSS quasars for improved statistical precision. Statistics are further improved by including Ly$\alpha$ absorption occurring in the Ly$\beta$ wavelength band of the spectra. From the measured BAO peak position along and across the line of sight, we determined the Hubble distance $D_{H}$ and the comoving angular diameter distance $D_{M}$ relative to the sound horizon at the drag epoch $r_{d}$: $D_{H}(z=2.35)/r_{d}=9.20\pm 0.36$ and $D_{M}(z=2.35)/r_{d}=36.3\pm 1.8$. These results are consistent at $1.5\sigma$ with the prediction of the best-fit spatially-flat cosmological model with the cosmological constant reported for the Planck (2016) analysis of cosmic microwave background anisotropies. Combined with the Ly$\alpha$ auto-correlation measurement presented in a companion paper, the BAO measurements at $z=2.34$ are within $1.7\sigma$ of the predictions of this model.


title: Polarized electron-beam acceleration driven by vortex laser pulses

abstract: We propose a new approach based on an all-optical set-up for generating relativistic polarized electron beams via vortex Laguerre-Gaussian (LG) laser-driven wakefield acceleration. Using a pre-polarized gas target, we find that the topology of the vortex wakefield resolves the depolarization issue of the injected electrons. In full three-dimensional particle-in-cell simulations, incorporating the spin dynamics via the Thomas-Bargmann Michel Telegdi equation, the LG laser preserves the electron spin polarization by more than 80% at high beam charge and flux. The method releases the limit on beam flux for polarized electron acceleration and promises more than an order of magnitude boost in peak flux, as compared to Gaussian beams. These results suggest a promising table-top method to produce energetic polarized electron beams.


title: Effective Andr\'e-Oort Type Results for Almost Holomorphic Modular Funcions

abstract: In this short paper we discuss a number of effective and/or explicit results of Andre-Oort type for the nonholomorphic function "$\chi^*$", which I have discussed in a number of other papers. After working in a rather ad-hoc manner to get some good estimates on the tails of the $q$-expansions involved, we prove weak effective Andr\'e-Oort results for $\chi^*$, which mimic but are not full analogues of effective Andr\'e-Oort results known due to K\"uhne/Bilu-Masser-Zannier for the classical modular function $j$. Then we go on to discuss what we call an "explicit" result; that certain triples of special points cannot often be collinear, looking for an analogue of results known for $j$. Again we cannot get a perfect analogy, but we do prove a weaker result and discuss what remains to be proved to complete this. An important result which arises as a side-effect of the explicit calculation done here is "Corollary 2.4", which affirms a conjecture I made in earlier papers, that for a quadratic point $\tau$ we have $\mathbb{Q}(j(\tau)) = \mathbb{Q}(\chi^*(\tau))$. Although it appears here somewhat tangentially, it may be the most significant result in the paper.


title: Vacuum energy in the effective field theory of general relativity

abstract: In the framework of an effective field theory of general relativity a model of scalar and vector bosons interacting with the metric field is considered. It is shown in the framework of a two-loop order calculation that for the cosmological constant term which is fixed by the condition of vanishing vacuum energy the graviton remains massless and there exists a self-consistent effective field theory of general relativity coupled to matter fields defined on a flat Minkowski background. This result is obtained under the assumption that the energy-momentum tensor of the gravitational field is given by the pseudotensor of Landau-Lifshitz's classic textbook. Implications for the cosmological constant problem are also briefly discussed.


title: Local average sampling and reconstruction with fundamental splines of fractional order

abstract: We analyse sampling and average sampling techniques for fractional spline subspaces of $L^{2}({\mathbb{R}}).$ Fractional B-splines $\beta_{\sigma}$ are extensions of Schoenberg's polynomial splines of integral order to real order $\sigma > -1$. We present the interpolation with fundamental splines of fractional order for $\sigma \geq 1$ and the average sampling with fundamental splines of fractional order for $\sigma \geq \frac{3}{2}.$ Further, we generalise Kramer's lemma in the context of local average sampling.


title: TURTLE: A C library for an optimistic stepping through a topography

abstract: TURTLE is a C library providing utilities allowing to navigate through a topography described by a Digital Elevation Model (DEM). The library has been primarily designed for the Monte Carlo transport of particles scattering over medium to long ranges, e.g. atmospheric muons. But, it can also efficiently handle ray tracing problems with very large DEMs ($10^9$ nodes or more), e.g. for neutrino simulations. The TURTLE library was built on an optimistic ray tracing algorithm, detailed in the present paper. This algorithm proceeds by trials and errors, approximating the topography within the modelling uncertainties of the DEM data. This allows to traverse a topography in constant time, i.e. independently of the number of grid nodes, and with no added memory. Detailed performance studies are provided by comparison to other ray tracing algorithms and as an application to muon transport in a Monte Carlo simulation.


title: Unsupervised Embedding Learning via Invariant and Spreading Instance Feature

abstract: This paper studies the unsupervised embedding learning problem, which requires an effective similarity measurement between samples in low-dimensional embedding space. Motivated by the positive concentrated and negative separated properties observed from category-wise supervised learning, we propose to utilize the instance-wise supervision to approximate these properties, which aims at learning data augmentation invariant and instance spread-out features. To achieve this goal, we propose a novel instance based softmax embedding method, which directly optimizes the `real' instance features on top of the softmax function. It achieves significantly faster learning speed and higher accuracy than all existing methods. The proposed method performs well for both seen and unseen testing categories with cosine similarity. It also achieves competitive performance even without pre-trained network over samples from fine-grained categories.


title: Optimal Sampling of Water Distribution Network Dynamics using Graph Fourier Transform

abstract: Water Distribution Networks (WDNs) are critical infrastructures that ensure safe drinking water. One of the major threats is the accidental or intentional injection of pollutants. Data collection remains challenging in underground WDNs and in order to quantify its threat to end users, modeling pollutant spread with minimal sensor data is can important open challenge. Existing approaches using numerical optimisation suffer from scalability issues and lack detailed insight and performance guarantees. Applying general data-driven approaches such as compressed sensing (CS) offer limited improvements in sample node reduction. Graph theoretic approaches link topology (e.g. Laplacian spectra) to optimal sensing locations, it neglects the complex dynamics. In this work, we introduce a novel Graph Fourier Transform (GFT) that exploits the low-rank property to optimally sample junction nodes in WDNs. The proposed GFT allows us to fully recover the full network dynamics using a subset of data sampled at the identified nodes. The proposed GFT technique offers attractive improvements over existing numerical optimisation, compressed sensing, and graph theoretic approaches. Our results show that, on average, with nearly 30-40\% of the junctions monitored, we are able to fully recover the dynamics of the whole network. The framework is useful beyond the application of WDNs and can be applied to a variety of infrastructure sensing for digital twin modeling.


title: Reinforced Imitation in Heterogeneous Action Space

abstract: Imitation learning is an effective alternative approach to learn a policy when the reward function is sparse. In this paper, we consider a challenging setting where an agent and an expert use different actions from each other. We assume that the agent has access to a sparse reward function and state-only expert observations. We propose a method which gradually balances between the imitation learning cost and the reinforcement learning objective. In addition, this method adapts the agent's policy based on either mimicking expert behavior or maximizing sparse reward. We show, through navigation scenarios, that (i) an agent is able to efficiently leverage sparse rewards to outperform standard state-only imitation learning, (ii) it can learn a policy even when its actions are different from the expert, and (iii) the performance of the agent is not bounded by that of the expert, due to the optimized usage of sparse rewards.


title: QCD analysis of non-singlet structure functions at NNLO accuracy, based on the Laplace transform

abstract: In this work, using the Laplace transformation technique we present our results for non-singlet quark distributions as well as nucleon structure function $F_2(x,Q^2)$ in unpolarized case at next-to-next-to-leading order (NNLO) QCD accuracy. We shall particularly compare our results for the sets of valence-quark parton distribution functions with the contemporary collaborations like CT14, CT18, MMHT14, MKAM16 and NNPDF. To construct the nucleon structure function we employ the expansion of Jacobi polynomials which is a suitable transform to convert the results of non-singlet structure function from the Laplace $s$-space to Bjorken $x$-space. We shall also consider the contributions of target mass correction as well as the higher twist effects at large-$x$ region for the proton and deuteron structure functions. Our results for the unpolarized quark distribution functions and nucleon structure functions are in good agreement with recent theoretical models and available experimental data.


title: Uniform Input-to-State Stability for Switched and Time-Varying Impulsive Systems

abstract: We provide a Lyapunov-function-based method for establishing different types of uniform input-to-state stability (ISS) for time-varying impulsive systems. The method generalizes to impulsive systems with inputs the well-established philosophy of assessing the stability of a system by reducing the problem to that of the stability of a scalar system given by the evolution of the Lyapunov function on the system trajectories. This reduction is performed in such a way so that the resulting scalar system has no inputs. Novel sufficient conditions for ISS are provided, which generalize existing results for time-invariant and time-varying, switched and nonswitched, impulsive and nonimpulsive systems in several directions.


title: Iterative Normalization: Beyond Standardization towards Efficient Whitening

abstract: Batch Normalization (BN) is ubiquitously employed for accelerating neural network training and improving the generalization capability by performing standardization within mini-batches. Decorrelated Batch Normalization (DBN) further boosts the above effectiveness by whitening. However, DBN relies heavily on either a large batch size, or eigen-decomposition that suffers from poor efficiency on GPUs. We propose Iterative Normalization (IterNorm), which employs Newton's iterations for much more efficient whitening, while simultaneously avoiding the eigen-decomposition. Furthermore, we develop a comprehensive study to show IterNorm has better trade-off between optimization and generalization, with theoretical and experimental support. To this end, we exclusively introduce Stochastic Normalization Disturbance (SND), which measures the inherent stochastic uncertainty of samples when applied to normalization operations. With the support of SND, we provide natural explanations to several phenomena from the perspective of optimization, e.g., why group-wise whitening of DBN generally outperforms full-whitening and why the accuracy of BN degenerates with reduced batch sizes. We demonstrate the consistently improved performance of IterNorm with extensive experiments on CIFAR-10 and ImageNet over BN and DBN.


title: Does it Swing? Microtiming Deviations and Swing Feeling in Jazz

abstract: Jazz music that swings has the fascinating power to elicit a pleasant sensation of flow in listeners and the desire to synchronize body movements with the music. Whether microtiming deviations (MTDs), i.e. small timing deviations below the bar or phrase level, enhance the feeling of swing is highly debated in the current literature. Studies on other groove related genres did not find evidence for a positive impact of MTDs. The present study addresses jazz music and swing in particular, as there is some evidence that microtiming patterns are genre-specific. We recorded twelve piano jazz standards played by a professional pianist and manipulated the natural MTDs of the recordings in systematic ways by quantizing, expanding and inverting them. MTDs were defined with respect to a grid determined by the average swing ratio. The original and manipulated versions were presented in an online survey and evaluated by 160 listeners with various musical skill levels and backgrounds. Across pieces the quantized versions (without MTDs) were rated slightly higher and versions with expanded MTDs were rated lower with regard to swing than the original recordings. Unexpectedly, inversion had no impact on swing ratings except for two pieces. Our results suggest that naturally fluctuating MTDs are not an essential factor for the feeling of swing.


title: Eccentric Binary Black Holes with Spin via the Direct Integration of the Post-Newtonian Equations of Motion

abstract: We integrate the third and a half post-Newtonian equations of motion for a fully generic binary black hole system, allowing both for non-circular orbits, and for one or both of the black holes to spin, in any orientation. Using the second post-Newtonian order expression beyond the leading order quadrupole formula, we study the gravitational waveforms produced from such systems. Our results are validated by comparing to Taylor T4 in the aligned-spin circular cases, and the additional effects and modulations introduced by the eccentricity and the spins are analyzed. We use the framework to evaluate the evolution of eccentricity, and trace its contributions to source terms corresponding to the different definitions. Finally, we discuss how this direct integration equations-of-motion code may be relevant to existing and upcoming gravitational wave detectors, showing fully generic, precessing, eccentric gravitational waveforms from a fiducial binary system with the orbital plane and spin precession, and the eccentricity reduction.


title: Bus Travel Time Prediction: A Lognormal Auto-Regressive (AR) Modeling Approach

abstract: Providing real time information about the arrival time of the transit buses has become inevitable in urban areas to make the system more user-friendly and advantageous over various other transportation modes. However, accurate prediction of arrival time of buses is still a challenging problem in dynamically varying traffic conditions especially under heterogeneous traffic condition without lane discipline. One broad approach researchers have adopted over the years is to segment the entire bus route into segments and work with these segment travel times as the data input (from GPS traces) for prediction. This paper adopts this approach and proposes predictive modelling approaches which fully exploit the temporal correlations in the bus GPS data. Specifically, we propose two approaches: (a) classical time-series approach employing a seasonal AR model (b)unconventional linear, non-stationary AR approach. The second approach is a novel technique and exploits the notion of partial correlation for learning from data. A detailed analysis of the marginal distributions of the data from Indian conditions (used here), revealed a predominantly log-normal behavior. This aspect was incorporated into the above proposed predictive models and statistically optimal prediction schemes in the lognormal sense are utilized for all predictions. Both the above temporal predictive modeling approaches predict ahead in time at each segment independently. For real-time bus travel time prediction, one however needs to predict across multiple segments ahead in space. Towards a complete solution, the study also proposes an intelligent procedure to perform (real-time) multi-section ahead travel-time predictions based on either of the above proposed temporal models. Results showed a clear improvement in prediction accuracy using the proposed methods,


title: Feature-Based Interpolation and Geodesics in the Latent Spaces of Generative Models

abstract: Interpolating between points is a problem connected simultaneously with finding geodesics and study of generative models. In the case of geodesics, we search for the curves with the shortest length, while in the case of generative models we typically apply linear interpolation in the latent space. However, this interpolation uses implicitly the fact that Gaussian is unimodal. Thus the problem of interpolating in the case when the latent density is non-Gaussian is an open problem. In this paper, we present a general and unified approach to interpolation, which simultaneously allows us to search for geodesics and interpolating curves in latent space in the case of arbitrary density. Our results have a strong theoretical background based on the introduced quality measure of an interpolating curve. In particular, we show that maximising the quality measure of the curve can be equivalently understood as a search of geodesic for a certain redefinition of the Riemannian metric on the space. We provide examples in three important cases. First, we show that our approach can be easily applied to finding geodesics on manifolds. Next, we focus our attention in finding interpolations in pre-trained generative models. We show that our model effectively works in the case of arbitrary density. Moreover, we can interpolate in the subset of the space consisting of data possessing a given feature. The last case is focused on finding interpolation in the space of chemical compounds.


title: Token-Level Ensemble Distillation for Grapheme-to-Phoneme Conversion

abstract: Grapheme-to-phoneme (G2P) conversion is an important task in automatic speech recognition and text-to-speech systems. Recently, G2P conversion is viewed as a sequence to sequence task and modeled by RNN or CNN based encoder-decoder framework. However, previous works do not consider the practical issues when deploying G2P model in the production system, such as how to leverage additional unlabeled data to boost the accuracy, as well as reduce model size for online deployment. In this work, we propose token-level ensemble distillation for G2P conversion, which can (1) boost the accuracy by distilling the knowledge from additional unlabeled data, and (2) reduce the model size but maintain the high accuracy, both of which are very practical and helpful in the online production system. We use token-level knowledge distillation, which results in better accuracy than the sequence-level counterpart. What is more, we adopt the Transformer instead of RNN or CNN based models to further boost the accuracy of G2P conversion. Experiments on the publicly available CMUDict dataset and an internal English dataset demonstrate the effectiveness of our proposed method. Particularly, our method achieves 19.88% WER on CMUDict dataset, outperforming the previous works by more than 4.22% WER, and setting the new state-of-the-art results.


title: A Kac model for kinetic annihilation

abstract: In this paper we consider the stochastic dynamics of a finite system of particles in a finite volume (Kac-like particle system) which annihilate with probability $\alpha \in (0,1)$ or collide elastically with probability $1-\alpha$. We first establish the well-posedness of the particle system which exhibits no conserved quantities. We rigorously prove that, in some thermodynamic limit, a suitable hierarchy of kinetic equations is recovered for which tensorized solution to the homogenous Boltzmann with annihilation is a solution. For bounded collision kernels, this shows in particular that propagation of chaos holds true. Furthermore, we make conjectures about the limit behaviour of the particle system when hard-sphere interactions are taken into account.


title: Alternative Anti-Quantum-Channel Disturbance Decoder for Quantum Key Distribution

abstract: In the letter, we propose an anti-quantum-channel disturbance decoder for quantum key distribution (QKD). The decoder is based on a quarter-wave plate reflector-Michelson (Q-M) interferometer, with which the QKD system can be free of polarization disturbance caused by quantum channel and optical devices in the system. The theoretical analysis indicates that the Q-M interferometer is immune to polarization-induced signal fading and its corresponding operator is Pauli Matrix {\sigma}2, which naturally satisfies the anti-disturbance condition. A Q-M interferometer based time-bin phase encoding QKD setup is demonstrated and the experimental results show that the QKD setup works stably with a low quantum bit error rate and an average safe key rate about 7.34 kbps over 50.4 km standard optical fiber for two hours in the lab.


title: Resistive state of SFS Josephson junctions in the presence of moving domain walls

abstract: We describe resistive states of the system combining two types of orderings - superconducting and ferromagnetic one. It is shown that in the presence of magnetization dynamics such systems become inherently dissipative and in principle cannot sustain any amount of the superconducting current because of the voltage generated by the magnetization dynamics. We calculate generic current-voltage characteristics of a superconductor/ferromagnet/superconductor Josephson junction with an unpinned domain wall and find the low-current resistance associated with the domain wall motion. We suggest the finite slope of Shapiro steps as the characteristic feature of the regime with domain wall oscillations driven by the ac external current flowing through the junction.


title: UM-IU@LING at SemEval-2019 Task 6: Identifying Offensive Tweets Using BERT and SVMs

abstract: This paper describes the UM-IU@LING's system for the SemEval 2019 Task 6: OffensEval. We take a mixed approach to identify and categorize hate speech in social media. In subtask A, we fine-tuned a BERT based classifier to detect abusive content in tweets, achieving a macro F1 score of 0.8136 on the test data, thus reaching the 3rd rank out of 103 submissions. In subtasks B and C, we used a linear SVM with selected character n-gram features. For subtask C, our system could identify the target of abuse with a macro F1 score of 0.5243, ranking it 27th out of 65 submissions.


title: Doodle to Search: Practical Zero-Shot Sketch-based Image Retrieval

abstract: In this paper, we investigate the problem of zero-shot sketch-based image retrieval (ZS-SBIR), where human sketches are used as queries to conduct retrieval of photos from unseen categories. We importantly advance prior arts by proposing a novel ZS-SBIR scenario that represents a firm step forward in its practical application. The new setting uniquely recognizes two important yet often neglected challenges of practical ZS-SBIR, (i) the large domain gap between amateur sketch and photo, and (ii) the necessity for moving towards large-scale retrieval. We first contribute to the community a novel ZS-SBIR dataset, QuickDraw-Extended, that consists of 330,000 sketches and 204,000 photos spanning across 110 categories. Highly abstract amateur human sketches are purposefully sourced to maximize the domain gap, instead of ones included in existing datasets that can often be semi-photorealistic. We then formulate a ZS-SBIR framework to jointly model sketches and photos into a common embedding space. A novel strategy to mine the mutual information among domains is specifically engineered to alleviate the domain gap. External semantic knowledge is further embedded to aid semantic transfer. We show that, rather surprisingly, retrieval performance significantly outperforms that of state-of-the-art on existing datasets that can already be achieved using a reduced version of our model. We further demonstrate the superior performance of our full model by comparing with a number of alternatives on the newly proposed dataset. The new dataset, plus all training and testing code of our model, will be publicly released to facilitate future research


title: On the saturation of acoustic mode frequencies at high solar activity

abstract: Acoustic mode frequencies obtained by applying spherical harmonic decomposition to HMI, MDI and GONG observations were analysed throughout the solar cycle. Evidence of a deviation from a linear relation with solar radio flux was found indicating a saturation effect at high solar activity. The Gompertz model, which is one of the most frequently used sigmoid functions to fit growth data, is used. It is shown that its fitting to MDI and GONG data are statistically significant and a median saturation of four-hundred sfu is estimated. This saturation level is 50% larger than any obtained in the last century, hence the small effect observed in the minimum-to-maximum frequency shift. However, as shown here, it should not be disregarded.


title: Regularized Sample Average Approximation for High-Dimensional Stochastic Optimization Under Low-Rankness

abstract: This paper concerns a high-dimensional stochastic programming problem of minimizing a function of expected cost with a matrix argument. To this problem, one of the most widely applied solution paradigms is the sample average approximation (SAA), which uses the average cost over sampled scenarios as a surrogate to approximate the expected cost. Traditional SAA theories require the sample size to grow rapidly when the problem dimensionality increases. Indeed, for a problem of optimizing over a $p$-by-$p$ matrix, the sample complexity of the SAA is given by $\tilde O(1)\cdot \frac{p^2}{\epsilon^2}\cdot{polylog}(\frac{1}{\epsilon})$ to achieve an $\epsilon$-suboptimality gap, for some poly-logarithmic function ${polylog}(\,\cdot\,)$ and some quantity $\tilde O(1)$ independent of dimensionality $p$ and sample size $n$. In contrast, this paper considers a regularized SAA (RSAA) with a low-rankness-inducing penalty. We demonstrate that the sample complexity of RSAA is $\tilde O(1)\cdot \frac{p}{\epsilon^3}\cdot {polylog}(p,\,\frac{1}{\epsilon})$, which is almost linear in $p$ and thus indicates a substantially lower dependence on dimensionality. Therefore, RSAA can be more advantageous than SAA especially for larger scale and higher dimensional problems. Due to the close correspondence between stochastic programming and statistical learning, our results also indicate that high-dimensional low-rank matrix recovery is possible generally beyond a linear model, even if the common assumption of restricted strong convexity is completely absent.


title: An Integrated Approach for Keyphrase Generation via Exploring the Power of Retrieval and Extraction

abstract: In this paper, we present a novel integrated approach for keyphrase generation (KG). Unlike previous works which are purely extractive or generative, we first propose a new multi-task learning framework that jointly learns an extractive model and a generative model. Besides extracting keyphrases, the output of the extractive model is also employed to rectify the copy probability distribution of the generative model, such that the generative model can better identify important contents from the given document. Moreover, we retrieve similar documents with the given document from training data and use their associated keyphrases as external knowledge for the generative model to produce more accurate keyphrases. For further exploiting the power of extraction and retrieval, we propose a neural-based merging module to combine and re-rank the predicted keyphrases from the enhanced generative model, the extractive model, and the retrieved keyphrases. Experiments on the five KG benchmarks demonstrate that our integrated approach outperforms the state-of-the-art methods.


title: A 4d N=1 Cardy Formula

abstract: We study the asymptotic behavior of the (modified) superconformal index for 4d $\mathcal{N} = 1$ gauge theory. By considering complexified chemical potential, we find that the `high-temperature limit' of the index can be written in terms of the conformal anomalies $3c-2a$. We also find macroscopic entropy from our asymptotic free energy when the Hofman-Maldacena bound $1/2 < a/c < 3/2$ for the interacting SCFT is satisfied. We study $\mathcal{N} = 1$ theories that are dual to AdS$_5 \times Y^{p, p}$ and find that the Cardy limit of our index accounts for the Bekenstein-Hawking entropy of large black holes.


title: Optomechanical control of mode conversion in a hybrid semiconductor microcavity containing a quantum dot

abstract: The future of quantum communication systems and quantum networks heavily rely on the ability to fabricate and coherently control the conversion of photons between different modes based on a solid-state plateform. In this work, we propose and theoretically investigate a scheme to optomechanically control coherent mode conversion of optical photons by utilizing two optically coupled hybrid semiconductor microcavities containing a quantum dot (QD). One of the microcavity is pumped by an external laser and the second cavity is driven by light emitted by the QD that is embedded in the interface separating the two microcavities. The semiconductor microcavities can be fabricated using distributed Bragg reflectors (DBR) and can be made movable. We have demonstrated that photon-mode-conversion efficiency can be coherently manipulated by the optomechanical mode under appropriate conditions.


title: Scaling and spatial intermittency of thermal dissipation in turbulent convection

abstract: We derive scaling relations for the thermal dissipation rate in the bulk and in the boundary layers for moderate and large Prandtl number (Pr) convection. Using direct numerical simulations of Rayleigh-B\'{e}nard convection, we show that the thermal dissipation in the bulk is suppressed compared to passive scalar dissipation. The suppression is stronger for large Pr. We further show that the dissipation in the boundary layers dominates that in the bulk for both moderate and large Pr. The probability distribution functions of thermal dissipation rate, both in the bulk and in the boundary layers, are stretched exponential, similar to passive scalar dissipation.


title: Channel Estimation for Ambient Backscatter Communication Systems with Massive-Antenna Reader

abstract: Ambient backscatter, an emerging green communication technology, has aroused great interest from both academia and industry. One open problem for ambient backscatter communication (AmBC) systems is channel estimation for a massive-antenna reader. In this paper, we focus on channel estimation problem in AmBC systems with uniform linear array (ULA) at the reader which consists of large number of antennas. We first design a two-step method to jointly estimate channel gains and direction of arrivals (DoAs), and then refine the estimates through angular rotation. Additionally, Cramer-Rao lower bounds (CRLBs) are derived for both the modulus of the channel gain and the DoA estimates. Simulations are then provided to validate the analysis, and to show the efficiency of the proposed approach.


title: Structural, elastic, thermal and lattice dynamic properties of new 321 MAX phases

abstract: A new series of MAX family designated as 321 phases are recently reported with Nb3As2C, V3As2C, Nb3P2C and Ta3P2C. Most of the physical properties of these new MAX phase compounds are unexplored and the present study aims to investigate their structural, elastic, thermal, and lattice dynamical properties. Their mechanical and dynamical stabilities are examined. All the phases are elastically anisotropic and brittle in nature. The Debye temperatures and lattice thermal conductivities have been calculated. Lattice dynamical features are investigated in detail and infrared and Raman modes are identified. High melting temperature of these compounds are favorable for their applications at elevated temperatures.


title: The prospects of gravitational waves on constraining the anisotropy of the Universe

abstract: The observation of GW150914 indicated a new independent measurement of the luminosity distance of a gravitational wave event. In this paper, we constrain the anisotropy of the Universe by using gravitational wave events. We simulate hundreds of events of binary neutron star merging that may be observed by Einstein Telescope. Full simulation for producing process of gravitational wave data is employed. We find that 200 of binary neutron star merging in redshift $(0,1)$ observed by Einstein Telescope may constrain the anisotropy with an accuracy comparable to the result from Union2.1 supernovae. This result shows that gravitational waves can be a powerful tool in investigating the cosmological anisotropy.


title: Embodied Question Answering in Photorealistic Environments with Point Cloud Perception

abstract: To help bridge the gap between internet vision-style problems and the goal of vision for embodied perception we instantiate a large-scale navigation task -- Embodied Question Answering [1] in photo-realistic environments (Matterport 3D). We thoroughly study navigation policies that utilize 3D point clouds, RGB images, or their combination. Our analysis of these models reveals several key findings. We find that two seemingly naive navigation baselines, forward-only and random, are strong navigators and challenging to outperform, due to the specific choice of the evaluation setting presented by [1]. We find a novel loss-weighting scheme we call Inflection Weighting to be important when training recurrent models for navigation with behavior cloning and are able to out perform the baselines with this technique. We find that point clouds provide a richer signal than RGB images for learning obstacle avoidance, motivating the use (and continued study) of 3D deep learning models for embodied navigation.


title: Concentration in vanishing adiabatic exponent limit of solutions to the Aw-Rascle traffic model

abstract: In this paper, we study the phenomenon of concentration and the formation of delta shock wave in vanishing adiabatic exponent limit of Riemann solutions to the Aw-Rascle traffic model. It is proved that as the adiabatic exponent vanishes, the limit of solutions tends to a special delta-shock rather than the classical one to the zero pressure gas dynamics. In order to further study this problem, we consider a perturbed Aw-Rascle model and proceed to investigate the limits of solutions. We rigorously proved that, as $\gamma$ tends to one, any Riemann solution containing two shock waves tends to a delta-shock to the zero pressure gas dynamics in the distribution sense. Moreover, some representative numerical simulations are exhibited to confirm the theoretical analysis.


title: Flat-band many-body localization and ergodicity breaking in the Creutz ladder

abstract: We study disorder-free many-body localization in the flat-band Creutz ladder, which was recently realized in cold-atoms in an optical lattice. In a non-interacting case, the flat-band structure of the system leads to a Wannier wavefunction localized on four adjacent lattice sites. In the flat-band regime both with and without interactions, the level spacing analysis exhibits Poisson-like distribution indicating the existence of disorder-free localization. Calculations of the inverse participation ratio support this observation. Interestingly, this type of localization is robust to weak disorders, whereas for strong disorders, the system exhibits a crossover into the conventional disorder-induced many-body localizated phase. Physical picture of this crossover is investigated in detail. We also observe non-ergodic dynamics in the flat-band regime without disorder. The memory of an initial density wave pattern is preserved for long times.


title: Practical rare event sampling for extreme mesoscale weather

abstract: Extreme mesoscale weather, including tropical cyclones, squall lines, and floods, can be enormously damaging and yet challenging to simulate; hence, there is a pressing need for more efficient simulation strategies. Here we present a new rare event sampling algorithm called Quantile Diffusion Monte Carlo (Quantile DMC). Quantile DMC is a simple-to-use algorithm that can sample extreme tail behavior for a wide class of processes. We demonstrate the advantages of Quantile DMC compared to other sampling methods and discuss practical aspects of implementing Quantile DMC. To test the feasibility of Quantile DMC for extreme mesoscale weather, we sample extremely intense realizations of two historical tropical cyclones, 2010 Hurricane Earl and 2015 Hurricane Joaquin. Our results demonstrate Quantile DMC's potential to provide low-variance extreme weather statistics while highlighting the work that is necessary for Quantile DMC to attain greater efficiency in future applications.


title: R\'eduction stable en dimension sup\'erieure [d'apr\`es Koll\'ar, Hacon-Xu...]

abstract: The moduli space of stable curves of Deligne and Mumford is a compactification of the moduli space of smooth curves of genus >=2 that parametrizes certain nodal curves. It is a powerful tool for the study of algebraic curves. Higher-dimensional analogues were constructed by Koll\'ar, Shepherd-Barron and Alexeev in dimension 2, and by Viehweg in the case of smooth varieties. We will explain the recent ideas allowing for the construction of these moduli spaces in general, including the stable reduction theorem in higher dimension, which reflects their compactness. L'espace de modules des courbes stables de Deligne et Mumford est une compactification de l'espace de modules des courbes lisses de genre >=2, param\'etrant certaines courbes nodales. C'est un outil puissant pour l'\'etude des courbes alg\'ebriques. Des analogues en dimension sup\'erieure ont \'et\'e construits par Koll\'ar, Shepherd-Barron et Alexeev en dimension 2, et par Viehweg dans le cas des vari\'et\'es lisses. Nous expliquerons les id\'ees r\'ecentes ayant permis la construction de ces espaces de modules en g\'en\'eral, notamment le th\'eor\`eme de r\'eduction stable en dimension sup\'erieure, qui refl\`ete leur compacit\'e.


title: A p-adic analogue of Siegel's Theorem on sums of squares

abstract: Siegel proved that every totally positive element of a number field K is the sum of four squares, so in particular the Pythagoras number is uniformly bounded across number fields. The p-adic Kochen operator provides a p-adic analogue of squaring, and a certain localisation of the ring generated by this operator consists of precisely the totally p-integral elements of K. We use this to formulate and prove a p-adic analogue of Siegel's theorem, by introducing the p-Pythagoras number of a general field, and showing that this number is uniformly bounded across number fields. We also generally study fields with finite p-Pythagoras number and show that the growth of the p-Pythagoras number in finite extensions is bounded.


title: Density-friendly Graph Decomposition

abstract: Decomposing a graph into a hierarchical structure via $k$-core analysis is a standard operation in any modern graph-mining toolkit. $k$-core decomposition is a simple and efficient method that allows to analyze a graph beyond its mere degree distribution. More specifically, it is used to identify areas in the graph of increasing centrality and connectedness, and it allows to reveal the structural organization of the graph. Despite the fact that $k$-core analysis relies on vertex degrees, $k$-cores do not satisfy a certain, rather natural, density property. Simply put, the most central $k$-core is not necessarily the densest subgraph. This inconsistency between $k$-cores and graph density provides the basis of our study. We start by defining what it means for a subgraph to be locally-dense, and we show that our definition entails a nested chain decomposition of the graph, similar to the one given by $k$-cores, but in this case the components are arranged in order of increasing density. We show that such a locally-dense decomposition for a graph $G=(V,E)$ can be computed in polynomial time. The running time of the exact decomposition algorithm is $O(|V|^2|E|)$ but is significantly faster in practice. In addition, we develop a linear-time algorithm that provides a factor-2 approximation to the optimal locally-dense decomposition. Furthermore, we show that the $k$-core decomposition is also a factor-2 approximation, however, as demonstrated by our experimental evaluation, in practice $k$-cores have different structure than locally-dense subgraphs, and as predicted by the theory, $k$-cores are not always well-aligned with graph density.


title: Deep Stacked Hierarchical Multi-patch Network for Image Deblurring

abstract: Despite deep end-to-end learning methods have shown their superiority in removing non-uniform motion blur, there still exist major challenges with the current multi-scale and scale-recurrent models: 1) Deconvolution/upsampling operations in the coarse-to-fine scheme result in expensive runtime; 2) Simply increasing the model depth with finer-scale levels cannot improve the quality of deblurring. To tackle the above problems, we present a deep hierarchical multi-patch network inspired by Spatial Pyramid Matching to deal with blurry images via a fine-to-coarse hierarchical representation. To deal with the performance saturation w.r.t. depth, we propose a stacked version of our multi-patch model. Our proposed basic multi-patch model achieves the state-of-the-art performance on the GoPro dataset while enjoying a 40x faster runtime compared to current multi-scale methods. With 30ms to process an image at 1280x720 resolution, it is the first real-time deep motion deblurring model for 720p images at 30fps. For stacked networks, significant improvements (over 1.2dB) are achieved on the GoPro dataset by increasing the network depth. Moreover, by varying the depth of the stacked model, one can adapt the performance and runtime of the same network for different application scenarios.


title: TULIP: A Toolbox for Linear Discriminant Analysis with Penalties

abstract: Linear discriminant analysis (LDA) is a powerful tool in building classifiers with easy computation and interpretation. Recent advancements in science technology have led to the popularity of datasets with high dimensions, high orders and complicated structure. Such datasetes motivate the generalization of LDA in various research directions. The R package TULIP integrates several popular high-dimensional LDA-based methods and provides a comprehensive and user-friendly toolbox for linear, semi-parametric and tensor-variate classification. Functions are included for model fitting, cross validation and prediction. In addition, motivated by datasets with diverse sources of predictors, we further include functions for covariate adjustment. Our package is carefully tailored for low storage and high computation efficiency. Moreover, our package is the first R package for many of these methods, providing great convenience to researchers in this area.


title: Weighted-Sum Average Age of Information in Unilaterally Powered Two-Way Data Exchanging Systems

abstract: This paper considers a two-way data exchanging system with a constant powered access point and an energy-harvesting powered smart device. The access point simultaneously transmits information and energy to the smart device with fixed powers $\bar{\rho} P_\text{t}$ and $\rho P_\text{t}$, respectively. Upon collecting enough energy, the smart device performs one block of transmission immediately. We investigate the timeless of the two-way data exchange in terms of age of information (AoI). Specifically, we investigate the trade-off between downlink timeliness and uplink timeliness by optimizing the weighted-sum average AoI. Moreover, we provide a gradient based method to compute this ratio numerically. Our numerical results show that power-splitting based systems outperform time-splitting based systems in terms of timeliness in general.


title: Segment Routing: a Comprehensive Survey of Research Activities, Standardization Efforts and Implementation Results

abstract: Fixed and mobile telecom operators, enterprise network operators and cloud providers strive to face the challenging demands coming from the evolution of IP networks (e.g. huge bandwidth requirements, integration of billions of devices and millions of services in the cloud). Proposed in the early 2010s, Segment Routing (SR) architecture helps face these challenging demands, and it is currently being adopted and deployed. SR architecture is based on the concept of source routing and has interesting scalability properties, as it dramatically reduces the amount of state information to be configured in the core nodes to support complex services. SR architecture was first implemented with the MPLS dataplane and then, quite recently, with the IPv6 dataplane (SRv6). IPv6 SR architecture (SRv6) has been extended from the simple steering of packets across nodes to a general network programming approach, making it very suitable for use cases such as Service Function Chaining and Network Function Virtualization. In this paper we present a tutorial and a comprehensive survey on SR technology, analyzing standardization efforts, patents, research activities and implementation results. We start with an introduction on the motivations for Segment Routing and an overview of its evolution and standardization. Then, we provide a tutorial on Segment Routing technology, with a focus on the novel SRv6 solution. We discuss the standardization efforts and the patents providing details on the most important documents and mentioning other ongoing activities. We then thoroughly analyze research activities according to a taxonomy. We have identified 8 main categories during our analysis of the current state of play: Monitoring, Traffic Engineering, Failure Recovery, Centrally Controlled Architectures, Path Encoding, Network Programming, Performance Evaluation and Miscellaneous...


title: Few-Shot Learning via Saliency-guided Hallucination of Samples

abstract: Learning new concepts from a few of samples is a standard challenge in computer vision. The main directions to improve the learning ability of few-shot training models include (i) a robust similarity learning and (ii) generating or hallucinating additional data from the limited existing samples. In this paper, we follow the latter direction and present a novel data hallucination model. Currently, most datapoint generators contain a specialized network (i.e., GAN) tasked with hallucinating new datapoints, thus requiring large numbers of annotated data for their training in the first place. In this paper, we propose a novel less-costly hallucination method for few-shot learning which utilizes saliency maps. To this end, we employ a saliency network to obtain the foregrounds and backgrounds of available image samples and feed the resulting maps into a two-stream network to hallucinate datapoints directly in the feature space from viable foreground-background combinations. To the best of our knowledge, we are the first to leverage saliency maps for such a task and we demonstrate their usefulness in hallucinating additional datapoints for few-shot learning. Our proposed network achieves the state of the art on publicly available datasets.


title: Entropy non-conservation and boundary conditions for Hamiltonian dynamical systems

abstract: Applying the theory of self-adjoint extensions of Hermitian operators to Koopman von Neumann classical mechanics, the most general set of probability distributions is found for which entropy is conserved by Hamiltonian evolution. A new dynamical phase associated with such a construction is identified. By choosing distributions not belonging to this class, we produce explicit examples of both free particles and harmonic systems evolving in a bounded phase-space in such a way that entropy is nonconserved. While these nonconserving states are classically forbidden, they may be interpreted as states of a quantum system tunneling through a potential barrier boundary. In this case, the allowed boundary conditions are the only distinction between classical and quantum systems. We show that the boundary conditions for a tunneling quantum system become the criteria for entropy preservation in the classical limit. These findings highlight how boundary effects drastically change the nature of a system.

categories: cond-mat.stat-mech math-ph math.MP physics.class-ph quant-ph


title: A PDE model for bleb formation and interaction with linker proteins

abstract: The aim of this paper is to further develop mathematical models for bleb formation in cells, including cell-membrane interactions with linker proteins. This leads to nonlinear reaction-diffusion equations on a surface coupled to fluid dynamics in the bulk. We provide a detailed mathematical analysis and investigate some singular limits of the model, connecting it to previous literature. Moreover, we provide numerical simulations in different scenarios, confirming that the model can reproduce experimental results on bleb initation.


title: Utilizing Bluetooth Low Energy to recognize proximity, touch and humans

abstract: Interacting with humans is one of the main challenges for mobile robots in a human inhabited environment. To enable adaptive behavior, a robot needs to recognize touch gestures and/or the proximity to interacting individuals. Moreover, a robot interacting with two or more humans usually needs to distinguish between them. However, this remains both a configuration and cost intensive task. In this paper we utilize inexpensive Bluetooth Low Energy (BLE) devices and propose an easy and configurable technique to enhance the robot's capabilities to interact with surrounding people. In a noisy laboratory setting, a mobile spherical robot is utilized in three proof-of-concept experiments of the proposed system architecture. Firstly, we enhance the robot with proximity information about the individuals in the surrounding environment. Secondly, we exploit BLE to utilize it as a touch sensor. And lastly, we use BLE to distinguish between interacting individuals. Results show that observing the raw received signal strength (RSS) between BLE devices already enhances the robot's interaction capabilities and that the provided infrastructure can be facilitated to enable adaptive behavior in the future. We show one and the same sensor system can be used to detect different types of information relevant in human-robot interaction (HRI) experiments.


title: Cross-task learning for audio tagging, sound event detection and spatial localization: DCASE 2019 baseline systems

abstract: The Detection and Classification of Acoustic Scenes and Events (DCASE) 2019 challenge focuses on audio tagging, sound event detection and spatial localisation. DCASE 2019 consists of five tasks: 1) acoustic scene classification, 2) audio tagging with noisy labels and minimal supervision, 3) sound event localisation and detection, 4) sound event detection in domestic environments, and 5) urban sound tagging. In this paper, we propose generic cross-task baseline systems based on convolutional neural networks (CNNs). The motivation is to investigate the performance of a variety of models across several audio recognition tasks without exploiting the specific characteristics of the tasks. We looked at CNNs with 5, 9, and 13 layers, and found that the optimal architecture is task-dependent. For the systems we considered, we found that the 9-layer CNN with average pooling after convolutional layers is a good model for a majority of the DCASE 2019 tasks.


title: Broadcast Age of Information in CSMA/CA Based Wireless Networks

abstract: We consider a wireless sensor network in which all the nodes wish to spread their updates over the network using CSMA/CA protocol. We investigate the age of information of the spreading process from a transmitter perspective, which is referred to as the \textit{broadcast age of information (BAoI)}. To be specific, BAoI is the age of the latest update successfully broadcasted to the one-hop neighbors of a node, and thus is suitable to measure the rapidity of the update spreading process. We establish an equivalent transmission model of the network by deriving the transmission probability and the collision probability of nodes. With this equivalent model, we then present the average BAoI of the network explicitly. Our results present the scaling laws of average BAoI with respect to node density and frame length, and are further illustrated through numerical results. As is shown, the average BAoI is increasing with node density and is convex in frame length, i.e., would be large when frame length is very small or very large.


title: The Mathematics of Text Structure

abstract: In previous work we gave a mathematical foundation, referred to as DisCoCat, for how words interact in a sentence in order to produce the meaning of that sentence. To do so, we exploited the perfect structural match of grammar and categories of meaning spaces. Here, we give a mathematical foundation, referred to as DisCoCirc, for how sentences interact in texts in order to produce the meaning of that text. First we revisit DisCoCat. While in DisCoCat all meanings are fixed as states (i.e. have no input), in DisCoCirc word meanings correspond to a type, or system, and the states of this system can evolve. Sentences are gates within a circuit which update the variable meanings of those words. Like in DisCoCat, word meanings can live in a variety of spaces e.g. propositional, vectorial, or cognitive. The compositional structure are string diagrams representing information flows, and an entire text yields a single string diagram in which word meanings lift to the meaning of an entire text. While the developments in this paper are independent of a physical embodiment (cf. classical vs. quantum computing), both the compositional formalism and suggested meaning model are highly quantum-inspired, and implementation on a quantum computer would come with a range of benefits. We also praise Jim Lambek for his role in mathematical linguistics in general, and the development of the DisCo program more specifically.


title: Large Margin Softmax Loss for Speaker Verification

abstract: In neural network based speaker verification, speaker embedding is expected to be discriminative between speakers while the intra-speaker distance should remain small. A variety of loss functions have been proposed to achieve this goal. In this paper, we investigate the large margin softmax loss with different configurations in speaker verification. Ring loss and minimum hyperspherical energy criterion are introduced to further improve the performance. Results on VoxCeleb show that our best system outperforms the baseline approach by 15\% in EER, and by 13\%, 33\% in minDCF08 and minDCF10, respectively.


title: The Western Bulge of 162173 Ryugu Formed as a Result of a Rotationally Driven Deformation Process

abstract: 162173 Ryugu, the target of Hayabusa2, has a round shape with an equatorial ridge, which is known as a spinning top-shape. A strong centrifugal force is a likely contributor to Ryugu's top-shaped features. Observations by Optical Navigation Camera onboard Hayabusa2 show a unique longitudinal variation in geomorphology; the western side of this asteroid, later called the western bulge, has a smooth surface and a sharp equatorial ridge, compared to the other side. Here, we propose a structural deformation process that generated the western bulge. Applying the mission-derived shape model, we employ a finite element model technique to analyze the locations that experience structural failure within the present shape. Assuming that materials are uniformly distributed, our model shows the longitudinal variation in structurally failed regions when the spin period is shorter than ~3.75 h. Ryugu is structurally intact in the subsurface region of the western bulge while other regions are sensitive to structural failure. We infer that this variation is indicative of the deformation process that occurred in the past, and the western bulge is more relaxed structurally than the other region. Our analysis also shows that this deformation process might occur at a spin period between ~3.5 h and ~3.0 h, providing the cohesive strength ranging between ~4 Pa and ~10 Pa.


title: New developments of the methodology of the Modified method of simplest equation with application

abstract: We discuss an extension of the modified method of simplest equation for obtaining exact analytical solutions of nonlinear partial differential equations. The extension includes the possibility for use of: (i) more than one simplest equation; (ii) relationship that contains as particular cases the relationship used by Hirota \cite{hirota} and the relationship used in the previous version of the methodology; (iii) transformation of the solution that contains as particular case the possibility of use of the Painleve expansion; (iv) more than one balance equation. The discussed version of the methodology allows: obtaining multi-soliton solutions of nonlinear partial differential equations if such solutions do exist and obtaining particular solutions of nonintegrable nonlinear partial differential equations. Examples for the application of the methodology are discussed.


title: System FR as Foundations for Stainless

abstract: We present the design, implementation, and foundation of a verifier for higher-order functional programs with generics and recursive data types. Our system supports proving safety and termination using preconditions, postconditions and assertions. It supports writing proof hints using assertions and recursive calls. To formalize the soundness of the system we introduce System FR, a calculus supporting System F polymorphism, dependent refinement types, and recursive types (including recursion through contravariant positions of function types). Through the use of sized types, System FR supports reasoning about termination of lazy data structures such as streams. We formalize a reducibility argument using the Coq proof assistant and prove the soundness of a type-checker with respect to call-by-value semantics, ensuring type safety and normalization for typeable programs. Our program verifier is implemented as an alternative verification-condition generator for the Stainless tool, which relies on existing SMT-based solver backend for automation. We demonstrate the efficiency of our approach by verifying a collection of higher-order functional programs comprising around 14000 lines of polymorphic higher-order Scala code, including graph search algorithms, basic number theory, monad laws, functional data structures, and assignments from popular Functional Programming MOOCs.


title: SDRSAC: Semidefinite-Based Randomized Approach for Robust Point Cloud Registration without Correspondences

abstract: This paper presents a novel randomized algorithm for robust point cloud registration without correspondences. Most existing registration approaches require a set of putative correspondences obtained by extracting invariant descriptors. However, such descriptors could become unreliable in noisy and contaminated settings. In these settings, methods that directly handle input point sets are preferable. Without correspondences, however, conventional randomized techniques require a very large number of samples in order to reach satisfactory solutions. In this paper, we propose a novel approach to address this problem. In particular, our work enables the use of randomized methods for point cloud registration without the need of putative correspondences. By considering point cloud alignment as a special instance of graph matching and employing an efficient semi-definite relaxation, we propose a novel sampling mechanism, in which the size of the sampled subsets can be larger-than-minimal. Our tight relaxation scheme enables fast rejection of the outliers in the sampled sets, resulting in high-quality hypotheses. We conduct extensive experiments to demonstrate that our approach outperforms other state-of-the-art methods. Importantly, our proposed method serves as a generic framework which can be extended to problems with known correspondences.


title: Fingerprints of slingshot non-sequential double ionization on two-electron probability distributions

abstract: We study double ionization of He driven by a near-single-cycle laser pulse at low intensities at 400 nm. Using a three-dimensional semiclassical model, we identify the pathways that prevail non-sequential double ionization (NSDI). We focus mostly on the delayed pathway, where one electron ionizes with a time-delay after recollision. We have recently shown that the mechanism that prevails the delayed pathway depends on intensity. For low intensities slingshot-NSDI is the mechanism that prevails. Here, we identify the differences in two-electron probability distributions of the prevailing NSDI pathways. This allows us to identify properties of the two-electron escape and thus gain significant insight into slingshot-NSDI. Interestingly, we find that an observable fingerprint of slingshot-NSDI is the two electrons escaping with large and roughly equal energies.


title: When AWGN-based Denoiser Meets Real Noises

abstract: Discriminative learning-based image denoisers have achieved promising performance on synthetic noises such as Additive White Gaussian Noise (AWGN). The synthetic noises adopted in most previous work are pixel-independent, but real noises are mostly spatially/channel-correlated and spatially/channel-variant. This domain gap yields unsatisfied performance on images with real noises if the model is only trained with AWGN. In this paper, we propose a novel approach to boost the performance of a real image denoiser which is trained only with synthetic pixel-independent noise data dominated by AWGN. First, we train a deep model that consists of a noise estimator and a denoiser with mixed AWGN and Random Value Impulse Noise (RVIN). We then investigate Pixel-shuffle Down-sampling (PD) strategy to adapt the trained model to real noises. Extensive experiments demonstrate the effectiveness and generalization of the proposed approach. Notably, our method achieves state-of-the-art performance on real sRGB images in the DND benchmark among models trained with synthetic noises. Codes are available at https://github.com/yzhouas/PD-Denoising-pytorch.


title: Self-supervised speaker embeddings

abstract: Contrary to i-vectors, speaker embeddings such as x-vectors are incapable of leveraging unlabelled utterances, due to the classification loss over training speakers. In this paper, we explore an alternative training strategy to enable the use of unlabelled utterances in training. We propose to train speaker embedding extractors via reconstructing the frames of a target speech segment, given the inferred embedding of another speech segment of the same utterance. We do this by attaching to the standard speaker embedding extractor a decoder network, which we feed not merely with the speaker embedding, but also with the estimated phone sequence of the target frame sequence. The reconstruction loss can be used either as a single objective, or be combined with the standard speaker classification loss. In the latter case, it acts as a regularizer, encouraging generalizability to speakers unseen during training. In all cases, the proposed architectures are trained from scratch and in an end-to-end fashion. We demonstrate the benefits from the proposed approach on VoxCeleb and Speakers in the wild, and we report notable improvements over the baseline.


title: Exploring the Attack Surface of Blockchain: A Systematic Overview

abstract: In this paper, we systematically explore the attack surface of the Blockchain technology, with an emphasis on public Blockchains. Towards this goal, we attribute attack viability in the attack surface to 1) the Blockchain cryptographic constructs, 2) the distributed architecture of the systems using Blockchain, and 3) the Blockchain application context. To each of those contributing factors, we outline several attacks, including selfish mining, the 51% attack, Domain Name System (DNS) attacks, distributed denial-of-service (DDoS) attacks, consensus delay (due to selfish behavior or distributed denial-of-service attacks), Blockchain forks, orphaned and stale blocks, block ingestion, wallet thefts, smart contract attacks, and privacy attacks. We also explore the causal relationships between these attacks to demonstrate how various attack vectors are connected to one another. A secondary contribution of this work is outlining effective defense measures taken by the Blockchain technology or proposed by researchers to mitigate the effects of these attacks and patch associated vulnerabilities


title: Blindfolded monkeys or financial analysts: who is worth your money? New evidence on informational inefficiencies in the U.S. stock market

abstract: The efficient market hypothesis has been considered one of the most controversial arguments in finance, with the academia divided between who claims the impossibility of beating the market and who believes that it is possible to gain over the average profits. If the hypothesis holds, it means, as suggested by Burton Malkiel, that a blindfolded monkey selecting stocks by throwing darts at a newspaper's financial pages could perform as well as a financial analyst, or even better. In this paper we use a novel approach, based on confidence intervals for proportions, to assess the degree of inefficiency in the S&P 500 Index components concluding that several stocks are inefficient: we estimated the proportion of inefficient stocks in the index to be between 12.13% and 27.87%. This supports other studies proving that a financial analyst, probably, is a better investor than a blindfolded monkey.


title: Drinfeld discriminant function and Fourier expansion of harmonic cochains

abstract: Let $F_\infty=\mathbb{F}_q(\!(1/T)\!)$ be the completion of $\mathbb{F}_q(T)$ at $1/T$. We develop a theory of Fourier expansions for harmonic cochains on the edges of the Bruhat-Tits building of $\mathrm{PGL}_r(F_\infty)$, $r\geq 2$, generalizing an earlier construction of Gekeler for $r=2$. We then apply this theory to study modular units on the Drinfeld symmetric space $\Omega^r$ over $F_\infty$, and the cuspidal divisor groups of Satake compactifications of certain Drinfeld modular varieties. In particular, we obtain a higher dimensional analogue of a result of Ogg for classical modular curves $X_0(p)$ of prime level.


title: Spectroscopic confirmation of the binary nature of the hybrid pulsator KIC 5709664 found with the frequency modulation method

abstract: We started a program to search for companions around hybrid $\delta$ Sct/$\gamma$ Dor stars with the frequency modulation method using Kepler data. Our best candidate was KIC 5709664, where we could identify Fourier peaks with sidelobes, suggesting binary orbital motion. We determined the orbital parameters with the phase modulation method and took spectroscopic measurements to confirm unambiguously the binary nature with radial velocities. The spectra show that the object is a double-lined spectroscopic binary, and we determined the orbital solutions from the radial velocity curve fit. The parameters from the phase modulation method and the radial velocity fits are in good agreement. We combined a radial velocity and phase modulation approach to determine the orbital parameters as accurately as possible. We determined that the pulsator is a hybrid $\delta$ Sct/$\gamma$ Dor star in an eccentric binary system with an orbital period of ~95 d and an eccentricity of 0.55. The measured mass ratio is 0.67. We analysed the pulsation content and extracted 38 frequencies with amplitudes greater than 20 $\mu$mag. At low frequencies, we found broad power excesses which are likely attributed to spots on the rotating surface of the lower-mass component. We inferred rotation periods of 0.56 and 2.53 d for the primary and secondary, respectively.


title: A Compendium on Network and Host based Intrusion Detection Systems

abstract: The techniques of deep learning have become the state of the art methodology for executing complicated tasks from various domains of computer vision, natural language processing, and several other areas. Due to its rapid development and promising benchmarks in those fields, researchers started experimenting with this technique to perform in the area of, especially in intrusion detection related tasks. Deep learning is a subset and a natural extension of classical Machine learning and an evolved model of neural networks. This paper contemplates and discusses all the methodologies related to the leading edge Deep learning and Neural network models purposing to the arena of Intrusion Detection Systems.


title: On the controllability and Stabilization of the Benjamin Equation

abstract: The aim of this paper is to study the controllability and stabilization for the Benjamin equation on a periodic domain $\mathbb{T}$. We show that the Benjamin equation is globally exactly controllable and globally exponentially stabilizable in $H_{p}^{s}(\mathbb{T}),$ with $s\geq 0.$ First we prove propagation of compactness, propagation of regularity of solution in Bourgain's spaces and unique continuation property, and use them to obtain the global exponential stabilizability corresponding to a natural feedback law. Combining the global exponential stability and the local controllability result we prove the global controllability as well. Also, we prove that the closed-loop system with a different feedback control law is locally exponentially stable with an arbitrary decay rate. Finally, a time-varying feedback law is designed to guarantee a global exponential stability with an arbitrary decay rate. The results obtained here extend the ones we proved for the linearized Benjamin equation in \cite{Vielma and Panthee}.


title: VATEX: A Large-Scale, High-Quality Multilingual Dataset for Video-and-Language Research

abstract: We present a new large-scale multilingual video description dataset, VATEX, which contains over 41,250 videos and 825,000 captions in both English and Chinese. Among the captions, there are over 206,000 English-Chinese parallel translation pairs. Compared to the widely-used MSR-VTT dataset, VATEX is multilingual, larger, linguistically complex, and more diverse in terms of both video and natural language descriptions. We also introduce two tasks for video-and-language research based on VATEX: (1) Multilingual Video Captioning, aimed at describing a video in various languages with a compact unified captioning model, and (2) Video-guided Machine Translation, to translate a source language description into the target language using the video information as additional spatiotemporal context. Extensive experiments on the VATEX dataset show that, first, the unified multilingual model can not only produce both English and Chinese descriptions for a video more efficiently, but also offer improved performance over the monolingual models. Furthermore, we demonstrate that the spatiotemporal video context can be effectively utilized to align source and target languages and thus assist machine translation. In the end, we discuss the potentials of using VATEX for other video-and-language research.


title: Transverse Force Tomography

abstract: While twist-2 GPDs allow for a determination of the distribution of partons on the transverse plane, twist-3 GPDs contain quark-gluon correlations that provide information about the average transverse color Lorentz force acting on quarks. We demonstrate how twist-3 GPDs can be used to provide transverse position information about that force.


title: Usability in the Larger Reality: A Contrarian Argument for the Importance of Social and Political Considerations

abstract: Usability engineering is situated in a much larger social and institutional context than is usually acknowledged by usability professionals in the way that they define their field. The definitions and processes used in the improvement of user interfaces are subordinate to interests that often have narrow goals, having adverse effects on user awareness and autonomy that have further adverse effects on society as a whole. These effects are brought about by the way that knowledge about systems is limited by the design of the interface that limits the user to tasks and goals defined by organizations, often commercial ones. It is the point at which the structures of the user interface are defined by usability professionals that sources of the limitation of knowledge can be identified. These sources are defined by their reliance on a construction of the user's wants and needs that cyclically reinforce, through the actual use of the interface, the user's own construction of her wants and needs. To alleviate this, it is necessary to come up with new processes of user interface design that do not make assumptions about the user that tend to subordinate the user, and it is also necessary to reconstruct the user as a participant in the interface. NOTE: This article was written in 2003 as a final project for a Master's course in human-computer interaction at the University of Ottawa. The author attempted to publish it at the time, but did not really understand the process. The ideas stand up fairly well, however, and he would like to contribute it as a comment on the current state of affairs. It is only lightly edited for format.


title: A simplified characteristic functions of quantum heat

abstract: This paper presents a simplified structure of the characteristic function of the distribution of energy changes in a bosonic environment interacting linearly with a quantum system. This characteristic function of quantum heat can be expressed using the same functionals (Feynman-Vernon action) as for the quantum state, with only the cross-terms in the double path integral shifted in time.


title: Domains with a continuous exhaustion in weakly complete surfaces

abstract: In previous works, G. Tomassini and the authors studied and classified complex surfaces admitting a real-analytic pluri-subharmonic exhaustion function; let $X$ be such a surface and $D\subseteq X$ a domain admitting a \emph{continuous} plurisubharmonic exhaustion function: what can be said about the geometry of $D$? If the exhaustion of $D$ is assumed to be smooth, the second author already answered this question; however, the continuous case is more difficult and requires different methods. In the present paper, we address such question by studying the local maximum sets contained in $D$ and their interplay with the complex geometric structure of $X$; we conclude that, if $D$ is not a modification of a Stein space, then it shares the same geometric features of $X$.


title: LP-3DCNN: Unveiling Local Phase in 3D Convolutional Neural Networks

abstract: Traditional 3D Convolutional Neural Networks (CNNs) are computationally expensive, memory intensive, prone to overfit, and most importantly, there is a need to improve their feature learning capabilities. To address these issues, we propose Rectified Local Phase Volume (ReLPV) block, an efficient alternative to the standard 3D convolutional layer. The ReLPV block extracts the phase in a 3D local neighborhood (e.g., 3x3x3) of each position of the input map to obtain the feature maps. The phase is extracted by computing 3D Short Term Fourier Transform (STFT) at multiple fixed low frequency points in the 3D local neighborhood of each position. These feature maps at different frequency points are then linearly combined after passing them through an activation function. The ReLPV block provides significant parameter savings of at least, 3^3 to 13^3 times compared to the standard 3D convolutional layer with the filter sizes 3x3x3 to 13x13x13, respectively. We show that the feature learning capabilities of the ReLPV block are significantly better than the standard 3D convolutional layer. Furthermore, it produces consistently better results across different 3D data representations. We achieve state-of-the-art accuracy on the volumetric ModelNet10 and ModelNet40 datasets while utilizing only 11% parameters of the current state-of-the-art. We also improve the state-of-the-art on the UCF-101 split-1 action recognition dataset by 5.68% (when trained from scratch) while using only 15% of the parameters of the state-of-the-art. The project webpage is available at https://sites.google.com/view/lp-3dcnn/home.


title: Entropy production in systems with unidirectional transitions

abstract: The entropy production is one of the most essential features for systems operating out of equilibrium. The formulation for discrete-state systems goes back to the celebrated Schnakenberg's work and hitherto can be carried out when for each transition between two states also the reverse one is allowed. Nevertheless, several physical systems may exhibit a mixture of both unidirectional and bidirectional transitions, and how to properly define the entropy production in this case is still an open question. Here, we present a solution to such a challenging problem. The average entropy production can be consistently defined, employing a mapping that preserves the average fluxes, and its physical interpretation is provided. We describe a class of stochastic systems composed of unidirectional links forming cycles and detailed-balanced bidirectional links, showing that they behave in a pseudo-deterministic fashion. This approach is applied to a system with time-dependent stochastic resetting. Our framework is consistent with thermodynamics and leads to some intriguing observations on the relation between the arrow of time and the average entropy production for resetting events.


title: $X$-Ramanujan Graphs

abstract: Let $X$ be an infinite graph of bounded degree; e.g., the Cayley graph of a free product of finite groups. If $G$ is a finite graph covered by $X$, it is said to be $X$-Ramanujan if its second-largest eigenvalue $\lambda_2(G)$ is at most the spectral radius $\rho(X)$ of $X$, and more generally $k$-quasi-$X$-Ramanujan if $\lambda_k(G)$ is at most $\rho(X)$. In case $X$ is the infinite $\Delta$-regular tree, this reduces to the well known notion of a finite $\Delta$-regular graph being Ramanujan. Inspired by the Interlacing Polynomials method of Marcus, Spielman, and Srivastava, we show the existence of infinitely many $k$-quasi-$X$-Ramanujan graphs for a variety of infinite $X$. In particular, $X$ need not be a tree; our analysis is applicable whenever $X$ is what we call an additive product graph. This additive product is a new construction of an infinite graph $\mathsf{AddProd}(A_1, \dots, A_c)$ from finite 'atom' graphs $A_1, \dots, A_c$ over a common vertex set. It generalizes the notion of the free product graph $A_1 * \cdots * A_c$ when the atoms $A_j$ are vertex-transitive, and it generalizes the notion of the universal covering tree when the atoms $A_j$ are single-edge graphs. Key to our analysis is a new graph polynomial $\alpha(A_1, \dots, A_c;x)$ that we call the additive characteristic polynomial. It generalizes the well known matching polynomial $\mu(G;x)$ in case the atoms $A_j$ are the single edges of $G$, and it generalizes the $r$-characteristic polynomial introduced in [Ravichandran'16, Leake-Ravichandran'18]. We show that $\alpha(A_1, \dots, A_c;x)$ is real-rooted, and all of its roots have magnitude at most $\rho(\mathsf{AddProd}(A_1, \dots, A_c))$. This last fact is proven by generalizing Godsil's notion of treelike walks on a graph $G$ to a notion of freelike walks on a collection of atoms $A_1, \dots, A_c$.


title: DeepSEED: 3D Squeeze-and-Excitation Encoder-Decoder Convolutional Neural Networks for Pulmonary Nodule Detection

abstract: Pulmonary nodule detection plays an important role in lung cancer screening with low-dose computed tomography (CT) scans. It remains challenging to build nodule detection deep learning models with good generalization performance due to unbalanced positive and negative samples. In order to overcome this problem and further improve state-of-the-art nodule detection methods, we develop a novel deep 3D convolutional neural network with an Encoder-Decoder structure in conjunction with a region proposal network. Particularly, we utilize a dynamically scaled cross entropy loss to reduce the false positive rate and combat the sample imbalance problem associated with nodule detection. We adopt the squeeze-and-excitation structure to learn effective image features and utilize inter-dependency information of different feature maps. We have validated our method based on publicly available CT scans with manually labelled ground-truth obtained from LIDC/IDRI dataset and its subset LUNA16 with thinner slices. Ablation studies and experimental results have demonstrated that our method could outperform state-of-the-art nodule detection methods by a large margin.


title: Primordial Black Hole Remnants as Dark Energy and an Instability of De Sitter Space towards Power-Law Accelerating Expansion

abstract: Starting from a discussion of the black hole information loss paradox, we argue that Primordial Black Hole Remnants (PBHRs) of Planck mass, should they exist, are a plausible candidate for dark energy. We call this proposal the PBHR model. We also find an instability of de Sitter space towards a space with power-law accelerating expansion, the time dependence of the cosmological constant and the resulting form of the metric, and propose that this is the dominant instability of de Sitter space. We conjecture that a similar instability does not afflict a space sourced by PBHRs. We find that the PBHR model satisfies the upper limits on $\beta$, the fraction of the Universe's mass in PBHs at their formation time, for a fair range of initial PBH masses. We derive information on the present day gravitational wave background due to the PBHs in our scenario.


title: Integral points on Hilbert moduli schemes

abstract: We use the method of Faltings (Arakelov, Par\v{s}in, Szpiro) in order to explicitly study integral points on a class of varieties over $\mathbb Z$ called Hilbert moduli schemes. For instance, integral models of Hilbert modular varieties are classical examples of Hilbert moduli schemes. Our main result gives explicit upper bounds for the height and the number of integral points on Hilbert moduli schemes.


title: Roe bimodules as morphisms of discrete metric spaces

abstract: For two discrete metric spaces, $X$ and $Y$ we consider metrics on $X\sqcup Y$ compatible with the metrics on $X$ and $Y$. As morphisms from $X$ to $Y$ we consider the Roe bimodules, i.e. the norm closures of bounded finite propagation operators from $l^2(X)$ to $l^2(Y)$. We study the corresponding category $\mathcal M$, which is also a 2-category. We show that almost isometries determine morphisms in $\mathcal M$. We also consider the case $Y=X$, when there is a richer algebraic structure on the set of morphisms of $\mathcal M$: it is a partially ordered semigroup with the neutral element, with involution, and with a lot of idempotents. We also give a condition when a morphism is a $C^*$-algebra.


title: Chance-Constrained Ancillary Service Specification for Heterogeneous Storage Devices

abstract: We present a method to find the maximum magnitude of any supply-shortfall service that an aggregator of energy storage devices is able to sell to a grid operator. This is first demonstrated in deterministic settings, then applied to scenarios in which device availabilities are stochastic. In this case we implement chance constraints on the inability to deliver as promised. We show a significant computational improvement in using our method in place of straightforward scenario simulation. As an extension, we present an approximation to this method which allows the determined fleet capability to be applied to any chosen service, rather than having to re-solve the chance-constrained optimisation each time.


title: Fabrication of Superconducting YBa2Cu4O8 Film via Coprecipitation

abstract: We have successfully synthesized the c-axis oriented YBa2Cu4O8 (Y-124) film on a SrTiO3 (1 0 0) substrate via a coprecipitation and a dip-coating method. The precipitations including Y, Ba and Cu ions were obtained using their metal nitrates solution and the aqueous solution of sodium hydroxide and oxalic acid. Superconducting transition of the synthesized film was observed at 64-70 K corresponding to bulk Y-124 in the magnetization and resistance measurement. The developed method is suitable to synthesize superconducting Y-124 films for technological applications.