title: Bayesian Constraint Relaxation

abstract: Prior information often takes the form of parameter constraints. Bayesian methods include such information through prior distributions having constrained support. By using posterior sampling algorithms, one can quantify uncertainty without relying on asymptotic approximations. However, sharply constrained priors are (a) not necessary in some settings; and (b) tend to limit modeling scope to a narrow set of distributions that are tractable computationally. Inspired by the vast literature that replaces the slab-and-spike prior with a continuous approximation, we propose to replace the sharp indicator function of the constraint with an exponential kernel, thereby creating a close-to-constrained neighborhood within the Euclidean space in which the constrained subspace is embedded. This kernel decays with distance from the constrained space at a rate depending on a relaxation hyperparameter. By avoiding the sharp constraint, we enable use of off-the-shelf posterior sampling algorithms, such as Hamiltonian Monte Carlo, facilitating automatic computation in broad models. We study the constrained and relaxed distributions under multiple settings, and theoretically quantify their differences. We illustrate the method through multiple novel modeling examples.


title: An algebraic perspective on integer sparse recovery

abstract: Compressed sensing is a relatively new mathematical paradigm that shows a small number of linear measurements are enough to efficiently reconstruct a large dimensional signal under the assumption the signal is sparse. Applications for this technology are ubiquitous, ranging from wireless communications to medical imaging, and there is now a solid foundation of mathematical theory and algorithms to robustly and efficiently reconstruct such signals. However, in many of these applications, the signals of interest do not only have a sparse representation, but have other structure such as lattice-valued coefficients. While there has been a small amount of work in this setting, it is still not very well understood how such extra information can be utilized during sampling and reconstruction. Here, we explore the problem of integer sparse reconstruction, lending insight into when this knowledge can be useful, and what types of sampling designs lead to robust reconstruction guarantees. We use a combination of combinatorial, probabilistic and number-theoretic methods to discuss existence and some constructions of such sensing matrices with concrete examples. We also prove sparse versions of Minkowski's Convex Body and Linear Forms theorems that exhibit some limitations of this framework.


title: Utilitarian Welfare and Representation Guarantees of Approval-Based Multiwinner Rules

abstract: To choose a suitable multiwinner voting rule is a hard and ambiguous task. Depending on the context, it varies widely what constitutes the choice of an ``optimal'' subset of alternatives. In this paper, we provide a quantitative analysis of multiwinner voting rules using methods from the theory of approximation algorithms---we estimate how well multiwinner rules approximate two extreme objectives: a representation criterion defined via the Approval Chamberlin--Courant rule and a utilitarian criterion defined via Multiwinner Approval Voting. With both theoretical and experimental methods, we classify multiwinner rules in terms of their quantitative alignment with these two opposing objectives. Our results provide fundamental information about the nature of multiwinner rules and, in particular, about the necessary tradeoffs when choosing such a rule.


title: A deep learning approach for detecting traffic accidents from social media data

abstract: This paper employs deep learning in detecting the traffic accident from social media data. First, we thoroughly investigate the 1-year over 3 million tweet contents in two metropolitan areas: Northern Virginia and New York City. Our results show that paired tokens can capture the association rules inherent in the accident-related tweets and further increase the accuracy of the traffic accident detection. Second, two deep learning methods: Deep Belief Network (DBN) and Long Short-Term Memory (LSTM) are investigated and implemented on the extracted token. Results show that DBN can obtain an overall accuracy of 85% with about 44 individual token features and 17 paired token features. The classification results from DBN outperform those of Support Vector Machines (SVMs) and supervised Latent Dirichlet allocation (sLDA). Finally, to validate this study, we compare the accident-related tweets with both the traffic accident log on freeways and traffic data on local roads from 15,000 loop detectors. It is found that nearly 66% of the accident-related tweets can be located by the accident log and more than 80% of them can be tied to nearby abnormal traffic data. Several important issues of using Twitter to detect traffic accidents have been brought up by the comparison including the location and time bias, as well as the characteristics of influential users and hashtags.


title: A novel calibration framework for survival analysis when a binary covariate is measured at sparse time points

abstract: The goals in clinical and cohort studies often include evaluation of the association of a time-dependent binary treatment or exposure with a survival outcome. Recently, several impactful studies targeted the association between aspirin-taking and survival following colorectal cancer diagnosis. Due to surgery, aspirin-taking value is zero at baseline and may change its value to one at some time point. Estimating this association is complicated by having only intermittent measurements on aspirin-taking. Naive, commonly-used, methods can lead to substantial bias. We present a class of calibration models for the distribution of the time of status change of the binary covariate. Estimates obtained from these models are then incorporated into the proportional hazard partial likelihood in a natural way. We develop nonparametric, semiparametric and parametric calibration models, and derive asymptotic theory for the methods that we implement in the aspirin and colorectal cancer study. Our methodology allows to include additional baseline variables in the calibration models for the status change time of the binary covariate. We further develop a risk-set calibration approach that is more useful in settings in which the association between the binary covariate and survival is strong.


title: The Mutating Contact Process: Model Introduction and Qualitative Analysis of Phase Transitions in its Survival

abstract: We introduce and study the mutating contact process, a variant of the multitype contact process, where one type mutates at a constant rate to the other type. We prove that on $\mathbb{Z}$ a single mutant cannot survive while on $\mathbb{T}_{d}$ there are distinct weak survival and extinction of a single mutant phases, yet the limiting distribution concentrates on configurations with no mutants of the first type for any values of the parameters.


title: Slugbot: An Application of a Novel and Scalable Open Domain Socialbot Framework

abstract: In this paper we introduce a novel, open domain socialbot for the Amazon Alexa Prize competition, aimed at carrying on friendly conversations with users on a variety of topics. We present our modular system, highlighting our different data sources and how we use the human mind as a model for data management. Additionally we build and employ natural language understanding and information retrieval tools and APIs to expand our knowledge bases. We describe our semistructured, scalable framework for crafting topic-specific dialogue flows, and give details on our dialogue management schemes and scoring mechanisms. Finally we briefly evaluate the performance of our system and observe the challenges that an open domain socialbot faces.


title: SN2013fs and SN2013fr: Exploring the circumstellar-material diversity in Type II supernovae

abstract: We present photometry and spectroscopy of SN2013fs and SN2013fr in the first 100 days post-explosion. Both objects showed transient, relatively narrow H$\alpha$ emission lines characteristic of SNeIIn, but later resembled normal SNeII-P or SNeII-L, indicative of fleeting interaction with circumstellar material (CSM). SN2013fs was discovered within 8hr of explosion. Its light curve exhibits a plateau, with spectra revealing strong CSM interaction at early times. It is a less luminous version of the transitional SNIIn PTF11iqb, further demonstrating a continuum of CSM interaction intensity between SNeII-P and IIn. It requires dense CSM within 6.5$\times$10$^{14}$~cm of the progenitor, from a phase of advanced pre-SN mass loss shortly before explosion. Spectropolarimetry of SN2013fs shows little continuum polarization, but noticeable line polarization during the plateau phase. SN2013fr morphed from a SNIIn at early times to a SNII-L. After the first epoch its narrow lines probably arose from host-galaxy emission, but the bright, narrow H$\alpha$ emission at early times may be intrinsic. As for SN2013fs, this would point to a short-lived phase of strong CSM interaction if proven to be intrinsic, suggesting a continuum between SNeIIn and II-L. It is a low-velocity SNII-L, like SN2009kr but more luminous. SN2013fr also developed an IR excess at later times, due to warm CSM dust that require a more sustained phase of strong pre-SN mass loss.


title: Computational Analysis for the Rational Design of Anti-Amyloid Beta (ABeta) Antibodies

abstract: Alzheimer's Disease (AD) is a neurodegenerative disorder that lacks effective treatment options. Anti-amyloid beta (ABeta) antibodies are the leading drug candidates to treat AD, but the results of clinical trials have been disappointing. Introducing rational mutations into anti-ABeta antibodies to increase their effectiveness is a way forward, but the path to take is unclear. In this study, we demonstrate the use of computational fragment-based docking and MMPBSA binding free energy calculations in the analysis of anti-ABeta antibodies for rational drug design efforts. Our fragment-based docking method successfully predicted the emergence of the common EFRH epitope, MD simulations coupled with MMPBSA binding free energy calculations were used to analyze scenarios described in prior studies, and we introduced rational mutations into PFA1 to improve its calculated binding affinity towards the pE3-ABeta3-8 form of ABeta. Two out of four proposed mutations stabilized binding. Our study demonstrates that a computational approach may lead to an improved drug candidate for AD in the future.


title: Do we need to modify Maxwell's equations?

abstract: Maxwell's equations are modified to incorporate a scalar field to account for the London's superconductivity. Assuming the electromagnetic field is described by the Klein-Gordon equation, London's equations of superconductivity are then derived, which are invariant under a new set of transformations. The invariance of the modified Maxwell's equations under these transformations requires the electromagnetic field and the scalar field to be scale-invariant. Relying on these transformations, a quantized Josephson-like current is derived. This current gives rise to a residual magnetic field. The spatial and temporal variations of the scalar field are linked to the electric polarization such that the polarization vector is curl-less.


title: Improvement to the Prediction of Fuel Cost Distributions Using ARIMA Model

abstract: Availability of a validated, realistic fuel cost model is a prerequisite to the development and validation of new optimization methods and control tools. This paper uses an autoregressive integrated moving average (ARIMA) model with historical fuel cost data in development of a three-step-ahead fuel cost distribution prediction. First, the data features of Form EIA-923 are explored and the natural gas fuel costs of Texas generating facilities are used to develop and validate the forecasting algorithm for the Texas example. Furthermore, the spot price associated with the natural gas hub in Texas is utilized to enhance the fuel cost prediction. The forecasted data is fit to a normal distribution and the Kullback-Leibler divergence is employed to evaluate the difference between the real fuel cost distributions and the estimated distributions. The comparative evaluation suggests the proposed forecasting algorithm is effective in general and is worth pursuing further.


title: Separated Kaon Electroproduction Cross Section and the Kaon Form Factor from 6 GeV JLab Data

abstract: The $^{1}H$($e,e^\prime K^+$)$\Lambda$ reaction was studied as a function of the Mandelstam variable $-t$ using data from the E01-004 (FPI-2) and E93-018 experiments that were carried out in Hall C at the 6 GeV Jefferson Lab. The cross section was fully separated into longitudinal and transverse components, and two interference terms at four-momentum transfers $Q^2$ of 1.00, 1.36 and 2.07 GeV$^2$. The kaon form factor was extracted from the longitudinal cross section using the Regge model by Vanderhaeghen, Guidal, and Laget. The results establish the method, previously used successfully for pion analyses, for extracting the kaon form factor. Data from 12 GeV Jefferson Lab experiments are expected to have sufficient precision to distinguish between theoretical predictions, for example recent perturbative QCD calculations with modern parton distribution amplitudes. The leading-twist behavior for light mesons is predicted to set in for values of $Q^2$ between 5-10 GeV$^2$, which makes data in the few GeV regime particularly interesting. The $Q^2$ dependence at fixed $x$ and $-t$ of the longitudinal cross section we extracted seems consistent with the QCD factorization prediction within the experimental uncertainty.


title: Tauberian class estimates for vector-valued distributions

abstract: We study Tauberian properties of regularizing transforms of vector-valued tempered distributions, that is, transforms of the form $M^{\mathbf{f}}_{\varphi}(x,y)=(\mathbf{f}\ast\varphi_{y})(x)$, where the kernel $\varphi$ is a test function and $\varphi_{y}(\cdot)=y^{-n}\varphi(\cdot/y)$. We investigate conditions which ensure that a distribution that a priori takes values in locally convex space actually takes values in a narrower Banach space. Our goal is to characterize spaces of Banach space valued tempered distributions in terms of so-called class estimates for the transform $M^{\mathbf{f}}_{\varphi}(x,y)$. Our results generalize and improve earlier Tauberian theorems of Drozhzhinov and Zav'yalov [Sb. Math. 194 (2003), 1599-1646]. Special attention is paid to find the optimal class of kernels $\varphi$ for which these Tauberian results hold.


title: Understanding Hormonal Crosstalk in Arabidopsis Root Development via Emulation and History Matching

abstract: A major challenge in plant developmental biology is to understand how plant growth is coordinated by interacting hormones and genes. To meet this challenge, it is important to not only use experimental data, but also formulate a mathematical model. For the mathematical model to best describe the true biological system, it is necessary to understand the parameter space of the model, along with the links between the model, the parameter space and experimental observations. We develop sequential history matching methodology, using Bayesian emulation, to gain substantial insight into biological model parameter spaces. This is achieved by finding sets of acceptable parameters in accordance with successive sets of physical observations. These methods are then applied to a complex hormonal crosstalk model for Arabidopsis root growth. In this application, we demonstrate how an initial set of 22 observed trends reduce the volume of the set of acceptable inputs to a proportion of 6.1 x 10^(-7) of the original space. Additional sets of biologically relevant experimental data, each of size 5, reduce the size of this space by a further three and two orders of magnitude respectively. Hence, we provide insight into the constraints placed upon the model structure by, and the biological consequences of, measuring subsets of observations.


title: DeepIso: A Deep Learning Model for Peptide Feature Detection

abstract: Liquid chromatography with tandem mass spectrometry (LC-MS/MS) based proteomics is a well-established research field with major applications such as identification of disease biomarkers, drug discovery, drug design and development. In proteomics, protein identification and quantification is a fundamental task, which is done by first enzymatically digesting it into peptides, and then analyzing peptides by LC-MS/MS instruments. The peptide feature detection and quantification from an LC-MS map is the first step in typical analysis workflows. In this paper we propose a novel deep learning based model, DeepIso, that uses Convolutional Neural Networks (CNNs) to scan an LC-MS map to detect peptide features and estimate their abundance. Existing tools are often designed with limited engineered features based on domain knowledge, and depend on pretrained parameters which are hardly updated despite huge amount of new coming proteomic data. Our proposed model, on the other hand, is capable of learning multiple levels of representation of high dimensional data through its many layers of neurons and continuously evolving with newly acquired data. To evaluate our proposed model, we use an antibody dataset including a heavy and a light chain, each digested by Asp-N, Chymotrypsin, Trypsin, thus giving six LC-MS maps for the experiment. Our model achieves 93.21% sensitivity with specificity of 99.44% on this dataset. Our results demonstrate that novel deep learning tools are desirable to advance the state-of-the-art in protein identification and quantification.


title: Jacob's Ladder: Prime numbers in 2d

abstract: Prime numbers are one of the most intriguing figures in mathematics. Despite centuries of research, many questions remain still unsolved. In recent years, computer simulations are playing a fundamental role in the study of an immense variety of problems. In this work, we present a simple representation of prime numbers in two dimensions that allows us to formulate a number of conjectures that may lead to important avenues in the field of research on prime numbers. In particular, although the zeroes in our representation grow in a somewhat erratic, hardly predictable way, the gaps between them present a remarkable and intriguing property: a clear exponential decay in the frequency of gaps vs gap size. The smaller the gaps, the more frequently they appear. Additionally, the sequence of zeroes, despite being non-consecutive numbers, contains a number of primes approximately equal to n/log(n) , being n the number of terms in the sequence.


title: The structure factor of primes

abstract: Although the prime numbers are deterministic, they can be viewed, by some measures, as pseudo-random numbers. In this article, we numerically study the pair statistics of the primes using statistical-mechanical methods, especially the structure factor $S(k)$ in an interval $M \leq p \leq M + L$ with $M$ large, and $L/M$ smaller than unity. We show that the structure factor of the prime-number configurations in such intervals exhibits well-defined Bragg-like peaks along with a small "diffuse" contribution. This indicates that the primes are appreciably more correlated and ordered than previously thought. Our numerical results definitively suggest an explicit formula for the locations and heights of the peaks. This formula predicts infinitely many peaks in any non-zero interval, similar to the behavior of quasicrystals. However, primes differ from quasicrystals in that the ratio between the location of any two predicted peaks is rational. We also show numerically that the diffuse part decays slowly as $M$ and $L$ increases. This suggests that the diffuse part vanishes in an appropriate infinite-system-size limit.


title: Congruences of Power Sums

abstract: The following congruence for power sums, $S_n(p)$, is well known and has many applications: $1^n+2^n +\dots +p^n \equiv\begin{cases} -1 \text{ mod } p, & \text{ if } \ p-1 \ | \ n; 0 \text{ mod } p, & \text{ if } \ p-1 \ \not| \ n, \end{cases}$ where $n\in{\mathbb N}$ and $p$ is prime. We extend this congruence, in particular, to the case when $p$ is any power of a prime. We also show that the sequence $(S_n(m) \text{ mod } k )_{m \geq 1}$ is periodic and determine its period.


title: Time Dependent Geometry in Massive Gravity

abstract: In this paper, we will analyze a time dependent geometry in a massive theory of gravity. This will be done by analyzing Vaidya space-time in such a massive theory of gravity. As gravitational collapse is a time dependent system, we will analyze it using the Vaidya space-time in massive gravity. The Vainshtein and dRGT mechanisms are used to obtain a ghost free massive gravity, and construct such time dependent solutions. Singularities formed, their nature and strength will be studied in detail. We will also study the thermodynamical aspects of such a geometry by calculating the important thermodynamical quantities for such a system, and analyzing the thermodynamical behavior of such quantities.


title: Boundary value problem with measures for fractional elliptic equations involving source nonlinearities

abstract: We are concerned with positive solutions of equation (E) $(-\Delta)^s u=f(u)$ in a domain $\Omega \subset \mathbb{R}^N$ ($N>2s$), where $s \in (\frac{1}{2},1)$ and $f\in C^{\alpha}_{loc}(\mathbb{R})$ for some $\alpha \in(0,1)$. We establish a universal a priori estimate for positive solutions of (E), as well as for their gradients. Then for $C^2$ bounded domain $\Omega$, we prove the existence of positive solutions of (E) with prescribed boundary value $\rho \nu$, where $\rho>0$ and $\nu$ is a positive Radon measure on $\partial \Omega$ with total mass $1$, and discuss regularity property of the solutions. When $f(u)=u^p$, we demonstrate that there exists a critical exponent $p_s:=\frac{N+s}{N-s}$ in the following sense. If $p\geq p_s$, the problem does not admit any positive solution with $\nu$ being a Dirac mass. If $p\in(1,p_s)$ there exits a threshold value $\rho^*>0$ such that for $\rho\in (0, \rho^*]$, the problem admits a positive solution and for $\rho>\rho^*$, no positive solution exists. We also show that, for $\rho>0$ small enough, the problem admits at least two positive solutions.


title: Radiation Forces and the Abraham-Minkowski Problem

abstract: Recent years have witnessed a number of beautiful experiments in radiation optics. Our purpose with this mini-review is to highlight some developments of radiation pressure physics in general, and thereafter to focus on the importance of the mentioned experiments in regard to the classic Abraham-Minkowski problem. That means, what is the "correct" expression for electromagnetic momentum density in continuous matter. In our opinion one sees relatively often that authors over-interpret the importance of their experimental findings with respect to the momentum problem. Most of these experiments are actually unable to discriminate between these energy-momentum tensors at all, since they can be easily described in terms of force expressions that are common for Abraham and Minkowski. Moreover, we emphasize the inherent ambiguity in applying formal conservation principles to the radiation field in a dielectric, the reason being that the electromagnetic field in matter is only a subsystem which has to be supplemented by the mechanical subsystem to be closed. Finally, we make some suggestions regarding the connection between macroscopic electrodynamics and the Casimir effect, suggesting that there is a limit for the magnitudes of cutoff parameters in QFT related to surface tension in ordinary hydromechanics.


title: Characterization of distributions of $Q$-independent random variables on locally compact Abelian groups

abstract: Let $X$ be a second countable locally compact Abelian group. We prove some group analogues of the Skitovich--Darmois, Heyde and Kac--Bernstein characterisation theorems for $Q$-independent random variables taking values in the group $X$. The proofs of these theorems are reduced to solving some functional equations on the character group of the group $X$.


title: Photoevaporating PDR models with the Hydra PDR Code

abstract: Recent Herschel and ALMA observations of Photodissociation Regions (PDRs) have revealed the presence of a high thermal pressure (P ~ 10^7-10^8 K cm-3) thin compressed layer at the PDR surface where warm molecular tracer emission (e.g. CH+, SH+, high-J CO, H2,...) originate. These high pressures (unbalanced by the surrounding environment) and a correlation between pressure and incident FUV field (G0) seem to indicate a dynamical origin with the radiation field playing an important role in driving the dynamics. We investigate whether photoevaporation of the illuminated edge of a molecular cloud could explain these high pressures and pressure-UV field correlation. We developed a 1D hydrodynamical PDR code coupling hydrodynamics, EUV and FUV radiative transfer and time-dependent thermo-chemical evolution. We applied it to a 1D plane-parallel photoevaporation scenario where a UV-illuminated molecular cloud can freely evaporate in a surrounding low-pressure medium. We find that photoevaporation can produce high thermal pressures and the observed P-G0 correlation, almost independently from the initial gas density. In addition, we find that constant-pressure PDR models are a better approximation to the structure of photoevaporating PDRs than constant-density PDR models, although moderate pressure gradients are present. Strong density gradients from the molecular to the neutral atomic region are found, which naturally explain the large density contrasts (1-2 orders of magnitude) derived from observations of different tracers. The photoevaporating PDR is preceded by a low velocity shock (a few km/s) propagating into the molecular cloud. Photoevaporating PDR models offer a promising explanation to the recent observational evidence of dynamical effects in PDRs.


title: Frequency Independent Framework for Synthesis of Programmable Non-reciprocal Networks

abstract: Passive and linear nonreciprocal networks at microwave frequencies hold great promises in enabling new front-end architectures for wireless communication systems. Their nonreciprocity has been achieved by disrupting the time-reversal symmetry using various forms of biasing schemes, but only over a limited frequency range. Here we demonstrate a framework for synthesizing theoretically frequency-independent multi-port nonreciprocal networks. The framework is highly expandable, and can have an arbitrary number of ports while simultaneously sustaining balanced performance and providing unprecedented programmability of non-reciprocity. A 4-port circulator based on such a framework is implemented and tested to produce broadband nonreciprocal performance from 10 MHz to 900 MHz with a temporal switching effort at 23.8 MHz. With the combination of broad bandwidth, low temporal effort, and high programmability, the framework could inspire new ways of implementing multiple input multiple output (MIMO) communication systems for 5G.


title: Moving unstable particles and special relativity

abstract: In Poincare-Wigner-Dirac theory of relativistic interactions, boosts are dynamical. This means that - just like time translations - boost transformations have non-trivial effect on internal variables of interacting systems. This is different from space translations and rotations, whose actions are always universal, trivial and interaction-independent. Applying this theory to unstable particles viewed from a moving reference frame, we prove that the decay probability cannot be invariant with respect to boosts. Different moving observers may see different internal compositions of the same unstable particle. Unfortunately, this effect is too small to be noticeable in modern experiments.


title: An All-Sky Search for Bursts of Very High Energy Gamma Rays with HAWC

abstract: A new ground-based wide-field extensive air shower array known as the High-Altitude Water Cherenkov (HAWC) Observatory promises a new window to monitoring the $\sim$100 GeV gamma-ray sky with the potential for detecting a high energy spectral cutoff in gamma-ray bursts (GRBs). It represents a roughly 15 times sensitivity gain over the previous generation of wide-field gamma-ray air shower instruments and is able to detect the Crab Nebula at high significance ($>$5 $\sigma$) with each daily transit. Its wide field-of-view ($\sim$2 sr) and $>$95% uptime make it an ideal instrument for detecting GRB emission at $\sim$100 GeV with an expectation for observing $\sim$1 GRB per year based on existing measurements of GRB emission. An all-sky, self-triggered search for VHE emission produced by GRBs with HAWC has been developed. We present the results of this search on three characteristic GRB emission timescales, 0.2 seconds, 1 second, and 10 seconds, in the first year of the fully-populated HAWC detector which is the most sensitive dataset to date. No significant detections were found, allowing us to place upper limits on the rate of GRBs containing appreciable emission in the $\sim$100 GeV band. These constraints exclude previously unexamined parameter space.


title: Neutrino Astronomy 2017

abstract: This overview of neutrino astronomy emphasizes observation of astrophysical neutrinos by IceCube and interesting limits on Galactic neutrinos from IceCube and ANTARES.


title: Asymptotic bounds for spherical codes

abstract: The set of all error-correcting codes C over a fixed finite alphabet F of cardinality q determines the set of code points in the unit square with coordinates (R(C), delta (C)):= (relative transmission rate, relative minimal distance). The central problem of the theory of such codes consists in maximizing simultaneously the transmission rate of the code and the relative minimum Hamming distance between two different code words. The classical approach to this problem explored in vast literature consists in the inventing explicit constructions of "good codes" and comparing new classes of codes with earlier ones. Less classical approach studies the geometry of the whole set of code points (R,delta) (with q fixed), at first independently of its computability properties, and only afterwords turning to the problems of computability, analogies with statistical physics etc. The main purpose of this article consists in extending this latter strategy to domain of spherical codes.


title: Split-gate device for indirect excitons

abstract: We present a concept and experimental proof of principle for split-gate devices for indirect excitons (IXs). The split-gate forms a narrow channel, a point contact, for IX current. Control of IX flow through the split-gate with both gate voltage and excitation power is demonstrated.


title: An Implementation of Back-Propagation Learning on GF11, a Large SIMD Parallel Computer

abstract: Current connectionist simulations require huge computational resources. We describe a neural network simulator for the IBM GF11, an experimental SIMD machine with 566 processors and a peak arithmetic performance of 11 Gigaflops. We present our parallel implementation of the backpropagation learning algorithm, techniques for increasing efficiency, performance measurements on the NetTalk text-to-speech benchmark, and a performance model for the simulator. Our simulator currently runs the back-propagation learning algorithm at 900 million connections per second, where each "connection per second" includes both a forward and backward pass. This figure was obtained on the machine when only 356 processors were working; with all 566 processors operational, our simulation will run at over one billion connections per second. We conclude that the GF11 is well-suited to neural network simulation, and we analyze our use of the machine to determine which features are the most important for high performance.


title: Reeb Posets and Tree Approximations

abstract: A well known result in the analysis of finite metric spaces due to Gromov says that given any $(X,d_X)$ there exists a \emph{tree metric} $t_X$ on $X$ such that $\|d_X-t_X\|_\infty$ is bounded above by twice $\mathrm{hyp}(X)\cdot \log(2\,|X|)$. Here $\mathrm{hyp}(X)$ is the \emph{hyperbolicity} of $X$, a quantity that measures the \emph{treeness} of $4$-tuples of points in $X$. This bound is known to be asymptotically tight. We improve this bound by restricting ourselves to metric spaces arising from filtered posets. By doing so we are able to replace the cardinality appearing in Gromov's bound by a certain poset theoretic invariant (the maximum length of fences in the poset) which can be much smaller thus significantly improving the approximation bound. The setting of metric spaces arising from posets is rich: For example, save for the possible addition of new vertices, every finite metric graph can be induced from a filtered poset. Since every finite metric space can be isometrically embedded into a finite metric graph, our ideas are applicable to finite metric spaces as well. At the core of our results lies the adaptation of the Reeb graph and Reeb tree constructions and the concept of hyperbolicity to the setting of posets, which we use to formulate and prove a tree approximation result for any filtered poset.


title: A bound on the inducibility of cycles

abstract: In 1975, Pippenger and Golumbic conjectured that every n-vertex graph has at most $n^k/(k^k - k)$ induced cycles of length k for k at least 5. We prove that every n-vertex graph has at most $2 n^k/k^k$ induced cycles of length k.


title: Plan in 2D, execute in 3D: An augmented reality solution for cup placement in total hip arthroplasty

abstract: Reproducibly achieving proper implant alignment is a critical step in total hip arthroplasty (THA) procedures that has been shown to substantially affect patient outcome. In current practice, correct alignment of the acetabular cup is verified in C-arm X-ray images that are acquired in an anterior-posterior (AP) view. Favorable surgical outcome is, therefore, heavily dependent on the surgeon's experience in understanding the 3D orientation of a hemispheric implant from 2D AP projection images. This work proposes an easy to use intra-operative component planning system based on two C-arm X-ray images that is combined with 3D augmented reality (AR) visualization that simplifies impactor and cup placement according to the planning by providing a real-time RGBD data overlay. We evaluate the feasibility of our system in a user study comprising four orthopedic surgeons at the Johns Hopkins Hospital, and also report errors in translation, anteversion, and abduction as low as 1.98 mm, 1.10 degrees, and 0.53 degrees, respectively. The promising performance of this AR solution shows that deploying this system could eliminate the need for excessive radiation, simplify the intervention, and enable reproducibly accurate placement of acetabular implants.


title: TopP-S: Persistent homology based multi-task deep neural networks for simultaneous predictions of partition coefficient and aqueous solubility

abstract: Aqueous solubility and partition coefficient are important physical properties of small molecules. Accurate theoretical prediction of aqueous solubility and partition coefficient plays an important role in drug design and discovery. The prediction accuracy depends crucially on molecular descriptors which are typically derived from theoretical understanding of the chemistry and physics of small molecules. The present work introduces an algebraic topology based method, called element specific persistent homology (ESPH), as a new representation of small molecules that is entirely different from conventional chemical and/or physical representations. ESPH describes molecular properties in terms of multiscale and multicomponent topological invariants. Such topological representation is systematical, comprehensive, and scalable with respect to molecular size and composition variations. However, it cannot be literally translated into a physical interpretation. Fortunately, it is readily suitable for machine learning methods, rendering topological learning algorithms. Due to the inherent correlation between solubility and partition coefficient, a uniform ESPH representation is developed for both properties, which facilitates multi-task deep neural networks for their simultaneous predictions. This strategy leads to more accurate prediction of relatively small data sets. A total of six data sets is considered in the present work to validate the proposed topological and multi-task deep learning approaches. It is demonstrate that the proposed approaches achieve some of the most accurate predictions of aqueous solubility and partition coefficient. Our software is available online at {\url{http://weilab.math.msu.edu/TopP-S/}}


title: Fingerprints of Berry phases in the bulk exciton spectrum of a topological insulator

abstract: We examine excitons formed in the bulk of a topological insulator as the system is tuned via a parameter between topological and trivial insulating phases, arguing that nontrivial topology has fingerprints in the spectrum of these excitons. The closely related hydrogen atom problem is well known to have a degeneracy due to a hidden symmetry, and the changes to the excitonic spectrum that we find can be understood as a result of breaking of this underlying symmetry due to the Berry phase. Furthermore, this phase is found to affect the spectrum in the topological parameter regime much more strongly than in the trivial regime. We first construct a semiclassical model of the system to develop qualitative intuition for the effects at play, then move to a more robust numerical simulation of the full quantum system, working with the Bernevig-Hughes-Zhang model of a 2D topological insulator.


title: On-the-fly Augmented Reality for Orthopaedic Surgery Using a Multi-Modal Fiducial

abstract: Fluoroscopic X-ray guidance is a cornerstone for percutaneous orthopaedic surgical procedures. However, two-dimensional observations of the three-dimensional anatomy suffer from the effects of projective simplification. Consequently, many X-ray images from various orientations need to be acquired for the surgeon to accurately assess the spatial relations between the patient's anatomy and the surgical tools. In this paper, we present an on-the-fly surgical support system that provides guidance using augmented reality and can be used in quasi-unprepared operating rooms. The proposed system builds upon a multi-modality marker and simultaneous localization and mapping technique to co-calibrate an optical see-through head mounted display to a C-arm fluoroscopy system. Then, annotations on the 2D X-ray images can be rendered as virtual objects in 3D providing surgical guidance. We quantitatively evaluate the components of the proposed system, and finally, design a feasibility study on a semi-anthropomorphic phantom. The accuracy of our system was comparable to the traditional image-guided technique while substantially reducing the number of acquired X-ray images as well as procedure time. Our promising results encourage further research on the interaction between virtual and real objects, that we believe will directly benefit the proposed method. Further, we would like to explore the capabilities of our on-the-fly augmented reality support system in a larger study directed towards common orthopaedic interventions.


title: Multiplicity freeness of unitary representations in sections of holomorphic Hilbert bundles

abstract: We prove several results asserting that the action of a Banach-Lie group on Hilbert spaces of holomorphic sections of a holomorphic Hilbert space bundle over a complex Banach manifold is multiplicity free. These results require the existence of compatible antiholomorphic bundle maps and certain multiplicity freeness assumptions for stabilizer groups. For the group action on the base, the notion of an $(S,\sigma)$-weakly visible action (generalizing T.Koboyashi's visible actions) provides an effective way to express the assumptions in an economical fashion. In particular, we derive a version for group actions on homogeneous bundles for larger groups. We illustrate these general results by several examples related to operator groups and von Neumann algebras.


title: The Distortion of the Reeb Quotient Map on Riemannian Manifolds

abstract: Given a metric space $X$ and a function $f: X \to \mathbb{R}$, the Reeb construction gives metric a space $X_f$ together with a quotient map $X \to X_f$. Under suitable conditions $X_f$ becomes a metric graph and can therefore be used as a graph approximation to $X$. The Gromov-Hausdorff distance from $X_f$ to $X$ is bounded by the half of the metric distortion of the quotient map. In this paper we consider the case where $X$ is a compact Riemannian manifold and $f$ is an excellent Morse function. In this case we provide bounds on the distortion of the quotient map which involve the first Betti number of the original space and a novel invariant which we call thickness.


title: DENSER: Deep Evolutionary Network Structured Representation

abstract: Deep Evolutionary Network Structured Representation (DENSER) is a novel approach to automatically design Artificial Neural Networks (ANNs) using Evolutionary Computation. The algorithm not only searches for the best network topology (e.g., number of layers, type of layers), but also tunes hyper-parameters, such as, learning parameters or data augmentation parameters. The automatic design is achieved using a representation with two distinct levels, where the outer level encodes the general structure of the network, i.e., the sequence of layers, and the inner level encodes the parameters associated with each layer. The allowed layers and range of the hyper-parameters values are defined by means of a human-readable Context-Free Grammar. DENSER was used to evolve ANNs for CIFAR-10, obtaining an average test accuracy of 94.13%. The networks evolved for the CIFA--10 are tested on the MNIST, Fashion-MNIST, and CIFAR-100; the results are highly competitive, and on the CIFAR-100 we report a test accuracy of 78.75%. To the best of our knowledge, our CIFAR-100 results are the highest performing models generated by methods that aim at the automatic design of Convolutional Neural Networks (CNNs), and are amongst the best for manually designed and fine-tuned CNNs.


title: Expansion of Iterated Stratonovich Stochastic Integrals of Multiplicity 3 Based on Generalized Multiple Fourier Series Converging in the Mean: General Case of Series Summation

abstract: The article is devoted to the development of the method of expansion and mean-square approximation of iterated Ito stochastic integrals based on generalized multiple Fourier series converging in the mean. We adapt this method for iterated Stratonovich stochastic integrals of multiplicity 3 from the Taylor-Stratonovich expansion. The main result of the article has been derived with using the triple Fourier-Legendre series and triple trigonometric Fourier series for the general case of series summation. Some recent results on the expansion of iterated Stratonovich stochastic integrals of multiplicities 3 to 6 are given. The results of the article can be applied to the numerical integration of Ito stochastic differential equations in accordance with the strong criterion of convergence.


title: A Study on the Use of Eye Tracking to Adapt Gameplay and Procedural Content Generation in First-Person Shooter Games

abstract: This paper studies the use of eye tracking in a First-Person Shooter (FPS) game as a~mechanism to: (1) control the attention of the player's avatar according to the attention deployed by the player, and (2) guide the gameplay and game's procedural content generation, accordingly. This results in a more natural use of eye tracking in comparison to a use in which the eye tracker directly substitutes control input devices, such as gamepads. The study was conducted on a custom endless runner FPS, Zombie Runner, using an affordable eye tracker. Evaluation sessions showed that the proposed use of eye tracking provides a more challenging and immersive experience to the player, when compared to its absence. However, a strong correlation between eye tracker calibration problems and player's overall experience was found. This means that eye tracking technology still needs to evolve but also means that once technology gets mature enough players are expected to benefit greatly from the inclusion of eye tracking in their gaming experience.


title: Adaptive Finite Element Solution of the Porous Medium Equation in Pressure Formulation

abstract: A lack of regularity in the solution of the porous medium equation poses a serious challenge in its theoretical and numerical studies. A common strategy in theoretical studies is to utilize the pressure formulation of the equation where a new variable called the mathematical pressure is introduced. It is known that the new variable has much better regularity than the original one and Darcy's law for the movement of the free boundary can be expressed naturally in this new variable. The pressure formulation has not been used in numerical studies. The goal of this work is to study its use in the adaptive finite element solution of the porous medium equation. The MMPDE moving mesh strategy is employed for adaptive mesh movement while linear finite elements are used for spatial discretization. The free boundary is traced explicitly by integrating Darcy's law with the Euler scheme. Numerical results are presented for three two-dimensional examples. The method is shown to be second-order in space and first-order in time in the pressure variable. Moreover, the convergence order of the error in the location of the free boundary is almost second-order in the maximum norm. However, numerical results also show that the convergence order of the method in the original variable stays between first-order and second-order in the $L^1$ norm or between 0.5th-order and first-order in the $L^2$ norm. Nevertheless, the current method can offer some advantages over numerical methods based on the original formulation for situations with large exponents or when a more accurate location of the free boundary is desired.


title: Spatial Variations in the Dust-to-Gas Ratio of Enceladus' Plume

abstract: On day 138 of 2010, the plume of dust and gas emerging from Enceladus' South Polar Terrain passed between the Sun and the Cassini spacecraft. This solar occultation enabled Cassini's Ultraviolet Imaging Spectrograph (UVIS) and the Visual and Infrared Mapping Spectrometer (VIMS) to obtain simultaneous measurements of the plume's gas and dust components along the same lines of sight. The UVIS measurements of the plume's gas content are described in Hansen et al. (2011, GRL 38:11202) , while this paper describes the VIMS data and the information they provide about the plume's particle content. Together, the VIMS and UVIS measurements reveal that the plume material above Baghdad and Damascus sulci has a dust-to-gas mass ratio that is roughly an order of magnitude higher than the material above Alexandria and Cairo sulci. Similar trends in the plume's dust-to-gas ratio are also found in data obtained when Cassini flew through the plume in 2009, during which time the Ion and Neutral Mass Spectrometer (INMS), Radio and Plasma Wave Science instrument (RPWS) and Cosmic Dust Analyzer (CDA) instruments made in-situ measurements of the plume's gas and dust densities (Dong et al. 2015 JGR 120:915-937). These and other previously-published systematic differences in the material erupting from different fissures likely reflect variations in subsurface conditions across Encealdus' South Polar Terrain.


title: Computational Higher Type Theory IV: Inductive Types

abstract: This is the fourth in a series of papers extending Martin-L\"of's meaning explanation of dependent type theory to higher-dimensional types. In this installment, we show how to define cubical type systems supporting a general schema of indexed cubical inductive types whose constructors may take dimension parameters and have a specified boundary. Using this schema, we are able to specify and implement many of the higher inductive types which have been postulated in homotopy type theory, including homotopy pushouts, the torus, $W$-quotients, truncations, arbitrary localizations. By including indexed inductive types, we enable the definition of identity types. The addition of higher inductive types makes computational higher type theory a model of homotopy type theory, capable of interpreting almost all of the constructions in the HoTT Book (with the exception of inductive-inductive types). This is the first such model with an explicit canonicity theorem, which specifies the canonical values of higher inductive types and confirms that every term in an inductive type evaluates to such a value.


title: Comment on "Carnot efficiency at divergent power output" (and additional discussion)

abstract: In a recent Letter [EPL, 118 (2017) 40003], Polettini and Esposito claimed that it is theoretically possible for a thermodynamic machine to achieve Carnot efficiency at divergent power output through the use of infinitely-fast processes. It appears however that this assertion is misleading as it is not supported by their derivations as demonstrated below. In this Comment, we first show that there is a confusion regarding the notion of optimal efficiency. We then analyze the quantum dot engine described in Ref. [EPL, 118 (2017) 40003] and demonstrate that Carnot efficiency is recovered only for vanishing output power. Moreover, a discussion on the use of infinite thermodynamical forces to reach Carnot efficiency is also presented in the appendix.


title: How Many Rounds Should You Expect in Urn Solitaire?

abstract: A certain sampling process, concerning an urn with balls of two colors, proposed in 1965 by B.E. Oakley and R.L. Perry, and discussed by Peter Winkler and Martin Gardner, that has an extremely simple answer for the probability, namely the constant function 1/2, has a far more complicated expected duration, that we discover and sketch the proof of. So unlike, for example, the classical gambler's ruin problem, for which both `probability of winning' and `expected duration' have very simple expressions, in this case the expected number of rounds is extremely complicated, and beyond the scope of humans.


title: Robust PCA for Anomaly Detection in Cyber Networks

abstract: This paper uses network packet capture data to demonstrate how Robust Principal Component Analysis (RPCA) can be used in a new way to detect anomalies which serve as cyber-network attack indicators. The approach requires only a few parameters to be learned using partitioned training data and shows promise of ameliorating the need for an exhaustive set of examples of different types of network attacks. For Lincoln Lab's DARPA intrusion detection data set, the method achieves low false-positive rates while maintaining reasonable true-positive rates on individual packets. In addition, the method correctly detected packet streams in which an attack which was not previously encountered, or trained on, appears.


title: LoopSmart: Smart Visual SLAM Through Surface Loop Closure

abstract: We present a visual simultaneous localization and mapping (SLAM) framework of closing surface loops. It combines both sparse feature matching and dense surface alignment. Sparse feature matching is used for visual odometry and globally camera pose fine-tuning when dense loops are detected, while dense surface alignment is the way of closing large loops and solving surface mismatching problem. To achieve smart dense surface loop closure, a highly efficient CUDA-based global point cloud registration method and a map content dependent loop verification method are proposed. We run extensive experiments on different datasets, our method outperforms state-of-the-art ones in terms of both camera trajectory and surface reconstruction accuracy.


title: Functional control of network dynamics using designed Laplacian spectra

abstract: Complex real-world phenomena across a wide range of scales, from aviation and internet traffic to signal propagation in electronic and gene regulatory circuits, can be efficiently described through dynamic network models. In many such systems, the spectrum of the underlying graph Laplacian plays a key role in controlling the matter or information flow. Spectral graph theory has traditionally prioritized unweighted networks. Here, we introduce a complementary framework, providing a mathematically rigorous weighted graph construction that exactly realizes any desired spectrum. We illustrate the broad applicability of this approach by showing how designer spectra can be used to control the dynamics of various archetypal physical systems. Specifically, we demonstrate that a strategically placed gap induces chimera states in Kuramoto-type oscillator networks, completely suppresses pattern formation in a generic Swift-Hohenberg model, and leads to persistent localization in a discrete Gross-Pitaevskii quantum network. Our approach can be generalized to design continuous band gaps through periodic extensions of finite networks.


title: Testing Optimality of Sequential Decision-Making

abstract: This paper provides a statistical method to test whether a system that performs a binary sequential hypothesis test is optimal in the sense of minimizing the average decision times while taking decisions with given reliabilities. The proposed method requires samples of the decision times, the decision outcomes, and the true hypotheses, but does not require knowledge on the statistics of the observations or the properties of the decision-making system. The method is based on fluctuation relations for decision time distributions which are proved for sequential probability ratio tests. These relations follow from the martingale property of probability ratios and hold under fairly general conditions. We illustrate these tests with numerical experiments and discuss potential applications.

categories: cs.IT cond-mat.stat-mech cs.NE math.IT physics.bio-ph


title: Punctured spheres in complex hyperbolic surfaces and bielliptic ball quotient compactifications

abstract: In this paper, we study punctured spheres in two dimensional ball quotient compactifications $(X, D)$. For example, we show that smooth toroidal compactifications of ball quotients cannot contain properly holomorphically embedded $3$-punctured spheres. We also use totally geodesic punctured spheres to prove ampleness of $K_X + \alpha D$ for $\alpha \in (\frac{1}{4}, 1)$, giving a sharp version of a theorem of the first author with G. Di Cerbo. Finally, we produce the first examples of bielliptic ball quotient compactifications modeled on the Gaussian integers.


title: Near-horizon structure of escape zones of electrically charged particles around weakly magnetized rotating black hole

abstract: An interplay of magnetic fields and gravitation drives accretion and outflows near black holes. However, a specific mechanism is still a matter of debate; it is very likely that different processes dominate under various conditions. In particular, for the acceleration of particles and their collimation in jets, an ordered component of the magnetic field seems to be essential. Here we discuss the role of large-scale magnetic fields in transporting the charged particles and dust grains from the bound orbits in the equatorial plane of a rotating (Kerr) black hole and the resulting acceleration along trajectories escaping the system in a direction parallel to the symmetry axis (perpendicular to the accretion disk). We consider a specific scenario of destabilization of circular geodesics of initially neutral matter by charging (e.g., due to photoionization). Some particles may be set on escaping trajectories and attain relativistic velocity. The case of charged particles differs from charged dust grains by their charge-to-mass ratio, but the acceleration mechanism operates in a similar manner. It appears that the chaotic dynamics controls the outflow and supports the formation of near-horizon escape zones. We employ the technique of recurrence plots to characterize the onset of chaos in the outflowing medium. We investigate the system numerically and construct the basin-boundary plots, which show the location and the extent of the escape zones. The effects of black hole spin and magnetic field strength on the formation and location of escape zones are discussed, and the maximal escape velocity is computed.


title: Sex-by-age differences in the resting-state brain connectivity

abstract: Recently we developed a novel method for assessing the hierarchical modularity of functional brain networks - the probability associated community estimation(PACE). The PACE algorithm is unique in that it permits a dual formulation, thus yielding equivalent connectome modular structure regardless of whether considering positive or negative edges. This method was rigorously validated using F1000 and HCP data. We detected novel sex differences in resting-state connectivity that were not previously reported. This current study more thoroughly examined sex differences as a function of age and their clinical correlates, with findings supporting a basal configuration framework. To this end, we found that men and women do not significantly differ in the 22-25 age range. However, these same non-significant differences attained statistical significance in the 26-30 age group, while becoming highly statistically significant in the 31-35 age group. At the most global level, areas of diverging sex difference include parts of the prefrontal cortex and the temporal lobe, amygdala, hippocampus, inferior parietal lobule, posterior cingulate, and precuneus. Further, we identified statistically different self-reported summary scores of inattention, hyperactivity, and anxiety problems between men and women. These self-reports additionally divergently interact with age and the basal configuration between sexes. In sum, our study supports a paradigm change in how we conceptualize the functional connectome, shifting away from simple concepts, and towards thinking globally and probabilistically how the brain exhibits dynamic sex-specific connectivity configuration as a function of age, and the role this sex-by-age configuration at rest might play in mental health frequency and presentation, including symptom patterns in depression.


title: A Robust Preconditioner for High-Contrast Problems

abstract: A finite-element discretization of such an equation yields a linear system whose conditioning worsens as the variations in the values of PDE coefficients becomes large. This paper introduces a procedure by which the discrete system obtained from a linear finite element discretization of the given continuum problem is converted into an equivalent linear system of the saddle point type. Then a robust preconditioner for the Lanczos method of minimized iterations for solving the derived saddle point problem is proposed. Robustness with respect to the contrast parameter and the mesh size is justified. Numerical examples support theoretical results and demonstrate independence of the number of iterations on the contrast, the mesh size and also on the different contrasts on the inclusions.


title: Hygienic Source-Code Generation Using Functors

abstract: Existing source-code-generating tools such as Lex and Yacc suffer from practical inconveniences because they use disembodied code to implement actions. To prevent this problem, such tools could generate closed functors that are then instantiated by the programmer with appropriate action code. This results in all code being type checked in its appropriate context, and it assists the type checker in localizing errors correctly. We have implemented a lexer generator and parser generator based on this technique for Standard ML, OCaml, and Haskell.


title: Binder migration during drying of lithium-ion battery electrodes: modelling and comparison to experiment

abstract: The drying process is a crucial step in electrode manufacture as it can affect the component distribution within the electrode. Phenomena such as binder migration can have negative effects in the form of poor cell performance (e.g. capacity fade) or mechanical failure (e.g. electrode delamination from the current collector). We present a mathematical model that tracks the evolution of the binder concentration in the electrode during drying. Solutions to the model predict that low drying rates lead to a favourable homogeneous binder profile across the electrode film, whereas high drying rates result in an unfavourable accumulation of binder near the evaporation surface. These results show strong qualitative agreement with experimental observations and provide a cogent explanation for why fast drying conditions result in poorly performing electrodes. Finally, we provide some guidelines on how the drying process could be optimised to offer relatively short drying times whilst simultaneously maintaining a roughly homogeneous binder distribution.


title: Frobenius-Perron Theory of Modified ADE Bound Quiver Algebras

abstract: The Frobenius-Perron dimension for an abelian category was recently introduced. We apply this theory to the category of representations of the finite-dimensional radical squared zero algebras associated to certain modified ADE graphs. In particular, we take an ADE quiver with arrows in a certain orientation and an arbitrary number of loops at each vertex. We show that the Frobenius-Perron dimension of this category is equal to the maximum number of loops at a vertex. Along the way, we introduce a result which can be applied in general to calculate the Frobenius-Perron dimension of a radical square zero bound quiver algebra. We use this result to introduce a family of abelian categories which produce arbitrarily large irrational Frobenius-Perron dimensions.


title: Object Referring in Videos with Language and Human Gaze

abstract: We investigate the problem of object referring (OR) i.e. to localize a target object in a visual scene coming with a language description. Humans perceive the world more as continued video snippets than as static images, and describe objects not only by their appearance, but also by their spatio-temporal context and motion features. Humans also gaze at the object when they issue a referring expression. Existing works for OR mostly focus on static images only, which fall short in providing many such cues. This paper addresses OR in videos with language and human gaze. To that end, we present a new video dataset for OR, with 30, 000 objects over 5, 000 stereo video sequences annotated for their descriptions and gaze. We further propose a novel network model for OR in videos, by integrating appearance, motion, gaze, and spatio-temporal context into one network. Experimental results show that our method effectively utilizes motion cues, human gaze, and spatio-temporal context. Our method outperforms previousOR methods. For dataset and code, please refer https://people.ee.ethz.ch/~arunv/ORGaze.html.


title: Metal-poor star formation triggered by the feedback effects from Pop III stars

abstract: Metal enrichment by the first-generation (Pop III) stars is the very first step of the matter cycle in the structure formation and it is followed by the formation of extremely metal-poor (EMP) stars. To investigate the enrichment process by the Pop III stars, we carry out a series of numerical simulations including the feedback effects of photoionization and supernovae (SNe) of Pop III stars with a range of masses of minihaloes (MHs), M_halo , and Pop III stars, M_PopIII . We find that the metal-rich ejecta reaches neighbouring haloes and external enrichment (EE) occurs when the halo binding energy is sufficiently below the SN explosion energy, E_SN . The neighbouring haloes are only superficially enriched, and the metallicity of the clouds is [Fe/H] < -5. Otherwise, the SN ejecta falls back and recollapses to form enriched cloud, i.e. internal enrichment (IE) process takes place. In case that a Pop III star explodes as a core-collapse SNe (CCSNe), MHs undergo IE, and the metallicity in the recollapsing region is -5 < [Fe/H] < -3 in most cases. We conclude that IE from a single CCSN can explain the formation of EMP stars. For pair-instability SNe (PISNe), EE takes place for all relevant mass range of MHs, consistent with no observational sign of PISNe among EMP stars.


title: Fixation probabilities and hitting times under low levels of frequency-dependent selection

abstract: In population genetics, diffusions on the unit interval are often used to model the frequency path of an allele. In this setting we derive approximations for fixation probabilities, expected hitting times and the expected site-frequency-spectrum under small frequency-dependent selection. Specifically, we rederive and extend the one-third rule of evolutionary game theory (Nowak et al., 2004) and effects of stochastic slowdown (Altrock and Traulsen, 2009). Since similar effects are of interest in other application areas, we formulate our results for general one-dimensional diffusions.


title: Spectral Asymmetry of Atoms in the van der Waals Potential of an Optical Nanofiber

abstract: We measure the modification of the transmission spectra of cold $^{87}$Rb atoms in the proximity of an optical nanofiber (ONF). Van der Waals interactions between the atoms an the ONF surface decrease the resonance frequency of atoms closer to the surface. An asymmetric spectra of the atoms holds information of their spatial distribution around the ONF. We use a far-detuned laser beam coupled to the ONF to thermally excite atoms at the ONF surface. We study the change of transmission spectrum of these atoms as a function of heating laser power. A semi-classical phenomenological model for the thermal excitation of atoms in the atom-surface van der Waals bound states is in good agreement with the measurements. This result suggests that van der Waals potentials could be used to trap and probe atoms at few nanometers from a dielectric surfaces, a key tool for hybrid photonic-atomic quantum systems.


title: A practical tutorial on autoencoders for nonlinear feature fusion: Taxonomy, models, software and guidelines

abstract: Many of the existing machine learning algorithms, both supervised and unsupervised, depend on the quality of the input characteristics to generate a good model. The amount of these variables is also important, since performance tends to decline as the input dimensionality increases, hence the interest in using feature fusion techniques, able to produce feature sets that are more compact and higher level. A plethora of procedures to fuse original variables for producing new ones has been developed in the past decades. The most basic ones use linear combinations of the original variables, such as PCA (Principal Component Analysis) and LDA (Linear Discriminant Analysis), while others find manifold embeddings of lower dimensionality based on non-linear combinations, such as Isomap or LLE (Linear Locally Embedding) techniques. More recently, autoencoders (AEs) have emerged as an alternative to manifold learning for conducting nonlinear feature fusion. Dozens of AE models have been proposed lately, each with its own specific traits. Although many of them can be used to generate reduced feature sets through the fusion of the original ones, there also AEs designed with other applications in mind. The goal of this paper is to provide the reader with a broad view of what an AE is, how they are used for feature fusion, a taxonomy gathering a broad range of models, and how they relate to other classical techniques. In addition, a set of didactic guidelines on how to choose the proper AE for a given task is supplied, together with a discussion of the software tools available. Finally, two case studies illustrate the usage of AEs with datasets of handwritten digits and breast cancer.


title: SpectralNet: Spectral Clustering using Deep Neural Networks

abstract: Spectral clustering is a leading and popular technique in unsupervised data analysis. Two of its major limitations are scalability and generalization of the spectral embedding (i.e., out-of-sample-extension). In this paper we introduce a deep learning approach to spectral clustering that overcomes the above shortcomings. Our network, which we call SpectralNet, learns a map that embeds input data points into the eigenspace of their associated graph Laplacian matrix and subsequently clusters them. We train SpectralNet using a procedure that involves constrained stochastic optimization. Stochastic optimization allows it to scale to large datasets, while the constraints, which are implemented using a special-purpose output layer, allow us to keep the network output orthogonal. Moreover, the map learned by SpectralNet naturally generalizes the spectral embedding to unseen data points. To further improve the quality of the clustering, we replace the standard pairwise Gaussian affinities with affinities leaned from unlabeled data using a Siamese network. Additional improvement can be achieved by applying the network to code representations produced, e.g., by standard autoencoders. Our end-to-end learning procedure is fully unsupervised. In addition, we apply VC dimension theory to derive a lower bound on the size of SpectralNet. State-of-the-art clustering results are reported on the Reuters dataset. Our implementation is publicly available at https://github.com/kstant0725/SpectralNet .


title: On a class of polynomials connected to Bell polynomials

abstract: In this paper, we study a class of sequences of polynomials linked to the sequence of Bell polynomials. Some sequences of this class have applications on the theory of hyperbolic differential equations and other sequences generalize Laguerre polynomials and associated Lah polynomials. We discuss, for these polynomials, their explicit expressions, relations to the successive derivatives of a given function, real zeros and recurrence relations. Some known results are significantly simplified.


title: Neural Style Transfer for Audio Spectograms

abstract: There has been fascinating work on creating artistic transformations of images by Gatys. This was revolutionary in how we can in some sense alter the 'style' of an image while generally preserving its 'content'. In our work, we present a method for creating new sounds using a similar approach, treating it as a style-transfer problem, starting from a random-noise input signal and iteratively using back-propagation to optimize the sound to conform to filter-outputs from a pre-trained neural architecture of interest. For demonstration, we investigate two different tasks, resulting in bandwidth expansion/compression, and timbral transfer from singing voice to musical instruments. A feature of our method is that a single architecture can generate these different audio-style-transfer types using the same set of parameters which otherwise require different complex hand-tuned diverse signal processing pipelines.


title: Investigation of a dilute polymer solution in confined geometries

abstract: The paper presents a short overview of the theoretical, numerical and experimental works on the critical behavior of a dilute polymer solution of long-flexible polymer chains confined in semi-infinite space restricted by a surface or in a slit geometry of two parallel walls with different adsorbing or repelling properties in respect for polymers as well as in a solution of mesoscopic spherical colloidal particles of one sort or two different sorts. We discuss the application of the massive field theory approach in a fixed space dimensions d=3 up to one loop order for such topics as:(a) the investigation of the elastic properties of real polymer chain immersed in a good solvent and anchored by one end to the surface and with other end being under tension of the external applied force;(b) the calculation of the monomer density profiles, the depletion interaction potentials and the depletion forces which arise in a dilute polymer solution immersed in confined geometries, like slit of two parallel walls with different adsorbing or repelling properties in respect for polymers or in the polymer-colloid mixtures with mesoscopic spherical colloidal particles of one sort or two different sorts. The presented results give possibility better to understand the complexity of physical effects arising from confinement and indicate about the interesting and nontrivial behavior of linear polymer chains in confined geometries and are in good qualitative and quantitative agreement with previous theoretical investigations, results of DFT, MC simulations and experimental data based on the AFM and TIRM. Besides, the obtained results have important practical applications for better understanding of the elastic properties of the individual macromolecules, networks, gels and brush layers as well as indicate about possibility of application in production of new types of nano- and micro-electromechanical devices.


title: The Hubble IR cutoff in holographic ellipsoidal cosmologies

abstract: It is well known that for spatially flat FRW cosmologies, the holographic dark energy disfavours the Hubble parameter as a candidate for the IR cutoff. For overcoming this problem, we explore the use of this cutoff in holographic ellipsoidal cosmological models, and derive the general ellipsoidal metric induced by a such holographic energy density. Despite the drawbacks that this cutoff presents in homogeneous and isotropic universes, based on this general metric, we developed a suitable ellipsoidal holographic cosmological model, filled with a dark matter and a dark energy components. At late time stages, the cosmic evolution is dominated by a holographic anisotropic dark energy with barotropic equations of state. The cosmologies expand in all directions in accelerated manner. Since the ellipsoidal cosmologies given here are not asymptotically FRW, the deviation from homogeneity and isotropy of the universe on large cosmological scales remains constant during all cosmic evolution. This feature allows studied holographic ellipsoidal cosmologies to be ruled by an equation of state $\omega=p/\rho$, whose range belongs to quintessence or even phantom matter.


title: 21CMMC with a 3D light-cone: the impact of the co-evolution approximation on the astrophysics of reionisation and cosmic dawn

abstract: We extend 21CMMC, a Monte Carlo Markov Chain sampler of 3D reionisation simulations, to perform parameter estimation directly on 3D light-cones of the cosmic 21cm signal. This brings theoretical analysis closer to the tomographic 21-cm observations achievable with next generation interferometers like HERA and the SKA. Parameter recovery can therefore account for modes which evolve with redshift/frequency. Additionally, simulated data can be more easily corrupted to resemble real data. Using the light-cone version of 21CMMC, we quantify the biases in the recovered astrophysical parameters if we use the 21cm power spectrum from the co-evolution approximation to fit a 3D light-cone mock observation. While ignoring the light-cone effect under most assumptions will not significantly bias the recovered astrophysical parameters, it can lead to an underestimation of the associated uncertainty. However significant biases ($\sim$few -- 10 $\sigma$) can occur if the 21cm signal evolves rapidly (i.e. the epochs of reionisation and heating overlap significantly) and: (i) foreground removal is very efficient, allowing large physical scales ($k\lesssim0.1$~Mpc$^{-1}$) to be used in the analysis or (ii) theoretical modelling is accurate to within $\sim10$ per cent in the power spectrum amplitude.


title: Estimation in the spiked Wigner model: A short proof of the replica formula

abstract: We consider the problem of estimating a rank-one perturbation of a Wigner matrix in a setting of low signal-to-noise ratio. This serves as a simple model for principal component analysis in high dimensions. The mutual information per variable between the spike and the observed matrix, or equivalently, the normalized Kullback-Leibler divergence between the planted and null models are known to converge to the so-called {\em replica-symmetric} formula, the properties of which determine the fundamental limits of estimation in this model. We provide in this note a short and transparent proof of this formula, based on simple executions of Gaussian interpolations and standard concentration-of-measure arguments. The \emph{Franz-Parisi potential}, that is, the free entropy at a fixed overlap, plays an important role in our proof. Furthermore, our proof can be generalized straightforwardly to spiked tensor models of even order.


title: Differentially Private Releasing via Deep Generative Model (Technical Report)

abstract: Privacy-preserving releasing of complex data (e.g., image, text, audio) represents a long-standing challenge for the data mining research community. Due to rich semantics of the data and lack of a priori knowledge about the analysis task, excessive sanitization is often necessary to ensure privacy, leading to significant loss of the data utility. In this paper, we present dp-GAN, a general private releasing framework for semantic-rich data. Instead of sanitizing and then releasing the data, the data curator publishes a deep generative model which is trained using the original data in a differentially private manner; with the generative model, the analyst is able to produce an unlimited amount of synthetic data for arbitrary analysis tasks. In contrast of alternative solutions, dp-GAN highlights a set of key features: (i) it provides theoretical privacy guarantee via enforcing the differential privacy principle; (ii) it retains desirable utility in the released model, enabling a variety of otherwise impossible analyses; and (iii) most importantly, it achieves practical training scalability and stability by employing multi-fold optimization strategies. Through extensive empirical evaluation on benchmark datasets and analyses, we validate the efficacy of dp-GAN.


title: Fluctuations of the aperture-averaged orbital angular momentum after propagation through turbulence

abstract: In the recent paper [1] it was shown that for paraxial propagation of scalar waves, the transverse linear momentum and orbital angular momentum (OAM) are related to the wave coherence function. Although both of these quantities are conserved during free-space propagation, they fluctuate for beam propagation in a random inhomogeneous medium. We hereby present an extension of this theory to the case of OAM fluctuations of a spherical wave intercepted by a finite aperture. A complete asymptotic theory for the aperture-averaged OAM variance is developed for both weak and strong fluctuation conditions, based on the asymptotic expansions of the Feynman path-integral solution for the fourth-order coherence function of a spherical wave propagating through a random inhomogeneous medium. We show that"square root" law, and that the weak/strong fluctuation conditions for the aperture-averaged OAM are not defined by the values of the scintillation index of the incident wave.


title: Combination of Hyperband and Bayesian Optimization for Hyperparameter Optimization in Deep Learning

abstract: Deep learning has achieved impressive results on many problems. However, it requires high degree of expertise or a lot of experience to tune well the hyperparameters, and such manual tuning process is likely to be biased. Moreover, it is not practical to try out as many different hyperparameter configurations in deep learning as in other machine learning scenarios, because evaluating each single hyperparameter configuration in deep learning would mean training a deep neural network, which usually takes quite long time. Hyperband algorithm achieves state-of-the-art performance on various hyperparameter optimization problems in the field of deep learning. However, Hyperband algorithm does not utilize history information of previous explored hyperparameter configurations, thus the solution found is suboptimal. We propose to combine Hyperband algorithm with Bayesian optimization (which does not ignore history when sampling next trial configuration). Experimental results show that our combination approach is superior to other hyperparameter optimization approaches including Hyperband algorithm.


title: Response of photomultiplier tubes to xenon scintillation light

abstract: We present the precision calibration of 35 Hamamatsu R11410-22 photomultiplier tubes (PMTs) with xenon scintillation light centred near 175 nm. This particular PMT variant was developed specifically for the LUX-ZEPLIN (LZ) dark matter experiment. A room-temperature xenon scintillation cell coupled to a vacuum cryostat was used to study the full-face PMT response at both room and low temperature $\textrm{($\sim$ -100$^\circ$C)}$, in particular to determine the quantum efficiency (QE) and double photoelectron emission (DPE) probability in LZ operating conditions. For our sample with an average QE of $\textrm{(32.4$\pm$2.9)%}$ at room temperature, we find a relative improvement of $\textrm{(17.9$\pm$5.2)%}$ upon cooling (where uncertainty values refer to the sample standard deviation). The mean DPE probability in response to single vacuum ultraviolet (VUV) photons is $\textrm{(22.6$\pm$2.0)%}$ at low temperature; the DPE increase relative to room temperature, measured here for the first time, was $\textrm{(12.2$\pm$3.9)%}$. Evidence of a small triple photoelectron emission probability $\textrm{($\sim$0.6%)}$ has also been observed. Useful correlations are established between these parameters and the QE as measured by the manufacturer. The single VUV photon response is also measured for one ETEL D730/9829QB, a PMT with a more standard bialkali photocathode used in the ZEPLIN-III experiment, for which we obtained a cold DPE fraction of $\textrm{(9.1$\pm$0.1)%}$. Hence, we confirm that this effect is not restricted to the low-temperature bialkali photocathode technology employed by Hamamatsu. This highlights the importance of considering this phenomenon in the interpretation of data from liquid xenon scintillation and electroluminescence detectors, and from many other optical measurements in this wavelength region.


title: Discrete FRFT-Based Frame and Frequency Synchronization for Coherent Optical Systems

abstract: A joint frame and carrier frequency synchronization algorithm for coherent optical systems, based on the digital computation of the fractional Fourier transform (FRFT), is proposed. The algorithm utilizes the characteristics of energy centralization of chirp signals in the FRFT domain, together with the time and phase shift properties of the FRFT. Chirp signals are used to construct a training sequence (TS), and fractional cross-correlation is employed to define a detection metric for the TS, from which a set of equations can be obtained. Estimates of both the timing offset and carrier frequency offset (CFO) are obtained by solving these equations. This TS is later employed in a phase-dependent decision-directed least-mean square algorithm for adaptive equalization. Simulation results of a 32-Gbaud coherent polarization division multiplexed Nyquist system show that the proposed scheme has a wide CFO estimation range and accurate synchronization performance even in poor optical signal-to-noise ratio conditions.


title: Bandwidth-Efficient Synchronization for Fiber Optic Transmission: System Performance Measurements

abstract: In this article, we first provide a brief overview of optical transmission systems and some of their performance specifications. We then present a simple, robust, and bandwidth-efficient OFDM synchronization method, and carry out measurements to validate the presented synchronization method with the aid of an experimental setup.


title: Robust Frame and Frequency Synchronization Based on Alamouti Coding for RGI-CO-OFDM

abstract: We propose an algorithm for carrying out joint frame and frequency synchronization in reduced-guard-interval coherent optical orthogonal frequency division multiplexing (RGI-CO-OFDM) systems. The synchronization is achieved by using the same training symbols (TS) employed for training-aided channel estimation (TA-CE), thereby avoiding additional training overhead. The proposed algorithm is designed for polarization division multiplexing (PDM) RGI-CO-OFDM systems that use the Alamouti-type polarization-time coding for TA-CE. Due to their optimal TA-CE performance, Golay complementary sequences have been used as the TS in the proposed algorithm. The frame synchronization is accomplished by exploiting the cross-correlation between the received TS from the two orthogonal polarizations. The arrangement of the TS is also used to estimate the carrier frequency offset. Simulation results of a PDM RGI-CO-OFDM system operating at 238.1 Gb/s data rate (197.6-Gb/s after coding), with a total overhead of 9.2% (31.6% after coding), show that the proposed scheme has accurate synchronization, and is robust to linear fiber impairments.


title: Joint timing and frequency synchronization based on weighted CAZAC sequences for reduced-guard-interval CO-OFDM systems

abstract: A novel joint symbol timing and carrier frequency offset (CFO) estimation algorithm is proposed for reduced-guard-interval coherent optical orthogonal frequency-division multiplexing (RGI-CO-OFDM) systems. The proposed algorithm is based on a constant amplitude zero autocorrelation (CAZAC) sequence weighted by a pseudo-random noise (PN) sequence. The symbol timing is accomplished by using only one training symbol of two identical halves, with the weighting applied to the second half. The special structure of the training symbol is also utilized in estimating the CFO. The performance of the proposed algorithm is demonstrated by means of numerical simulations in a 115.8-Gb/s 16-QAM RGI-CO-OFDM system.


title: Principal component analysis for big data

abstract: Big data is transforming our world, revolutionizing operations and analytics everywhere, from financial engineering to biomedical sciences. The complexity of big data often makes dimension reduction techniques necessary before conducting statistical inference. Principal component analysis, commonly referred to as PCA, has become an essential tool for multivariate data analysis and unsupervised dimension reduction, the goal of which is to find a lower dimensional subspace that captures most of the variation in the dataset. This article provides an overview of methodological and theoretical developments of PCA over the last decade, with focus on its applications to big data analytics. We first review the mathematical formulation of PCA and its theoretical development from the view point of perturbation analysis. We then briefly discuss the relationship between PCA and factor analysis as well as its applications to large covariance estimation and multiple testing. PCA also finds important applications in many modern machine learning problems, and we focus on community detection, ranking, mixture model and manifold learning in this paper.


title: Simple sampling clock synchronisation scheme for reduced-guard-interval coherent optical OFDM systems

abstract: A simple data-aided scheme for sampling clock synchronisation in reduced-guard-interval coherent optical orthogonal frequency division multiplexing (RGI-CO-OFDM) systems is proposed. In the proposed scheme, the sampling clock offset (SCO) is estimated by using the training symbols reserved for channel estimation, thus avoiding extra training overhead. The SCO is then compensated by resampling, using a time-domain interpolation filter. The feasibility of the proposed scheme is demonstrated by means of numerical simulations in a 32-Gbaud 16-QAM dual-polarisation RGI-CO-OFDM system.


title: Intelligence Graph

abstract: In fact, there exist three genres of intelligence architectures: logics (e.g. \textit{Random Forest, A$^*$ Searching}), neurons (e.g. \textit{CNN, LSTM}) and probabilities (e.g. \textit{Naive Bayes, HMM}), all of which are incompatible to each other. However, to construct powerful intelligence systems with various methods, we propose the intelligence graph (short as \textbf{\textit{iGraph}}), which is composed by both of neural and probabilistic graph, under the framework of forward-backward propagation. By the paradigm of iGraph, we design a recommendation model with semantic principle. First, the probabilistic distributions of categories are generated from the embedding representations of users/items, in the manner of neurons. Second, the probabilistic graph infers the distributions of features, in the manner of probabilities. Last, for the recommendation diversity, we perform an expectation computation then conduct a logic judgment, in the manner of logics. Experimentally, we beat the state-of-the-art baselines and verify our conclusions.


title: Distance between arithmetic progressions and perfect squares

abstract: In this paper, we study how close the terms of a finite arithmetic progression can get to a perfect square. The answer depends on the initial term, the common difference and the number of terms in the arithmetic progression.


title: Reflection suppression by the hyperbolic-medium antennas and silicon particles

abstract: Optical antennas made out of materials with hyperbolic dispersion is an alternative approach to realizing efficient subwavelength scatterers and may overcome limitations imposed by plasmonic and all-dielectric designs. Recently emerged natural hyperbolic material hexagonal boron nitride supports phonon-polariton excitations with low optical losses and high anisotropy. Here we study scattering properties of the hyperbolic-medium (HM) antennas, and in particular, we consider a combination of two types of the particles - HM bars and silicon spheres - arranged in a periodic array. We analyze excitation of electric and magnetic resonances in the particles and effect of their overlap in the array. We theoretically demonstrate that decrease of reflectance from the array can be achieved with appropriate particle dimensions where electric and magnetic resonances of different particle types overlap, and the resonance oscillations are in phase. In this case, generalized Kerker condition is satisfied, and particle dimers in the array efficiently scatter light in the forward direction. The effect can be used in designing metasurfaces based on hexagonal boron nitride scatterers with an application in mid-infrared photonics.


title: Evanescent Modes and Step-like Acoustic Black Holes

abstract: We consider a model of an acoustic black hole formed by a quasi-one dimensional Bose-Einstein condensate with a step-like horizon. This system is analyzed by solving the corresponding Bogoliubov-de Gennes equation with an appropriate matching condition at the jump. When the step is between a subsonic and supersonic flow, a sonic horizon develops and in addition to the scattering coefficients we compute the distribution of the accompanying analogue Hawking radiation. Additionally, in response to the abrupt variation in flow and non-linear Bogoliubov dispersion relation, evanescent solutions of the Bogoliubov-de Gennes equation also appear and decay out from the horizon. We bound this decay length and show that these modes produce a modulation of observables outside the event horizon by their interference with outgoing Hawking flux. We go further and find specific superpositions of ingoing eigenmodes which exhibit coherent cancellation of the Hawking flux outside the horizon but nevertheless have evanescent support outside the black hole. We conclude by speculating that when quasiparticle interactions are included, evanescent modes may yield a leakage of information across the event horizon via interactions between the real outgoing Hawking flux and the virtual evanescent modes, and that we may expect this as a generic feature of models which break Lorentz invariance at the UV (Planck) scale.


title: The Definition and Numerical Method of Final Value Problem and Arbitrary Value Problem

abstract: Many Engineering Problems could be mathematically described by Final Value Problem, which is the inverse problem of Initial Value Problem. Accordingly, the paper studies the final value problem in the field of ODE problems and analyses the differences and relations between initial and final value problems. The more general new concept of the endpoints-value problem which could describe both initial and final problems is proposed. Further, we extend the concept into inner-interval value problem and arbitrary value problem and point out that both endpoints-value problem and inner-interval value problem are special forms of arbitrary value problem. Particularly, the existence and uniqueness of the solutions of final value problem and inner-interval value problem of first order ordinary differential equation are proved for discrete problems. The numerical calculation formulas of the problems are derived, and for each algorithm, we propose the convergence and stability conditions of them. Furthermore, multivariate and high-order final value problems are further studied, and the condition of fixed delay is also discussed in this paper. At last, the effectiveness of the considered methods is validated by numerical experiment.


title: Learning $3$D-FilterMap for Deep Convolutional Neural Networks

abstract: We present a novel and compact architecture for deep Convolutional Neural Networks (CNNs) in this paper, termed $3$D-FilterMap Convolutional Neural Networks ($3$D-FM-CNNs). The convolution layer of $3$D-FM-CNN learns a compact representation of the filters, named $3$D-FilterMap, instead of a set of independent filters in the conventional convolution layer. The filters are extracted from the $3$D-FilterMap as overlapping $3$D submatrics with weight sharing among nearby filters, and these filters are convolved with the input to generate the output of the convolution layer for $3$D-FM-CNN. Due to the weight sharing scheme, the parameter size of the $3$D-FilterMap is much smaller than that of the filters to be learned in the conventional convolution layer when $3$D-FilterMap generates the same number of filters. Our work is fundamentally different from the network compression literature that reduces the size of a learned large network in the sense that a small network is directly learned from scratch. Experimental results demonstrate that $3$D-FM-CNN enjoys a small parameter space by learning compact $3$D-FilterMaps, while achieving performance compared to that of the baseline CNNs which learn the same number of filters as that generated by the corresponding $3$D-FilterMap.


title: On Convergence to Essential Singularities

abstract: An iterative optimization method applied to a function $f$ on $\mathbb{R}^n$ will produce a sequence of arguments $\{\mathbf{x}_k\}_{k \in \mathbb{N}}$; this sequence is often constrained such that $\{f(\mathbf{x}_k)\}_{k \in \mathbb{N}}$ is monotonic. As part of the analysis of an iterative method, one may ask under what conditions the sequence $\{\mathbf{x}_k\}_{k \in \mathbb{N}}$ converges. In 2005, Absil et al.\ employed the {\L}ojasiewicz gradient inequality in a proof of convergence; this requires that the objective function exist at a cluster point of the sequence. Here we provide a convergence result that does not require $f$ to be defined at the limit $\lim_{k \to \infty} \mathbf{x}_k$, should the limit exist. We show that a variant of the {\L}ojasiewicz gradient inequality holds on sets adjacent to singularities of bounded multivariate rational functions. We extend the results of Absil et al.\ to prove that if $\{\mathbf{x}_k\}_{k \in \mathbb{N}} \subset \mathbb{R}^n$ has a cluster point $\mathbf{x}_*$, if $f$ is a bounded multivariate rational function on $\mathbb{R}^n$, and if a technical condition holds, then $\mathbf{x}_k \to \mathbf{x}_*$ even if $\mathbf{x}_*$ is not in the domain of $f$. We demonstrate how this may be employed to analyze divergent sequences by mapping them to projective space, and consider the implications this has for the study of low-rank tensor approximations.


title: Imaging and variability studies of CTA~102 during the 2016 January $\gamma$-ray flare

abstract: The $\gamma$-ray bright blazar CTA 102 is studied using imaging (new 15 GHz and archival 43 GHz Very Long Baseline Array, VLBA data) and time variable optical flux density, polarization degree and electric vector position angle (EVPA) spanning between 2015 June 1 and 2016 October 1, covering a prominent $\gamma$-ray flare during 2016 January. The pc-scale jet indicates expansion with oscillatory features upto 17 mas. Component proper motions are in the range 0.04 - 0.33 mas/yr with acceleration upto 1.2 mas followed by a slowing down beyond 1.5 mas. A jet bulk Lorentz factor $\geq$ 17.5, position angle of 128.3 degrees, inclination angle $\leq$ 6.6 degrees and intrinsic half opening angle $\leq$ 1.8 degrees are derived from the VLBA data. These inferences are employed in a helical jet model to infer long term variability in flux density, polarization degree, EVPA and a rotation of the Stokes Q and U parameters. A core distance of $r_{\rm core,43 \ GHz}$ = 22.9 pc, and a magnetic field strength at 1 pc and the core location of 1.57 G and 0.07 G respectively are inferred using the core shift method. The study is useful in the context of estimating jet parameters and in offering clues to distinguish mechanisms responsible for variability over different timescales.