title: Rank-based Lasso -- efficient methods for high-dimensional robust model selection

abstract: We consider the problem of identifying significant predictors in large data bases, where the response variable depends on the linear combination of explanatory variables through an unknown link function, corrupted with the noise from the unknown distribution. We utilize the natural, robust and efficient approach, which relies on replacing values of the response variables by their ranks and then identifying significant predictors by using well known Lasso. We provide new consistency results for the proposed procedure (called ,,RankLasso") and extend the scope of its applications by proposing its thresholded and adaptive versions. Our theoretical results show that these modifications can identify the set of relevant predictors under much wider range of data generating scenarios than regular RankLasso. Theoretical results are supported by the simulation study and the real data analysis, which show that our methods can properly identify relevant predictors, even when the error terms come from the Cauchy distribution and the link function is nonlinear. They also demonstrate the superiority of the modified versions of RankLasso in the case when predictors are substantially correlated. The numerical study shows also that RankLasso performs substantially better in model selection than LADLasso, which is a well established methodology for robust model selection.


title: Extraction and Analysis of Clinically Important Follow-up Recommendations in a Large Radiology Dataset

abstract: Communication of follow-up recommendations when abnormalities are identified on imaging studies is prone to error. In this paper, we present a natural language processing approach based on deep learning to automatically identify clinically important recommendations in radiology reports. Our approach first identifies the recommendation sentences and then extracts reason, test, and time frame of the identified recommendations. To train our extraction models, we created a corpus of 567 radiology reports annotated for recommendation information. Our extraction models achieved 0.92 f-score for recommendation sentence, 0.65 f-score for reason, 0.73 f-score for test, and 0.84 f-score for time frame. We applied the extraction models to a set of over 3.3 million radiology reports and analyzed the adherence of follow-up recommendations.


title: On the isometric conjecture of Banach

abstract: Let $V$ be a Banach space where for fixed $n$, $1<n<\dim(V)$, all of its $n$-dimensional subspaces are isometric. In 1932, Banach asked if under this hypothesis $V$ is necessarily a Hilbert space. Gromov, in 1967, answered it positively for even $n$ and all $V$. In this paper we give a positive answer for real $V$ and odd $n$ of the form $n=4k+1$, with the possible exception of $n=133.$ Our proof relies on a new characterization of ellipsoids in ${\mathbb{R}}^n$, $n\geq 5$, as the only symmetric convex bodies all of whose linear hyperplane sections are linearly equivalent affine bodies of revolution.


title: AUTOVC: Zero-Shot Voice Style Transfer with Only Autoencoder Loss

abstract: Non-parallel many-to-many voice conversion, as well as zero-shot voice conversion, remain under-explored areas. Deep style transfer algorithms, such as generative adversarial networks (GAN) and conditional variational autoencoder (CVAE), are being applied as new solutions in this field. However, GAN training is sophisticated and difficult, and there is no strong evidence that its generated speech is of good perceptual quality. On the other hand, CVAE training is simple but does not come with the distribution-matching property of a GAN. In this paper, we propose a new style transfer scheme that involves only an autoencoder with a carefully designed bottleneck. We formally show that this scheme can achieve distribution-matching style transfer by training only on a self-reconstruction loss. Based on this scheme, we proposed AUTOVC, which achieves state-of-the-art results in many-to-many voice conversion with non-parallel data, and which is the first to perform zero-shot voice conversion.


title: Budget-aware Semi-Supervised Semantic and Instance Segmentation

abstract: Methods that move towards less supervised scenarios are key for image segmentation, as dense labels demand significant human intervention. Generally, the annotation burden is mitigated by labeling datasets with weaker forms of supervision, e.g. image-level labels or bounding boxes. Another option are semi-supervised settings, that commonly leverage a few strong annotations and a huge number of unlabeled/weakly-labeled data. In this paper, we revisit semi-supervised segmentation schemes and narrow down significantly the annotation budget (in terms of total labeling time of the training set) compared to previous approaches. With a very simple pipeline, we demonstrate that at low annotation budgets, semi-supervised methods outperform by a wide margin weakly-supervised ones for both semantic and instance segmentation. Our approach also outperforms previous semi-supervised works at a much reduced labeling cost. We present results for the Pascal VOC benchmark and unify weakly and semi-supervised approaches by considering the total annotation budget, thus allowing a fairer comparison between methods.


title: Resource-aware Elastic Swap Random Forest for Evolving Data Streams

abstract: Continual learning based on data stream mining deals with ubiquitous sources of Big Data arriving at high-velocity and in real-time. Adaptive Random Forest ({\em ARF}) is a popular ensemble method used for continual learning due to its simplicity in combining adaptive leveraging bagging with fast random Hoeffding trees. While the default ARF size provides competitive accuracy, it is usually over-provisioned resulting in the use of additional classifiers that only contribute to increasing CPU and memory consumption with marginal impact in the overall accuracy. This paper presents Elastic Swap Random Forest ({\em ESRF}), a method for reducing the number of trees in the ARF ensemble while providing similar accuracy. {\em ESRF} extends {\em ARF} with two orthogonal components: 1) a swap component that splits learners into two sets based on their accuracy (only classifiers with the highest accuracy are used to make predictions); and 2) an elastic component for dynamically increasing or decreasing the number of classifiers in the ensemble. The experimental evaluation of {\em ESRF} and comparison with the original {\em ARF} shows how the two new components contribute to reducing the number of classifiers up to one third while providing almost the same accuracy, resulting in speed-ups in terms of per-sample execution time close to 3x.


title: Kernel Mean Matching for Content Addressability of GANs

abstract: We propose a novel procedure which adds "content-addressability" to any given unconditional implicit model e.g., a generative adversarial network (GAN). The procedure allows users to control the generative process by specifying a set (arbitrary size) of desired examples based on which similar samples are generated from the model. The proposed approach, based on kernel mean matching, is applicable to any generative models which transform latent vectors to samples, and does not require retraining of the model. Experiments on various high-dimensional image generation problems (CelebA-HQ, LSUN bedroom, bridge, tower) show that our approach is able to generate images which are consistent with the input set, while retaining the image quality of the original model. To our knowledge, this is the first work that attempts to construct, at test time, a content-addressable generative model from a trained marginal model.


title: Entanglement of indistinguishable particles: a comparative study

abstract: There is a debate in course about the quantification of entanglement of indistinguishable particles and recently a new method due to Lo Franco and Compagno (LFC) [Sci. Rep. \textbf{6}, 20603 (2016)] appeared with the aim of settling the controversies of this debate. In this work we show that the LFC approach can be recovered using the second quantization formalism and a local single-particle basis to perform the trace over one particle state. The use of the second quantization formalism has the advantage of being well known in many-body physics. We also compare the LFC and second quantization approaches, or equivalently, the effect of the partial trace over one particle depending on the local and nonlocal caracter of the single-particle basis. Additionally, we study the role played by the exchange correlations in the quantification of entanglement of indistinguishable particles.


title: Approximate Bayesian computation via the energy statistic

abstract: Approximate Bayesian computation (ABC) has become an essential part of the Bayesian toolbox for addressing problems in which the likelihood is prohibitively expensive or entirely unknown, making it intractable. ABC defines a pseudo-posterior by comparing observed data with simulated data, traditionally based on some summary statistics, the elicitation of which is regarded as a key difficulty. Recently, using data discrepancy measures has been proposed in order to bypass the construction of summary statistics. Here we propose to use the importance-sampling ABC (IS-ABC) algorithm relying on the so-called two-sample energy statistic. We establish a new asymptotic result for the case where both the observed sample size and the simulated data sample size increase to infinity, which highlights to what extent the data discrepancy measure impacts the asymptotic pseudo-posterior. The result holds in the broad setting of IS-ABC methodologies, thus generalizing previous results that have been established only for rejection ABC algorithms. Furthermore, we propose a consistent V-statistic estimator of the energy statistic, under which we show that the large sample result holds, and prove that the rejection ABC algorithm, based on the energy statistic, generates pseudo-posterior distributions that achieves convergence to the correct limits, when implemented with rejection thresholds that converge to zero, in the finite sample setting. Our proposed energy statistic based ABC algorithm is demonstrated on a variety of models, including a Gaussian mixture, a moving-average model of order two, a bivariate beta and a multivariate $g$-and-$k$ distribution. We find that our proposed method compares well with alternative discrepancy measures.


title: Diagonal Acceleration for Covariance Matrix Adaptation Evolution Strategies

abstract: We introduce an acceleration for covariance matrix adaptation evolution strategies (CMA-ES) by means of adaptive diagonal decoding (dd-CMA). This diagonal acceleration endows the default CMA-ES with the advantages of separable CMA-ES without inheriting its drawbacks. Technically, we introduce a diagonal matrix D that expresses coordinate-wise variances of the sampling distribution in DCD form. The diagonal matrix can learn a rescaling of the problem in the coordinates within linear number of function evaluations. Diagonal decoding can also exploit separability of the problem, but, crucially, does not compromise the performance on non-separable problems. The latter is accomplished by modulating the learning rate for the diagonal matrix based on the condition number of the underlying correlation matrix. dd-CMA-ES not only combines the advantages of default and separable CMA-ES, but may achieve overadditive speedup: it improves the performance, and even the scaling, of the better of default and separable CMA-ES on classes of non-separable test functions that reflect, arguably, a landscape feature commonly observed in practice. The paper makes two further secondary contributions: we introduce two different approaches to guarantee positive definiteness of the covariance matrix with active CMA, which is valuable in particular with large population size; we revise the default parameter setting in CMA-ES, proposing accelerated settings in particular for large dimension. All our contributions can be viewed as independent improvements of CMA-ES, yet they are also complementary and can be seamlessly combined. In numerical experiments with dd-CMA-ES up to dimension 5120, we observe remarkable improvements over the original covariance matrix adaptation on functions with coordinate-wise ill-conditioning. The improvement is observed also for large population sizes up to about dimension squared.


title: Factorizations of skew braces

abstract: We introduce strong left ideals of skew braces and prove that they produce non-trivial decomposition of set-theoretic solutions of the Yang-Baxter equation. We study factorization of skew left braces through strong left ideals and we prove analogs of It\^{o}'s theorem in the context of skew left braces. As a corollary, we obtain applications to the retractability problem of involutive non-degenerate solutions of the Yang-Baxter equation. Finally, we classify skew braces that contain no non-trivial proper ideals.


title: Search by Lackadaisical Quantum Walk with Nonhomogeneous Weights

abstract: The lackadaisical quantum walk, which is a quantum walk with a weighted self-loop at each vertex, has been shown to speed up dispersion on the line and improve spatial search on the complete graph and periodic square lattice. In these investigations, each self-loop had the same weight, owing to each graph's vertex-transitivity. In this paper, we propose lackadaisical quantum walks where the self-loops have different weights. We investigate spatial search on the complete bipartite graph, which can be irregular with $N_1$ and $N_2$ vertices in each partite set, and this naturally leads to self-loops in each partite set having different weights $l_1$ and $l_2$, respectively. We analytically prove that for large $N_1$ and $N_2$, if the $k$ marked vertices are confined to, say, the first partite set, then with the typical initial uniform state over the vertices, the success probability is improved from its non-lackadaisical value when $l_1 = kN_2/2N_1$ and $N_2 > (3 - 2\sqrt{2}) N_1$, regardless of $l_2$. When the initial state is stationary under the quantum walk, however, then the success probability is improved when $l_1 = kN_2/2N_1$, now without a constraint on the ratio of $N_1$ and $N_2$, and again independent of $l_2$. Next, when marked vertices lie in both partite sets, then for either initial state, there are many configurations for which the self-loops yield no improvement in quantum search, no matter what weights they take.


title: Generative Design in Minecraft: Chronicle Challenge

abstract: We introduce the Chronicle Challenge as an optional addition to the Settlement Generation Challenge in Minecraft. One of the foci of the overall competition is adaptive procedural content generation (PCG), an arguably under-explored problem in computational creativity. In the base challenge, participants must generate new settlements that respond to and ideally interact with existing content in the world, such as the landscape or climate. The goal is to understand the underlying creative process, and to design better PCG systems. The Chronicle Challenge in particular focuses on the generation of a narrative based on the history of a generated settlement, expressed in natural language. We discuss the unique features of the Chronicle Challenge in comparison to other competitions, clarify the characteristics of a chronicle eligible for submission and describe the evaluation criteria. We furthermore draw on simulation-based approaches in computational storytelling as examples to how this challenge could be approached.


title: DARNet: Deep Active Ray Network for Building Segmentation

abstract: In this paper, we propose a Deep Active Ray Network (DARNet) for automatic building segmentation. Taking an image as input, it first exploits a deep convolutional neural network (CNN) as the backbone to predict energy maps, which are further utilized to construct an energy function. A polygon-based contour is then evolved via minimizing the energy function, of which the minimum defines the final segmentation. Instead of parameterizing the contour using Euclidean coordinates, we adopt polar coordinates, i.e., rays, which not only prevents self-intersection but also simplifies the design of the energy function. Moreover, we propose a loss function that directly encourages the contours to match building boundaries. Our DARNet is trained end-to-end by back-propagating through the energy minimization and the backbone CNN, which makes the CNN adapt to the dynamics of the contour evolution. Experiments on three building instance segmentation datasets demonstrate our DARNet achieves either state-of-the-art or comparable performances to other competitors.


title: Optical excitation of surface plasmons and terahertz emission from metals

abstract: We propose a microscopic theory of terahertz (THz) radiation generation on metal gratings under the action of femtosecond laser pulses. In contrast to previous models, only low-frequency currents inside the metal are considered without involving electron emission. The presented model is based on plasmon-enhanced thermal effects and explains the resonant character of optical-to-THz conversion giving an adequate estimation for the full signal energy. Numerical modeling reproduces specific experimental features like delayed character of THz response and low conversion efficiency when the grating depth is too large.


title: Crowd Density Estimation using Novel Feature Descriptor

abstract: Crowd density estimation is an important task for crowd monitoring. Many efforts have been done to automate the process of estimating crowd density from images and videos. Despite series of efforts, it remains a challenging task. In this paper, we proposes a new texture feature-based approach for the estimation of crowd density based on Completed Local Binary Pattern (CLBP). We first divide the image into blocks and then re-divide the blocks into cells. For each cell, we compute CLBP and then concatenate them to describe the texture of the corresponding block. We then train a multi-class Support Vector Machine (SVM) classifier, which classifies each block of image into one of four categories, i.e. Very Low, Low, Medium, and High. We evaluate our technique on the PETS 2009 dataset, and from the experiments, we show to achieve 95% accuracy for the proposed descriptor. We also compare other state-of-the-art texture descriptors and from the experimental results, we show that our proposed method outperforms other state-of-the-art methods.


title: Pareto-Optimal Allocation of Transactive Energy at Market Equilibrium in Distribution Systems: A Constrained Vector Optimization Approach

abstract: In a grid constrained transactive distribution system market, distribution locational marginal pricing DLMP is influenced by the distance from the substation to an energy user, thereby causing households that are further away from the substation to be charged more. The Jain index of fairness, which has been recently applied to alleviate this undesirable effect of inefficient energy allocations, is used in this research to quantify fairness. It is shown that the Jain index is strictly quasi-concave. A bilevel distributed mechanism is proposed, where at the lower level, auction mechanisms are invoked simultaneously at each aggregator to obtain energy costs under market equilibrium conditions. A constrained multi gradient ascent algorithm, Augmented Lagrangian Multigradient Approach ALMA, is proposed for implementation at the upper level to attain energy allocations that represent tradeoffs between efficiency and fairness. Theoretical issues pertaining to ALMA as a generic algorithm for constrained vector optimization are considered. It is shown that when the objectives are restricted to be strictly quasi concave functions and if the feasible region is convex, ALMA converges towards global Pareto optimality. The overall effectiveness of the proposed approach is confirmed through a set of MATLAB simulations implemented on a modified IEEE 37-bus system platform.


title: The Experimental Realization of an Artificial Low-Reynolds-Number Swimmer with Three-Dimensional Maneuverability

abstract: The motion of biological micro-robots -- similar to that of swimming microorganisms such as bacteria or spermatozoa -- is governed by different physical rules than what we experience in our daily life. This is particularly due to the low-Reynolds-number condition of swimmers in micron scales. The Quadroar swimmer, with three-dimensional maneuverability, has been introduced for moving in these extreme cases: either as a bio-medical micro-robot swimming in biological fluids or a mm-scale robot performing inspection missions in highly viscous fluid reservoirs. Our previous studies address the theoretical modeling of this type of swimmer system. In this work, we present the mechatronic design, fabrication, and experimental study of a mm-scale Quadroar swimmer. We describe the design methodology and component selection of the system based on the required performance. A supervisory control scheme is presented to achieve an accurate trajectory tracking for all the actuators used in the swimmer. Finally, we have conducted experiments in silicone oil (with 5000 cP viscosity) where two primary modes of swimming - forward translation and planar reorientation - have been tested and compared with the theoretical model.


title: Online Normalization for Training Neural Networks

abstract: Online Normalization is a new technique for normalizing the hidden activations of a neural network. Like Batch Normalization, it normalizes the sample dimension. While Online Normalization does not use batches, it is as accurate as Batch Normalization. We resolve a theoretical limitation of Batch Normalization by introducing an unbiased technique for computing the gradient of normalized activations. Online Normalization works with automatic differentiation by adding statistical normalization as a primitive. This technique can be used in cases not covered by some other normalizers, such as recurrent networks, fully connected networks, and networks with activation memory requirements prohibitive for batching. We show its applications to image classification, image segmentation, and language modeling. We present formal proofs and experimental results on ImageNet, CIFAR, and PTB datasets.


title: Addressing the Loss-Metric Mismatch with Adaptive Loss Alignment

abstract: In most machine learning training paradigms a fixed, often handcrafted, loss function is assumed to be a good proxy for an underlying evaluation metric. In this work we assess this assumption by meta-learning an adaptive loss function to directly optimize the evaluation metric. We propose a sample efficient reinforcement learning approach for adapting the loss dynamically during training. We empirically show how this formulation improves performance by simultaneously optimizing the evaluation metric and smoothing the loss landscape. We verify our method in metric learning and classification scenarios, showing considerable improvements over the state-of-the-art on a diverse set of tasks. Importantly, our method is applicable to a wide range of loss functions and evaluation metrics. Furthermore, the learned policies are transferable across tasks and data, demonstrating the versatility of the method.


title: Threats on Logic Locking: A Decade Later

abstract: To reduce the cost of ICs and to meet the market's demand, a considerable portion of manufacturing supply chain, including silicon fabrication, packaging and testing may be pushed offshore. Utilizing a global IC manufacturing supply chain, and inclusion of non-trusted parties in the supply chain has raised concerns over security and trust related challenges including those of overproduction, counterfeiting, IP piracy, and Hardware Trojans to name a few. To reduce the risk of IC manufacturing in an untrusted and globally distributed supply chain, the researchers have proposed various locking and obfuscation mechanisms for hiding the functionality of the ICs during the manufacturing, that requires the activation of the IP after fabrication using the key value(s) that is only known to the IP/IC owner. At the same time, many such proposed obfuscation and locking mechanisms are broken with attacks that exploit the inherent vulnerabilities in such solutions. The past decade of research in this area, has resulted in many such defense and attack solutions. In this paper, we review a decade of research on hardware obfuscation from an attacker perspective, elaborate on attack and defense lessons learned, and discuss future directions that could be exploited for building stronger defenses.


title: Transferable Clean-Label Poisoning Attacks on Deep Neural Nets

abstract: Clean-label poisoning attacks inject innocuous looking (and "correctly" labeled) poison images into training data, causing a model to misclassify a targeted image after being trained on this data. We consider transferable poisoning attacks that succeed without access to the victim network's outputs, architecture, or (in some cases) training data. To achieve this, we propose a new "polytope attack" in which poison images are designed to surround the targeted image in feature space. We also demonstrate that using Dropout during poison creation helps to enhance transferability of this attack. We achieve transferable attack success rates of over 50% while poisoning only 1% of the training set.


title: Compact Sets of Baire Class One Functions and Maximal Almost Disjoint Families

abstract: We provide a proof that analytic almost disjoint families of infinite sets of integers cannot be maximal using a result of Bourgain about compact sets of Baire class one functions. Inspired by this and related ideas, we then provide a new proof of that there are no maximal almost disjoint families in Solovay's model. We then use the ideas behind this proof to provide an extension of a dichotomy result by Rosenthal and by Bourgain, Fremlin and Talagrand to general pointwise bounded functions in Solovay's model. We then show that the same conclusions can be drawn about the model obtained when we add a generic selective ultrafilter to the Solovay model.


title: Electronic structure of Bi2Te3/FeTe heterostructure: implications for unconventional superconductivity

abstract: We have performed angle-resolved photoemission spectroscopy on a heterostructure consisting of topological insulator Bi2Te3 and iron chalcogenide FeTe fabricated on SrTiO3 substrate by molecular-beam-epitaxy technique. This system was recently found to show superconductivity albeit non-superconducting nature of each constituent material. Upon interfacing FeTe with two quintuple layers of Bi2Te3, we found that the Dirac-cone surface state of Bi2Te3 is shifted toward higher binding energy, while the holelike band at the Fermi level originating from FeTe moves toward lower binding energy. This suggests that electron charge transfer takes place from FeTe to Bi2Te3 through the interface. The present result points to importance of hole-doped FeTe interface for the occurrence of unconventional superconductivity.


title: Kepler Planet Occurrence Rates for Mid-Type M Dwarfs as a Function of Spectral Type

abstract: Previous studies of planet occurrence rates largely relied on photometric stellar characterizations. In this paper, we present planet occurrence rates for mid-type M dwarfs using spectroscopy, parallaxes, and photometry to determine stellar characteristics. Our spectroscopic observations have allowed us to constrain spectral type, temperatures, and in some cases metallicities for 337 out of 561 probable mid-type M dwarfs in the primary Kepler field. We use a random forest classifier to assign a spectral type to the remaining 224 stars. Combining our data with Gaia parallaxes, we compute precise ($\sim$3%) stellar radii and masses, which we use to update planet parameters and planet occurrence rates for Kepler mid-type M dwarfs. Within the Kepler field, there are seven M3 V to M5 V stars which host 13 confirmed planets between 0.5 and 2.5 Earth radii and at orbital periods between 0.5 and 10 days. For this population, we compute a planet occurrence rate of $1.19^{+0.70}_{-0.49}$ planets per star. For M3 V, M4 V, and M5 V, we compute planet occurrence rates of $0.86^{+1.32}_{-0.68}$, $1.36^{+2.30}_{-1.02}$, and $3.07^{+5.49}_{-2.49}$ planets per star, respectively.


title: Learning What and Where to Transfer

abstract: As the application of deep learning has expanded to real-world problems with insufficient volume of training data, transfer learning recently has gained much attention as means of improving the performance in such small-data regime. However, when existing methods are applied between heterogeneous architectures and tasks, it becomes more important to manage their detailed configurations and often requires exhaustive tuning on them for the desired performance. To address the issue, we propose a novel transfer learning approach based on meta-learning that can automatically learn what knowledge to transfer from the source network to where in the target network. Given source and target networks, we propose an efficient training scheme to learn meta-networks that decide (a) which pairs of layers between the source and target networks should be matched for knowledge transfer and (b) which features and how much knowledge from each feature should be transferred. We validate our meta-transfer approach against recent transfer learning methods on various datasets and network architectures, on which our automated scheme significantly outperforms the prior baselines that find "what and where to transfer" in a hand-crafted manner.


title: Pin TQFT and Grassmann integral

abstract: We discuss a recipe to produce a lattice construction of fermionic phases of matter on unoriented manifolds. This is performed by extending the construction of spin TQFT via the Grassmann integral proposed by Gaiotto and Kapustin, to the unoriented pin$_\pm$ case. As an application, we construct gapped boundaries for time-reversal-invariant Gu-Wen fermionic SPT phases. In addition, we provide a lattice definition of (1+1)d pin$_-$ invertible theory whose partition function is the Arf-Brown-Kervaire invariant, which generates the $\mathbb{Z}_8$ classification of (1+1)d topological superconductors. We also compute the indicator formula of $\mathbb{Z}_{16}$ valued time-reversal anomaly for (2+1)d pin$_+$ TQFT based on our construction.


title: A tunable ferroelectric based unreleased RF resonator

abstract: This paper introduces the first tunable ferroelectric capacitor (FeCAP) based unreleased RF MEMS resonator, integrated seamlessly in Texas Instruments' 130nm Ferroelectric RAM (FeRAM) technology. An array of FeCAPs in this complementary metal-oxide-semiconductor (CMOS) technology's back-end-of-line (BEOL) process were used to define the acoustic resonance cavity as well as the electromechanical transducers. To achieve high quality factor (Q) of the resonator, acoustic waveguiding for vertical confinement within the CMOS stack is studied and optimized. Additional design considerations are discussed to obtain lateral confinement and suppression of spurious modes. An FeCAP resonator is demonstrated with fundamental resonance at 703 MHz and Q of 1012. This gives a frequency quality factor product fQ = 7.11$\times$10$^1$$^1$ which is 1.6$\times$ higher than the most state-of-the-art Pb(Zr,Ti)O$_3$ (PZT) resonators. Due to the ferroelectric characteristics of the FeCAPs, transduction of the resonator can be switched on and off by adjusting the electric polarization. In this case, the resonance can be turned off completely at $\pm$0.3V corresponding to the coercive voltage of the constituent FeCAP transducers. These novel switchable resonators may have promising applications in on-chip timing, ad-hoc radio front ends, and chip-scale sensors.


title: Indicating Asynchronous Array Multipliers

abstract: Multiplication is an important arithmetic operation that is frequently encountered in microprocessing and digital signal processing applications, and multiplication is physically realized using a multiplier. This paper discusses the physical implementation of many indicating asynchronous array multipliers, which are inherently elastic and modular and are robust to timing, process and parametric variations. We consider the physical realization of many indicating asynchronous array multipliers using a 32/28nm CMOS technology. The weak-indication array multipliers comprise strong-indication or weak-indication full adders, and strong-indication 2-input AND functions to realize the partial products. The multipliers were synthesized in a semi-custom ASIC design style using standard library cells including a custom-designed 2-input C-element. 4x4 and 8x8 multiplication operations were considered for the physical implementations. The 4-phase return-to-zero (RTZ) and the 4-phase return-to-one (RTO) handshake protocols were utilized for data communication, and the delay-insensitive dual-rail code was used for data encoding. Among several weak-indication array multipliers, a weak-indication array multiplier utilizing a biased weak-indication full adder and the strong-indication 2-input AND function is found to have reduced cycle time and power-cycle time product with respect to RTZ and RTO handshaking for 4x4 and 8x8 multiplications. Further, the 4-phase RTO handshaking is found to be preferable to the 4-phase RTZ handshaking for achieving enhanced optimizations of the design metrics.


title: Polarization of Astrophysical Events with Precessing Jets

abstract: A central compact object (CCO, e.g. a black hole) with an accretion disk has been suggested as the common central engine of various astrophysical phenomena, such as gamma-ray bursts (GRBs), tidal disruption events (TDEs) and active galactic nuclei (AGNs). A jet powered by such a system might precess due to the misalignment of the angular momenta of the CCO and accretion disk. Some quasi-periodic behaviors observed in the light curves of these phenomena can be well interpreted within the framework of a precessing jet model. In this paper, we study the emission polarization of precessing jets in the three kinds of phenomena. The polarization angle also shows a gradual change for the synchrotron emission in both the random and toroidal magnetic field configurations with the precessing jet, while it can only change abruptly by $90^\circ$ for the non-precessing top-hat jet. Polarization properties are periodic due to the assumptions made in our model. The polarization observations are crucial to confirm the precession nature of jets in GRBs, TDEs and AGNs.


title: Time-Varying Downlink Channel Tracking for Quantized Massive MIMO Networks

abstract: This paper proposes a Bayesian downlink channel estimation algorithm for time-varying massive MIMO networks. In particular, the quantization effects at the receiver are considered. In order to fully exploit the sparsity and time correlations of channels, we formulate the time-varying massive MIMO channel as the simultaneously sparse signal model. Then, we propose a sparse Bayesian learning (SBL) framework to learn the model parameters of the sparse virtual channel. To reduce complexity, we employ the expectation maximization (EM) algorithm to achieve the approximated solution. Specifically, the factor graph and the general approximate message passing (GAMP) algorithms are used to compute the desired posterior statistics in the expectation step, so that high-dimensional integrals over the marginal distributions can be avoided. The non-zero supporting vector of a virtual channel is then obtained from channel statistics by a k-means clustering algorithm. After that, the reduced dimensional GAMP based scheme is applied to make the full use of the channel temporal correlation so as to enhance the virtual channel tracking accuracy. Finally, we demonstrate the efficacy of the proposed schemes through simulations.


title: Roles of crust and core in the tidal deformability of neutron stars

abstract: With the recent measurement of GW170817 providing constraints on the tidal deformability of a neutron star, it is very important to understand what features of the equation of state have the biggest effect on it. We therefore study the contribution of the crust to the tidal deformability and the moment of inertia of a neutron star for a variety of well-known equations of state. It is found that the contributions to these quantities from the low density crust are typically quite small and as a result the determination of the tidal deformability provides an important constraint on the equation of state of dense matter.


title: Task-Driven Modular Networks for Zero-Shot Compositional Learning

abstract: One of the hallmarks of human intelligence is the ability to compose learned knowledge into novel concepts which can be recognized without a single training example. In contrast, current state-of-the-art methods require hundreds of training examples for each possible category to build reliable and accurate classifiers. To alleviate this striking difference in efficiency, we propose a task-driven modular architecture for compositional reasoning and sample efficient learning. Our architecture consists of a set of neural network modules, which are small fully connected layers operating in semantic concept space. These modules are configured through a gating function conditioned on the task to produce features representing the compatibility between the input image and the concept under consideration. This enables us to express tasks as a combination of sub-tasks and to generalize to unseen categories by reweighting a set of small modules. Furthermore, the network can be trained efficiently as it is fully differentiable and its modules operate on small sub-spaces. We focus our study on the problem of compositional zero-shot classification of object-attribute categories. We show in our experiments that current evaluation metrics are flawed as they only consider unseen object-attribute pairs. When extending the evaluation to the generalized setting which accounts also for pairs seen during training, we discover that naive baseline methods perform similarly or better than current approaches. However, our modular network is able to outperform all existing approaches on two widely-used benchmark datasets.


title: Proceedings ML Family / OCaml Users and Developers workshops

abstract: This volume contains the joint post-proceedings of the 2017 editions of the ML Family Workshop and the OCaml Users and Developers Workshop which took place in Oxford, UK, September 2017, and which were colocated with the ICFP 2017 conference.


title: Passage Ranking with Weak Supervision

abstract: In this paper, we propose a \textit{weak supervision} framework for neural ranking tasks based on the data programming paradigm \citep{Ratner2016}, which enables us to leverage multiple weak supervision signals from different sources. Empirically, we consider two sources of weak supervision signals, unsupervised ranking functions and semantic feature similarities. We train a BERT-based passage-ranking model (which achieves new state-of-the-art performances on two benchmark datasets with full supervision) in our weak supervision framework. Without using ground-truth training labels, BERT-PR models outperform BM25 baseline by a large margin on all three datasets and even beat the previous state-of-the-art results with full supervision on two of the datasets.


title: Reduced Form Capital Optimization

abstract: We formulate banks' capital optimization problem as a classic mean variance optimization, by leveraging an accurate linear approximation to the Shapely or Constrained Aumann-Shapley (CAS) allocation of max or nested max cost functions. This reduced form formulation admits an analytical solution, to the optimal leveraged balance sheet (LBS) and risk weighted assets (RWA) target of banks' business units for achieving the best return on capital.


title: Multi-Scale Theory of Elasticity for Geomaterials

abstract: The modern theory of elasticity and the first law of thermodynamics are cornerstones of engineering science that share the concept of reversibility. Engineering researchers have known for four decades that the modern theory violates the first law of thermodynamics when applied to the more commonly accepted empirical models of geomaterial stiffness. This paper develops a cross-scale theory of elasticity that is compatible with the empirical models and the first law of thermodynamics. This theory includes a material sample's total-volume to solid-volume ratio as an independent internal variable, distinguishes deformation into uniform and contraction-swelling components, introduces a uniformity surface that partitions stress space into contraction and swelling sub-domains, couples the macroscopic properties to the volume ratio and extrapolates the accepted empirical models to states that include shear stress. This paper broadens the scope of the theory of elasticity to include soft condensed matter.


title: Structural Color 3D Printing By Shrinking Photonic Crystals

abstract: The rings, spots and stripes found on some butterflies, Pachyrhynchus weevils, and many chameleons are notable examples of natural organisms employing photonic crystals to produce colorful patterns. Despite advances in nanotechnology, we still lack the ability to print arbitrary colors and shapes in all three dimensions at this microscopic length scale. Commercial nanoscale 3D printers based on two-photon polymerization are incapable of patterning photonic crystal structures with the requisite ~300 nm lattice constant to achieve photonic stopbands/ bandgaps in the visible spectrum and generate colors. Here, we introduce a means to produce 3D-printed photonic crystals with a 5x reduction in lattice constants (periodicity as small as 280 nm), achieving sub-100-nm features with a full range of colors. The reliability of this process enables us to engineer the bandstructures of woodpile photonic crystals that match experiments, showing that observed colors can be attributed to either slow light modes or stopbands. With these lattice structures as 3D color volumetric elements (voxels), we printed 3D microscopic scale objects, including the first multi-color microscopic model of the Eiffel Tower measuring only 39-microns tall with a color pixel size of 1.45 microns. The technology to print 3D structures in color at the microscopic scale promises the direct patterning and integration of spectrally selective devices, such as photonic crystal-based color filters, onto free-form optical elements and curved surfaces.


title: Deep Reinforcement Learning for Scheduling in Cellular Networks

abstract: Integrating artificial intelligence (AI) into wireless networks has drawn significant interest in both industry and academia. A common solution is to replace partial or even all modules in the conventional systems, which is often lack of efficiency and robustness due to their ignoring of expert knowledge. In this paper, we take deep reinforcement learning (DRL) based scheduling as an example to investigate how expert knowledge can help with AI module in cellular networks. A simulation platform, which has considered link adaption, feedback and other practical mechanisms, is developed to facilitate the investigation. Besides the traditional way, which is learning directly from the environment, for training DRL agent, we propose two novel methods, i.e., learning from a dual AI module and learning from the expert solution. The results show that, for the considering scheduling problem, DRL training procedure can be improved on both performance and convergence speed by involving the expert knowledge. Hence, instead of replacing conventional scheduling module in the system, adding a newly introduced AI module, which is capable to interact with the conventional module and provide more flexibility, is a more feasible solution.


title: Lijiang 2.4-meter Telescope and its Instruments

abstract: Lijiang 2.4-meter Telescope(LJT), the largest common-purpose optical telescope in China, has been applied to the world-wide astronomers since 2008. It is located at Gaomeigu site, Lijiang Observatory(LJO), the southwest of China. The site has very good observational conditions. Since 10-year operation, several instruments have been equipped on the LJT. Astronomers can perform both photometric and spectral observations. The main scientific goals of LJT include photometric and spectral evolution of supernova, reverberation mapping of active galactic nucleus, physical properties of binary star and near-earth object(comet and asteroid), identification of exoplanet, and all kinds of transients. Until now, the masses of 41 high accretion rate black holes have been measured, and more than 168 supernova have been identified by the LJT. More than 190 papers related to the LJT have been published. In this paper, the general observation condition of the Gaomeigu site is introduced at first. Then, the LJT structure is described in detail, including the optical, mechanical, motion and control system. The specification of all the instruments, and some detailed parameters of the YFOSC is also presented. Finally, some important scientific results and future expectations are summarized.


title: Unsupervised Deep Contrast Enhancement with Power Constraint for OLED Displays

abstract: Various power-constrained contrast enhancement (PCCE) techniques have been applied to an organic light emitting diode (OLED) display for reducing the power demands of the display while preserving the image quality. In this paper, we propose a new deep learning-based PCCE scheme that constrains the power consumption of the OLED displays while enhancing the contrast of the displayed image. In the proposed method, the power consumption is constrained by simply reducing the brightness a certain ratio, whereas the perceived visual quality is preserved as much as possible by enhancing the contrast of the image using a convolutional neural network (CNN). Furthermore, our CNN can learn the PCCE technique without a reference image by unsupervised learning. Experimental results show that the proposed method is superior to conventional ones in terms of image quality assessment metrics such as a visual saliency-induced index (VSI) and a measure of enhancement (EME).


title: Adaptivity and Optimality: A Universal Algorithm for Online Convex Optimization

abstract: In this paper, we study adaptive online convex optimization, and aim to design a universal algorithm that achieves optimal regret bounds for multiple common types of loss functions. Existing universal methods are limited in the sense that they are optimal for only a subclass of loss functions. To address this limitation, we propose a novel online method, namely Maler, which enjoys the optimal $O(\sqrt{T})$, $O(d\log T)$ and $O(\log T)$ regret bounds for general convex, exponentially concave, and strongly convex functions respectively. The essential idea is to run multiple types of learning algorithms with different learning rates in parallel, and utilize a meta algorithm to track the best one on the fly. Empirical results demonstrate the effectiveness of our method.


title: A Neural Network-Evolutionary Computational Framework for Remaining Useful Life Estimation of Mechanical Systems

abstract: This paper presents a framework for estimating the remaining useful life (RUL) of mechanical systems. The framework consists of a multi-layer perceptron and an evolutionary algorithm for optimizing the data-related parameters. The framework makes use of a strided time window to estimate the RUL for mechanical components. Tuning the data-related parameters can become a very time consuming task. The framework presented here automatically reshapes the data such that the efficiency of the model is increased. Furthermore, the complexity of the model is kept low, e.g. neural networks with few hidden layers and few neurons at each layer. Having simple models has several advantages like short training times and the capacity of being in environments with limited computational resources such as embedded systems. The proposed method is evaluated on the publicly available C-MAPSS dataset, its accuracy is compared against other state-of-the art methods for the same dataset.


title: In-Plane Magnetic-Field-Induced Quantum Anomalous Hall Plateau Transition

abstract: We study the critical properties of the in-plane magnetic field-induced quantum anomalous Hall (QAH) plateau transition in axion insulators. Take even septuple layer film MnBi$_2$Te$_4$ as a concrete example, we find the mirror symmetry breaking from in-plane field could induce axion insulator to QAH insulator transition, which belongs to generic integer quantum Hall plateau transition. The chiral Majorana fermion does not necessarily emerge at the QAH plateau transition in MnBi$_2$Te$_4$ due to strong exchange field, but may be quite feasible in its descendent materials MnBi$_4$Te$_7$ and MnBi$_6$Te$_{10}$.


title: Hybrid Stochastic Gradient Descent Algorithms for Stochastic Nonconvex Optimization

abstract: We introduce a hybrid stochastic estimator to design stochastic gradient algorithms for solving stochastic optimization problems. Such a hybrid estimator is a convex combination of two existing biased and unbiased estimators and leads to some useful property on its variance. We limit our consideration to a hybrid SARAH-SGD for nonconvex expectation problems. However, our idea can be extended to handle a broader class of estimators in both convex and nonconvex settings. We propose a new single-loop stochastic gradient descent algorithm that can achieve $O(\max\{\sigma^3\varepsilon^{-1},\sigma\varepsilon^{-3}\})$-complexity bound to obtain an $\varepsilon$-stationary point under smoothness and $\sigma^2$-bounded variance assumptions. This complexity is better than $O(\sigma^2\varepsilon^{-4})$ often obtained in state-of-the-art SGDs when $\sigma < O(\varepsilon^{-3})$. We also consider different extensions of our method, including constant and adaptive step-size with single-loop, double-loop, and mini-batch variants. We compare our algorithms with existing methods on several datasets using two nonconvex models.


title: A Modified Mixed Domain Method for Modeling Acoustic Wave Propagation in Strongly Heterogeneous Media

abstract: In this paper, phase correction and amplitude compensation are introduced to a previously developed mixed domain method (MDM), which is only accurate for modeling wave propagation in weakly heterogeneous media. Multiple reflections are also incorporated with the one-way model to improve the accuracy. The resulting model is denoted as the modified mixed-domain method (MMDM) and is numerically evaluated for its accuracy and efficiency using two distinct cases: a layered medium and a human skull. It is found that the MMDM is significantly more accurate than the MDM for strongly heterogeneous media, especially when the phase aberrating layer is roughly perpendicular to the acoustic beam. Additionally, convergence study suggests that the second-order reflection is sufficient for wave modeling in lossy biological media. The method developed in this work could be used to facilitate therapeutic ultrasound for treating brain-related diseases and disorders.


title: Multi-Cap Optimization for Wireless Data Plans with Time Flexibility

abstract: An effective way for a Mobile network operator (MNO) to improve its revenue is price discrimination, i.e., providing different combinations of data caps and subscription fees. Rollover data plan (allowing the unused data in the current month to be used in the next month) is an innovative data mechanism with time flexibility. In this paper, we study the MNO's optimal multi-cap data plans with time flexibility in a realistic asymmetric information scenario. Specifically, users are associated with multi-dimensional private information, and the MNO designs a contract (with different data caps and subscription fees) to induce users to truthfully reveal their private information. This problem is quite challenging due to the multi-dimensional private information. We address the challenge in two aspects. First, we find that a feasible contract (satisfying incentive compatibility and individual rationality) should allocate the data caps according to users' willingness-to-pay (captured by the slopes of users' indifference curves). Second, for the non-convex data cap allocation problem, we propose a Dynamic Quota Allocation Algorithm, which has a low complexity and guarantees the global optimality. Numerical results show that the time-flexible data mechanisms increase both the MNO's profit (25% on average) and users' payoffs (8.2% on average) under price discrimination.


title: Stability of Disordered Topological Superconducting Phases in Magnet--Superconductor Hybrid Systems

abstract: Magnet-superconductor hybrid heterostructures constitute a promising candidate system for the quantum engineering of chiral topological superconductivity. Here, we investigate the stability of their topological phases in the presence of various types of potential and magnetic disorder. In particular we consider magnetic disorder in the coupling strength and spin-orientation, as well as percolation type disorder representing missing magnetic moments. We show that potential disorder leads to the weakest suppression of topological phases, while percolation disorder leads to their strongest suppression. In addition, we demonstrate that in the case of correlated potential disorder, the spatial structure of the disorder potential is correlated not only with the particle number density, but also the Chern number density. Finally, we demonstrate how the disorder-induced destruction of topological superconductivity is reflected in the spatial structure and distribution of the Chern number density.


title: Revolving Fractals

abstract: Davis and Knuth in 1970 introduced the notion of revolving sequences, as representations of a Gaussian integer. Later, Mizutani and Ito pointed out a close relationship between a set of points determined by all revolving sequences and a self-similar set, which is called the Dragon. We will show how their result can be generalized, giving a new parametrized expression for certain self-similar sets.


title: SmartBullets: A Cloud-Assisted Bullet Screen Filter based on Deep Learning

abstract: Bullet-screen is a technique that enables the website users to send real-time comment `bullet' cross the screen. Compared with the traditional review of a video, bullet-screen provides new features of feeling expression to video watching and more iterations between video viewers. However, since all the comments from the viewers are shown on the screen publicly and simultaneously, some low-quality bullets will reduce the watching enjoyment of the users. Although the bullet-screen video websites have provided filter functions based on regular expression, bad bullets can still easily pass the filter through making a small modification. In this paper, we present SmartBullets, a user-centered bullet-screen filter based on deep learning techniques. A convolutional neural network is trained as the classifier to determine whether a bullet need to be removed according to its quality. Moreover, to increase the scalability of the filter, we employ a cloud-assisted framework by developing a backend cloud server and a front-end browser extension. The evaluation of 40 volunteers shows that SmartBullets can effectively remove the low-quality bullets and improve the overall watching experience of viewers.


title: Connectivity-Aware UAV Path Planning with Aerial Coverage Maps

abstract: Cellular networks are promising to support effective wireless communications for unmanned aerial vehicles (UAVs), which will help to enable various long-range UAV applications. However, these networks are optimized for terrestrial users, and thus do not guarantee seamless aerial coverage. In this paper, we propose to overcome this difficulty by exploiting controllable mobility of UAVs, and investigate connectivity-aware UAV path planning. To explicitly impose communication requirements on UAV path planning, we introduce two new metrics to quantify the cellular connectivity quality of a UAV path. Moreover, aerial coverage maps are used to provide accurate locations of scattered coverage holes in the complicated propagation environment. We formulate the UAV path planning problem as finding the shortest path subject to connectivity constraints. Based on graph search methods, a novel connectivity-aware path planning algorithm with low complexity is proposed. The effectiveness and superiority of our proposed algorithm are demonstrated using the aerial coverage map of an urban section in Virginia, which is built by ray tracing. Simulation results also illustrate a tradeoff between the path length and connectivity quality of UAVs.


title: Game Theoretic Optimization via Gradient-based Nikaido-Isoda Function

abstract: Computing Nash equilibrium (NE) of multi-player games has witnessed renewed interest due to recent advances in generative adversarial networks. However, computing equilibrium efficiently is challenging. To this end, we introduce the Gradient-based Nikaido-Isoda (GNI) function which serves: (i) as a merit function, vanishing only at the first-order stationary points of each player's optimization problem, and (ii) provides error bounds to a stationary Nash point. Gradient descent is shown to converge sublinearly to a first-order stationary point of the GNI function. For the particular case of bilinear min-max games and multi-player quadratic games, the GNI function is convex. Hence, the application of gradient descent in this case yields linear convergence to an NE (when one exists). In our numerical experiments, we observe that the GNI formulation always converges to the first-order stationary point of each player's optimization problem.


title: Rethinking the Usage of Batch Normalization and Dropout in the Training of Deep Neural Networks

abstract: In this work, we propose a novel technique to boost training efficiency of a neural network. Our work is based on an excellent idea that whitening the inputs of neural networks can achieve a fast convergence speed. Given the well-known fact that independent components must be whitened, we introduce a novel Independent-Component (IC) layer before each weight layer, whose inputs would be made more independent. However, determining independent components is a computationally intensive task. To overcome this challenge, we propose to implement an IC layer by combining two popular techniques, Batch Normalization and Dropout, in a new manner that we can rigorously prove that Dropout can quadratically reduce the mutual information and linearly reduce the correlation between any pair of neurons with respect to the dropout layer parameter $p$. As demonstrated experimentally, the IC layer consistently outperforms the baseline approaches with more stable training process, faster convergence speed and better convergence limit on CIFAR10/100 and ILSVRC2012 datasets. The implementation of our IC layer makes us rethink the common practices in the design of neural networks. For example, we should not place Batch Normalization before ReLU since the non-negative responses of ReLU will make the weight layer updated in a suboptimal way, and we can achieve better performance by combining Batch Normalization and Dropout together as an IC layer.


title: Orthogonal Deep Neural Networks

abstract: In this paper, we introduce the algorithms of Orthogonal Deep Neural Networks (OrthDNNs) to connect with recent interest of spectrally regularized deep learning methods. OrthDNNs are theoretically motivated by generalization analysis of modern DNNs, with the aim to find solution properties of network weights that guarantee better generalization. To this end, we first prove that DNNs are of local isometry on data distributions of practical interest; by using a new covering of the sample space and introducing the local isometry property of DNNs into generalization analysis, we establish a new generalization error bound that is both scale- and range-sensitive to singular value spectrum of each of networks' weight matrices. We prove that the optimal bound w.r.t. the degree of isometry is attained when each weight matrix has a spectrum of equal singular values, among which orthogonal weight matrix or a non-square one with orthonormal rows or columns is the most straightforward choice, suggesting the algorithms of OrthDNNs. We present both algorithms of strict and approximate OrthDNNs, and for the later ones we propose a simple yet effective algorithm called Singular Value Bounding (SVB), which performs as well as strict OrthDNNs, but at a much lower computational cost. We also propose Bounded Batch Normalization (BBN) to make compatible use of batch normalization with OrthDNNs. We conduct extensive comparative studies by using modern architectures on benchmark image classification. Experiments show the efficacy of OrthDNNs.


title: Genuinely Nonlocal Product Bases: Classification and Entanglement Assisted Discrimination

abstract: An orthogonal product basis of a composite Hilbert space is genuinely nonlocal if the basis states are locally indistinguishable across every bipartition. From an operational point of view such a basis corresponds to a separable measurement that cannot be implemented by local operations and classical communication (LOCC) unless all the parties come together in a single location. In this work we classify genuinely nonlocal product bases into different categories. Our classification is based on state elimination property of the set via orthogonality-preserving measurements when all the parties are spatially separated or different subsets of the parties come together. We then study local state discrimination protocols for several such bases with additional entangled resources shared among the parties. Apart from consuming less entanglement than teleportation based schemes our protocols indicate operational significance of the proposed classification and exhibit nontrivial use of genuine entanglement in local state discrimination problem.


title: What is the Minimal Systemic Risk in Financial Exposure Networks?

abstract: Management of systemic risk in financial markets is traditionally associated with setting (higher) capital requirements for market participants. There are indications that while equity ratios have been increased massively since the financial crisis, systemic risk levels might not have lowered, but even increased. It has been shown that systemic risk is to a large extent related to the underlying network topology of financial exposures. A natural question arising is how much systemic risk can be eliminated by optimally rearranging these networks and without increasing capital requirements. Overlapping portfolios with minimized systemic risk which provide the same market functionality as empirical ones have been studied by [pichler2018]. Here we propose a similar method for direct exposure networks, and apply it to cross-sectional interbank loan networks, consisting of 10 quarterly observations of the Austrian interbank market. We show that the suggested framework rearranges the network topology, such that systemic risk is reduced by a factor of approximately 3.5, and leaves the relevant economic features of the optimized network and its agents unchanged. The presented optimization procedure is not intended to actually re-configure interbank markets, but to demonstrate the huge potential for systemic risk management through rearranging exposure networks, in contrast to increasing capital requirements that were shown to have only marginal effects on systemic risk [poledna2017]. Ways to actually incentivize a self-organized formation toward optimal network configurations were introduced in [thurner2013] and [poledna2016]. For regulatory policies concerning financial market stability the knowledge of minimal systemic risk for a given economic environment can serve as a benchmark for monitoring actual systemic risk in markets.


title: Multicore fiber-based quantum access network

abstract: We propose a quantum access network based on multicore fiber (MCF) to scale up the number of users in quantum key distribution (QKD) networks. The MCF is used as feeder fiber and single core single mode fibers (SSMFs) are used as drop fibers. Quantum signals (QSs) are integrated with classical signals (CSs) in both MCF and SSMFs to save deployment cost since access networks are cost sensitive. Due to the integration, spontaneous Raman scattering (SRS) and intercore crosstalk (ICXT) are the main impairment sources to QKD. To alleviate the noise, we propose a core and wavelength assignment scheme (CWAS) that a dedicated core of MCF is used to transmit QSs and the wavelengths of QSs are set lower than those of upstream signals. Also, we demonstrate that wavelength time division multiplexing (WTDM) is suitable for QSs which are required to support large number of quantum users, since WTDM can realize higher secure key rate (SKR) than time division multiplexing (TDM) and require lower cost than wavelength division multiplexing (WDM). Finally, the proposed quantum access network is verified experimentally. The experiment results are consistent with our analysis. The properties of SRS in the proposed architecture are shown in the experiments through the quantum bit error rates (QBERs) in different experimental case, which verifies the superiority of the proposed CWAS. Also, the characteristics of the SKRs prove that the number of receivers has a great impact on the performance of QSs using WTDM.


title: Symmetric and strongly symmetric homeomorphisms on the real line with non-symmetric inversion

abstract: We show an example of a symmetric homeomorphism $h$ of the real line $\mathbb{R}$ onto itself such that $h^{-1}$ is not symmetric. This implies that the set of all symmetric self-homeomorphisms of $\mathbb{R}$ does not constitute a group under the composition. We also deal with strongly symmetric self-homeomorphisms of $\mathbb{R}$ along the same line. These results reveal the difference of the sets of such self-homeomorphisms of the real line from those of the unit circle.


title: EigenDamage: Structured Pruning in the Kronecker-Factored Eigenbasis

abstract: Reducing the test time resource requirements of a neural network while preserving test accuracy is crucial for running inference on resource-constrained devices. To achieve this goal, we introduce a novel network reparameterization based on the Kronecker-factored eigenbasis (KFE), and then apply Hessian-based structured pruning methods in this basis. As opposed to existing Hessian-based pruning algorithms which do pruning in parameter coordinates, our method works in the KFE where different weights are approximately independent, enabling accurate pruning and fast computation. We demonstrate empirically the effectiveness of the proposed method through extensive experiments. In particular, we highlight that the improvements are especially significant for more challenging datasets and networks. With negligible loss of accuracy, an iterative-pruning version gives a 10$\times$ reduction in model size and a 8$\times$ reduction in FLOPs on wide ResNet32.


title: Simultaneous Inference Under the Vacuous Orientation Assumption

abstract: I propose a novel approach to simultaneous inference that alleviates the need to specify a correlational structure among marginal errors. The vacuous orientation assumption retains what the normal i.i.d. assumption implies about the distribution of error configuration, but relaxes the implication that the error orientation is isotropic. When a large number of highly dependent hypotheses are tested simultaneously, the proposed model produces calibrated posterior inference by leveraging the logical relationship among them. This stands in contrast to the conservative performance of the Bonferroni correction, even if neither approaches makes assumptions about error dependence. The proposed model employs the Dempster-Shafer Extended Calculus of Probability, and delivers posterior inference in the form of stochastic three-valued logic.


title: Decomposable operators, local S-spectrum and S-spectrum in the quaternionic setting

abstract: In a right quaternionic Hilbert space, following the complex formalism, decomposable operators, the so-called Bishop's property and the single valued extension property are defined and the connections between them are studied to certain extent. In particular, for a decomposable operator, it is shown that the S-spectrum, approximate S-point spectrum, surjectivity S-spectrum and the union of all local S-spectra coincide. Using continuous right slice-regular functions we have also studied certain properties of local S-spectrum and local S-spectral subspaces.


title: Singularity formation in the harmonic map flow with free boundary

abstract: In the past years, there has been a new light shed on the harmonic map problem with free boundary in view of its connection with nonlocal equations. Here we fully exploit this link, considering the harmonic map flow with free boundary \begin{equation}\label{e:main0} \begin{cases} u_t = \Delta u\text{ in }\mathbb{R}^2_+\times (0, T),\\ u(x,0,t) \in \mathbb{S}^1\text{ for all }(x,0,t)\in \partial\mathbb{R}^2_+\times (0, T),\\ \frac{du}{dy}(x,0,t)\perp T_{u(x,0,t)}\mathbb{S}^1\text{ for all }(x,0,t)\in \partial\mathbb{R}^2_+\times (0, T),\\ u(\cdot, 0) = u_0\text{ in }\mathbb{R}^2_+ \end{cases} \end{equation} for a function $u:\mathbb{R}^2_+\times [0, T)\to \mathbb{R}^2$. Here $u_0 :\mathbb{R}^2_+\to \mathbb{R}^2$ is a given smooth map and $\perp$ stands for orthogonality. We prove the existence of initial data $u_0$ such that (\ref{e:main0}) blows up at finite time with a profile being the half-harmonic map. This answers a question raised by Yunmei Chen and Fanghua Lin in Remark 4.9 of \cite{ChenLinJGA1998}.


title: Automated detection of business-relevant outliers in e-commerce conversion rate

abstract: We evaluate how modern outlier detection methods perform in identifying outliers in e-commerce conversion rate data. Based on the limitations identified, we then present a novel method to detect outliers in e-commerce conversion rate. This unsupervised method is made more business relevant by letting it automatically adjust the sensitivity based on the activity observed on the e-commerce platform. We call this outlier detection method the fluid IQR. Using real e-commerce conversion data acquired from a known store, we compare the performance of the existing and the new outlier detection methods. Fluid IQR method outperforms the existing outlier detection methods by a large margin when it comes to business-relevance. Furthermore, the fluids IQR method is the most robust outlier detection method in the presence of clusters of extreme outliers or level shifts. Future research will evaluate how the fluid IQR method perform in diverse e-business settings.


title: Expectation variables on a para-contact metric manifold exactly derived from master equations

abstract: Based on information and para-contact metric geometries, in this paper a class of dynamical systems is formulated for describing time-development of expectation variables. Here such systems for expectation variables are exactly derived from continuous-time master equations describing nonequilibrium processes.


title: Explorations and Lessons Learned in Building an Autonomous Formula SAE Car from Simulations

abstract: This paper describes the exploration and learnings during the process of developing a self-driving algorithm in simulation, followed by deployment on a real car. We specifically concentrate on the Formula Student Driverless competition. In such competitions, a formula race car, designed and built by students, is challenged to drive through previously unseen tracks that are marked by traffic cones. We explore and highlight the challenges associated with training a deep neural network that uses a single camera as input for inferring car steering angles in real-time. The paper explores in-depth creation of simulation, usage of simulations to train and validate the software stack and then finally the engineering challenges associated with the deployment of the system in real-world.


title: Constrained low-tubal-rank tensor recovery for hyperspectral images mixed noise removal by bilateral random projections

abstract: In this paper, we propose a novel low-tubal-rank tensor recovery model, which directly constrains the tubal rank prior for effectively removing the mixed Gaussian and sparse noise in hyperspectral images. The constraints of tubal-rank and sparsity can govern the solution of the denoised tensor in the recovery procedure. To solve the constrained low-tubal-rank model, we develop an iterative algorithm based on bilateral random projections to efficiently solve the proposed model. The advantage of random projections is that the approximation of the low-tubal-rank tensor can be obtained quite accurately in an inexpensive manner. Experimental examples for hyperspectral image denoising are presented to demonstrate the effectiveness and efficiency of the proposed method.


title: Protein folding analysis using features obtained by persistent homology

abstract: Understanding the protein folding process is an outstanding issue in biophysics; recent developments in molecular dynamics simulation have provided insights into this phenomenon. However, the large freedom of atomic motion hinders the understanding of this process. In this study, we applied persistent homology, an emerging methods to analyze topological features in a dataset, to reveal protein folding dynamics. We developed a new method to characterize protein structure based on persistent homology and applied this method to molecular dynamics simulations of chignolin. Using principle component analysis or non-negative matrix factorization, our analysis method revealed two stable states and one saddle state, corresponding to the native, misfolded, and transition states, respectively. We also identified an unfolded state with slow dynamics in the reduced space. Our method serves as a promising tool to understand the protein folding process.


title: Automaticity for graphs of groups

abstract: In this article we construct asynchronous and sometimes synchronous automatic structures for amalgamated products and HNN extensions of groups that are strongly asynchronously (or synchronously) coset automatic with respect to the associated automatic subgroups, subject to further geometric conditions. These results are proved in the general context of fundamental groups of graphs of groups. The hypotheses of our closure results are satisfied in a variety of examples such as Artin groups of sufficiently large type, Coxeter groups, virtually abelian groups, and groups that are hyperbolic relative to virtually abelian subgroups.


title: Electric-field-induced Z2 topological phase transition in strained single bilayer Bi(111)

abstract: For controlling the critical electric fields of the topological phase transition in single bilayer Bi(111), we investigated topological phases in a strained system through first-principles calculations. We found a quadratic band touching semimetallic state at tensile strain $\epsilon=0.5$%. Around this strain, the topological phase can be switched to a trivial insulator by an infinitesimal electric field. The positions at which Dirac cones appear in the electric-field-induced topological phase transition changed for the strain $\epsilon>0.5$% and $\epsilon<0.5$%. Our results indicate that this topological phase transition could be applied to novel spintronic devices.


title: Measuring Bayesian Robustness Using R\'enyi Divergence

abstract: This paper deals with measuring the Bayesian robustness of classes of contaminated priors. Two different classes of priors in the neighborhood of the elicited prior are considered. The first one is the well-known $\epsilon$-contaminated class, while the second one is the geometric mixing class. The proposed measure of robustness is based on computing the curvature of R\'enyi divergence between posterior distributions. Examples are used to illustrate the results by using simulated and real data sets.


title: Depth map estimation methodology for detecting free-obstacle navigation areas

abstract: This paper presents a vision-based methodology which makes use of a stereo camera rig and a one dimension LiDAR to estimate free obstacle areas for quadrotor navigation. The presented approach fuses information provided by a depth map from a stereo camera rig, and the sensing distance of the 1D-LiDAR. Once the depth map is filtered with a Weighted Least Squares filter (WLS), the information is fused through a Kalman filter algorithm. To determine if there is a free space large enough for the quadrotor to pass through, our approach marks an area inside the disparity map by using the Kalman Filter output information. The whole process is implemented in an embedded computer Jetson TX2 and coded in the Robotic Operating System (ROS). Experiments demonstrate the effectiveness of our approach.


title: Joint haze image synthesis and dehazing with mmd-vae losses

abstract: Fog and haze are weathers with low visibility which are adversarial to the driving safety of intelligent vehicles equipped with optical sensors like cameras and LiDARs. Therefore image dehazing for perception enhancement and haze image synthesis for testing perception abilities are equivalently important in the development of such autonomous driving systems. From the view of image translation, these two problems are essentially dual with each other, which have the potentiality to be solved jointly. In this paper, we propose an unsupervised Image-to-Image Translation framework based on Variational Autoencoders (VAE) and Generative Adversarial Nets (GAN) to handle haze image synthesis and haze removal simultaneously. Since the KL divergence in the VAE objectives could not guarantee the optimal mapping under imbalanced and unpaired training samples with limited size, Maximum mean discrepancy (MMD) based VAE is utilized to ensure the translating consistency in both directions. The comprehensive analysis on both synthesis and dehazing performance of our method demonstrate the feasibility and practicability of the proposed method.


title: Mabuchi's soliton metric and relative D-stability

abstract: For Fano manifolds T. Mabuchi introduced a generalization of the K\"ahler-Einstein metric, which is characterized as the critical point of the Ricci-Calabi functional. We show that a Fano manifold admits Mabuchi's metric if and only if it is uniformly relatively D-stable.


title: Semiclassical Phase Reduction Theory for Quantum Synchronization

abstract: We develop a general theoretical framework of semiclassical phase reduction for analyzing synchronization of quantum limit-cycle oscillators. The dynamics of quantum dissipative systems exhibiting limit-cycle oscillations are reduced to a simple, one-dimensional classical stochastic differential equation approximately describing the phase dynamics of the system under the semiclassical approximation. The density matrix and power spectrum of the original quantum system can be approximately reconstructed from the reduced phase equation. The developed framework enables us to analyze synchronization dynamics of quantum limit-cycle oscillators using the standard methods for classical limit-cycle oscillators in a quantitative way. As an example, we analyze synchronization of a quantum van der Pol oscillator under harmonic driving and squeezing, including the case that the squeezing is strong and the oscillation is asymmetric. The developed framework provides insights into the relation between quantum and classical synchronization and will facilitate systematic analysis and control of quantum nonlinear oscillators.


title: BERT Rediscovers the Classical NLP Pipeline

abstract: Pre-trained text encoders have rapidly advanced the state of the art on many NLP tasks. We focus on one such model, BERT, and aim to quantify where linguistic information is captured within the network. We find that the model represents the steps of the traditional NLP pipeline in an interpretable and localizable way, and that the regions responsible for each step appear in the expected sequence: POS tagging, parsing, NER, semantic roles, then coreference. Qualitative analysis reveals that the model can and often does adjust this pipeline dynamically, revising lower-level decisions on the basis of disambiguating information from higher-level representations.


title: Interlayer decoupling in twisted bilayers of $\beta$-phosphorus and arsenic: a computational study

abstract: We investigate magnetism and band structure engineering in Moir\'e superlattice of blue phosphorus ($\beta$-P) and grey arsenene ($\beta$-As) bilayers, using \textit{ab initio} calculations. The electronic states near the valence and conduction band edges have significant $p_z$ character in both the bilayers. Thus, twisting the layers significantly reduce the interlayer orbital overlap, leading to a decrease in the binding energy (up to $\sim33\%$) and an increase in interlayer distance (up to $\sim10\%$), compared to the most stable AA-stacking. This interlayer decoupling also results in a notable increase (up to $\sim$25-50\%) of the bandgap of twisted bilayers, with the valance band edge becoming relatively flat with van-Hove singularities in the density of states. Thus, hole doping induces a Stoner instability, leading to ferromagnetic ground state, which is more robust in Moir\'e superlattices, than that of AA-stacked $\beta$-P and $\beta$-As.


title: Strain-Fluctuation-Induced Near-Quantization of Valley Hall Conductivity in Graphene Systems

abstract: We develop a theory of the valley Hall effect in high-quality graphene samples, in which strain fluctuation-induced random gauge potentials have been suggested as the dominant source of disorder. We find a near-quantized value of valley Hall conductivity in the band transport regime, which originates from an enhanced side jump of a Dirac electron when it scatters off the gauge potential. By assuming a small residue charge density our theory reproduces qualitatively the temperature- and gap-dependence of the observed valley Hall effect at the charge neutral point. Our study suggests that the valley Hall effect in graphene systems represents a new paradigm for the anomalous Hall physics where gauge disorder plays an important role.


title: Learning-based Single-step Quantitative Susceptibility Mapping Reconstruction Without Brain Extraction

abstract: Quantitative susceptibility mapping (QSM) estimates the underlying tissue magnetic susceptibility from MRI gradient-echo phase signal and typically requires several processing steps. These steps involve phase unwrapping, brain volume extraction, background phase removal and solving an ill-posed inverse problem. The resulting susceptibility map is known to suffer from inaccuracy near the edges of the brain tissues, in part due to imperfect brain extraction, edge erosion of the brain tissue and the lack of phase measurement outside the brain. This inaccuracy has thus hindered the application of QSM for measuring the susceptibility of tissues near the brain edges, e.g., quantifying cortical layers and generating superficial venography. To address these challenges, we propose a learning-based QSM reconstruction method that directly estimates the magnetic susceptibility from total phase images without the need for brain extraction and background phase removal, referred to as autoQSM. The neural network has a modified U-net structure and is trained using QSM maps computed by a two-step QSM method. 209 healthy subjects with ages ranging from 11 to 82 years were employed for patch-wise network training. The network was validated on data dissimilar to the training data, e.g. in vivo mouse brain data and brains with lesions, which suggests that the network has generalized and learned the underlying mathematical relationship between magnetic field perturbation and magnetic susceptibility. AutoQSM was able to recover magnetic susceptibility of anatomical structures near the edges of the brain including the veins covering the cortical surface, spinal cord and nerve tracts near the mouse brain boundaries. The advantages of high-quality maps, no need for brain volume extraction and high reconstruction speed demonstrate its potential for future applications.


title: Few results in connection with sum and product theorems of relative $(p,q)$-$\varphi$ order, relative $(p,q)$-$\varphi$ type and relative $(p,q)$-$\varphi$ weak type of meromorphic functions with respect to entire functions

abstract: Orders and types of entire and meromorphic functions have been actively investigated by many authors. In the present paper, we aim at investigating some basic properties in connection with sum and product of relative $(p,q)$-$\varphi$ order, relative $(p,q)$-$\varphi$ type, and relative $(p,q)$-$\varphi$ weak type of meromorphic functions with respect to entire functions.


title: GhostLink: Latent Network Inference for Influence-aware Recommendation

abstract: Social influence plays a vital role in shaping a user's behavior in online communities dealing with items of fine taste like movies, food, and beer. For online recommendation, this implies that users' preferences and ratings are influenced due to other individuals. Given only time-stamped reviews of users, can we find out who-influences-whom, and characteristics of the underlying influence network? Can we use this network to improve recommendation? While prior works in social-aware recommendation have leveraged social interaction by considering the observed social network of users, many communities like Amazon, Beeradvocate, and Ratebeer do not have explicit user-user links. Therefore, we propose GhostLink, an unsupervised probabilistic graphical model, to automatically learn the latent influence network underlying a review community -- given only the temporal traces (timestamps) of users' posts and their content. Based on extensive experiments with four real-world datasets with 13 million reviews, we show that GhostLink improves item recommendation by around 23% over state-of-the-art methods that do not consider this influence. As additional use-cases, we show that GhostLink can be used to differentiate between users' latent preferences and influenced ones, as well as to detect influential users based on the learned influence graph.


title: Hybrid ED/DMRG approach to the thermodynamics of 1D quantum models

abstract: Exact diagonalization (ED) of small model systems gives the thermodynamics of spin chains or quantum cell models at high temperature $T$. Density matrix renormalization group (DMRG) calculations of progressively larger systems are used to obtain excitations up to a cutoff $W_C$ and the low-$T$ thermodynamics. The hybrid approach is applied to the magnetic susceptibility $\chi(T)$ and specific heat $C(T)$ of spin-$1/2$ chains with isotropic exchange such as the linear Heisenberg antiferromagnet (HAF) and the frustrated $J_1-J_2$ model with ferromagnetic (F) $J_1 < 0$ and antiferromagnetic (AF) $J_2 > 0$. The hybrid approach is fully validated by comparison with HAF results. It extends $J_1-J_2$ thermodynamics down to $T \sim 0.01|J_1|$ for $J_2/|J_1| \geq \alpha_c = 1/4$ and is consistent with other methods. The criterion for the cutoff $W_C(N)$ in systems of $N$ spins is discussed. The cutoff leads to bounds for the thermodynamic limit that are best satisfied at a specific $T(N)$ at system size $N$.


title: DoubleSqueeze: Parallel Stochastic Gradient Descent with Double-Pass Error-Compensated Compression

abstract: A standard approach in large scale machine learning is distributed stochastic gradient training, which requires the computation of aggregated stochastic gradients over multiple nodes on a network. Communication is a major bottleneck in such applications, and in recent years, compressed stochastic gradient methods such as QSGD (quantized SGD) and sparse SGD have been proposed to reduce communication. It was also shown that error compensation can be combined with compression to achieve better convergence in a scheme that each node compresses its local stochastic gradient and broadcast the result to all other nodes over the network in a single pass. However, such a single pass broadcast approach is not realistic in many practical implementations. For example, under the popular parameter server model for distributed learning, the worker nodes need to send the compressed local gradients to the parameter server, which performs the aggregation. The parameter server has to compress the aggregated stochastic gradient again before sending it back to the worker nodes. In this work, we provide a detailed analysis on this two-pass communication model and its asynchronous parallel variant, with error-compensated compression both on the worker nodes and on the parameter server. We show that the error-compensated stochastic gradient algorithm admits three very nice properties: 1) it is compatible with an \emph{arbitrary} compression technique; 2) it admits an improved convergence rate than the non error-compensated stochastic gradient methods such as QSGD and sparse SGD; 3) it admits linear speedup with respect to the number of workers. The empirical study is also conducted to validate our theoretical results.


title: An Energy-Efficient Controller for Wirelessly-Powered Communication Networks

abstract: In a wirelessly-powered communication network (WPCN), an energy access point (E-AP) supplies the energy needs of the network nodes through radio frequency wave transmission, and the nodes store their received energy in their batteries for possible data transmission. In this paper, we propose an online control policy for energy transfer from the E-AP to the wireless nodes and for data transfer among the nodes. With our proposed control policy, all data queues of the nodes are stable, while the average energy consumption of the network is shown to be within a bounded gap of the minimum energy required for stabilizing the network. Our proposed policy is designed using a quadratic Lyapunov function to capture the limitations on the energy consumption of the nodes imposed by their battery levels. We show that under the proposed control policy, the backlog level in the data queues and the stored energy level in the batteries fluctuate in small intervals around some constant levels. Consequently, by imposing negligible average data drop rate, the data buffer size and the battery capacity of the nodes can be significantly reduced.


title: Modal Group Velocity Mismatch Induced Intermodal Modulation Instability in Step-index Fiber

abstract: We present detailed experimental study on noise-seeded intermodal modulation instability (IM-MI) in normal dispersion region of a conventional step-index fiber. The sharp refractive index contrast between core and cladding leads to large group velocity mismatch between the spatial modes, coaxing to efficient IM-MI and generation of multiple spectral peaks along with Raman peaks. Evolution of the spectrum with pump powers and fiber lengths are observed. Experimental findings are well supported with the theoretical framework based on bimodal-MI model considering the distinct dispersion parameters of the participating modes.


title: Stability and variational analysis of cavity solitons under various perturbations

abstract: We theoretically investigate the dynamics and stability of a temporal cavity soliton (CS) excited inside a silicon-based microresonator that exhibits free-carrier generation as a result of two-photon absorption (TPA). The optical propagation of the CS is modeled through a mean-field Lugiato-Lefever equation (LLE) coupled with an ordinary differential equation accounting for the generation of free carriers owing to TPA. The CS experiences several perturbations (like intrapulse Raman scattering (IRS), TPA, free-carrier absorption (FCA), free-carrier dispersion (FCD), etc.) during its round-trip evolution inside the cavity. We develop a full variational analysis based on a Ritz optimization principle which is useful in deriving simple analytical expressions describing the dynamics of individual pulse parameters of the CS under perturbation. TPA and FCA limit the efficient comb generation and modify the stability condition of the CS. We determine the critical condition of stability modified due to TPA and derive closed-form expressions of the saturated amplitude and width of stable CS. We perform detailed modulation-instability analysis and obtain stability condition against perturbations of steady-state solution of LLE. The CS experiences FCD which leads to a temporal acceleration resulting in spectral blueshift. Exploiting the variational analysis, we estimate these temporal and spectral shifts. We also include IRS in our perturbation theory and analytically estimate the frequency redshifting. Finally, we study the effect of pump-phase-modulation on a stable CS. All our analytical results are found to be in good agreement with the data obtained from the full numerical solution of LLE.


title: Demographic Inference and Representative Population Estimates from Multilingual Social Media Data

abstract: Social media provide access to behavioural data at an unprecedented scale and granularity. However, using these data to understand phenomena in a broader population is difficult due to their non-representativeness and the bias of statistical inference tools towards dominant languages and groups. While demographic attribute inference could be used to mitigate such bias, current techniques are almost entirely monolingual and fail to work in a global environment. We address these challenges by combining multilingual demographic inference with post-stratification to create a more representative population sample. To learn demographic attributes, we create a new multimodal deep neural architecture for joint classification of age, gender, and organization-status of social media users that operates in 32 languages. This method substantially outperforms current state of the art while also reducing algorithmic bias. To correct for sampling biases, we propose fully interpretable multilevel regression methods that estimate inclusion probabilities from inferred joint population counts and ground-truth population counts. In a large experiment over multilingual heterogeneous European regions, we show that our demographic inference and bias correction together allow for more accurate estimates of populations and make a significant step towards representative social sensing in downstream applications with multilingual social media.


title: The Apache Point Observatory Catalog of Optical Diffuse Interstellar Bands

abstract: Aiming for a new and more comprehensive DIB catalog between 4,000 and 9,000{\AA}, we revisited the Atlas Catalog based on the observations of HD 183143 and HD 204827 (Hobbs et al. 2008 and 2009). Twenty-five medium-to-highly reddened sight lines were selected, sampling a variety of spectral types of the background star and the interstellar environments. The median SNR of these spectra is ~ 1,300 around 6,400{\AA}. Compared to the Atlas Catalog, 22 new DIBs were found, and the boundaries of 27 (sets) of DIBs were adjusted, resulting in an updated catalog containing 559 DIBs that we refer to as the Apache Point Observatory Catalog of Optical Diffuse Interstellar Bands. Measurements were then made based on this catalog. We found our survey most sensitive between 5,500 and 7,000{\AA} due largely to the local SNR of the spectra, the relative absence of interfering stellar lines, and the weakness of telluric residuals. For our data sample, the number of DIBs detected in a given sight line is mostly dependent on EB-V and less on the spectral type of the background star. Some dependence on fH2 is observed, but less well-determined due to the limited size of the data sample. The variations of the wavelengths of each DIB in different sight lines are generally larger than those of the known interstellar lines CH+, CH, and K I. Those variations could be due to the inherent error in the measurement, or to differences in the velocity components among sight lines.


title: A New Estimation Algorithm for Box-Cox Transformation Cure Rate Model and Comparison With EM Algorithm

abstract: In this paper, we develop a new estimation procedure based on the non-linear conjugate gradient (NCG) algorithm for the Box-Cox transformation cure rate model. We compare the performance of the NCG algorithm with the well-known expectation maximization (EM) algorithm through a simulation study and show the advantages of the NCG algorithm over the EM algorithm. In particular, we show that the NCG algorithm allows simultaneous maximization of all model parameters when the likelihood surface is flat with respect to a Box-Cox model parameter. This is a big advantage over the EM algorithm, where a profile likelihood approach has been proposed in the literature that may not provide satisfactory results. We finally use the NCG algorithm to analyze a well-known melanoma data and show that it results in a better fit.


title: Deep Kinship Verification via Appearance-shape Joint Prediction and Adaptation-based Approach

abstract: Kinship verification aims to identify the kin relation between two given face images. It is a very challenging problem due to the lack of training data and facial similarity variations between kinship pairs. In this work, we build a novel appearance and shape based deep learning pipeline. First we adopt the knowledge learned from general face recognition network to learn general facial features. Afterwards, we learn kinship oriented appearance and shape features from kinship pairs and combine them for the final prediction. We have evaluated the model performance on a widely used popular benchmark and demonstrated the superiority over the state-of-the-art.