title: On Robustness Analysis of a Dynamic Average Consensus Algorithm to Communication Delay

abstract: This paper studies the robustness of a dynamic average consensus algorithm to communication delay over strongly connected and weight-balanced (SCWB) digraphs. Under delay-free communication, the algorithm of interest achieves a practical asymptotic tracking of the dynamic average of the time-varying agents' reference signals. For this algorithm, in both its continuous-time and discrete-time implementations, we characterize the admissible communication delay range and study the effect of the delay on the rate of convergence and the tracking error bound. Our study also includes establishing a relationship between the admissible delay bound and the maximum degree of the SCWB digraphs. We also show that for delays in the admissible bound, for static signals the algorithms achieve perfect tracking. Moreover, when the interaction topology is a connected undirected graph, we show that the discrete-time implementation is guaranteed to tolerate at least one step delay. Simulations demonstrate our results.


title: Adversarial Structure Matching for Structured Prediction Tasks

abstract: Pixel-wise losses, e.g., cross-entropy or L2, have been widely used in structured prediction tasks as a spatial extension of generic image classification or regression. However, its i.i.d. assumption neglects the structural regularity present in natural images. Various attempts have been made to incorporate structural reasoning mostly through structure priors in a cooperative way where co-occurring patterns are encouraged. We, on the other hand, approach this problem from an opposing angle and propose a new framework, Adversarial Structure Matching (ASM), for training such structured prediction networks via an adversarial process, in which we train a structure analyzer that provides the supervisory signals, the ASM loss. The structure analyzer is trained to maximize the ASM loss, or to emphasize recurring multi-scale hard negative structural mistakes among co-occurring patterns. On the contrary, the structured prediction network is trained to reduce those mistakes and is thus enabled to distinguish fine-grained structures. As a result, training structured prediction networks using ASM reduces contextual confusion among objects and improves boundary localization. We demonstrate that our ASM outperforms pixel-wise IID loss or structural prior GAN loss on three different structured prediction tasks: semantic segmentation, monocular depth estimation, and surface normal prediction.


title: PG-TS: Improved Thompson Sampling for Logistic Contextual Bandits

abstract: We address the problem of regret minimization in logistic contextual bandits, where a learner decides among sequential actions or arms given their respective contexts to maximize binary rewards. Using a fast inference procedure with Polya-Gamma distributed augmentation variables, we propose an improved version of Thompson Sampling, a Bayesian formulation of contextual bandits with near-optimal performance. Our approach, Polya-Gamma augmented Thompson Sampling (PG-TS), achieves state-of-the-art performance on simulated and real data. PG-TS explores the action space efficiently and exploits high-reward arms, quickly converging to solutions of low regret. Its explicit estimation of the posterior distribution of the context feature covariance leads to substantial empirical gains over approximate approaches. PG-TS is the first approach to demonstrate the benefits of Polya-Gamma augmentation in bandits and to propose an efficient Gibbs sampler for approximating the analytically unsolvable integral of logistic contextual bandits.


title: PCA by Optimisation of Symmetric Functions has no Spurious Local Optima

abstract: Principal Component Analysis (PCA) finds the best linear representation of data, and is an indispensable tool in many learning and inference tasks. Classically, principal components of a dataset are interpreted as the directions that preserve most of its "energy", an interpretation that is theoretically underpinned by the celebrated Eckart-Young-Mirsky Theorem. This paper introduces many other ways of performing PCA, with various geometric interpretations, and proves that the corresponding family of non-convex programs have no spurious local optima, while possessing only strict saddle points. These programs therefore loosely behave like convex problems and can be efficiently solved to global optimality, for example, with certain variants of the stochastic gradient descent. Beyond providing new geometric interpretations and enhancing our theoretical understanding of PCA, our findings might pave the way for entirely new approaches to structured dimensionality reduction, such as sparse PCA and nonnegative matrix factorisation. More specifically, we study an unconstrained formulation of PCA using determinant optimisation that might provide an elegant alternative to the deflating scheme commonly used in sparse PCA.


title: Fast Kernel Approximations for Latent Force Models and Convolved Multiple-Output Gaussian processes

abstract: A latent force model is a Gaussian process with a covariance function inspired by a differential operator. Such covariance function is obtained by performing convolution integrals between Green's functions associated to the differential operators, and covariance functions associated to latent functions. In the classical formulation of latent force models, the covariance functions are obtained analytically by solving a double integral, leading to expressions that involve numerical solutions of different types of error functions. In consequence, the covariance matrix calculation is considerably expensive, because it requires the evaluation of one or more of these error functions. In this paper, we use random Fourier features to approximate the solution of these double integrals obtaining simpler analytical expressions for such covariance functions. We show experimental results using ordinary differential operators and provide an extension to build general kernel functions for convolved multiple output Gaussian processes.


title: The prime geodesic theorem in square mean

abstract: We strengthen the recent result of Cherubini and Guerreiro on the square mean of the error term in the prime geodesic theorem for $\mathrm{PSL}_2(\mathbb{Z})$. We also develop a short interval version of this result.


title: A constrained shape optimization problem in Orlicz-Sobolev spaces

abstract: In this manuscript we study the following optimization problem: given a bounded and regular domain $\Omega\subset \mathbb{R}^N$ we look for an optimal shape for the "$\mathrm{W}-$vanishing window" on the boundary with prescribed measure over all admissible profiles in the framework of the Orlicz-Sobolev spaces associated to constant for the "Sobolev trace embedding". In this direction, we establish existence of minimizer profiles and optimal sets, as well as we obtain further properties for such extremals. Finally, we also place special emphasis on analyzing the corresponding optimization problem involving an "$\mathrm{A}-$vanishing hole" (inside the domain) with volume constraint.


title: The effect of disorder on polaritons in a coupled array of cavities

abstract: The effect of disorder in the intensity of the driving laser on a coupled array of cavities described by a Bose-Hubbard Hamiltonian for dark-state polaritons is investigated. A canonically-transformed Gutzwiller wave function is used to investigate the phase diagram and dynamics of a one-dimensional system with uniformly distributed disorder in the Rabi frequency. In the phase diagram, we find the emergence of a Bose glass phase that increases in extent as the strength of the disorder increases. We study the dynamics of the system when subject to a ramp in the Rabi frequency which, starting from the superfluid phase, is decreased linearly and then increased to its initial value. We investigate the dependence of the density of excitations, the relaxation of the superfluid order parameter and the excess energy pumped into the system on the inverse ramp rate, $\tau$. We find that, in the absence of disorder, the defect density oscillates with a constant envelope, while the relaxation of the order parameter and excess energy oscillate with $\tau^{-1.5}$ and $\tau^{-2}$ envelopes respectively. In the presence of disorder in the Rabi frequency, the defect density oscillates with a decaying envelope, the relaxation of the order parameter no longer decreases as $\tau$ increases while the residual energy decreases as $\tau$ increases. The rate at which the envelope of the defect density decays increases with increasing disorder strength, while the excess energy falls off more slowly with increasing disorder strength.


title: X-ray reflectivity of chemically vapor deposited diamond single crystals in the Laue geometry

abstract: Absolute X-ray reflectivity of chemically vapor deposited (CVD) diamond single crystals was measured in the Laue geometry in the double-crystal non-dispersive setting with an asymmetric Si beam conditioner crystal. The measurements were supplemented by rocking curve topography. The measured reflectivity curves are examined in the framework of Darwin-Hamilton approach using a set of two independent parameters, the characteristic thickness of mosaic blocks and their average angular misorientation. Due to strong extinction effects the width of reflectivity curves does not directly represent the average misorientation of the blocks. Two different sets of parameters were found for the 111 asymmetric reflection in the two different scattering configurations (beam compression and beam expansion). Analysis of the rocking curve topographs shows that this discrepancy can be attributed to inhomogeneity of the diamond crystal microstructure.


title: Using permutations to detect, quantify and correct for confounding in machine learning predictions

abstract: Clinical machine learning applications are often plagued with confounders that are clinically irrelevant, but can still artificially boost the predictive performance of the algorithms. Confounding is especially problematic in mobile health studies run "in the wild", where it is challenging to balance the demographic characteristics of participants that self select to enter the study. An effective approach to remove the influence of confounders is to match samples in order to improve the balance in the data. The caveat is that we end-up with a smaller number of participants to train and evaluate the machine learning algorithm. Alternative confounding adjustment methods that make more efficient use of the data (e.g., inverse probability weighting) usually rely on modeling assumptions, and it is unclear how robust these methods are to violations of these assumptions. Here, rather than proposing a new approach to prevent/reduce the learning of confounding signals by a machine learning algorithm, we develop novel statistical tools to detect, quantify and correct for the influence of observed confounders. Our tools are based on restricted and standard permutation approaches and can be used to evaluate how well a confounding adjustment method is actually working. We use restricted permutations to test if an algorithm has learned disease signal in the presence of confounding signal, and to develop a novel statistical test to detect confounding learning per se. Furthermore, we prove that restricted permutations provide an alternative method to compute partial correlations, and use this result as a motivation to develop a novel approach to estimate the corrected predictive performance of a learner. We evaluate the statistical properties of our methods in simulation studies.


title: Quantum critical behavior of a three-dimensional superfluid-Mott glass transition

abstract: The superfluid to insulator quantum phase transition of a three-dimensional particle-hole symmetric system of disordered bosons is studied. To this end, a site-diluted quantum rotor Hamiltonian is mapped onto a classical (3+1)-dimensional XY model with columnar disorder and analyzed by means of large-scale Monte Carlo simulations. The superfluid-Mott insulator transition of the clean, undiluted system is in the 4D XY universality class and shows mean-field critical behavior with logarithmic corrections. The clean correlation length exponent $\nu = 1/2$ violates the Harris criterion, indicating that disorder must be a relevant perturbation. For nonzero dilutions below the lattice percolation threshold of $p_c = 0.688392$, our simulations yield conventional power-law critical behavior with dilution-independent critical exponents $z=1.67(6)$, $\nu = 0.90(5)$, $\beta/\nu = 1.09(3)$, and $\gamma/\nu = 2.50(3)$. The critical behavior of the transition across the lattice percolation threshold is controlled by the classical percolation exponents. Our results are discussed in the context of a classification of disordered quantum phase transitions, as well as experiments in superfluids, superconductors and magnetic systems.


title: Unsupervised Cross-Modal Alignment of Speech and Text Embedding Spaces

abstract: Recent research has shown that word embedding spaces learned from text corpora of different languages can be aligned without any parallel data supervision. Inspired by the success in unsupervised cross-lingual word embeddings, in this paper we target learning a cross-modal alignment between the embedding spaces of speech and text learned from corpora of their respective modalities in an unsupervised fashion. The proposed framework learns the individual speech and text embedding spaces, and attempts to align the two spaces via adversarial training, followed by a refinement procedure. We show how our framework could be used to perform spoken word classification and translation, and the results on these two tasks demonstrate that the performance of our unsupervised alignment approach is comparable to its supervised counterpart. Our framework is especially useful for developing automatic speech recognition (ASR) and speech-to-text translation systems for low- or zero-resource languages, which have little parallel audio-text data for training modern supervised ASR and speech-to-text translation models, but account for the majority of the languages spoken across the world.


title: Unsupervised Learning of Neural Networks to Explain Neural Networks

abstract: This paper presents an unsupervised method to learn a neural network, namely an explainer, to interpret a pre-trained convolutional neural network (CNN), i.e., explaining knowledge representations hidden in middle conv-layers of the CNN. Given feature maps of a certain conv-layer of the CNN, the explainer performs like an auto-encoder, which first disentangles the feature maps into object-part features and then inverts object-part features back to features of higher conv-layers of the CNN. More specifically, the explainer contains interpretable conv-layers, where each filter disentangles the representation of a specific object part from chaotic input feature maps. As a paraphrase of CNN features, the disentangled representations of object parts help people understand the logic inside the CNN. We also learn the explainer to use object-part features to reconstruct features of higher CNN layers, in order to minimize loss of information during the feature disentanglement. More crucially, we learn the explainer via network distillation without using any annotations of sample labels, object parts, or textures for supervision. We have applied our method to different types of CNNs for evaluation, and explainers have significantly boosted the interpretability of CNN features.


title: Metric for Automatic Machine Translation Evaluation based on Universal Sentence Representations

abstract: Sentence representations can capture a wide range of information that cannot be captured by local features based on character or word N-grams. This paper examines the usefulness of universal sentence representations for evaluating the quality of machine translation. Although it is difficult to train sentence representations using small-scale translation datasets with manual evaluation, sentence representations trained from large-scale data in other tasks can improve the automatic evaluation of machine translation. Experimental results of the WMT-2016 dataset show that the proposed method achieves state-of-the-art performance with sentence representation features only.


title: Solving the Rubik's Cube Without Human Knowledge

abstract: A generally intelligent agent must be able to teach itself how to solve problems in complex domains with minimal human supervision. Recently, deep reinforcement learning algorithms combined with self-play have achieved superhuman proficiency in Go, Chess, and Shogi without human data or domain knowledge. In these environments, a reward is always received at the end of the game, however, for many combinatorial optimization environments, rewards are sparse and episodes are not guaranteed to terminate. We introduce Autodidactic Iteration: a novel reinforcement learning algorithm that is able to teach itself how to solve the Rubik's Cube with no human assistance. Our algorithm is able to solve 100% of randomly scrambled cubes while achieving a median solve length of 30 moves -- less than or equal to solvers that employ human domain knowledge.


title: Polariton dynamics of a disordered three-cavity system of four-level atom

abstract: The effect of disorder in the intensity of the driving laser on the dynamics of a disordered three-cavity system of four-level atoms is investigated. This system can be described by a Bose-Hubbard Hamiltonian for dark-state polaritons. We examine the evolution of the first- and second-order correlation functions, the photon and atomic excitation numbers and the basis state occupation probabilities. We use the full Hamiltonian and the approximate Bose-Hubbard Hamiltonian with uniform and speckle disorder, as well as with different dipole couplings. We find that the results for the two Hamiltonians are in good agreement. We also find that it is possible to obtain bunching and antibunching of the polaritons by varying the dipole couplings and that polaritons can be driven into a purely photonic state by varying the laser intensity.


title: Deep Dynamical Modeling and Control of Unsteady Fluid Flows

abstract: The design of flow control systems remains a challenge due to the nonlinear nature of the equations that govern fluid flow. However, recent advances in computational fluid dynamics (CFD) have enabled the simulation of complex fluid flows with high accuracy, opening the possibility of using learning-based approaches to facilitate controller design. We present a method for learning the forced and unforced dynamics of airflow over a cylinder directly from CFD data. The proposed approach, grounded in Koopman theory, is shown to produce stable dynamical models that can predict the time evolution of the cylinder system over extended time horizons. Finally, by performing model predictive control with the learned dynamical models, we are able to find a straightforward, interpretable control law for suppressing vortex shedding in the wake of the cylinder.


title: Progressive Ensemble Networks for Zero-Shot Recognition

abstract: Despite the advancement of supervised image recognition algorithms, their dependence on the availability of labeled data and the rapid expansion of image categories raise the significant challenge of zero-shot learning. Zero-shot learning (ZSL) aims to transfer knowledge from labeled classes into unlabeled classes to reduce human labeling effort. In this paper, we propose a novel progressive ensemble network model with multiple projected label embeddings to address zero-shot image recognition. The ensemble network is built by learning multiple image classification functions with a shared feature extraction network but different label embedding representations, which enhance the diversity of the classifiers and facilitate information transfer to unlabeled classes. A progressive training framework is then deployed to gradually label the most confident images in each unlabeled class with predicted pseudo-labels and update the ensemble network with the training data augmented by the pseudo-labels. The proposed model performs training on both labeled and unlabeled data. It can naturally bridge the domain shift problem in visual appearances and be extended to the generalized zero-shot learning scenario. We conduct experiments on multiple ZSL datasets and the empirical results demonstrate the efficacy of the proposed model.


title: Projection-Free Bandit Convex Optimization

abstract: In this paper, we propose the first computationally efficient projection-free algorithm for bandit convex optimization (BCO). We show that our algorithm achieves a sublinear regret of $O(nT^{4/5})$ (where $T$ is the horizon and $n$ is the dimension) for any bounded convex functions with uniformly bounded gradients. We also evaluate the performance of our algorithm against baselines on both synthetic and real data sets for quadratic programming, portfolio selection and matrix completion problems.


title: Learning to Repair Software Vulnerabilities with Generative Adversarial Networks

abstract: Motivated by the problem of automated repair of software vulnerabilities, we propose an adversarial learning approach that maps from one discrete source domain to another target domain without requiring paired labeled examples or source and target domains to be bijections. We demonstrate that the proposed adversarial learning approach is an effective technique for repairing software vulnerabilities, performing close to seq2seq approaches that require labeled pairs. The proposed Generative Adversarial Network approach is application-agnostic in that it can be applied to other problems similar to code repair, such as grammar correction or sentiment translation.


title: Two geometric input transformation methods for fast online reinforcement learning with neural nets

abstract: We apply neural nets with ReLU gates in online reinforcement learning. Our goal is to train these networks in an incremental manner, without the computationally expensive experience replay. By studying how individual neural nodes behave in online training, we recognize that the global nature of ReLU gates can cause undesirable learning interference in each node's learning behavior. We propose reducing such interferences with two efficient input transformation methods that are geometric in nature and match well the geometric property of ReLU gates. The first one is tile coding, a classic binary encoding scheme originally designed for local generalization based on the topological structure of the input space. The second one (EmECS) is a new method we introduce; it is based on geometric properties of convex sets and topological embedding of the input space into the boundary of a convex set. We discuss the behavior of the network when it operates on the transformed inputs. We also compare it experimentally with some neural nets that do not use the same input transformations, and with the classic algorithm of tile coding plus a linear function approximator, and on several online reinforcement learning tasks, we show that the neural net with tile coding or EmECS can achieve not only faster learning but also more accurate approximations. Our results strongly suggest that geometric input transformation of this type can be effective for interference reduction and takes us a step closer to fully incremental reinforcement learning with neural nets.


title: Norm-Preservation: Why Residual Networks Can Become Extremely Deep?

abstract: Augmenting neural networks with skip connections, as introduced in the so-called ResNet architecture, surprised the community by enabling the training of networks of more than 1,000 layers with significant performance gains. This paper deciphers ResNet by analyzing the effect of skip connections, and puts forward new theoretical results on the advantages of identity skip connections in neural networks. We prove that the skip connections in the residual blocks facilitate preserving the norm of the gradient, and lead to stable back-propagation, which is desirable from optimization perspective. We also show that, perhaps surprisingly, as more residual blocks are stacked, the norm-preservation of the network is enhanced. Our theoretical arguments are supported by extensive empirical evidence. Can we push for extra norm-preservation? We answer this question by proposing an efficient method to regularize the singular values of the convolution operator and making the ResNet's transition layers extra norm-preserving. Our numerical investigations demonstrate that the learning dynamics and the classification performance of ResNet can be improved by making it even more norm preserving. Our results and the introduced modification for ResNet, referred to as Procrustes ResNets, can be used as a guide for training deeper networks and can also inspire new deeper architectures.


title: Algorithmic Trading with Fitted Q Iteration and Heston Model

abstract: We present the use of the fitted Q iteration in algorithmic trading. We show that the fitted Q iteration helps alleviate the dimension problem that the basic Q-learning algorithm faces in application to trading. Furthermore, we introduce a procedure including model fitting and data simulation to enrich training data as the lack of data is often a problem in realistic application. We experiment our method on both simulated environment that permits arbitrage opportunity and real-world environment by using prices of 450 stocks. In the former environment, the method performs well, implying that our method works in theory. To perform well in the real-world environment, the agents trained might require more training (iteration) and more meaningful variables with predictive value.


title: Semisupervised Learning on Heterogeneous Graphs and its Applications to Facebook News Feed

abstract: Graph-based semi-supervised learning is a fundamental machine learning problem, and has been well studied. Most studies focus on homogeneous networks (e.g. citation network, friend network). In the present paper, we propose the Heterogeneous Embedding Label Propagation (HELP) algorithm, a graph-based semi-supervised deep learning algorithm, for graphs that are characterized by heterogeneous node types. Empirically, we demonstrate the effectiveness of this method in domain classification tasks with Facebook user-domain interaction graph, and compare the performance of the proposed HELP algorithm with the state of the art algorithms. We show that the HELP algorithm improves the predictive performance across multiple tasks, together with semantically meaningful embedding that are discriminative for downstream classification or regression tasks.


title: A bistable belief dynamics model for radicalization within sectarian conflict

abstract: We introduce a two-variable model to describe spatial polarization, radicalization, and conflict. Individuals in the model harbor a continuous belief variable as well as a discrete radicalization level expressing their tolerance to neighbors with different beliefs. A novel feature of our model is that it incorporates a bistable radicalization process to address memory-dependent social behavior. We demonstrate how bistable radicalization may explain contradicting observations regarding whether social segregation exacerbates or alleviates conflicts. We also extend our model by introducing a mechanism to include institutional influence, such as propaganda or education, and examine its effectiveness. In some parameter regimes, institutional influence may suppress the progression of radicalization and allow a population to achieve social conformity over time. In other cases, institutional intervention may exacerbate the spread of radicalization through a population of mixed beliefs. In such instances, our analysis implies that social segregation may be a viable option against sectarian conflict.


title: Apollonian metric, uniformity and Gromov hyperbolicity

abstract: The main purpose of this paper is to investigate the properties of a mapping which is required to be roughly bilipschitz with respect to the Apollonian metric (roughly Apollonian bilipschitz) of its domain. We prove that under these mappings the uniformity, $\varphi$-uniformity and $\delta$-hyperbolicity (in the sense of Gromov with respect to quasihyperbolic metric) of proper domains of $\mathbb{R}^n$ are invariant. As applications, we give four equivalent conditions for a quasiconformal mapping which is defined on a uniform domain to be roughly Apollonian bilipschitz, and we conclude that $\varphi$-uniformity is invariant under quasim\"obius mappings.


title: Optimal DR-Submodular Maximization and Applications to Provable Mean Field Inference

abstract: Mean field inference in probabilistic models is generally a highly nonconvex problem. Existing optimization methods, e.g., coordinate ascent algorithms, can only generate local optima. In this work we propose provable mean filed methods for probabilistic log-submodular models and its posterior agreement (PA) with strong approximation guarantees. The main algorithmic technique is a new Double Greedy scheme, termed DR-DoubleGreedy, for continuous DR-submodular maximization with box-constraints. It is a one-pass algorithm with linear time complexity, reaching the optimal 1/2 approximation ratio, which may be of independent interest. We validate the superior performance of our algorithms against baseline algorithms on both synthetic and real-world datasets.


title: Tell Me Something New: A New Framework for Asynchronous Parallel Learning

abstract: We present a novel approach for parallel computation in the context of machine learning that we call "Tell Me Something New" (TMSN). This approach involves a set of independent workers that use broadcast to update each other when they observe "something new". TMSN does not require synchronization or a head node and is highly resilient against failing machines or laggards. We demonstrate the utility of TMSN by applying it to learning boosted trees. We show that our implementation is 10 times faster than XGBoost and LightGBM on the splice-site prediction problem.


title: A new method for quantifying network cyclic structure to improve community detection

abstract: A distinguishing property of communities in networks is that cycles are more prevalent within communities than across communities. Thus, the detection of these communities may be aided through the incorporation of measures of the local "richness" of the cyclic structure. In this paper, we introduce renewal non-backtracking random walks (RNBRW) as a way of quantifying this structure. RNBRW gives a weight to each edge equal to the probability that a non-backtracking random walk completes a cycle with that edge. Hence, edges with larger weights may be thought of as more important to the formation of cycles. Of note, since separate random walks can be performed in parallel, RNBRW weights can be estimated very quickly, even for large graphs. We give simulation results showing that pre-weighting edges through RNBRW may substantially improve the performance of common community detection algorithms. Our results suggest that RNBRW is especially efficient for the challenging case of detecting communities in sparse graphs.


title: A level-set approach for a multi-scale cancer invasion model

abstract: Central to the quest for a deeper understanding of the cancer growth and spread process, the naturally multiscale character of cancer invasion demands appropriate multiscale modelling and analysis approach. The cross-talk between the tissue scale (macro-scale) cancer cell population dynamics and the cell-scale (micro-scale) proteolytic molecular processes along the tumour boundary plays a particularly important role within the invasion processes, leading to dramatic changes in tumour morphology and influencing the overall pattern of cancer spread. Building on the multiscale moving boundary framework proposed in Trucu et al. (Multiscale Model. Simul 11(1): 309-335), in this work we propose a new formulation of this process involving a novel derivation of the macro-scale boundary movement law based on micro-dynamics, involving a transport equation combined with the level-set method. This is explored numerically in a novel finite element macro-micro framework based on cut-cells.


title: A Tunable Base Station Cooperation Scheme for Poisson Cellular Networks

abstract: We propose a tunable location-dependent base station (BS) cooperation scheme by partitioning the plane into three regions: the cell centers, cell edges and cell corners. The area fraction of each region is tuned by the cooperation level $\gamma$ ranging from 0 to 1. Depending on the region a user resides in, he/she receives no cooperation, two-BS cooperation or three-BS cooperation. Here, we use a Poisson point process (PPP) to model BS locations and study a non-coherent joint transmission scheme, $\textit{i.e.}$, selected BSs jointly serve one user in the absence of channel state information (CSI). For the proposed scheme, we examine its performance as a function of the cooperation level using tools from stochastic geometry. We derive an analytical expression for the signal-to-interference ratio (SIR) distribution and its approximation based on the asymptotic SIR gain, along with the characterization of the normalized spectral efficiency per BS. Our result suggests that the proposed scheme with a moderate cooperation level can improve the SIR performance while maintaining the normalized spectral efficiency.


title: Lightweight (Reverse) Fuzzy Extractor with Multiple Referenced PUF Responses

abstract: A Physical unclonable functions (PUF), alike a fingerprint, exploits manufacturing randomness to endow each physical item with a unique identifier. One primary PUF application is the secure derivation of volatile cryptographic keys using a fuzzy extractor comprising of two procedures: i) secure sketch; and ii) entropy extraction. Although the entropy extractor can be lightweight, the overhead of the secure sketch responsible correcting naturally noisy PUF responses is usually costly. We observe that, in general, response unreliability with respect to a enrolled reference measurement increases with increasing differences between the in-the-field PUF operating condition and the operating condition used in evaluating the enrolled reference response. For the first time, we exploit such an important but inadvertent observation. In contrast to the conventional single reference response enrollment, we propose enrolling multiple reference responses (MRR) subject to the same challenge but under multiple distinct operating conditions. The critical observation here is that one of the reference operating conditions is likely to be closer to the operating condition of the field deployed PUF, thus, resulting in minimizing the expected unreliability when compared to the single reference under the nominal condition. Overall, MRR greatly reduces the demand for the expected number of erroneous bits for correction and, subsequently, achieve a significant reduction in the error correction overhead. The significant implementation efficiency gains from the proposed MRR method is demonstrated from software implementations of fuzzy extractors on batteryless resource constraint computational radio frequency identification devices, where realistic PUF data is collected from the embedded intrinsic SRAM PUFs.


title: Three-Dimensional Multicomponent Vesicles: Dynamics & Influence of Material Properties

abstract: In this work, the nonlinear dynamics of a fully three-dimensional multicomponent vesicle in shear flow are explored. Using a volume- and area-conserving projection method coupled to a gradient-augmented level set and surface phase method, the dynamics are systematically studied as a function of the membrane bending rigidity difference between the components, the speed of diffusion compared to the underlying shear flow, and the strength of the phase domain energy compared to the bending energy. Using a pre-segregated vesicle, three dynamics are observed: stationary phase, phase-treading, and a new dynamic called vertical banding. These regimes are very sensitive to the strength of the domain line energy, as the vertical banding regime is not observed when line energy is larger than the bending energy. These findings demonstrate that a complete understanding of multicomponent vesicle dynamics require that the full three-dimensional system be modeled, and show the complexity obtained when considering heterogeneous material properties.


title: Contour location via entropy reduction leveraging multiple information sources

abstract: We introduce an algorithm to locate contours of functions that are expensive to evaluate. The problem of locating contours arises in many applications, including classification, constrained optimization, and performance analysis of mechanical and dynamical systems (reliability, probability of failure, stability, etc.). Our algorithm locates contours using information from multiple sources, which are available in the form of relatively inexpensive, biased, and possibly noisy approximations to the original function. Considering multiple information sources can lead to significant cost savings. We also introduce the concept of contour entropy, a formal measure of uncertainty about the location of the zero contour of a function approximated by a statistical surrogate model. Our algorithm locates contours efficiently by maximizing the reduction of contour entropy per unit cost.

categories: stat.ML cs.LG math.DS math.OC physics.data-an


title: Productively Expressing High-performance Spatial Designs of Givens Rotation-based QR Decomposition Algorithm

abstract: QR decomposition is used prevalently in wireless communication. In this paper, we express the Givens-rotation-based QR decomposition algorithm on a spatial architecture using T2S (Temporal To Spatial), a high-productivity spatial programming methodology for expressing high-performance spatial designs. There are interesting challenges: the loop iteration space is not rectangular, and it is not obvious how the imperative algorithm can be expressed in a functional notation, the starting point of T2S. Using QR decomposition as an example, this paper elucidates some general principle, and de-mystifies high-performance spatial programming. The paper also serves as a tutorial of spatial programming for programmers who are not mathematicians, not expert programmers, and not experts on spatial architectures, but still hope to intuitively identify a high-performance design and map to spatial architectures efficiently.


title: A Compositional Approach to Network Algorithms

abstract: We present elements of a typing theory for flow networks, where "types", "typings", and "type inference" are formulated in terms of familiar notions from polyhedral analysis and convex optimization. Based on this typing theory, we develop an alternative approach to the design and analysis of network algorithms, which we illustrate by applying it to the max-flow problem in multiple-source, multiple-sink, capacited directed planar graphs.


title: A New Perspective on the Large-Scale Tidal Effect on the Galaxy Luminosity and Morphology

abstract: We study the mean tidal coherence of galaxy environments as a function of intrinsic luminosity determined by the absolute $r$-band magnitude. The tidal coherence of a galaxy environment is estimated as the cosine of the angle between two minor eigenvectors of the tidal field smoothed at the scales of $2$ and $30\,h^{-1}$Mpc centered on each of the local galaxies from the Sloan Digital Sky Data Release 10. Creating four luminosity-selected samples of the Sloan galaxies, we control them to have identical density distributions, in order to nullify the dominant effect of the local density. It is found that the samples containing more luminous wall and field galaxies yield lower mean values of the tidal coherence, which trend turns out to be robust against the variation of the smoothing scales. At fixed morphology, the same trend is found for the late-type spiral and lenticular galaxies in both of the field and wall environments. The early-type spiral field galaxies show no significant dependence on the tidal coherence, while both of the least and most luminous elliptical wall galaxies are found to dwell in the regions with highest tidal coherence.


title: Global Ultrasound Elastography Using Convolutional Neural Network

abstract: Displacement estimation is very important in ultrasound elastography and failing to estimate displacement correctly results in failure in generating strain images. As conventional ultrasound elastography techniques suffer from decorrelation noise, they are prone to fail in estimating displacement between echo signals obtained during tissue distortions. This study proposes a novel elastography technique which addresses the decorrelation in estimating displacement field. We call our method GLUENet (GLobal Ultrasound Elastography Network) which uses deep Convolutional Neural Network (CNN) to get a coarse time-delay estimation between two ultrasound images. This displacement is later used for formulating a nonlinear cost function which incorporates similarity of RF data intensity and prior information of estimated displacement. By optimizing this cost function, we calculate the finer displacement by exploiting all the information of all the samples of RF data simultaneously. The Contrast to Noise Ratio (CNR) and Signal to Noise Ratio (SNR) of the strain images from our technique is very much close to that of strain images from GLUE. While most elastography algorithms are sensitive to parameter tuning, our robust algorithm is substantially less sensitive to parameter tuning.


title: Number Sequence Prediction Problems for Evaluating Computational Powers of Neural Networks

abstract: Inspired by number series tests to measure human intelligence, we suggest number sequence prediction tasks to assess neural network models' computational powers for solving algorithmic problems. We define the complexity and difficulty of a number sequence prediction task with the structure of the smallest automaton that can generate the sequence. We suggest two types of number sequence prediction problems: the number-level and the digit-level problems. The number-level problems format sequences as 2-dimensional grids of digits and the digit-level problems provide a single digit input per a time step. The complexity of a number-level sequence prediction can be defined with the depth of an equivalent combinatorial logic, and the complexity of a digit-level sequence prediction can be defined with an equivalent state automaton for the generation rule. Experiments with number-level sequences suggest that CNN models are capable of learning the compound operations of sequence generation rules, but the depths of the compound operations are limited. For the digit-level problems, simple GRU and LSTM models can solve some problems with the complexity of finite state automata. Memory augmented models such as Stack-RNN, Attention, and Neural Turing Machines can solve the reverse-order task which has the complexity of simple pushdown automaton. However, all of above cannot solve general Fibonacci, Arithmetic or Geometric sequence generation problems that represent the complexity of queue automata or Turing machines. The results show that our number sequence prediction problems effectively evaluate machine learning models' computational capabilities.


title: M-estimation with the Trimmed l1 Penalty

abstract: We study high-dimensional estimators with the trimmed $\ell_1$ penalty, which leaves the $h$ largest parameter entries penalty-free. While optimization techniques for this nonconvex penalty have been studied, the statistical properties have not yet been analyzed. We present the first statistical analyses for $M$-estimation and characterize support recovery, $\ell_\infty$ and $\ell_2$ error of the trimmed $\ell_1$ estimates as a function of the trimming parameter $h$. Our results show different regimes based on how $h$ compares to the true support size. Our second contribution is a new algorithm for the trimmed regularization problem, which has the same theoretical convergence rate as the difference of convex (DC) algorithms, but in practice is faster and finds lower objective values. Empirical evaluation of $\ell_1$ trimming for sparse linear regression and graphical model estimation indicate that trimmed $\ell_1$ can outperform vanilla $\ell_1$ and non-convex alternatives. Our last contribution is to show that the trimmed penalty is beneficial beyond $M$-estimation, and yields promising results for two deep learning tasks: input structures recovery and network sparsification.


title: A rational framework for dynamic homogenization at finite wavelengths and frequencies

abstract: In this study, we establish an inclusive paradigm for the homogenization of scalar wave motion in periodic media (with or without the source term) at finite frequencies and wavelengths spanning the first Brioullin zone. We take the eigenvalue problem for the unit cell of periodicity as a point of departure, and we consider the projection of germane Bloch wave function onto a suitable eigenfunction as descriptor of effective wave motion. For generality the finite wavenumber, finite frequency (FW-FF) homogenization is pursued in~$\mathbb{R}^d$ via second-order asymptotic expansion about the apexes of "wavenumber quadrants" comprising the first Brioullin zone, at frequencies near given (optical) dispersion branch. We also consider the degenerate situations of crossing or merging dispersion branches with arbitrary multiplicity, where the effective description of wave motion reveals several distinct asymptotic regimes depending on the symmetries of the eigenfunction basis affiliated with a repeated eigenvalue. One of these regimes -- for whose occurence we expose a sufficient condition -- is shown to describe the so-called Dirac points, i.e. conical contacts between dispersion surfaces, that are relevant to the phenomenon of topological insulation. For all cases considered, the effective description turns out to admit the same general framework, with differences largely being limited to (i) the basis eigenfunction, (ii)~the reference cell of medium periodicity, and (iii)~the wavenumber-frequency scaling law underpinning the asymptotic expansion. We illustrate the utility of our analysis by several examples, including an asymptotic description of the Green's function near the edge of a band gap.


title: Frustration of square cupola in Sr(TiO)Cu$_{4}$(PO$_{4}$)$_{4}$

abstract: The structural and magnetic properties of the square-cupola antiferromagnet Sr(TiO)Cu$_{4}$(PO$_{4}$)$_{4}$ are investigated via x-ray diffraction, magnetization, heat capacity, and $^{31}$P nuclear magnetic resonance experiments on polycrystalline samples, as well as density-functional band-structure calculations. The temperature-dependent unit cell volume could be described well using the Debye approximation with the Debye temperature of $\theta_{\rm D} \simeq $ 550~K. Magnetic response reveals a pronounced two-dimensionality with a magnetic long-range-order below $T_{\rm N} \simeq 6.2$~K. High-field magnetization exhibits a kink at $1/3$ of the saturation magnetization. Asymmetric $^{31}$P NMR spectra clearly suggest strong in-plane anisotropy in the magnetic susceptibility, as anticipated from the crystal structure. From the $^{31}$P NMR shift vs bulk susceptibility plot, the isotropic and axial parts of the hyperfine coupling between $^{31}$P nuclei and the Cu$^{2+}$ spins are calculated to be $A_{\rm hf}^{\rm iso} \simeq 6539$ and $A_{\rm hf}^{\rm ax} \simeq 952$~Oe/$\mu_{\rm B}$, respectively. The low-temperature and low-field $^{31}$P NMR spectra indicate a commensurate antiferromagnetic ordering. Frustrated nature of the compound is inferred from the temperature-dependent $^{31}$P NMR spin-lattice relaxation rate and confirmed by our microscopic analysis that reveals strong frustration of the square cupola by next-nearest-neighbor exchange couplings.


title: Probing Signatures of a Distant Planet around the Young T-Tauri Star CI Tau Hosting a Possible Hot Jupiter

abstract: We search for signatures of a distant planet around the two-million-year-old classical T-Tauri star CI Tau hosting a hot Jupiter candidate (M_{p} sin{i} ~ 8.1 M_{Jupiter}) in an eccentric orbit (e ~0.3). To probe the existence of an outer perturber, we reanalyzed 1.3 mm dust continuum observations of the protoplanetary disk around CI Tau obtained by the Atacama Large Millimeter/submillimeter Array. We found a gap structure at ~0".8 in CI Tau's disk. Our visibility fitting assuming an axisymmetric surface brightness profile suggested that the gap is located at a deprojected radius of 104.5+/-1.6 au and has a width of 36.9+/-2.9 au. The brightness temperature around the gap was calculated to be ~2.3 K lower than that of the ambient disk. Gap-opening mechanisms such as secular gravitational instability and dust trapping can explain the gap morphology in the CI Tau disk. The scenario that an unseen planet created the observed gap structure cannot be ruled out, although the coexistence of an eccentric hot Jupiter and a distant planet around the young CI Tau would be challenging for gravitational scattering scenarios. The mass of the planet was estimated to be between ~0.25 M_{Jupiter} and ~0.8 M_{Jupiter} from the gap width and depth (0.41 +0.04/-0.06) in the modeled surface brightness image, which is lower than the current detection limits of high-contrast direct imaging. The young classical T-Tauri CI Tau may be a unique system to explore the existence of a potential distant planet as well as the origin of an eccentric hot Jupiter.


title: Fast Disparity Estimation using Dense Networks

abstract: Disparity estimation is a difficult problem in stereo vision because the correspondence technique fails in images with textureless and repetitive regions. Recent body of work using deep convolutional neural networks (CNN) overcomes this problem with semantics. Most CNN implementations use an autoencoder method; stereo images are encoded, merged and finally decoded to predict the disparity map. In this paper, we present a CNN implementation inspired by dense networks to reduce the number of parameters. Furthermore, our approach takes into account semantic reasoning in disparity estimation. Our proposed network, called DenseMapNet, is compact, fast and can be trained end-to-end. DenseMapNet requires 290k parameters only and runs at 30Hz or faster on color stereo images in full resolution. Experimental results show that DenseMapNet accuracy is comparable with other significantly bigger CNN-based methods.


title: GADAM: Genetic-Evolutionary ADAM for Deep Neural Network Optimization

abstract: Deep neural network learning can be formulated as a non-convex optimization problem. Existing optimization algorithms, e.g., Adam, can learn the models fast, but may get stuck in local optima easily. In this paper, we introduce a novel optimization algorithm, namely GADAM (Genetic-Evolutionary Adam). GADAM learns deep neural network models based on a number of unit models generations by generations: it trains the unit models with Adam, and evolves them to the new generations with genetic algorithm. We will show that GADAM can effectively jump out of the local optima in the learning process to obtain better solutions, and prove that GADAM can also achieve a very fast convergence. Extensive experiments have been done on various benchmark datasets, and the learning results will demonstrate the effectiveness and efficiency of the GADAM algorithm.


title: Migration of Planets Into and Out of Mean Motion Resonances in Protoplanetary Discs: Overstability of Capture and Nonlinear Eccentricity Damping

abstract: A number of multiplanet systems are observed to contain planets very close to mean motion resonances, although there is no significant pileup of precise resonance pairs. We present theoretical and numerical studies on the outcome of capture into first-order mean motion resonances (MMRs) using a parametrized planet migration model that takes into account nonlinear eccentricity damping due to planet-disk interaction. This parametrization is based on numerical hydrodynamical simulations and is more realistic than the simple linear parametrization widely used in previous analytic studies. We find that nonlinear eccentricity damping can significantly influence the stability and outcome of resonance capture. In particular, the equilibrium eccentricity of the planet captured into MMRs become larger, and the captured MMR state tends to be more stable compared to the prediction based on the simple migration model. In addition, when the migration is sufficiently fast or/and the planet mass ratio is sufficiently small, we observe a novel phenomenon of eccentricity overshoot, where the planet's eccentricity becomes very large before settling down to the lower equilibrium value. This can lead to the ejection of the smaller planet if its eccentricity approaches unity during the overshoot. This may help explain the lack of low-mass planet companion of hot Jupiters when compared to warm Jupiters.


title: On Deep Ensemble Learning from a Function Approximation Perspective

abstract: In this paper, we propose to provide a general ensemble learning framework based on deep learning models. Given a group of unit models, the proposed deep ensemble learning framework will effectively combine their learning results via a multilayered ensemble model. In the case when the unit model mathematical mappings are bounded, sigmoidal and discriminatory, we demonstrate that the deep ensemble learning framework can achieve a universal approximation of any functions from the input space to the output space. Meanwhile, to achieve such a performance, the deep ensemble learning framework also impose a strict constraint on the number of involved unit models. According to the theoretic proof provided in this paper, given the input feature space of dimension d, the required unit model number will be 2d, if the ensemble model involves one single layer. Furthermore, as the ensemble component goes deeper, the number of required unit model is proved to be lowered down exponentially.


title: Positive Entropy Through Pointwise Dynamics

abstract: We define some pointwise properties of topological dynamical systems and give pointwise conditions for such a system possesses positive topological entropy. We give sufficient conditions to obtain positive topological entropy for maps which are approximated by maps with the shadowing property in a uniform way.


title: Deep Loopy Neural Network Model for Graph Structured Data Representation Learning

abstract: Existing deep learning models may encounter great challenges in handling graph structured data. In this paper, we introduce a new deep learning model for graph data specifically, namely the deep loopy neural network. Significantly different from the previous deep models, inside the deep loopy neural network, there exist a large number of loops created by the extensive connections among nodes in the input graph data, which makes model learning an infeasible task. To resolve such a problem, in this paper, we will introduce a new learning algorithm for the deep loopy neural network specifically. Instead of learning the model variables based on the original model, in the proposed learning algorithm, errors will be back-propagated through the edges in a group of extracted spanning trees. Extensive numerical experiments have been done on several real-world graph datasets, and the experimental results demonstrate the effectiveness of both the proposed model and the learning algorithm in handling graph data.


title: Free-rider Episode Screening via Dual Partition Model

abstract: One of the drawbacks of frequent episode mining is that overwhelmingly many of the discovered patterns are redundant. Free-rider episode, as a typical example, consists of a real pattern doped with some additional noise events. Because of the possible high support of the inside noise events, such free-rider episodes may have abnormally high support that they cannot be filtered by frequency based framework. An effective technique for filtering free-rider episodes is using a partition model to divide an episode into two consecutive subepisodes and comparing the observed support of such episode with its expected support under the assumption that these two subepisodes occur independently. In this paper, we take more complex subepisodes into consideration and develop a novel partition model named EDP for free-rider episode filtering from a given set of episodes. It combines (1) a dual partition strategy which divides an episode to an underlying real pattern and potential noises; (2) a novel definition of the expected support of a free-rider episode based on the proposed partition strategy. We can deem the episode interesting if the observed support is substantially higher than the expected support estimated by our model. The experiments on synthetic and real-world datasets demonstrate EDP can effectively filter free-rider episodes compared with existing state-of-the-arts.


title: A Geometric Construction of Solutions to 11D Supergravity

abstract: Necessary and sufficient conditions are provided for a class of warped product manifolds with non-vanishing flux to be supersymmetric solutions of 11D supergravity. Many noncompact, but complete solutions can be obtained in this manner, including the multi-membrane solution initially found by Duff and Stelle. In a different direction, an explicit 5-parameter moduli space of solutions to 11D supergravity is also constructed which can be viewed as nonsupersymmetric deformations of the Duff-Stelle solution.


title: Reconciled Polynomial Machine: A Unified Representation of Shallow and Deep Learning Models

abstract: In this paper, we aim at introducing a new machine learning model, namely reconciled polynomial machine, which can provide a unified representation of existing shallow and deep machine learning models. Reconciled polynomial machine predicts the output by computing the inner product of the feature kernel function and variable reconciling function. Analysis of several concrete models, including Linear Models, FM, MVM, Perceptron, MLP and Deep Neural Networks, will be provided in this paper, which can all be reduced to the reconciled polynomial machine representations. Detailed analysis of the learning error by these models will also be illustrated in this paper based on their reduced representations from the function approximation perspective.


title: GEN Model: An Alternative Approach to Deep Neural Network Models

abstract: In this paper, we introduce an alternative approach, namely GEN (Genetic Evolution Network) Model, to the deep learning models. Instead of building one single deep model, GEN adopts a genetic-evolutionary learning strategy to build a group of unit models generations by generations. Significantly different from the wellknown representation learning models with extremely deep structures, the unit models covered in GEN are of a much shallower architecture. In the training process, from each generation, a subset of unit models will be selected based on their performance to evolve and generate the child models in the next generation. GEN has significant advantages compared with existing deep representation learning models in terms of both learning effectiveness, efficiency and interpretability of the learning process and learned results. Extensive experiments have been done on diverse benchmark datasets, and the experimental results have demonstrated the outstanding performance of GEN compared with the state-of-the-art baseline methods in both effectiveness of efficiency.


title: Sparsely Grouped Multi-task Generative Adversarial Networks for Facial Attribute Manipulation

abstract: Recent Image-to-Image Translation algorithms have achieved significant progress in neural style transfer and image attribute manipulation tasks. However, existing approaches require exhaustively labelling training data, which is labor demanding, difficult to scale up, and hard to migrate into new domains. To overcome such a key limitation, we propose Sparsely Grouped Generative Adversarial Networks (SG-GAN) as a novel approach that can translate images on sparsely grouped datasets where only a few samples for training are labelled. Using a novel one-input multi-output architecture, SG-GAN is well-suited for tackling sparsely grouped learning and multi-task learning. The proposed model can translate images among multiple groups using only a single commonly trained model. To experimentally validate advantages of the new model, we apply the proposed method to tackle a series of attribute manipulation tasks for facial images. Experimental results demonstrate that SG-GAN can generate image translation results of comparable quality with baselines methods on adequately labelled datasets and results of superior quality on sparsely grouped datasets. The official implementation is publicly available:https://github.com/zhangqianhui/Sparsely-Grouped-GAN.


title: On observation of position in quantum theory

abstract: Newtonian and Scrodinger dynamics can be formulated in a physically meaningful way within the same Hilbert space framework. This fact was recently used to discover an unexpected relation between classical and quantum motions that goes beyond the results provided by the Ehrenfest theorem. A formula relating the normal probability distribution and the Born rule was also found. Here the dynamical mechanism responsible for the latter formula is proposed and applied to measurements of macroscopic and microscopic systems. A relationship between the classical Brownian motion and the diffusion of state on the space of states is discovered. The role of measuring devices in quantum theory is investigated in the new framework. It is shown that the so-called collapse of the wave function is not measurement specific and does not require a "concentration" near the eigenstates of the measured observable. Instead, it is explained by the common diffusion of a state over the space of states under interaction with the apparatus and the environment. This in turn provides us with a basic reason for the definite position of macroscopic bodies in space.


title: Nature of the high-speed rupture of the two-dimensional Burridge-Knopoff model of earthquakes

abstract: The nature of the high-speed rupture or the main shock of the Burridge-Knopoff spring-block model in two dimensions obeying the rate-and-state dependent friction law is studied by means of extensive computer simulations. It is found that the rupture propagation in larger events is highly anisotropic and irregular in shape on longer length scales, although the model is completely uniform and the rupture-propagation velocity is kept constant everywhere at the rupture front. The manner of the rupture propagation sometimes mimics the successive ruptures of neighboring "asperities" observed in real large earthquakes. Large events tend to be unilateral, with its epicenter lying at the rim of its rupture zone. The epicenter site is also located next to the rim of the rupture zone of some past event. Event-size distributions are computed and discussed in comparison with those of the corresponding one-dimensional model. The magnitude distribution exhibits a power-law behavior resembling the Gutenberg-Richter law for smaller magnitudes, which changes over to a more characteristic behavior for larger magnitudes. The behavior of the rupture length for larger events is discussed in terms of the strongly anisotropic rupture propagation of large events reflecting the underlying geometry.


title: Physically optimizing inference

abstract: Data is scaling exponentially in fields ranging from genomics to neuroscience to economics. A central question is: can modern machine learning methods be applied to construct predictive models of natural systems like cells and brains based on large data sets? In this paper, we examine how inference is impacted when training data is generated by the statistical behavior of a physical system, and hence outside direct control by the experimentalist. We develop an information-theoretic analysis for the canonical problem of spin-network inference. Our analysis reveals the essential role that the physical properties of the spin network and its environment play in determining the difficulty of the underlying machine learning problem. Specifically, stochastic fluctuations drive a system to explore a range of configurations providing `raw' information for a learning algorithm to construct an accurate model; yet they also blur energetic differences between network states and thereby degrade information. This competition leads spin networks to generically have an intrinsic optimal temperature at which stochastic spin fluctuations provide maximal information for discriminating among competing models, maximizing inference efficiency. We demonstrate a simple active learning protocol that optimizes network temperature to boost inference efficiency and dramatically increases the efficiency of inference on a neural circuit reconstruction task. Our results reveal a fundamental link between physics and information and show how the physical environment can be tuned to optimize the efficiency of machine learning.

categories: cond-mat.stat-mech cond-mat.dis-nn physics.data-an q-bio.MN q-bio.QM


title: Diverse Few-Shot Text Classification with Multiple Metrics

abstract: We study few-shot learning in natural language domains. Compared to many existing works that apply either metric-based or optimization-based meta-learning to image domain with low inter-task variance, we consider a more realistic setting, where tasks are diverse. However, it imposes tremendous difficulties to existing state-of-the-art metric-based algorithms since a single metric is insufficient to capture complex task variations in natural language domain. To alleviate the problem, we propose an adaptive metric learning approach that automatically determines the best weighted combination from a set of metrics obtained from meta-training tasks for a newly seen few-shot task. Extensive quantitative evaluations on real-world sentiment analysis and dialog intent classification datasets demonstrate that the proposed method performs favorably against state-of-the-art few shot learning algorithms in terms of predictive accuracy. We make our code and data available for further study.


title: Optimization of Neon Soft X-ray Emission in Low Energy Dense Plasma Focus Device

abstract: The Lee model code is used in numerical experiments for characterizing and optimizing neon soft X-ray (Ysxr) yield of UNU/ICTP PFF machine operated at 14 kV and 30 micro F. The neon Ysxr yield of the dense plasma focus device is enhanced by reducing static inductance (L0) and anode length (z0) along with increasing anode radius (a) and cathode radius (b), keeping their ratio (c = b/a) constant at 3.368. At the optimum combination of the electrodes geometry and static inductance, the maximum computed value of neon Ysxr yield is 63.61 J at operating pressure 3.3 Torr with corresponding X-ray yield efficiency 2.16%, while the end axial speed becomes 6.42 cm/s. This value of neon Ysxr yield is twelve to thirteen times higher than the measured value (5.4 J) at 3.0 Torr. It is also found that this neon Ysxr yield is improved around seven times from previously computed value (9.5 J) at 3.5 Torr for optimum anode configuration of this machine. Our obtained results of neon Ysxr yield are also compared with the computed results of AECS-PF2 machine operated at 15 kV and 25 micro F and is found that our results are about three times better than that from the optimized AECS-PF2 at L0 = 15 nH.


title: Haar-open sets: a right way of generalizing the Steinhaus sum theorem to non-locally compact groups

abstract: Let $X$ be the countable product of Abelian locally compact Polish groups and $A,B\subset X$ be two Borel sets, which are not Haar-null in $X$. We prove that the sum-set $A+B:=\{a+b:a\in A,\;\;b\in B\}$ is Haar-open in the sense that for any non-empty compact subset $K\subset X$ and point $p\in K$ there exists a point $x\in X$ such that the set $K\cap(A+B+x)$ is a neighborhood of $p$ in $K$. This is a generalization of the classical Steinhaus Theorem (1920) to non-locally compact groups. We do not know if this generalization holds for Banach spaces.


title: Estimation of Non-Normalized Mixture Models and Clustering Using Deep Representation

abstract: We develop a general method for estimating a finite mixture of non-normalized models. Here, a non-normalized model is defined to be a parametric distribution with an intractable normalization constant. Existing methods for estimating non-normalized models without computing the normalization constant are not applicable to mixture models because they contain more than one intractable normalization constant. The proposed method is derived by extending noise contrastive estimation (NCE), which estimates non-normalized models by discriminating between the observed data and some artificially generated noise. We also propose an extension of NCE with multiple noise distributions. Then, based on the observation that conventional classification learning with neural networks is implicitly assuming an exponential family as a generative model, we introduce a method for clustering unlabeled data by estimating a finite mixture of distributions in an exponential family. Estimation of this mixture model is attained by the proposed extensions of NCE where the training data of neural networks are used as noise. Thus, the proposed method provides a probabilistically principled clustering method that is able to utilize a deep representation. Application to image clustering using a deep neural network gives promising results.


title: The global optimum of shallow neural network is attained by ridgelet transform

abstract: We prove that the global minimum of the backpropagation (BP) training problem of neural networks with an arbitrary nonlinear activation is given by the ridgelet transform. A series of computational experiments show that there exists an interesting similarity between the scatter plot of hidden parameters in a shallow neural network after the BP training and the spectrum of the ridgelet transform. By introducing a continuous model of neural networks, we reduce the training problem to a convex optimization in an infinite dimensional Hilbert space, and obtain the explicit expression of the global optimizer via the ridgelet transform.


title: Affine logic for constructive mathematics

abstract: We show that numerous distinctive concepts of constructive mathematics arise automatically from an "antithesis" translation of affine logic into intuitionistic logic via a Chu/Dialectica construction. This includes apartness relations, complemented subsets, anti-subgroups and anti-ideals, strict and non-strict order pairs, cut-valued metrics, and apartness spaces. We also explain the constructive bifurcation of some classical concepts using the choice between multiplicative and additive affine connectives. Affine logic and the antithesis construction thus systematically "constructivize" classical definitions, handling the resulting bookkeeping automatically.


title: Mechanism of interaction of discrete and continuous variable states for efficient generation of hybrid entangled states

abstract: We develop theory of realization of hybrid entanglement between discrete-variable (single photon) and continuous-variable states (coherent states). A highly transmissive beam splitter (HTBS) is used for interaction of the ingredients. Mechanism for generating the hybrid entangled states is based on the simultaneous displacement of the discrete-variable state on equal in absolute value but opposite in sign displacement amplitudes by coherent components, in such a way that all the information about the displacement amplitudes is lost with subsequent registration of photons in the auxiliary mode. Conditions for the balanced hybrid entangled states generation are found. Our approach follows along lines experimentally demonstrated in Nat. Photonics 8, 570-574 (2014).


title: Counting copies of a fixed subgraph in $F$-free graphs

abstract: Fix graphs $F$ and $H$ and let $ex(n,H,F)$ denote the maximum possible number of copies of the graph $H$ in an $n$-vertex $F$-free graph. The systematic study of this function was initiated by Alon and Shikhelman [{\it J. Comb. Theory, B}. {\bf 121} (2016)]. In this paper, we give new general bounds concerning this generalized Tur\'an function. We also determine $ex(n,P_k,K_{2,t})$ (where $P_k$ is a path on $k$ vertices) and $ex(n,C_k,K_{2,t})$ asymptotically for every $k$ and $t$. For example, it is shown that for $t \geq 2$ and $k\geq 5$ we have $ex(n,C_k,K_{2,t})=\left(\frac{1}{2k}+o(1)\right)(t-1)^{k/2}n^{k/2}$. We also characterize the graphs $F$ that cause the function $ex(n,C_k,F)$ to be linear in $n$. In the final section we discuss a connection between the function $ex(n,H,F)$ and Berge hypergraph problems.


title: Extremal areas of polygons with fixed perimeter

abstract: We consider the configuration space of planar $n$-gons with fixed perimeter, which is diffeomorphic to the complex projective space $\mathbb{C}P^{n-2}$. The oriented area function has the minimal number of critical points on the configuration space. We describe its critical points (these are regular stars) and compute their indices when they are Morse.


title: $\epsilon'/\epsilon$ from charged-Higgs-induced gluonic dipole operators

abstract: We study the effect of charged-Higgs-induced chromomagnetic operator, $Q_{8G}(-) \equiv \bar s \sigma^{\mu \nu} T^a \gamma_5 d G^a_{\mu \nu}$, on the Kaon direct CP violation $Re(\epsilon'/\epsilon)$. Using the matrix element $\langle \pi \pi | O_{8G}(-) | K^0 \rangle$ recently obtained by a large $N_c$ dual QCD approach, we find that if the Kobayashi-Maskawa phase is the origin of CP violation, the charged-Higgs-induced gluon penguin dipole operator in the type-III two-Higgs-doublet model can explain the measured $Re(\epsilon'/\epsilon)$ when the constraints from the relevant low energy flavor physics, such as $\Delta B(K)=2$, $B\to X_s \gamma$, and Kaon indirect CP violation parameter $\epsilon$, are included.


title: Addressing the Majorana vs. Dirac Question Using Neutrino Decays

abstract: We explain why it is so hard to determine whether neutrinos are Majorana or Dirac particles as long as the only neutrinos we study are ultra-relativistic. We then show how non-relativistic neutrinos could help, and focus on the angular distributions in the decays of an as-yet-to-be-discovered heavy neutrino $N$. We find that these angular distributions could very well tell us whether neutrinos are Majorana or Dirac particles.


title: Various damage mechanisms in carbon and silicon materials under femtosecond x-ray irradiation

abstract: We review the results of our research on damage mechanisms in materials irradiated with femtosecond free-electron-laser (FEL) pulses. They were obtained using our hybrid approach, XTANT (X-ray-induced Thermal And Nonthermal Transitions). Various damage mechanisms are discussed with respect to the pulse fluence and material properties on examples of diamond, amorphous carbon, C60 crystal, and silicon. We indicate conditions: producing thermal melting of targets as a result of electron-ion energy exchange; nonthermal phase transitions due to modification of the interatomic potential; Coulomb explosion due to accumulated net charge in finite-size systems; spallation or ablation at higher fluences due to detachment of sample fragments; and warm dense matter formation. Transient optical coefficients are compared with experimental data whenever available, proving the validity of our modeling approach. Predicted diffraction patterns can be compared with the results of ongoing or future FEL experiments. Limitations of our model and possible future directions of development are outlined.


title: Clustering algorithm for formations in football games

abstract: This paper develops a clustering algorithm for formations in team sports, with a focus on football games. Our method first clusters formations into several average formations: `442,' `4141,' `433,' `541,' and `343.' Then, each average formation is further divided into more specific patterns in which the configurations of players are slightly different. The latter step is based on hierarchical clustering and the Delaunay method, which defines the formation of a team as an adjacency matrix of Delaunay triangulation. A formation clustered using our method is expressed in a form such as `442-C1'.


title: Deep Predictive Coding Network with Local Recurrent Processing for Object Recognition

abstract: Inspired by "predictive coding" - a theory in neuroscience, we develop a bi-directional and dynamic neural network with local recurrent processing, namely predictive coding network (PCN). Unlike feedforward-only convolutional neural networks, PCN includes both feedback connections, which carry top-down predictions, and feedforward connections, which carry bottom-up errors of prediction. Feedback and feedforward connections enable adjacent layers to interact locally and recurrently to refine representations towards minimization of layer-wise prediction errors. When unfolded over time, the recurrent processing gives rise to an increasingly deeper hierarchy of non-linear transformation, allowing a shallow network to dynamically extend itself into an arbitrarily deep network. We train and test PCN for image classification with SVHN, CIFAR and ImageNet datasets. Despite notably fewer layers and parameters, PCN achieves competitive performance compared to classical and state-of-the-art models. Further analysis shows that the internal representations in PCN converge over time and yield increasingly better accuracy in object recognition. Errors of top-down prediction also reveal visual saliency or bottom-up attention.


title: Two-stage quality adaptive fingerprint image enhancement using Fuzzy c-means clustering based fingerprint quality analysis

abstract: Fingerprint recognition techniques are immensely dependent on quality of the fingerprint images. To improve the performance of recognition algorithm for poor quality images an efficient enhancement algorithm should be designed. Performance improvement of recognition algorithm will be more if enhancement process is adaptive to the fingerprint quality (wet, dry or normal). In this paper, a quality adaptive fingerprint enhancement algorithm is proposed. The proposed fingerprint quality assessment algorithm clusters the fingerprint images in appropriate quality class of dry, wet, normal dry, normal wet and good quality using fuzzy c-means technique. It considers seven features namely, mean, moisture, variance, uniformity, contrast, ridge valley area uniformity and ridge valley uniformity into account for clustering the fingerprint images in appropriate quality class. Fingerprint images of each quality class undergo through a two-stage fingerprint quality enhancement process. A quality adaptive preprocessing method is used as front-end before enhancing the fingerprint images with Gabor, short term Fourier transform and oriented diffusion filtering based enhancement techniques. Experimental results show improvement in the verification results for FVC2004 datasets. Significant improvement in equal error rate is observed while using quality adaptive preprocessing based approaches in comparison to the current state-of-the-art enhancement techniques.


title: Cellular function given parametric variation: excitability in the Hodgkin-Huxley model

abstract: How is reliable physiological function maintained in cells despite considerable variability in the values of key parameters of multiple interacting processes that govern that function? Here we use the classic Hodgkin-Huxley formulation of the squid giant axon action potential to propose a possible approach to this problem. Although the full Hodgkin-Huxley model is very sensitive to fluctuations that independently occur in its many parameters, the outcome is in fact determined by simple combinations of these parameters along two physiological dimensions: Structural and Kinetic (denoted $S$ and $K$). Structural parameters describe the properties of the cell, including its capacitance and the densities of its ion channels. Kinetic parameters are those that describe the opening and closing of the voltage-dependent conductances. The impacts of parametric fluctuations on the dynamics of the system, seemingly complex in the high dimensional representation of the Hodgkin-Huxley model, are tractable when examined within the $S-K$ plane. We demonstrate that slow inactivation, a ubiquitous activity-dependent feature of ionic channels, is a powerful local homeostatic control mechanism that stabilizes excitability amid changes in structural and kinetic parameters.


title: Theoretical and Numerical Investigation of Liquid-Gas Interface Location of Capillary Driven Flow During the Time Throughout Circular Microchannels

abstract: The main aim of this study is to find the best, most rapid, and the most accurate numerical method to find the liquid-gas interface of capillary driven flow during the time in circular Microchannels by using COMSOL Multiphysics software. Capillary driven flow by eliminating micropumps or any physical pressure gradient generators can make the microfluidic devices cheaper and more usable. Hence, by using this two-phase flow, the final costs of lots of microfluidic devices and lab-on-a-chip can significantly be decreased and help them to be commercialized. The first step to employing the capillary flow in these devices is the simulation of this flow inside the microchannels. One of the most common and valid software for this work is COMSOL Multiphysics; this fact reveals the importance of this study. In this research study, simulation results obtained by using two possible numerical methods in this software, for capillary flows of water and ethanol in two different circular microchannels, verified and compared with four other methods, which verified experimentally before. Finally, the most accurate and time-saving numerical method of this software will be specified. This appropriate technique can contribute to simulate microfluidic and lab-on-a-chip devices, which are made of different mechanical and electrical parts, in COMSOL Multiphysics software by choosing the best method.


title: Shabat Polynomials and Monodromy Groups of Trees Uniquely Determined by their Passport

abstract: A dessin d'enfant, or dessin, is a bicolored graph embedded into a Riemann surface. Acyclic dessins can be described analytically by pre-images of certain polynomials, called Shabat polynomials, and also algebraically by their monodromy groups, that is, the group generated by rotations of edges about black and white vertices. In this paper we investigate the Shabat polynomials and monodromy groups of planar acyclic dessins that are uniquely determined by their passports.


title: Neural networks with dynamical coefficients and adjustable connections on the basis of integrated backpropagation

abstract: We consider artificial neurons which will update their weight coefficients with an internal rule based on backpropagation, rather than using it as an external training procedure. To achieve this we include the backpropagation error estimate as a separate entity in all the neuron models and perform its exchange along the synaptic connections. In addition to this we add some special type of neurons with reference inputs, which will serve as a base source of error estimates for the whole network. Finally, we introduce a training control signal for all the neurons, which can enable the correction of weights and the exchange of error estimates. For recurrent neural networks we also demonstrate how to integrate backpropagation through time into their formalism with the help of some stack memory for reference inputs and external data inputs of neurons. Also, for widely used neural networks, such as long short-term memory, radial basis function networks, multilayer perceptrons and convolutional neural networks, we demonstrate their alternative description within the framework of our new formalism.


title: Optimal Consumption in the Stochastic Ramsey Problem without Boundedness Constraints

abstract: This paper investigates optimal consumption in the stochastic Ramsey problem with the Cobb-Douglas production function. Contrary to prior studies, we allow for general consumption processes, without any a priori boundedness constraint. A non-standard stochastic differential equation, with neither Lipschitz continuity nor linear growth, specifies the dynamics of the controlled state process. A mixture of probabilistic arguments are used to construct the state process, and establish its non-explosiveness and strict positivity. This leads to the optimality of a feedback consumption process, defined in terms of the value function and the state process. Based on additional viscosity solutions techniques, we characterize the value function as the unique classical solution to a nonlinear elliptic equation, among an appropriate class of functions. This characterization involves a condition on the limiting behavior of the value function at the origin, which is the key to dealing with unbounded consumptions. Finally, relaxing the boundedness constraint is shown to increase, strictly, the expected utility at all wealth levels.


title: alpha-induced reactions on 115In: cross section measurements and statistical model analysis

abstract: [Background] Alpha-nucleus optical potentials are basic ingredients of statistical model calculations used in nucleosynthesis simulations. While the nucleon+nucleus optical potential is fairly well known, for the alpha+nucleus optical potential several different parameter sets exist and large deviations, reaching sometimes even an order of magnitude, are found between the cross section predictions calculated using different parameter sets. [Purpose] A measurement of the radiative alpha-capture and the alpha-induced reaction cross sections on the nucleus 115In at low energies allows a stringent test of statistical model predictions. Since experimental data is scarce in this mass region, this measurement can be an important input to test the global applicability of alpha+nucleus optical model potentials and further ingredients of the statistical model. [Methods] The reaction cross sections were measured by means of the activation method. The produced activities were determined by off-line detection of the gamma-rays and characteristic x-rays emitted during the electron capture decay of the produced Sb isotopes. The 115In(alpha,gamma)119Sb and 115In(alpha,n)118Sbm reaction cross sections were measured between Ec.m. = 8.83 MeV - 15.58 MeV, and the 115In(alpha,n)118Sbg reaction was studied between Ec.m. = 11.10 MeV - 15.58 MeV. The theoretical analysis was performed within the statistical model.


title: Light propagation and optical scalars in torsion theories of gravity

abstract: We investigate the propagation of light rays and evolution of optical scalars in gauge theories of gravity where torsion is present. Recently the modified Raychaudhuri equation in the presence of torsion has been derived. We use this result to derive the basic equations of geometric optics for several different interesting solutions of the Poincar{\'e} gauge theory of gravity. The results show that the focusing effects for neighboring light rays will be different than general relativity. This in turn has practical consequences in the study of gravitational lensing effects and also determining the angular diameter distance for cosmological objects.


title: An optimal approximation of discrete random variables with respect to the Kolmogorov distance

abstract: We present an algorithm that takes a discrete random variable $X$ and a number $m$ and computes a random variable whose support (set of possible outcomes) is of size at most $m$ and whose Kolmogorov distance from $X$ is minimal. In addition to a formal theoretical analysis of the correctness and of the computational complexity of the algorithm, we present a detailed empirical evaluation that shows how the proposed approach performs in practice in different applications and domains.


title: High mode magnetohydrodynamic waves propagation in a twisted rotating jet emerging from a filament eruption

abstract: We study the conditions under which high mode magnetohydrodynamic (MHD) waves propagating on a rotating jet emerging from the filament eruption on 2013 April 10--11 can became unstable against the Kelvin--Helmholtz instability (KHI). The evolution of jet indicates the blob like structure at its boundary which could be one of the observable features of the KHI development. We model the jet as a twisted rotating axially moving magnetic flux tube and explore the propagation characteristics of the running MHD modes on the basis of dispersion relations derived in the framework of the ideal magnetohydrodynamics. It is established that unstable MHD waves with wavelengths in the range of $12$--$15$~Mm and instability developing times from $1.5$ to $2.6$~min can be detected at the excitation of high mode MHD waves. The magnitude of the azimuthal mode number $m$ crucially depends upon the twist of the internal magnetic field. It is found that at slightly twisted magnetic flux tube the appropriate azimuthal mode number is $m = 16$ while in the case of a moderately twisted flux tube it is equal to $18$.


title: Strong convergence of numerical discretizations for semilinear stochastic evolution equations driven by multiplicative white noise

abstract: For semilinear stochastic evolution equations whose coefficients are more general than the classical global Lipschitz, we present results on the strong convergence rates of numerical discretizations. The proof of them provides a new approach to strong convergence analysis of numerical discretizations for a large family of second order parabolic stochastic partial differential equations driven by space-time white noises. We apply these results to the stochastic advection-diffusion-reaction equation with a gradient term and multiplicative white noise, and show that the strong convergence rate of a fully discrete scheme constructed by spectral Galerkin approximation and explicit exponential integrator is exactly $\frac12$ in space and $\frac14$ in time. Compared with the optimal regularity of the mild solution, it indicates that the spetral Galerkin approximation is superconvergent and the convergence rate of the exponential integrator is optimal. Numerical experiments support our theoretical analysis.


title: High Curie temperature half metallic 2D M2Se3 (M = Co, Ni, and Pd) monolayers with superior mechanical flexibility

abstract: Pursuing two-dimensional (2D) intrinsic ferromagnetism with high Curie temperature and great mechanical flexibility has attracted great interest in flexible spintronics. In the present work, we carried out a density functional theory (DFT) investigation on the 2D M2Se3 (M=Co, Ni and Pd) monolayers to understand their structural stabilities, electronic, magnetic and mechanical properties. Our results show that the Co2Se3 monolayer exhibits a fascinating half-metallic ferromagnetism with high Curie temperature (>700K). In addition, due to their unique buckling hinge-like structure, M2Se3 monolayers possess the large out-of-plane negative Poisson's ratio (NPR) and superior mechanical flexibility evidenced by their unusual critical strain two times greater than the well-known 2D materials. These findings imply that 2D M2Se3 family is the promising materials for the applications in the flexible and high-density spintronic nanodevices.


title: The hierarchical and perturbative forms of stochastic Schr\"odinger equations and their applications to carrier dynamics in organic materials

abstract: A number of non-Markovian stochastic Schr\"odinger equations, ranging from the numerically exact hierarchical form towards a series of perturbative expressions sequentially presented in an ascending degrees of approximations are revisited in this short review, aiming at providing a systematic framework which is capable to connect different kinds of the wavefunction-based approaches for an open system coupled to the harmonic bath. One can optimistically expect the extensive future applications of those non-Markovian stochastic Schr\"odinger equations in large-scale realistic complex systems, benefiting from their favorable scaling with respect to the system size, the stochastic nature which is extremely suitable for parallel computing, and many other distinctive advantages. In addition, we have presented a few examples showing the excitation energy transfer in Fenna-Matthews-Olson complex, a quantitative measure of decoherence timescale of hot exciton, and the study of quantum interference effects upon the singlet fission processes in organic materials, since a deep understanding of both mechanisms is very important to explore the underlying microscopic processes and to provide novel design principles for highly efficient organic photovoltaics.


title: Pattern Transitions in a Soft Cylindrical Shell

abstract: Instability patterns of rolling up a sleeve appear more intricate than the ones of walking over a rug on floor, both characterized as uniaxially compressed soft-film/stiff-substrate systems. This can be explained by curvature effects. To investigate pattern transitions on a curved surface, we study a soft shell sliding on a rigid cylinder by experiments, computations and theoretical analyses. We reveal a novel post-buckling phenomenon involving multiple successive bifurcations: smooth-wrinkle-ridge-sagging transitions. The shell initially buckles into periodic axisymmetric wrinkles at the threshold and then a wrinkle-to-ridge transition occurs upon further axial compression. When the load increases to the third bifurcation, the amplitude of the ridge reaches its limit and the symmetry is broken with the ridge sagging into a recumbent fold. It is identified that hysteresis loops and the Maxwell equal-energy conditions are associated with the co-existence of wrinkle/ridge or ridge/sagging patterns. Such a bifurcation scheme is inherently general and independent of material constitutive models.


title: Learning to Multitask

abstract: Multitask learning has shown promising performance in many applications and many multitask models have been proposed. In order to identify an effective multitask model for a given multitask problem, we propose a learning framework called learning to multitask (L2MT). To achieve the goal, L2MT exploits historical multitask experience which is organized as a training set consists of several tuples, each of which contains a multitask problem with multiple tasks, a multitask model, and the relative test error. Based on such training set, L2MT first uses a proposed layerwise graph neural network to learn task embeddings for all the tasks in a multitask problem and then learns an estimation function to estimate the relative test error based on task embeddings and the representation of the multitask model based on a unified formulation. Given a new multitask problem, the estimation function is used to identify a suitable multitask model. Experiments on benchmark datasets show the effectiveness of the proposed L2MT framework.


title: Structural instability of driven Josephson circuits prevented by an inductive shunt

abstract: Superconducting circuits are a versatile platform to implement a multitude of Hamiltonians which perform quantum computation, simulation and sensing tasks. A key ingredient for realizing a desired Hamiltonian is the irradiation of the circuit by a strong drive. These strong drives provide an in-situ control of couplings, which cannot be obtained by near-equilibrium Hamiltonians. However, as shown in this paper, out-of-equilibrium systems are easily plagued by complex dynamics leading to instabilities. Predicting and preventing these instabilities is crucial, both from a fundamental and application perspective. We propose an inductively shunted transmon as the elementary circuit optimized for strong parametric drives. Developing a novel numerical approach that avoids the built-in limitations of perturbative analysis, we demonstrate that adding the inductive shunt significantly extends the range of pump powers over which the circuit behaves in a stable manner.


title: Properties of solutions to porous medium problems with different sources and boundary conditions

abstract: In this paper we study nonnegative and classical solutions $u=u(\nx,t)$ to porous medium problems of the type \begin{equation}\label{ProblemAbstract} \tag{$\Diamond$} \begin{cases} u_t=\Delta u^m + g(u,|\nabla u|) & {\bf x} \in \Omega, t\in I,\\ %u_\nu+hu=0 & \textrm{on}\; \partial \Omega, t>0,\\ u({\bf x},0)=u_0({\bf x})&{\bf x} \in \Omega,\\ \end{cases} \end{equation} where $\Omega$ is a bounded and smooth domain of $\R^N$, with $N\geq 1$, $I=(0,t^*)$ is the maximal interval of existence of $u$, $m>1$ and $u_0(\nx)$ is a nonngative and sufficiently regular function. The problem is equipped with different boundary conditions and depending on such boundary conditions as well as on the expression of the source $g$, global existence and blow-up criteria for solutions to \eqref{ProblemAbstract} are established. Additionally, in the three dimensional setting and when blow-up occurs, lower bounds for the blow-up time $t^*$ are also derived.