title: IRC: Cross-layer design exploration of Intermittent Robust Computation units for IoTs

abstract: Energy-harvesting-powered computing offers intriguing and vast opportunities to dramatically transform the landscape of the Internet of Things (IoT) devices by utilizing ambient sources of energy to achieve battery-free computing. In order to operate within the restricted energy capacity and intermittency profile, it is proposed to innovate Intermittent Robust Computation (IRC) Unit as a new duty-cycle-variable computing approach leveraging the non-volatility inherent in spin-based switching devices. The foundations of IRC will be advanced from the device-level upwards, by extending a Spin Hall Effect Magnetic Tunnel Junction (SHE-MTJ) device. The device will then be used to realize SHE-MTJ Majority/Polymorphic Gate (MG/PG) logic approaches and libraries. Then a Logic-Embedded Flip-Flop (LE-FF) is developed to realize rudimentary Boolean logic functions along with an inherent state-holding capability within a compact footprint. Finally, the NV-Clustering synthesis procedure and corresponding tool module are proposed to instantiate the LE-FF library cells within conventional Register Transfer Language (RTL) specifications. This selectively clusters together logic and NV state-holding functionality, based on energy and area minimization criteria. It also realizes middleware-coherent, intermittent computation without checkpointing, micro-tasking, or software bloat and energy overheads vital to IoT. Simulation results for various benchmark circuits including ISCAS-89 validate functionality and power dissipation, area, and delay benefits.


title: First cohomology of pure mapping class groups of big genus one and zero surfaces

abstract: We prove that the first integral cohomology of pure mapping class groups of infinite type genus one surfaces is trivial. For genus zero surfaces we prove that not every homomorphism to $\mathbb{Z}$ factors through a sphere with finitely many punctures. In fact we get an uncountable family of such maps.


title: Time-Varying Matrix Eigenanalyses via Zhang Neural Networks and look-Ahead Finite Difference Equations

abstract: This paper adapts look-ahead and backward finite difference formulas to compute future eigenvectors and eigenvalues of piecewise smooth time-varying symmetric matrix flows $A(t)$. It is based on the Zhang Neural Network (ZNN) model for time-varying problems and uses the associated error function $E(t) = A(t)V(t) - V(t) D(t)$ or $e_i(t) = A(t)v_i(t) -\la_i(t)v_i(t)$ with the Zhang design stipulation that $\dot E(t) = - \eta E(t)$ or $\dot e_i(t) = - \eta e_i(t)$ with $\eta > 0$ so that $E(t)$ and $e(t)$ decrease exponentially over time. This leads to a discrete-time differential equation of the form $P(t_k) \dot z(t_k) = q(t_k)$ for the eigendata vector $z(t_k)$ of $A(t_k)$. Convergent look-ahead finite difference formulas of varying error orders then allow us to express $z(t_{k+1})$ in terms of earlier $A$ and $z$ data. Numerical tests, comparisons and open questions complete the paper.


title: Rate of dark photon emission from electron positron annihilation in massive stars

abstract: We calculate the rate of production of dark photons from electron-positron pair annihilation in hot and dense matter characteristic of supernova progenitors. Given the non-linear dependence of the emission rate on the dark photon mass and current astrophysical constraints on the dark photon parameter space, we focus on the mass range of 1--10 MeV. For the conditions under consideration both mixing with the in-medium photon and plasma effects on the electron dispersion relation are non-negligible and are explored in detail. We perform our calculations to the leading order in the fine-structure constant. Transverse and longitudinal photon modes are treated separately given their different dispersion relations. We consider the implications for the evolution of massive stars when dark photons decay either into particles of the standard model or of the dark sector.


title: Zhang Neural Networks for Fast and Accurate Computations of the Field of Values

abstract: In this paper a new and different neural network, called Zhang Neural Network (ZNN) is appropriated from discrete time-varying matrix problems and applied to the angle parameter-varying matrix field of values (FoV) problem. This problem acts as a test bed for newly discovered convergent 1-step ahead finite difference formulas of high truncation orders. The ZNN method that uses a look-ahead finite difference scheme of error order 6 gives us 15+ accurate digits of the FoV boundary in record time when applied to hermitean matrix flows $A(t)$.


title: The Construction of High Order Convergent Look-Ahead Finite Difference Formulas for Zhang Neural Networks

abstract: Zhang Neural Networks rely on convergent 1-step ahead finite difference formulas of which very few are known. Those which are known have been constructed in ad-hoc ways and suffer from low truncation error orders. This paper develops a constructive method to find convergent look-ahead finite difference schemes of higher truncation error orders. The method consists of seeding the free variables of a linear system comprised of Taylor expansion coefficients followed by a minimization algorithm for the maximal magnitude root of the formula's characteristic polynomial. This helps us find new convergent 1-step ahead finite difference formulas of any truncation error order. Once a polynomial has been found with roots inside the complex unit circle and no repeated roots on it, the associated look-ahead ZNN discretization formula is convergent and can be used for solving any discretized ZNN based model. Our method recreates and validates the few known convergent formulas, all of which have truncation error orders at most 4. It also creates new convergent 1-step ahead difference formulas with truncation error orders 5 through 8.


title: A formalization of forcing and the unprovability of the continuum hypothesis

abstract: We describe a formalization of forcing using Boolean-valued models in the Lean 3 theorem prover, including the fundamental theorem of forcing and a deep embedding of first-order logic with a Boolean-valued soundness theorem. As an application of our framework, we specialize our construction to the Boolean algebra of regular opens of the Cantor space $2^{\omega_2 \times \omega}$ and formally verify the failure of the continuum hypothesis in the resulting model.


title: The tidal disruption event AT2017eqx: spectroscopic evolution from hydrogen rich to poor suggests an atmosphere and outflow

abstract: We present and analyse a new tidal disruption event (TDE), AT2017eqx at redshift z=0.1089, discovered by Pan-STARRS and ATLAS. The position of the transient is consistent with the nucleus of its host galaxy; it peaks at a luminosity of $L \approx 10^{44}$ erg s$^{-1}$; and the spectrum shows a persistent blackbody temperature $T \gtrsim 20,000$ K with broad H I and He II emission. The lines are initially centered at zero velocity, but by 100 days the H I lines disappear while the He II develops a blueshift of $\gtrsim 5,000$ km s$^{-1}$. Both the early- and late-time morphologies have been seen in other TDEs, but the complete transition between them is unprecedented. The evolution can be explained by combining an extended atmosphere, undergoing slow contraction, with a wind in the polar direction becoming visible at late times. Our observations confirm that a lack of hydrogen a TDE spectrum does not indicate a stripped star, while the proposed model implies that much of the diversity in TDEs may be due to the observer viewing angle. Modelling the light curve suggests AT2017eqx resulted from the complete disruption of a solar-mass star by a black hole of $\sim 10^{6.3} M_\odot$. The host is another quiescent, Balmer-strong galaxy, though fainter and less centrally concentrated than most TDE hosts. Radio limits rule out a relativistic jet, while X-ray limits at 500 days are among the deepest for a TDE at this phase.


title: First Abundance Measurement of Organic Molecules in the Atmosphere of HH 212 Protostellar Disk

abstract: HH 212 is one of the well-studied protostellar systems, showing the first vertically resolved disk with a warm atmosphere around the central protostar. Here we report a detection of 9 organic molecules (including newly detected ketene, formic acid, deuterated acetonitrile, methyl formate, and ethanol) in the disk atmosphere, confirming that the disk atmosphere is, for HH 212, the chemically rich component, identified before at a lower resolution as a "hot-corino". More importantly, we report the first systematic survey and abundance measurement of organic molecules in the disk atmosphere within $\sim$ 40 au of the central protostar. The relative abundances of these molecules are similar to those in the hot corinos around other protostars and in Comet Lovejoy. These molecules can be either (i) originally formed on icy grains and then desorbed into gas phase or (ii) quickly formed in the gas phase using simpler species ejected from the dust mantles. The abundances and spatial distributions of the molecules provide strong constraints on models of their formation and transport in star formation. These molecules are expected to form even more complex organic molecules needed for life and deeper observations are needed to find them.


title: Quantum-assisted associative adversarial network: Applying quantum annealing in deep learning

abstract: We present an algorithm for learning a latent variable generative model via generative adversarial learning where the canonical uniform noise input is replaced by samples from a graphical model. This graphical model is learned by a Boltzmann machine which learns low-dimensional feature representation of data extracted by the discriminator. A quantum annealer, the D-Wave 2000Q, is used to sample from this model. This algorithm joins a growing family of algorithms that use a quantum annealing subroutine in deep learning, and provides a framework to test the advantages of quantum-assisted learning in GANs. Fully connected, symmetric bipartite and Chimera graph topologies are compared on a reduced stochastically binarized MNIST dataset, for both classical and quantum annealing sampling methods. The quantum-assisted associative adversarial network successfully learns a generative model of the MNIST dataset for all topologies, and is also applied to the LSUN dataset bedrooms class for the Chimera topology. Evaluated using the Fr\'{e}chet inception distance and inception score, the quantum and classical versions of the algorithm are found to have equivalent performance for learning an implicit generative model of the MNIST dataset.


title: Integer Programming for Learning Directed Acyclic Graphs from Continuous Data

abstract: Learning directed acyclic graphs (DAGs) from data is a challenging task both in theory and in practice, because the number of possible DAGs scales superexponentially with the number of nodes. In this paper, we study the problem of learning an optimal DAG from continuous observational data. We cast this problem in the form of a mathematical programming model which can naturally incorporate a super-structure in order to reduce the set of possible candidate DAGs. We use the penalized negative log-likelihood score function with both $\ell_0$ and $\ell_1$ regularizations and propose a new mixed-integer quadratic optimization (MIQO) model, referred to as a layered network (LN) formulation. The LN formulation is a compact model, which enjoys as tight an optimal continuous relaxation value as the stronger but larger formulations under a mild condition. Computational results indicate that the proposed formulation outperforms existing mathematical formulations and scales better than available algorithms that can solve the same problem with only $\ell_1$ regularization. In particular, the LN formulation clearly outperforms existing methods in terms of computational time needed to find an optimal DAG in the presence of a sparse super-structure.


title: A penalized likelihood approach for efficiently estimating a partially linear additive transformation model with current status data

abstract: Current status data are commonly encountered in medical and epidemiological studies in which the failure time for study units is the outcome variable of interest. Data of this form are characterized by the fact that the failure time is not directly observed but rather is known relative to an observation time; i.e., the failure times are either left- or right-censored. Due to its structure, the analysis of such data can be challenging. To circumvent these challenges and to provide for a flexible modeling construct which can be used to analyze current status data, herein, a partially linear additive transformation model is proposed. In the formulation of this model, constrained $B$-splines are employed to model the monotone transformation function and nonlinear covariate effects. To provide for more efficient estimates, a penalization technique is used to regularize the estimation of all unknown functions. An easy to implement hybrid algorithm is developed for model fitting and a simple estimator of the large-sample variance-covariance matrix is proposed. It is shown theoretically that the proposed estimators of the finite-dimensional regression coefficients are root-$n$ consistent, asymptotically normal, and achieve the semi-parametric information bound while the estimators of the nonparametric components attain the optimal rate of convergence. The finite-sample performance of the proposed methodology is evaluated through extensive numerical studies and is further demonstrated through the analysis of uterine leiomyomata data.


title: Emergent Universality in a Quantum Tricritical Dicke Model

abstract: We propose a generalized Dicke model which supports a quantum tricritical point. We map out the phase diagram and investigate the critical behaviors of the model through exact low-energy effective Hamiltonian in the thermodynamic limit. As predicted by the Landau theory of phase transition, the order parameter shows non-universality at the tricritical point. Nevertheless, as a result of the separation of the classical and the quantum degrees of freedom, we find a universal relation between the excitation gap and the entanglement entropy for the entire critical line including the tricritical point. Here the universality is carried by the emergent quantum modes, whereas the order parameter is determined classically.


title: Is Gravity the Weakest Force?

abstract: It has recently been suggested that "gravity is the weakest force" in any theory with a suitable UV completion within quantum gravity. One formulation of this statement is the scalar weak gravity conjecture, which states that gravity is weaker than the force originating from scalar fields. We study the scalar weak gravity conjecture in de Sitter space, and discuss its low-energy consequences in light of the experimental searches for fifth forces and violations of the equivalence principle. We point out that some versions of the scalar weak gravity conjecture forbid the existence of very light scalar particles, such as the quintessence and axion-like particles. The absence of the quintessence field means that these versions of the scalar weak gravity conjecture are in phenomenological tension with the recently-proposed de Sitter swampland conjecture and its refinements. Some other versions of the scalar weak gravity conjecture escape these constraints, and could have interesting phenomenological consequences.


title: When and where do you want to hide? Recommendation of location privacy preferences with local differential privacy

abstract: In recent years, it has become easy to obtain location information quite precisely. However, the acquisition of such information has risks such as individual identification and leakage of sensitive information, so it is necessary to protect the privacy of location information. For this purpose, people should know their location privacy preferences, that is, whether or not he/she can release location information at each place and time. However, it is not easy for each user to make such decisions and it is troublesome to set the privacy preference at each time. Therefore, we propose a method to recommend location privacy preferences for decision making. Comparing to existing method, our method can improve the accuracy of recommendation by using matrix factorization and preserve privacy strictly by local differential privacy, whereas the existing method does not achieve formal privacy guarantee. In addition, we found the best granularity of a location privacy preference, that is, how to express the information in location privacy protection. To evaluate and verify the utility of our method, we have integrated two existing datasets to create a rich information in term of user number. From the results of the evaluation using this dataset, we confirmed that our method can predict location privacy preferences accurately and that it provides a suitable method to define the location privacy preference.


title: Radial Velocities, Space Motions, and Nearby Young Moving Group Memberships of Eleven Candidate Young Brown Dwarfs

abstract: We present new radial velocity (RV) measurements for 11 candidate young very-low-mass stars and brown dwarfs, with spectral types from M7 to L7. Candidate young objects were identified by features indicative of low surface gravity in their optical and/or near-infrared spectra. RV measurements are derived from high resolution (R=$\lambda$/$\Delta\lambda$=20,000) $J$ band spectra taken with NIRSPEC at the Keck Observatory. We combine RVs with proper motions and trigonometric distances to calculate three-dimensional space positions and motions and to evaluate membership probabilities for nearby young moving groups (NYMGs). We propose 2MASS J00452143+1634446 (L2$\beta$, $J$=13.06) as an RV standard given the precision and stability of measurements from three different studies. We test the precision and accuracy of our RV measurements as a function of spectral type of the comparison object, finding that RV results are essentially indistinguishable even with differences of $\pm$5 spectral subtypes. We also investigate the strengths of gravity-sensitive K~{\sc i} lines at 1.24--1.25 $\mu$m and evaluate their consistency with other age indicators. We confirm or re-confirm four brown dwarf members of NYMGs -- 2MASS J00452143+1634446, WISE J00470038+6803543, 2MASS J01174748$-$3403258, and 2MASS J19355595$-$2846343 -- and their previous age estimates. We identify one new brown dwarf member of the Carina-Near moving group, 2MASS J21543454$-$1055308. The remaining objects do not appear to be members of any known NYMGs, despite their spectral signatures of youth. These results add to the growing number of very-low-mass objects exhibiting signatures of youth that lack likely membership in a known NYMG, thereby compounding the mystery regarding local, low-density star formation.


title: Who Gets the Job and How are They Paid? Machine Learning Application on H-1B Case Data

abstract: In this paper, we use machine learning techniques to explore the H-1B application dataset disclosed by the Department of Labor (DOL), from 2008 to 2018, in order to provide more stylized facts of the international workers in US labor market. We train a LASSO Regression model to analyze the impact of different features on the applicant's wage, and a Logistic Regression with L1-Penalty as a classifier to study the feature's impact on the likelihood of the case being certified. Our analysis shows that working in the healthcare industry, working in California, higher job level contribute to higher salaries. In the meantime, lower job level, working in the education services industry and nationality of Philippines are negatively correlated with the salaries. In terms of application status, a Ph.D. degree, working in retail or finance, majoring in computer science will give the applicants a better chance of being certified. Applicants with no or an associate degree, working in the education services industry, or majoring in education are more likely to be rejected.


title: Quantifying Correlated Truncation Errors in Effective Field Theory

abstract: Effective field theories (EFTs) organize the description of complex systems into an infinite sequence of decreasing importance. Predictions are made with a finite number of terms, which induces a truncation error that is often left unquantified. We formalize the notion of EFT convergence and propose a Bayesian truncation error model for predictions that are correlated across the independent variables, e.g., energy or scattering angle. Central to our approach are Gaussian processes that encode both the naturalness and correlation structure of EFT coefficients. Our use of Gaussian processes permits efficient and accurate assessment of credible intervals, allows EFT fits to easily include correlated theory errors, and provides analytic posteriors for physical EFT-related quantities such as the expansion parameter. We demonstrate that model-checking diagnostics---applied to the case of multiple curves---are powerful tools for EFT validation. As an example, we assess a set of nucleon-nucleon scattering observables in chiral EFT. In an effort to be self contained, appendices include thorough derivations of our statistical results. Our methods are packaged in Python code, called gsum, that is available for download on GitHub.


title: Baseline Drift Estimation for Air Quality Data Using Quantile Trend Filtering

abstract: We address the problem of estimating smoothly varying baseline trends in time series data. This problem arises in a wide range of fields, including chemistry, macroeconomics, and medicine; however, our study is motivated by the analysis of data from low cost air quality sensors. Our methods extend the quantile trend filtering framework to enable the estimation of multiple quantile trends simultaneously while ensuring that the quantiles do not cross. To handle the computational challenge posed by very long time series, we propose a parallelizable alternating direction method of moments (ADMM) algorithm. The ADMM algorthim enables the estimation of trends in a piecewise manner, both reducing the computation time and extending the limits of the method to larger data sizes. We also address smoothing parameter selection and propose a modified criterion based on the extended Bayesian Information Criterion. Through simulation studies and our motivating application to low cost air quality sensor data, we demonstrate that our model provides better quantile trend estimates than existing methods and improves signal classification of low-cost air quality sensor output.


title: Kernel Mean Embedding of Instance-wise Predictions in Multiple Instance Regression

abstract: In this paper, we propose an extension to an existing algorithm (instance-MIR) which tackles the multiple instance regression (MIR) problem, also known as distribution regression. The MIR setting arises when the data is a collection of bags, where each bag consists of several instances which correspond to the same and unique real-valued label. The goal of a MIR algorithm is to find a mapping from the instances of an unseen bag to its target value. The instance-MIR algorithm treats all the instances separately and maps each instance to a label. The final bag label is then taken as the mean or the median of the predictions for that given bag. While it is conceptually simple, taking a single statistic to summarize the distribution of the labels in each bag is a limitation. In spite of this performance bottleneck, the instance-MIR algorithm has been shown to be competitive when compared to the current state-of-the-art methods. We address the aforementioned issue by computing the kernel mean embeddings of the distributions of the predicted labels, for each bag, and learn a regressor from these embeddings to the bag label. We test our algorithm (instance-kme-MIR) on five real world datasets and obtain better results than the baseline instance-MIR across all the datasets, while achieving state-of-the-art results on two of the datasets.


title: Realizing Petabyte Scale Acoustic Modeling

abstract: Large scale machine learning (ML) systems such as the Alexa automatic speech recognition (ASR) system continue to improve with increasing amounts of manually transcribed training data. Instead of scaling manual transcription to impractical levels, we utilize semi-supervised learning (SSL) to learn acoustic models (AM) from the vast firehose of untranscribed audio data. Learning an AM from 1 Million hours of audio presents unique ML and system design challenges. We present the design and evaluation of a highly scalable and resource efficient SSL system for AM. Employing the student/teacher learning paradigm, we focus on the student learning subsystem: a scalable and robust data pipeline that generates features and targets from raw audio, and an efficient model pipeline, including the distributed trainer, that builds a student model. Our evaluations show that, even without extensive hyper-parameter tuning, we obtain relative accuracy improvements in the 10 to 20$\%$ range, with higher gains in noisier conditions. The end-to-end processing time of this SSL system was 12 days, and several components in this system can trivially scale linearly with more compute resources.


title: Low-rank Matrix Optimization Using Polynomial-filtered Subspace Extraction

abstract: In this paper, we study first-order methods on a large variety of low-rank matrix optimization problems, whose solutions only live in a low dimensional eigenspace. Traditional first-order methods depend on the eigenvalue decomposition at each iteration which takes most of the computation time. In order to reduce the cost, we propose an inexact algorithm framework based on a polynomial subspace extraction. The idea is to use an additional polynomial-filtered iteration to extract an approximated eigenspace, and project the iteration matrix on this subspace, followed by an optimization update. The accuracy of the extracted subspace can be controlled by the degree of the polynomial filters. This kind of subspace extraction also enjoys the warm start property: the subspace of the current iteration is refined from the previous one. Then this framework is instantiated into two algorithms: the polynomial-filtered proximal gradient method and the polynomial-filtered alternating direction method of multipliers. We give a theoretical guarantee to the two algorithms that the polynomial degree is not necessarily very large. They share the same convergence speed as the corresponding original methods if the polynomial degree grows with an order $\Omega(\log k)$ at the $k$-th iteration. If the warm-start property is considered, the degree can be reduced to a constant, independent of the iteration $k$. Preliminary numerical experiments on several low-rank matrix optimization problems show that the polynomial filtered algorithms usually provide multi-fold speedups.


title: Energy-Efficient Mobile-Edge Computation Offloading over Multiple Fading Blocks

abstract: By allowing a mobile device to offload computation-intensive tasks to a base station, mobile edge computing (MEC) is a promising solution for saving the mobile device's energy. In real applications, the offloading may span multiple fading blocks. In this paper, we investigate energy-efficient offloading over multiple fading blocks with random channel gains. An optimization problem is formulated, which optimizes the amount of data for offloading to minimize the total expected energy consumption of the mobile device. Although the formulated optimization problem is non-convex, we prove that the objective function of the problem is piecewise convex, and accordingly develop an optimal solution for the problem. Numerical results verify the correctness of our findings and the effectiveness of our proposed method.


title: Classical neutral point particle in linearly polarized EM plane wave field

abstract: We study a covariant classical model of neutral point particles with magnetic moment interacting with external electromagnetic fields. Classical dynamical equations which reproduce a correct behavior in the non-relativistic limit are introduced. We also discuss the non-uniqueness of the covariant torque equation. The focus of this work is on Dirac neutrino beam control. We present a full analytical solution of the dynamical equations for a neutral point particle motion in the presence of an external linearly polarized EM plane wave (laser) fields. Neutrino beam control using extremely intense laser fields could possibly demonstrate Dirac nature of the neutrino. However, for linearly polarized ideal laser waves we show cancellation of all leading beam control effects.


title: Antisymmetric magnetoresistance in van der Waals Fe3GeTe2/graphite/Fe3GeTe2 tri-layer heterostructures

abstract: Van der Waals (vdW) ferromagnetic materials are rapidly establishing themselves as effective building blocks for next generation spintronic devices. When layered with non-magnetic vdW materials, such as graphene and/or topological insulators, vdW heterostructures can be assembled (with no requirement for lattice matching) to provide otherwise unattainable device structures and functionalities. We report a hitherto rarely seen antisymmetric magnetoresistance (MR) effect in van der Waals heterostructured Fe3GeTe2/graphite/Fe3GeTe2 devices. Unlike conventional giant magnetoresistance (GMR) which is characterized by two resistance states, the MR in these vdW heterostructures features distinct high, intermediate and low resistance states. This unique characteristic is suggestive of underlying physical mechanisms that differ from those observed before. After theoretical calculations, the three resistance behavior was attributed to a spin momentum locking induced spin polarized current at the graphite/FGT interface. Our work reveals that ferromagnetic heterostructures assembled from vdW materials can exhibit substantially different properties to those exhibited by similar heterostructures grown in vacuum. Hence, it highlights the potential for new physics and new spintronic applications to be discovered using vdW heterostructures.


title: Throughput Maximization in Two-hop DF Multiple-Relay Network with Simultaneous Wireless Information and Power Transfer

abstract: This paper investigates the end-to-end throughput maximization problem for a two-hop multiple-relay network, with relays powered by simultaneous wireless information and power transfer (SWIPT) technique. Nonlinearity of energy harvester at every relay node is taken into account and two models for approximating the nonlinearity are adopted: logistic model and linear cut-off model. Decode-and-forward (DF) is implemented, and time switching (TS) mode and power splitting (PS) mode are considered. Optimization problems are formulated for TS mode and PS mode under logistic model and linear cut-off model, respectively. End-to-end throughput is aimed to be maximized by optimizing the transmit power and bandwidth on every source-relay-destination link, and PS ratio and/or TS ratio on every relay node. Although the formulated optimization problems are all non-convex. Through a series of analysis and transformation, and with the aid of bi-level optimization and monotonic optimization, etc., we find the global optimal solution of every formulated optimization problem. In some case, a simple yet optimal solution of the formulated problem is also derived. Numerical results verify the effectiveness of our proposed methods.


title: Time-Dependent Density Functional Theory for Fermionic Superfluids: from Cold Atomic Gases, to Nuclei and Neutron Stars Crust

abstract: In cold atoms and in the crust of neutron stars the pairing gap can reach values comparable with the Fermi energy. While in nuclei the neutron gap is smaller, it is still of the order of a few percent of the Fermi energy. The pairing mechanism in these systems is due to short range attractive interactions between fermions and the size of the Cooper pair is either comparable to the inter-particle separation or it can be as big as a nucleus, which is still relatively small in size. Such a strong pairing gap is the result of the superposition of a very large number of particle-particle configurations, which contribute to the formation of the Copper pairs. These systems have been shown to be the host of a large number of remarkable phenomena, in which the large magnitude of the pairing gap plays an essential role: quantum shock waves, quantum turbulence, Anderson-Higgs mode, vortex rings, domain walls, soliton vortices, vortex pinning in neutron star crust, unexpected dynamics of fragmented condensates and role of pairing correlations in collisions on heavy-ions, Larkin-Ovchinnikov phase as an example of a Fermi supersolid, role pairing correlations control the dynamics of fissioning nuclei, self-bound superfluid fermion droplets of extremely low densities.


title: Manipulating Coherent Light Matter Interaction: Continuous Transition between Strong Coupling and Weak Coupling in MoS2 Monolayer Coupled with Plasmonic Nanocavities

abstract: Strong interactions between surface plasmons in ultra-compact nanocavities and excitons in two dimensional materials have attracted wide interests for its prospective realization of polariton devices at room temperature. Here, we propose a continuous transition from weak coupling to strong coupling between excitons in MoS2 monolayer and highly localized plasmons in ultra-compact nanoantenna. The nanoantenna is assembled by a silver nanocube positioned over a gold film and separated by a dielectric spacer layer. We observed a 1570-fold enhancement in the photoluminescence at weak coupling regime in hybrid nanocavities with thick spacer layers. The interaction between excitons and plasmons is then directly prompted to strong coupling regime by shrinking down the thickness of spacer layer. Room temperature formation of polaritons with Rabi splitting up to 190 meV was observed, which is the largest plasmon-exciton Rabi splitting reported in two dimensional materials. Numerical calculations quantified the relation between coupling strength, local density of states and spacer thickness, and revealed the transition between weak coupling and strong coupling in nanocavities. The findings in this work offer a guideline for feasible designs of plasmon-exciton interaction systems with gap plasmonic cavities.


title: Approximate Spielman-Teng theorems for the least singular value of random combinatorial matrices

abstract: An approximate Spielman-Teng theorem for the least singular value $s_n(M_n)$ of a random $n\times n$ square matrix $M_n$ is a statement of the following form: there exist constants $C,c >0$ such that for all $\eta \geq 0$, $\Pr(s_n(M_n) \leq \eta) \lesssim n^{C}\eta + \exp(-n^{c})$. The goal of this paper is to develop a simple and novel framework for proving such results for discrete random matrices. As an application, we prove an approximate Spielman-Teng theorem for $\{0,1\}$-valued matrices, each of whose rows is an independent vector with exactly $n/2$ zero components. This improves on previous work of Nguyen and Vu, and is the first such result in a `truly combinatorial' setting.


title: On the Middle Coefficient of a Cyclotomic Polynomial

abstract: In this article, we provide a short and elementary proof of the following result: For $n \geq 3$ the middle coefficient of $\Phi_n(x)$ is either zero (when $n$ is a power of $2$) or an odd integer.


title: TRAO Survey of Nearby Filamentary Molecular clouds, the Universal Nursery of Stars (TRAO FUNS) I. Dynamics and Chemistry of L1478 in the California Molecular Cloud

abstract: "TRAO FUNS" is a project to survey Gould Belt's clouds in molecular lines. This paper presents its first results on the central region of the California molecular cloud, L1478. We performed On-The-Fly mapping observations using the Taedeok Radio Astronomy Observatory (TRAO) 14m single dish telescope equipped with a 16 multi-beam array covering $\sim$1.0 square degree area of this region using C$^{18}$O (1-0) mainly tracing low density cloud and about 460 square arcminute area using N$_{2}$H$^{+}$ (1-0) mainly tracing dense cores. CS (2-1) and SO $(3_{2}-2_{1})$ were also used simultaneously to map $\sim$440 square arcminute area of this region. We identified 10 filaments by applying the dendrogram technique to the C$^{18}$O data-cube and 8 dense N$_{2}$H$^{+}$ cores by using {\sc FellWalker}. Basic physical properties of filaments such as mass, length, width, velocity field, and velocity dispersion are derived. It is found that L1478 consists of several filaments with slightly different velocities. Especially the filaments which are supercritical are found to contain dense cores detected in N$_{2}$H$^{+}$. Comparison of non-thermal velocity dispersions derived from C$^{18}$O and N$_{2}$H$^{+}$ for the filaments and dense cores indicates that some of dense cores share similar kinematics with those of the surrounding filaments while several dense cores have different kinematics with those of their filaments. This suggests that the formation mechanism of dense cores and filaments can be different in individual filaments depending on their morphologies and environments.


title: Influences of Human Demographics, Brand Familiarity and Security Backgrounds on Homograph Recognition

abstract: Homograph attack is a way that attackers deceive victims about which website domain name they are communicating with by exploiting the fact that many characters look alike. The attack becomes serious and is raising broad attention when recently many brand domains have been attacked such as Apple Inc., Adobe Inc., Lloyds Bank, etc. We first design a survey of human demographics, brand familiarity, and security backgrounds and apply it to 2,067 participants. We build a regression model to study which factors affect participants' ability in recognizing homograph domains. We find that for different levels of visual similarity, the participants exhibit different abilities. 13.95% of participants can recognize non-homographs while 16.60% of participants can recognize homographs whose the visual similarity with the target brand domains is under 99.9%; but when the similarity increases to 99.9%, the number of participants who can recognize homographs significantly drops down to only 0.19%; and for the homographs with 100% of visual similarity, there is no way for the participants to recognize. We also find that female participants tend to recognize homographs better the male but male participants tend to able to recognize non-homographs better than females. Security knowledge is a significant factor affecting both homographs and non-homographs; surprisingly, people who have strong security knowledge tend to be able to recognize homographs but not non-homographs. Furthermore, people who work or are educated in computer science or computer engineering do not appear as a factor affecting the ability in recognizing homographs; however, interestingly, right after they are explained about the homograph attack, people who work or are educated in computer science or computer engineering are the ones who can capture the situation the most quickly.


abstract: We introduce the Neural Collaborative Subspace Clustering, a neural model that discovers clusters of data points drawn from a union of low-dimensional subspaces. In contrast to previous attempts, our model runs without the aid of spectral clustering. This makes our algorithm one of the kinds that can gracefully scale to large datasets. At its heart, our neural model benefits from a classifier which determines whether a pair of points lies on the same subspace or not. Essential to our model is the construction of two affinity matrices, one from the classifier and the other from a notion of subspace self-expressiveness, to supervise training in a collaborative scheme. We thoroughly assess and contrast the performance of our model against various state-of-the-art clustering algorithms including deep subspace-based ones.


title: Autonomous Voltage Control for Grid Operation Using Deep Reinforcement Learning

abstract: Modern power grids are experiencing grand challenges caused by the stochastic and dynamic nature of growing renewable energy and demand response. Traditional theoretical assumptions and operational rules may be violated, which are difficult to be adapted by existing control systems due to the lack of computational power and accurate grid models for use in real time, leading to growing concerns in the secure and economic operation of the power grid. Existing operational control actions are typically determined offline, which are less optimized. This paper presents a novel paradigm, Grid Mind, for autonomous grid operational controls using deep reinforcement learning. The proposed AI agent for voltage control can learn its control policy through interactions with massive offline simulations, and adapts its behavior to new changes including not only load/generation variations but also topological changes. A properly trained agent is tested on the IEEE 14-bus system with tens of thousands of scenarios, and promising performance is demonstrated in applying autonomous voltage controls for secure grid operation.


title: Collinear true ternary fission as the consequence of the collective nuclear model

abstract: The concept of collinear spontaneous true ternary fission of 252Cf is subject to critical analysis. The conclusion is that the collinear flight of the fragments turns out to be a natural and most probable mode. The collinearity arises in the model on the prescission stage as a result of the account of the principles of the collective Bohr's model. It is partly destroyed at the post-scission stage of spreading of the fragments due to their Coulomb interaction, with the allowance for the spin effects arising at the moment of scission. The final angular distribution of the fragments is calculated by means of the trajectory simulations. The calculated relative angle of the heavy and light fragments is kept 180 degrees with an uncertainty within 0.4 degree, which justifies search for a collinear tri-partition at the modern stage of experiment.


title: Ultra-low-power orbital-controlled magnetization switching using a ferromagnetic oxide interface

abstract: A major challenge in spin-based electronics is reducing power consumption for magnetization switching of ferromagnets, which is being implemented by injecting a large spin-polarized current. The alternative approach is to control the magnetic anisotropy (MA) of the ferromagnet by an electric field. However, the voltage-induced MA is too weak to deterministically switch the magnetization without an assisting magnetic field, and the strategy towards this goal remains elusive. Here, we demonstrate a new scheme of orbital-controlled magnetization switching (OCMS): A sharp change in the MA is induced when the Fermi level is moved between energy bands with different orbital symmetries. Using a ferromagnetic oxide interface, we show that OCMS can be used to achieve a deterministic and magnetic-field-free 90 degree-magnetization switching solely by applying an extremely small electric field of 0.05 V/nm with a negligibly small current density of 10^-2 A/cm^2. Our results highlight the huge potential of band engineering in ferromagnetic materials for efficient magnetization control.


title: Handoff All Your Privacy: A Review of Apple's Bluetooth Low Energy Continuity Protocol

abstract: We investigate Apple's Bluetooth Low Energy (BLE) Continuity protocol, designed to support interoperability and communication between iOS and macOS devices, and show that the price for this seamless experience is leakage of identifying information and behavioral data to passive adversaries. First, we reverse engineer numerous Continuity protocol message types and identify data fields that are transmitted unencrypted. We show that Continuity messages are broadcast over BLE in response to actions such as locking and unlocking a device's screen, copying and pasting information, making and accepting phone calls, and tapping the screen while it is unlocked. Laboratory experiments reveal a significant flaw in the most recent versions of macOS that defeats BLE Media Access Control (MAC) address randomization entirely by causing the public MAC address to be broadcast. We demonstrate that the format and content of Continuity messages can be used to fingerprint the type and Operating System (OS) version of a device, as well as behaviorally profile users. Finally, we show that predictable sequence numbers in these frames can allow an adversary to track Apple devices across space and time, defeating existing anti-tracking techniques such as MAC address randomization.


title: Progressive amorphization of GeSbTe phase-change material under electron beam irradiation

abstract: Fast and reversible phase transitions in chalcogenide phase-change materials (PCMs), in particular, Ge-Sb-Te compounds, are not only of fundamental interests, but also make PCMs based random access memory (PRAM) a leading candidate for non-volatile memory and neuromorphic computing devices. To RESET the memory cell, crystalline Ge-Sb-Te has to undergo phase transitions firstly to a liquid state and then to an amorphous state, corresponding to an abrupt change in electrical resistance. In this work, we demonstrate a progressive amorphization process in GeSb2Te4 thin films under electron beam irradiation on transmission electron microscope (TEM). Melting is shown to be completely absent by the in situ TEM experiments. The progressive amorphization process resembles closely the cumulative crystallization process that accompanies a continuous change in electrical resistance. Our work suggests that if displacement forces can be implemented properly, it should be possible to emulate symmetric neuronal dynamics by using PCMs.


title: Enumeration of bounded lecture hall tableaux

abstract: Recently the authors introduced lecture hall tableaux in their study of multivariate little $q$-Jacobi polynomials. In this paper, we enumerate bounded lecture hall tableaux. We show that their enumeration is closely related to standard and semistandard Young tableaux. We also show that the number of bounded lecture hall tableaux is the coefficient of the Schur expansion of $s_\lambda(m+y_1,\dots,m+y_n)$. To prove this result, we use two main tools: non-intersecting lattice paths and bijections. In particular we use ideas developed by Krattenthaler to prove bijectively the hook content formula.


title: Streamwise-constant large-scale structures in Couette and Poiseuille flows

abstract: The linear amplification mechanisms leading to streamwise-constant large-scale structures in laminar and turbulent channel flows are considered. A key feature of the analysis is that the Orr--Sommerfeld and Squire operators are each considered separately. Physically this corresponds to considering two separate processes: (i) the response of wall-normal velocity fluctuations to external forcing; and (ii) the response of streamwise velocity fluctuations to wall-normal velocity fluctuations. In this way we exploit the fact that, for streamwise-constant fluctuations, the dynamics governing the wall-normal velocity are independent of the mean velocity profile (and therefore the mean shear). The analysis is performed for both plane Couette flow and plane Poiseuille flow; and for each we consider linear amplification mechanisms about both the laminar and turbulent mean velocity profiles. The analysis reveals two things. First, that the most amplified structures (with a spanwise spacing of approximately $4h$, where $h$ is the channel half height) are to a great extent encoded in the Orr-Sommerfeld operator alone, thus helping to explain their prevalence. Second---and consistent with numerical and experimental observations---that Couette flow is significantly more efficient than Poiseuille flow in leveraging wall-normal velocity fluctuations to produce large-scale streamwise streaks.


title: A Comparison Study of Credit Card Fraud Detection: Supervised versus Unsupervised

abstract: Credit card has become popular mode of payment for both online and offline purchase, which leads to increasing daily fraud transactions. An Efficient fraud detection methodology is therefore essential to maintain the reliability of the payment system. In this study, we perform a comparison study of credit card fraud detection by using various supervised and unsupervised approaches. Specifically, 6 supervised classification models, i.e., Logistic Regression (LR), K-Nearest Neighbors (KNN), Support Vector Machines (SVM), Decision Tree (DT), Random Forest (RF), Extreme Gradient Boosting (XGB), as well as 4 unsupervised anomaly detection models, i.e., One-Class SVM (OCSVM), Auto-Encoder (AE), Restricted Boltzmann Machine (RBM), and Generative Adversarial Networks (GAN), are explored in this study. We train all these models on a public credit card transaction dataset from Kaggle website, which contains 492 frauds out of 284,807 transactions. The labels of the transactions are used for supervised learning models only. The performance of each model is evaluated through 5-fold cross validation in terms of Area Under the Receiver Operating Curves (AUROC). Within supervised approaches, XGB and RF obtain the best performance with AUROC = 0.989 and AUROC = 0.988, respectively. While for unsupervised approaches, RBM achieves the best performance with AUROC = 0.961, followed by GAN with AUROC = 0.954. The experimental results show that supervised models perform slightly better than unsupervised models in this study. Anyway, unsupervised approaches are still promising for credit card fraud transaction detection due to the insufficient annotation and the data imbalance issue in real-world applications.


title: A Linear-logical Reconstruction of Intuitionistic Modal Logic S4

abstract: We propose a "modal linear logic" to reformulate intuitionistic modal logic S4 (IS4) in terms of linear logic, establishing an S4-version of Girard translation from IS4 to it. While the Girard translation from intuitionistic logic to linear logic is well-known, its extension to modal logic is non-trivial since a naive combination of the S4 modality and the exponential modality causes an undesirable interaction between the two modalities. To solve the problem, we introduce an extension of intuitionistic multiplicative exponential linear logic with a modality combining the S4 modality and the exponential modality, and show that it admits a sound translation from IS4. Through the Curry-Howard correspondence we further obtain a Geometry of Interaction Machine semantics of the modal lambda-calculus by Pfenning and Davies for staged computation.


title: Blockchain-based Bidirectional Updates on Fine-grained Medical Data

abstract: Electronic medical data sharing between stakeholders, such as patients, doctors, and researchers, can promote more effective medical treatment collaboratively. These sensitive and private data should only be accessed by authorized users. Given a total medical data, users may care about parts of them and other unrelated information might interfere with the user interested data search and increase the risk of exposure. Besides accessing these data, users may want to update them and propagate to other sharing peers so that all peers keep identical data after each update. To satisfy these requirements, in this paper we propose a medical data sharing architecture that addresses the permission control using smart contracts on the blockchain and splits data into fined grained pieces shared with different peers then synchronize full data and these pieces with bidirectional transformations. Medical data reside on each user\'s local database and permission related data are stored on smart contracts. Only all peers have gained the newest shared data after updates can they start to do next operations on it, which are enforced by smart contracts. Blockchain based immutable shared ledge enables users to trace data updates history. This paper can provide a new perspective to view full medical data as different slices to be shared with various peers but consistency after updates between them are still promised, which can protect the privacy and improve data search efficiency.


title: DeepSense: Enabling Carrier Sense in Low-Power Wide Area Networks Using Deep Learning

abstract: The last few years have seen the proliferation of low-power wide area networks like LoRa, Sigfox and 802.11ah, each of which use a different and sometimes proprietary coding and modulation scheme, work below the noise floor and operate on the same frequency band. We introduce DeepSense, which is the first carrier sense mechanism that enables random access and coexistence for low-power wide area networks even when signals are below the noise floor. Our key insight is that any communication protocol that operates below the noise floor has to use coding at the physical layer. We show that neural networks can be used as a general algorithmic framework that can learn the coding mechanisms being employed by such protocols to identify signals that are hidden within noise. Our evaluation shows that DeepSense performs carrier sense across 26 different LPWAN protocols and configurations below the noise floor and can operate in the presence of frequency shifts as well as concurrent transmissions. Beyond carrier sense, we also show that DeepSense can support multi bit-rate LoRa networks by classifying between 21 different LoRa configurations and flexibly adapting bitrates based on signal strength. In a deployment of a multi-rate LoRa network, DeepSense improves bit rate by 4x for nearby devices and provides a 1.7x increase in the number of locations that can connect to the campus-wide network.


title: Ergodic optimization theory for Axiom A flows

abstract: In this article, we consider the weighted ergodic optimization problem Axiom A attractors of a $C^2$ flow on a compact smooth manifold. The main result obtained in this paper is that for a generic observable from function space $\mc C^{0,\a}$ ($\a\in(0,1]$) or $\mc C^1$ the minimizing measure is unique and is supported on a periodic orbit.


title: On the density of S-adic integers near some projective G-varieties

abstract: We provide some general conditions which ensure that a system of inequalities involving homogeneous polynomials with coefficients in a S-adic field has nontrivial S-integral solutions. The proofs are based on the strong approximation property for Zariski-dense subgroups and adelic geometry of numbers. We give two examples of applications for systems involving quadratic and linear forms.


title: Condition-Transforming Variational AutoEncoder for Conversation Response Generation

abstract: This paper proposes a new model, called condition-transforming variational autoencoder (CTVAE), to improve the performance of conversation response generation using conditional variational autoencoders (CVAEs). In conventional CVAEs , the prior distribution of latent variable z follows a multivariate Gaussian distribution with mean and variance modulated by the input conditions. Previous work found that this distribution tends to become condition independent in practical application. In our proposed CTVAE model, the latent variable z is sampled by performing a non-lineartransformation on the combination of the input conditions and the samples from a condition-independent prior distribution N (0; I). In our objective evaluations, the CTVAE model outperforms the CVAE model on fluency metrics and surpasses a sequence-to-sequence (Seq2Seq) model on diversity metrics. In subjective preference tests, our proposed CTVAE model performs significantly better than CVAE and Seq2Seq models on generating fluency, informative and topic relevant responses.


title: The differential calculus of causal functions

abstract: Causal functions of sequences occur throughout computer science, from theory to hardware to machine learning. Mealy machines, synchronous digital circuits, signal flow graphs, and recurrent neural networks all have behaviour that can be described by causal functions. In this work, we examine a differential calculus of causal functions which includes many of the familiar properties of standard multivariable differential calculus. These causal functions operate on infinite sequences, but this work gives a different notion of an infinite-dimensional derivative than either the Fr\'echet or Gateaux derivative used in functional analysis. In addition to showing many standard properties of differentiation, we show causal differentiation obeys a unique recurrence rule. We use this recurrence rule to compute the derivative of a simple recurrent neural network called an Elman network by hand and describe how the computed derivative can be used to train the network.


title: Quantum interference of topological states of light

abstract: Topological insulators are materials that have a gapped bulk energy spectrum, but contain protected in-gap states appearing at their surface. These states exhibit remarkable properties such as unidirectional propagation and robustness to noise that offer an opportunity to improve the performance and scalability of quantum technologies. For quantum applications, it is essential that the topological states are indistinguishable. Here we report high-visibility quantum interference of single photon topological states in an integrated photonic circuit. Two topological boundary-states, initially at opposite edges of a coupled waveguide array, are brought into proximity, where they interfere and undergo a beamsplitter operation. We observe $93.1\pm2.8\%$ visibility Hong-Ou-Mandel (HOM) interference, a hallmark non-classical effect that is at the heart of linear optics-based quantum computation. Our work shows that it is feasible to generate and control highly indistinguishable single photon topological states, opening pathways to enhanced photonic quantum technology with topological properties, and to study quantum effects in topological materials.


title: Defocused images removal of axial overlapping scattering particles by using three-dimensional nonlinear diffusion based on digital holography

abstract: We propose a three-dimensional nonlinear diffusion method to implement the similar autofocusing function of multiple micro-objects and simultaneously remove the defocused images, which can distinguish the locations of certain sized scattering particles that are overlapping along z-axis. It is applied to all of the reconstruction slices that are generated from the captured hologram after each back propagation. For certain small sized particles, the maxima of maximum gradient magnitude of each reconstruction slice appears at the ground truth z position after applying the proposed scheme when the reconstruction range along z-axis is sufficiently long and the reconstruction depth spacing is sufficiently fine. Therefore, the reconstructed image at ground truth z position is remained, while the defocused images are diffused out. The results demonstrated that the proposed scheme can diffuse out the defocused images which are 20 um away from the ground truth z position in spite of that several scattering particles with different diameters are completely overlapping along z-axis with a distance of 800 um when the hologram pixel pitch is 2 um. It also demonstrated that the sparsity distribution of the ground truth z slice cannot be affected by the sparsity distribution of corresponding defocused images when the diameter of the particle is not more than 35um and the reconstruction depth spacing is not less than 20 um.


title: Circuit Relations for Real Stabilizers: Towards TOF+H

abstract: The real stabilizer fragment of quantum mechanics was shown to have a complete axiomatization in terms of the angle-free fragment of the ZX-calculus. This fragment of the ZX-calculus---although abstractly elegant---is stated in terms of identities, such as spider fusion which generally do not have interpretations as circuit transformations. We complete the category CNOT generated by the controlled not gate and the computational ancillary bits, presented by circuit relations, to the real stabilizer fragment of quantum mechanics. This is performed first, by adding the Hadamard gate and the scalar sqrt 2 as generators. We then construct translations to and from the angle-free fragment of the ZX-calculus, showing that they are inverses. We then discuss how this could potentially lead to a complete axiomatization, in terms of circuit relations, for the approximately universal fragment of quantum mechanics generated by the Toffoli gate, Hadamard gate and computational ancillary bits.


title: Understanding Art through Multi-Modal Retrieval in Paintings

abstract: In computer vision, visual arts are often studied from a purely aesthetics perspective, mostly by analysing the visual appearance of an artistic reproduction to infer its style, its author, or its representative features. In this work, however, we explore art from both a visual and a language perspective. Our aim is to bridge the gap between the visual appearance of an artwork and its underlying meaning, by jointly analysing its aesthetics and its semantics. We introduce the use of multi-modal techniques in the field of automatic art analysis by 1) collecting a multi-modal dataset with fine-art paintings and comments, and 2) exploring robust visual and textual representations in artistic images.


title: Design Automation for Efficient Deep Learning Computing

abstract: Efficient deep learning computing requires algorithm and hardware co-design to enable specialization: we usually need to change the algorithm to reduce memory footprint and improve energy efficiency. However, the extra degree of freedom from the algorithm makes the design space much larger: it's not only about designing the hardware but also about how to tweak the algorithm to best fit the hardware. Human engineers can hardly exhaust the design space by heuristics. It's labor consuming and sub-optimal. We propose design automation techniques for efficient neural networks. We investigate automatically designing specialized fast models, auto channel pruning, and auto mixed-precision quantization. We demonstrate such learning-based, automated design achieves superior performance and efficiency than rule-based human design. Moreover, we shorten the design cycle by 200x than previous work, so that we can afford to design specialized neural network models for different hardware platforms.


title: Box-counting dimension and analytic properties of hidden variable fractal interpolation functions with function contractivity factors

abstract: We estimate the bounds of box-counting dimension of hidden variable fractal interpolation functions (HVFIFs) and hidden variable bivariate fractal interpolation functions (HVBFIFs) with four function contractivity factors and present analytic properties of HVFIFs which are constructed to ensure more flexibility and diversity in modeling natural phenomena. Firstly, we construct the HVFIFs and analyze their smoothness and stability. Secondly, we obtain the lower and upper bounds of box-counting dimension of the HVFIFs. Finally, in the similar way, we get the lower and upper bounds of box-counting dimension of HVBFIFs constructed in [21].


title: No Evidence for Lunar Transit in New Analysis of Hubble Space Telescope Observations of the Kepler-1625 System

abstract: Observations of the Kepler-1625 system with the Kepler and Hubble Space Telescopes have suggested the presence of a candidate exomoon, Kepler-1625b I, a Neptune-radius satellite orbiting a long-period Jovian planet. Here we present a new analysis of the Hubble observations, using an independent data reduction pipeline. We find that the transit light curve is well fit with a planet-only model, with a best-fit $\chi^2_\nu$ equal to 1.01. The addition of a moon does not significantly improve the fit quality. We compare our results directly with the original light curve from Teachey & Kipping (2018), and find that we obtain a better fit to the data using a model with fewer free parameters (no moon). We discuss possible sources for the discrepancy in our results, and conclude that the lunar transit signal found by Teachey & Kipping (2018) was likely an artifact of the data reduction. This finding highlights the need to develop independent pipelines to confirm results that push the limits of measurement precision.


title: Reinterpreting CTC training as iterative fitting

abstract: The connectionist temporal classification (CTC) enables end-to-end sequence learning by maximizing the probability of correctly recognizing sequences during training. The outputs of a CTC-trained model tend to form a series of spikes separated by strongly predicted blanks, know as the spiky problem. To figure out the reason for it, we reinterpret the CTC training process as an iterative fitting task that is based on frame-wise cross-entropy loss. It offers us an intuitive way to compare target probabilities with model outputs for each iteration, and explain how the model outputs gradually turns spiky. Inspired by it, we put forward two ways to modify the CTC training. The experiments demonstrate that our method can well solve the spiky problem and moreover, lead to faster convergence over various training settings. Beside this, the reinterpretation of CTC, as a brand new perspective, may be potentially useful in other situations. The code is publicly available at https://github.com/hzli-ucas/caffe/tree/ctc.


title: Bidirectional Learning for Domain Adaptation of Semantic Segmentation

abstract: Domain adaptation for semantic image segmentation is very necessary since manually labeling large datasets with pixel-level labels is expensive and time consuming. Existing domain adaptation techniques either work on limited datasets, or yield not so good performance compared with supervised learning. In this paper, we propose a novel bidirectional learning framework for domain adaptation of segmentation. Using the bidirectional learning, the image translation model and the segmentation adaptation model can be learned alternatively and promote to each other. Furthermore, we propose a self-supervised learning algorithm to learn a better segmentation adaptation model and in return improve the image translation model. Experiments show that our method is superior to the state-of-the-art methods in domain adaptation of segmentation with a big margin. The source code is available at https://github.com/liyunsheng13/BDL.


title: Averaging principles for non-autonomous two-time-scale stochastic reaction-diffusion equations with polynomial growth

abstract: In this paper, we develop the averaging principle for a class of two-time-scale stochastic reaction-diffusion equations driven by Wiener processes and Poisson random measures. We assume that all coefficients of the equation have polynomial growth, and the drift term of the equation is non-Lipschitz. Hence, the classical formulation of the averaging principle under the Lipschitz condition is no longer available. To prove the validity of the averaging principle, the existence and uniqueness of the mild solution are proved firstly. Then, the existence of time-dependent evolution family of measures associated with the fast equation is studied, by which the averaged coefficient is obtained. Finally, the validity of the averaging principle is verified.


title: Objective Assessment of Social Skills Using Automated Language Analysis for Identification of Schizophrenia and Bipolar Disorder

abstract: Several studies have shown that speech and language features, automatically extracted from clinical interviews or spontaneous discourse, have diagnostic value for mental disorders such as schizophrenia and bipolar disorder. They typically make use of a large feature set to train a classifier for distinguishing between two groups of interest, i.e. a clinical and control group. However, a purely data-driven approach runs the risk of overfitting to a particular data set, especially when sample sizes are limited. Here, we first down-select the set of language features to a small subset that is related to a well-validated test of functional ability, the Social Skills Performance Assessment (SSPA). This helps establish the concurrent validity of the selected features. We use only these features to train a simple classifier to distinguish between groups of interest. Linear regression reveals that a subset of language features can effectively model the SSPA, with a correlation coefficient of 0.75. Furthermore, the same feature set can be used to build a strong binary classifier to distinguish between healthy controls and a clinical group (AUC = 0.96) and also between patients within the clinical group with schizophrenia and bipolar I disorder (AUC = 0.83).


title: Security Analysis of Near-Field Communication (NFC) Payments

abstract: Near-Field Communication (NFC) is a modern technology for short range communication with a variety of applications ranging from physical access control to contactless payments. These applications are often heralded as being more secure, as they require close physical proximity and do not involve Wi-Fi or mobile networks. However, these systems are still vulnerable to security attacks at the time of transaction, as they require little to no additional authentication from the user's end. In this paper, we propose a method to attack mobile-based NFC payment methods and make payments at locations far away from where the attack occurs. We evaluate our methods on our personal Apple and Google Pay accounts and demonstrate two successful attacks on these NFC payment systems.


title: Precise determination of excitation energies in condensed-phase molecular systems based on exciton-polariton measurements

abstract: The precise determination of the excitation energies in condensed-phase molecular systems is important for understanding system-environment interactions as well as for the prerequisite input data of theoretical models used to study the dynamics of the system. The excitation energies are usually determined by fitting of the measured optical spectra that contain broad and unresolved peaks as a result of the thermally random dynamics of the environment. Herein, we propose a method for precise energy determination by strongly coupling the molecular system to an optical cavity and measuring the energy of the resulting polariton. The effect of thermal fluctuations induced by the environment on the polariton is also investigated, from which a power scaling law relating the polariton's linewidth to the number of molecules is obtained. The power exponent gives important information about the environmental dynamics.


title: Optimization of the post-crisis recovery plans in scale-free networks

abstract: General Motors or a local business, which one is better to be stimulated in post-crisis recessions, where government stimulation is meant to overcome recessions? Due to the budget constraints, it is quite relevant to ask how one can increase the chance of economic recovery. One of the key elements to answer this question is to understand metastable features of the economic networks. Ising model has been suggested for studying such features in the literature. In the homogenous networks one needs at least a minimum activation, forcing an Ising network to switch its local equilibria, where such minimum is independent of the nodes characteristics. In the scale free networks however, when one aims to push the network to switch its vacuum, she faces the question of which nodes are better to be stimulated to minimize the cost. In the paper it has been shown that stimulation of the high degree nodes costs less in general. Despite regular networks, in the scale free networks, the stimulation cost depends on the networks features such as assortativity. Though we have utilized the Ising model to tackle a problem in economics, our analysis shed lights on many other problems concerning stimulations of socio-economic systems.

categories: physics.soc-ph cond-mat.stat-mech cs.SI q-fin.GN


title: Computer-aided diagnosis in histopathological images of the endometrium using a convolutional neural network and attention mechanisms

abstract: Uterine cancer, also known as endometrial cancer, can seriously affect the female reproductive organs, and histopathological image analysis is the gold standard for diagnosing endometrial cancer. However, due to the limited capability of modeling the complicated relationships between histopathological images and their interpretations, these computer-aided diagnosis (CADx) approaches based on traditional machine learning algorithms often failed to achieve satisfying results. In this study, we developed a CADx approach using a convolutional neural network (CNN) and attention mechanisms, called HIENet. Because HIENet used the attention mechanisms and feature map visualization techniques, it can provide pathologists better interpretability of diagnoses by highlighting the histopathological correlations of local (pixel-level) image features to morphological characteristics of endometrial tissue. In the ten-fold cross-validation process, the CADx approach, HIENet, achieved a 76.91 $\pm$ 1.17% (mean $\pm$ s. d.) classification accuracy for four classes of endometrial tissue, namely normal endometrium, endometrial polyp, endometrial hyperplasia, and endometrial adenocarcinoma. Also, HIENet achieved an area-under-the-curve (AUC) of 0.9579 $\pm$ 0.0103 with an 81.04 $\pm$ 3.87% sensitivity and 94.78 $\pm$ 0.87% specificity in a binary classification task that detected endometrioid adenocarcinoma (Malignant). Besides, in the external validation process, HIENet achieved an 84.50% accuracy in the four-class classification task, and it achieved an AUC of 0.9829 with a 77.97% (95% CI, 65.27%-87.71%) sensitivity and 100% (95% CI, 97.42%-100.00%) specificity. In summary, the proposed CADx approach, HIENet, outperformed three human experts and four end-to-end CNN-based classifiers on this small-scale dataset composed of 3,500 hematoxylin and eosin (H&E) images regarding overall classification performance.


title: Differential evolution algorithm of solving an inverse problem for the spatial Solow mathematical model

abstract: The differential evolution algorithm is applied to solve the optimization problem to reconstruct the production function (inverse problem) for the spatial Solow mathematical model using additional measurements of the gross domestic product for the fixed points. Since the inverse problem is ill-posed the regularized differential evolution is applied. For getting the optimized solution of the inverse problem the differential evolution algorithm is paralleled to 32 kernels. Numerical results for different technological levels and errors in measured data are presented and discussed.


title: Pygmy resonances and symmetry energy

abstract: I present a brief summary of the first three decades of studies of pygmy resonances in nuclei and their relation to the symmetry energy of nuclear matter. I discuss the first experiments and theories dedicated to study the electromagnetic response in halo nuclei and how a low energy peak was initially identified as a candidate for the pygmy resonance. This is followed by the description of a collective state in medium heavy and heavy nuclei which was definitely identified as a pygmy resonance. The role of the slope parameter of the symmetry energy in determining the properties of neutron stars is stressed. The theoretical and experimental information collected on pygmy resonances, neutron skins, and the numerous correlations found with the slope parameter is briefly reviewed.


title: A Decade of Mal-Activity Reporting: A Retrospective Analysis of Internet Malicious Activity Blacklists

abstract: This paper focuses on reporting of Internet malicious activity (or mal-activity in short) by public blacklists with the objective of providing a systematic characterization of what has been reported over the years, and more importantly, the evolution of reported activities. Using an initial seed of 22 blacklists, covering the period from January 2007 to June 2017, we collect more than 51 million mal-activity reports involving 662K unique IP addresses worldwide. Leveraging the Wayback Machine, antivirus (AV) tool reports and several additional public datasets (e.g., BGP Route Views and Internet registries) we enrich the data with historical meta-information including geo-locations (countries), autonomous system (AS) numbers and types of mal-activity. Furthermore, we use the initially labelled dataset of approx 1.57 million mal-activities (obtained from public blacklists) to train a machine learning classifier to classify the remaining unlabeled dataset of approx 44 million mal-activities obtained through additional sources. We make our unique collected dataset (and scripts used) publicly available for further research. The main contributions of the paper are a novel means of report collection, with a machine learning approach to classify reported activities, characterization of the dataset and, most importantly, temporal analysis of mal-activity reporting behavior. Inspired by P2P behavior modeling, our analysis shows that some classes of mal-activities (e.g., phishing) and a small number of mal-activity sources are persistent, suggesting that either blacklist-based prevention systems are ineffective or have unreasonably long update periods. Our analysis also indicates that resources can be better utilized by focusing on heavy mal-activity contributors, which constitute the bulk of mal-activities.


title: Partial-wave analysis of $J/\psi\to K^+K^-\pi^0$

abstract: A partial-wave analysis of the decay $J/\psi \to K^+K^-\pi^0$ has been made using $(223.7\pm1.4)\times 10^{6}$ $J/\psi$ events collected with the BESIII detector in 2009. The analysis, which is performed within the isobar-model approach, reveals contributions from $K^*_2(1430)^\pm$, $K^*_2(1980)^\pm$ and $K^*_4(2045)^\pm$ decaying to $K^\pm\pi^0$. The two latter states are observed in $J/\psi$ decays for the first time. Two resonance signals decaying to $K^+K^-$ are also observed. These contributions can not be reliably identified and their possible interpretations are discussed. The measured branching fraction $B(J/\psi \to K^+K^-\pi^0)$ of $(2.88\pm0.01\pm0.12)\times10^{-3}$ is more precise than previous results. Branching fractions for the reported contributions are presented as well. The results of the partial-wave analysis differ significantly from those previously obtained by BESII and BABAR.


title: Low-Memory Neural Network Training: A Technical Report

abstract: Memory is increasingly often the bottleneck when training neural network models. Despite this, techniques to lower the overall memory requirements of training have been less widely studied compared to the extensive literature on reducing the memory requirements of inference. In this paper we study a fundamental question: How much memory is actually needed to train a neural network? To answer this question, we profile the overall memory usage of training on two representative deep learning benchmarks -- the WideResNet model for image classification and the DynamicConv Transformer model for machine translation -- and comprehensively evaluate four standard techniques for reducing the training memory requirements: (1) imposing sparsity on the model, (2) using low precision, (3) microbatching, and (4) gradient checkpointing. We explore how each of these techniques in isolation affects both the peak memory usage of training and the quality of the end model, and explore the memory, accuracy, and computation tradeoffs incurred when combining these techniques. Using appropriate combinations of these techniques, we show that it is possible to the reduce the memory required to train a WideResNet-28-2 on CIFAR-10 by up to 60.7x with a 0.4% loss in accuracy, and reduce the memory required to train a DynamicConv model on IWSLT'14 German to English translation by up to 8.7x with a BLEU score drop of 0.15.


title: Maximum Entropy Based Significance of Itemsets

abstract: We consider the problem of defining the significance of an itemset. We say that the itemset is significant if we are surprised by its frequency when compared to the frequencies of its sub-itemsets. In other words, we estimate the frequency of the itemset from the frequencies of its sub-itemsets and compute the deviation between the real value and the estimate. For the estimation we use Maximum Entropy and for measuring the deviation we use Kullback-Leibler divergence. A major advantage compared to the previous methods is that we are able to use richer models whereas the previous approaches only measure the deviation from the independence model. We show that our measure of significance goes to zero for derivable itemsets and that we can use the rank as a statistical test. Our empirical results demonstrate that for our real datasets the independence assumption is too strong but applying more flexible models leads to good results.


title: LFFD: A Light and Fast Face Detector for Edge Devices

abstract: Face detection, as a fundamental technology for various applications, is always deployed on edge devices which have limited memory storage and low computing power. This paper introduces a Light and Fast Face Detector (LFFD) for edge devices. The proposed method is anchor-free and belongs to the one-stage category. Specifically, we rethink the importance of receptive field (RF) and effective receptive field (ERF) in the background of face detection. Essentially, the RFs of neurons in a certain layer are distributed regularly in the input image and theses RFs are natural "anchors". Combining RF "anchors" and appropriate RF strides, the proposed method can detect a large range of continuous face scales with 100% coverage in theory. The insightful understanding of relations between ERF and face scales motivates an efficient backbone for one-stage detection. The backbone is characterized by eight detection branches and common layers, resulting in efficient computation. Comprehensive and extensive experiments on popular benchmarks: WIDER FACE and FDDB are conducted. A new evaluation schema is proposed for application-oriented scenarios. Under the new schema, the proposed method can achieve superior accuracy (WIDER FACE Val/Test -- Easy: 0.910/0.896, Medium: 0.881/0.865, Hard: 0.780/0.770; FDDB -- discontinuous: 0.973, continuous: 0.724). Multiple hardware platforms are introduced to evaluate the running efficiency. The proposed method can obtain fast inference speed (NVIDIA TITAN Xp: 131.45 FPS at 640x480; NVIDIA TX2: 136.99 PFS at 160x120; Raspberry Pi 3 Model B+: 8.44 FPS at 160x120) with model size of 9 MB.


title: Sets of uniqueness, weakly sufficient sets and sampling sets for weighted spaces of holomorphic functions in the unit ball

abstract: We consider inductive limits of weighted spaces of holomorphic functions in the unit ball of $\mathbb C^n$. The relationship between sets of uniqueness, weakly sufficient sets and sampling sets in these spaces is studied. In particular, the equivalence of these sets, under general conditions of the weights, is obtained.


title: Better Automatic Evaluation of Open-Domain Dialogue Systems with Contextualized Embeddings

abstract: Despite advances in open-domain dialogue systems, automatic evaluation of such systems is still a challenging problem. Traditional reference-based metrics such as BLEU are ineffective because there could be many valid responses for a given context that share no common words with reference responses. A recent work proposed Referenced metric and Unreferenced metric Blended Evaluation Routine (RUBER) to combine a learning-based metric, which predicts relatedness between a generated response and a given query, with reference-based metric; it showed high correlation with human judgments. In this paper, we explore using contextualized word embeddings to compute more accurate relatedness scores, thus better evaluation metrics. Experiments show that our evaluation metrics outperform RUBER, which is trained on static embeddings.


title: Entrance Effects in Concentration-Gradient-Driven Flow Through an Ultrathin Porous Membrane

abstract: Transport of liquid mixtures through porous membranes is central to processes such as desalination, chemical separations and energy harvesting, with ultrathin membranes made from novel 2D nanomaterials showing exceptional promise. Here we derive, for the first time, general equations for the solution and solute fluxes through a circular pore in an ultrathin planar membrane induced by a solute concentration gradient. We show that the equations accurately capture the fluid fluxes measured in finite-element numerical simulations for weak solute-membrane interactions. We also derive scaling laws for these fluxes as a function of the pore size and the strength and range of solute-membrane interactions. These scaling relationships differ markedly from those for concentration-gradient-driven flow through a long cylindrical pore or for flow induced by a pressure gradient or electric field through a pore in an ultrathin membrane. These results have broad implications for transport of liquid mixtures through membranes with a thickness on the order of the characteristic pore size.

categories: cond-mat.soft cond-mat.mes-hall cond-mat.mtrl-sci physics.chem-ph physics.flu-dyn


title: Who Blames Whom in a Crisis? Detecting Blame Ties from News Articles Using Neural Networks

abstract: Blame games tend to follow major disruptions, be they financial crises, natural disasters or terrorist attacks. To study how the blame game evolves and shapes the dominant crisis narratives is of great significance, as sense-making processes can affect regulatory outcomes, social hierarchies, and cultural norms. However, it takes tremendous time and efforts for social scientists to manually examine each relevant news article and extract the blame ties (A blames B). In this study, we define a new task, Blame Tie Extraction, and construct a new dataset related to the United States financial crisis (2007-2010) from The New York Times, The Wall Street Journal and USA Today. We build a Bi-directional Long Short-Term Memory (BiLSTM) network for contexts where the entities appear in and it learns to automatically extract such blame ties at the document level. Leveraging the large unsupervised model such as GloVe and ELMo, our best model achieves an F1 score of 70% on the test set for blame tie extraction, making it a useful tool for social scientists to extract blame ties more efficiently.


title: Improving Few-Shot User-Specific Gaze Adaptation via Gaze Redirection Synthesis

abstract: As an indicator of human attention gaze is a subtle behavioral cue which can be exploited in many applications. However, inferring 3D gaze direction is challenging even for deep neural networks given the lack of large amount of data (groundtruthing gaze is expensive and existing datasets use different setups) and the inherent presence of gaze biases due to person-specific difference. In this work, we address the problem of person-specific gaze model adaptation from only a few reference training samples. The main and novel idea is to improve gaze adaptation by generating additional training samples through the synthesis of gaze-redirected eye images from existing reference samples. In doing so, our contributions are threefold: (i) we design our gaze redirection framework from synthetic data, allowing us to benefit from aligned training sample pairs to predict accurate inverse mapping fields; (ii) we proposed a self-supervised approach for domain adaptation; (iii) we exploit the gaze redirection to improve the performance of person-specific gaze estimation. Extensive experiments on two public datasets demonstrate the validity of our gaze retargeting and gaze estimation framework.


title: Efficient Simulation Budget Allocation for Subset Selection Using Regression Metamodels

abstract: This research considers the ranking and selection (R&S) problem of selecting the optimal subset from a finite set of alternative designs. Given the total simulation budget constraint, we aim to maximize the probability of correctly selecting the top-m designs. In order to improve the selection efficiency, we incorporate the information from across the domain into regression metamodels. In this research, we assume that the mean performance of each design is approximately quadratic. To achieve a better fit of this model, we divide the solution space into adjacent partitions such that the quadratic assumption can be satisfied within each partition. Using the large deviation theory, we propose an approximately optimal simulation budget allocation rule in the presence of partitioned domains. Numerical experiments demonstrate that our approach can enhance the simulation efficiency significantly.


title: Low-index contrast waveguide bend based on truncated Eaton lens implemented by graded photonic crystals

abstract: Low-index contrast waveguides such as silica waveguides are indispensable part of passive integrated optical components. Reducing the bending radius of silica waveguides with low bend loss is vital in miniaturizing silica planar lightwave circuits. The Eaton lens is a gradient index lens that can bend parallel light rays by 90{\deg}, 180{\deg}, or 360{\deg}. We present a low-loss and compact 90{\deg} waveguide bend with a radius of 9 $\mu$m designed by truncating the Eaton lens. The performance of the designed bend, implemented by graded photonic crystal, was evaluated by full-wave two-dimensional finite element method. The average bend loss in the C-band is 0.9dB while the average bend loss for the wavelength range of 1260-1675nm is 1.05dB. The proposed design strategy can be applied to other low-index contrast waveguides.


title: Detecting Machine-Translated Paragraphs by Matching Similar Words

abstract: Machine-translated text plays an important role in modern life by smoothing communication from various communities using different languages. However, unnatural translation may lead to misunderstanding, a detector is thus needed to avoid the unfortunate mistakes. While a previous method measured the naturalness of continuous words using a N-gram language model, another method matched noncontinuous words across sentences but this method ignores such words in an individual sentence. We have developed a method matching similar words throughout the paragraph and estimating the paragraph-level coherence, that can identify machine-translated text. Experiment evaluates on 2000 English human-generated and 2000 English machine-translated paragraphs from German showing that the coherence-based method achieves high performance (accuracy = 87.0%; equal error rate = 13.0%). It is efficiently better than previous methods (best accuracy = 72.4%; equal error rate = 29.7%). Similar experiments on Dutch and Japanese obtain 89.2% and 97.9% accuracy, respectively. The results demonstrate the persistence of the proposed method in various languages with different resource levels.


title: Towards Combining On-Off-Policy Methods for Real-World Applications

abstract: In this paper, we point out a fundamental property of the objective in reinforcement learning, with which we can reformulate the policy gradient objective into a perceptron-like loss function, removing the need to distinguish between on and off policy training. Namely, we posit that it is sufficient to only update a policy $\pi$ for cases that satisfy the condition $A(\frac{\pi}{\mu}-1)\leq0$, where $A$ is the advantage, and $\mu$ is another policy. Furthermore, we show via theoretic derivation that a perceptron-like loss function matches the clipped surrogate objective for PPO. With our new formulation, the policies $\pi$ and $\mu$ can be arbitrarily apart in theory, effectively enabling off-policy training. To examine our derivations, we can combine the on-policy PPO clipped surrogate (which we show to be equivalent with one instance of the new reformation) with the off-policy IMPALA method. We first verify the combined method on the OpenAI Gym pendulum toy problem. Next, we use our method to train a quadrotor position controller in a simulator. Our trained policy is efficient and lightweight enough to perform in a low cost micro-controller at a minimum update rate of 500 Hz. For the quadrotor, we show two experiments to verify our method and demonstrate performance: 1) hovering at a fixed position, and 2) tracking along a specific trajectory. In preliminary trials, we are also able to apply the method to a real-world quadrotor.


title: Heun algebras of Lie type

abstract: We introduce Heun algebras of Lie type. They are obtained from bispectral pairs associated to simple or solvable Lie algebras of dimension three or four. For $\mathfrak{su}(2)$, this leads to the Heun-Krawtchouk algebra. The corresponding Heun-Krawtchouk operator is identified as the Hamiltonian of the quantum analogue of the Zhukovski-Voltera gyrostat. For $\mathfrak{su}(1,1)$, one obtains the Heun algebras attached to the Meixner, Meixner-Pollaczek and Laguerre polynomials. These Heun algebras are shown to be isomorphic the the Hahn algebra. Focusing on the harmonic oscillator algebra $\mathfrak{ho}$ leads to the Heun-Charlier algebra. The connections to orthogonal polynomials are achieved through realizations of the underlying Lie algebras in terms of difference and differential operators. In the $\mathfrak{su}(1,1)$ cases, it is observed that the Heun operator can be transformed into the Hahn, Continuous Hahn and Confluent Heun operators respectively.


title: Facilitating Bayesian Continual Learning by Natural Gradients and Stein Gradients

abstract: Continual learning aims to enable machine learning models to learn a general solution space for past and future tasks in a sequential manner. Conventional models tend to forget the knowledge of previous tasks while learning a new task, a phenomenon known as catastrophic forgetting. When using Bayesian models in continual learning, knowledge from previous tasks can be retained in two ways: 1). posterior distributions over the parameters, containing the knowledge gained from inference in previous tasks, which then serve as the priors for the following task; 2). coresets, containing knowledge of data distributions of previous tasks. Here, we show that Bayesian continual learning can be facilitated in terms of these two means through the use of natural gradients and Stein gradients respectively.


title: Measurements of magnetization on the Sierpi\'{n}ski carpet

abstract: Phase transition of the classical Ising model on the Sierpi\'{n}ski carpet, which has the fractal dimension $\log_3^{~} 8 \approx 1.8927$, is studied by an adapted variant of the higher-order tensor renormalization group method. The second-order phase transition is observed at the critical temperature $T_{\rm c}^{~} \approx 1.478$. Position dependence of local functions is studied through impurity tensors inserted at different locations on the fractal lattice. The critical exponent $\beta$ associated with the local magnetization varies by two orders of magnitude, depending on lattice locations, whereas $T_{\rm c}^{~}$ is not affected. Furthermore, we employ automatic differentiation to accurately and efficiently compute the average spontaneous magnetization per site as a first derivative of free energy with respect to the external field, yielding the global critical exponent of $\beta \approx 0.135$.


title: Efficient FPGA Floorplanning for Partial Reconfiguration-Based Applications

abstract: Partial Reconfiguration (PR) is a technique that allows reconfiguring the FPGA chip at runtime. However, current design support tools require manual floorplanning of the partial modules. Several approaches have been proposed in this field, but only a few of them consider all aspects of PR, like the shape and the aspect ratio of the reconfigurable region. Most of them are defined for old FPGA architectures and have a high computational time. This paper introduces an efficient automatic floorplanning algorithm, which takes into account the heterogeneous architectures of modern FPGA families, as well as PR constraints, introducing the aspect ratio constraint to optimize routing. The algorithm generates possible placements of the partial modules, then applies a recursive pseudo-bipartitioning heuristic search to find the best floorplan. The experiments showed that the algorithm's performance is significantly better than the one of other algorithms in this field.


title: Towards the theory of strong minimum. A view from variational analysis

abstract: The key element of the approach to the theory of necessary conditions in optimal control discussed in the paper is reduction of the original constrained problem to unconstrained minimization with subsequent application of a suitable mechanism of local analysis to characterize minima of (necessarily nonsmooth) functionals that appear after reduction. Using unconstrained minimization at the crucial step of obtaining necessary conditions definitely facilitates studies of new phenomena and allows to get more transparent and technically simple proofs of known results. In the paper we offer a new proof of the maximum principle for a nonsmooth optimal control problem (in the standard Pontryagin form) with state constraints and then prove a new second order condition for a strong minimum in the same problem but with data differentiable with respect to the state and control variables. The role of variational analysis is twofold. Conceptually, the main considerations behind the reduction are connected with metric regularity and Ekeland's principle. On the other hand, technically, calculation of subdifferentials of components of the functionals that appear after the reduction is an essential part of the proofs.