title: Benchmarking High Bandwidth Memory on FPGAs

abstract: FPGAs are starting to be enhanced with High Bandwidth Memory (HBM) as a way to reduce the memory bandwidth bottleneck encountered in some applications and to give the FPGA more capacity to deal with application state. However, the performance characteristics of HBM are still not well specified, especially in the context of FPGAs. In this paper, we bridge the gap between nominal specifications and actual performance by benchmarkingHBM on a state-of-the-art FPGA, i.e., a Xilinx Alveo U280 featuring a two-stack HBM subsystem. To this end, we propose Shuhai, a benchmarking tool that allows us to demystify all the underlying details of HBM on an FPGA. FPGA-based benchmarking should also provide a more accurate picture of HBM than doing so on CPUs/GPUs, since CPUs/GPUs are noisier systems due to their complex control logic and cache hierarchy. Since the memory itself is complex, leveraging custom hardware logic to benchmark inside an FPGA provides more details as well as accurate and deterministic measurements. We observe that 1) HBM is able to provide up to 425GB/s memory bandwidth, and 2) how HBM is used has a significant impact on performance, which in turn demonstrates the importance of unveiling the performance characteristics of HBM so as to select the best approach. As a yardstick, we also applyShuhaito DDR4to show the differences between HBM and DDR4.Shuhai can be easily generalized to other FPGA boards or other generations of memory, e.g., HBM3, and DDR3. We will makeShuhaiopen-source, benefiting the community


title: Probing gravity and growth of structure with gravitational waves and galaxies' peculiar velocity

abstract: The low-redshift velocity field is a unique probe of the growth of cosmic structure and gravity. We propose to use distances from gravitational wave (GW) detections, in conjunction with the redshifts of their host galaxies from wide field spectroscopic surveys (e.g. DESI, 4MOST, TAIPAN), to measure peculiar motions within the local Universe. Such measurement has the potential to constrain the growth rate $f\sigma_8$ and test gravity through determination of the gravitational growth index $\gamma$, complementing constraints from other peculiar velocity measurements. We find that binary neutron star mergers with associated counterpart at $z\lesssim 0.2$ that will be detected by the Einstein Telescope (ET) will be able to constrain $f\sigma_8$ to $\sim 3\%$ precision after $10$ years of operations when combined with galaxy overdensities from DESI and TAIPAN. If a larger network of third generation GW detectors is available (e.g. including the Cosmic Explorer), the same constraints can be reached over a shorter timescale ($\sim 5$ years for a 3 detectors network). The same events (plus information from their hosts' redshifts) can constrain $\gamma$ to $\sigma_\gamma\lesssim 0.04$. This constraint is precise enough to discern General Relativity from other popular gravity models at $3\sigma$. This constraint is improved to $\sigma_\gamma\sim 0.02-0.03$ when combined with galaxy overdensities. The potential of combining galaxies' peculiar velocities with gravitational wave detections for cosmology highlights the need for extensive optical to near--infrared follow--up of nearby gravitational wave events, or exquisite GW localization, in the next decade.


title: Market-based Short-Term Allocations in Small Cell Wireless Networks

abstract: Mobile users (or UEs, to use 3GPP terminology) served by small cells in dense urban settings may abruptly experience a significant deterioration in their channel to their serving base stations (BSs) in several scenarios, such as after turning a corner around a tall building, or a sudden knot of traffic blocking the direct path between the UE and its serving BS. In this work, we propose a scheme to temporarily increase the data rate to/from this UE with additional bandwidth from the nearest Coordinated Multi-Point (CoMP) cluster of BSs, while the slower process of handover of the UE to a new serving BS is ongoing. We emphasize that this additional bandwidth is additional to the data rates the UE is getting over its primary connection to the current serving BS and, after the handover, to the new serving BS. The key novelty of the present work is the proposal of a decentralized market-based resource allocation method to perform resource allocation to support Coordinated Beamforming (CB) CoMP. It is scalable to large numbers of UEs and BSs, and it is fast because resource allocations are made bilaterally, between BSs and UEs. Once the resource allocation to the UE has been made, the coordinated of transmissions occurs as per the usual CB methods. Thus the proposed method has the benefit of giving the UE access to its desired amount of resources fast, without waiting for handover to complete, or reporting channel state information before it knows the resources it will be allocated for receiving transmissions from the serving BS.


title: Quest for New Quantum States via Field-Editing Technology

abstract: We report new quantum states in spin-orbit-coupled single crystals that are synthesized using a game-changing technology that "field-edits" crystal structures (borrowing from the phrase "genome editing") via application of magnetic field during crystal growth. This study is intended to fundamentally address a major challenge facing the research community today: A great deal of theoretical work predicting exotic states for strongly spin-orbit-coupled, correlated materials has thus far met very limited experimental confirmation. These conspicuous discrepancies are due chiefly to the extreme sensitivity of these materials to structural distortions. The results presented here demonstrate that the "field-edited" materials not only are much less distorted but also exhibit novel phenomena absent in their "non-edited" counterparts. The field-edited materials include an array of 4d and 5d transition metal oxides, and three representative materials presented here are Ba4Ir3O10, Ca2RuO4, and Sr2IrO4. This study provides an entirely new paradigm for discovery of new quantum states and materials otherwise unavailable.


title: Examining the validity of the two-dimensional conical model to describe the three-dimensional ZrTe5

abstract: Understanding the low-energy excitation state in three-dimensional layered compound ZrTe5 remains a challenging problem in the study of novel topological materials. Recently, a two-dimensional conical model was proposed to explain the experimental optical spectroscopy in the 3D ZrTe5, Martino et al. [Phys. Rev. Lett. 122, 217402 (2019)]. Motivated by this work, in this paper, we perform a systematic theoretical study on the optical conductivity of this model in both cases without and with an external magnetic field to further demonstrate the validity of this model and to recover new physics.We find that there exist completely different characteristics for optical conductivity along different directions, due to anisotropic low-energy excitations in this two-dimensional conical model. Specifically, for the interband optical conductivity, we find asymptotic dependence on the optical frequency as Re(\sigma_x)\sim\omega^{1/2} and Re(\sigma_z)\sim{\omega}^{3/2}, which are universal both in the gapped insulator phase and Weyl semimetal phase. For the magneto-optical conductivity, on the contrary, Re(\sigma^B_{x/z}) shows distinct signatures in the gapped insulator phase and Weyl semimetal phase, which can help distinguish the two phases. Our results, to be verified in future experiments, could provide more insights into the understanding of the topological nature of ZrTe5.


title: A Discrete Multi-Sequence Cauchy-Schwarz-Like Inequality

abstract: We prove a general inequality for more than two sequences mirroring that of the discrete two-sequence Cauchy-Schwarz.


title: Generalizing Outside the Training Set: When Can Neural Networks Learn Identity Effects?

abstract: Often in language and other areas of cognition, whether two components of an object are identical or not determine whether it is well formed. We call such constraints identity effects. When developing a system to learn well-formedness from examples, it is easy enough to build in an identify effect. But can identity effects be learned from the data without explicit guidance? We provide a simple framework in which we can rigorously prove that algorithms satisfying simple criteria cannot make the correct inference. We then show that a broad class of algorithms including deep neural networks with standard architecture and training with backpropagation satisfy our criteria, dependent on the encoding of inputs. Finally, we demonstrate our theory with computational experiments in which we explore the effect of different input encodings on the ability of algorithms to generalize to novel inputs.


title: Straightforward computation of high-pressure elastic constants using Hooke's law: A prototype of metal Ru

abstract: In this paper, we did a systematic comparative study on the accuracy of two computational methods of elastic constants combined with the density functional theory (DFT), the stress-strain method and the energy-strain method. We took metal Ru as a prototype to compare its high-pressure elastic constants calculated by our present stress-strain method with the previous energy-strain results by others. Although the two methods yielded almost the same accuracy of high-pressure elastic constants for Ru, our stress-strain method directly based on the Hooke's law of elasticity theory is much straightforward and simple to implement. However, the energy-strain method needs complicated pressure corrections because of the pressure effects on the total energy. Various crystal systems have various pressure correction methods. Hence, the stress-strain method is preferred to calculate the high-pressure elastic constants of materials. Furthermore, we analyzed the variations of the elastic moduli, elastic anisotropy, sound velocities, Debye temperature of Ru with pressure.


title: Spectral Neural Network Potentials for Binary Alloys

abstract: In this work, we present a numerical implementation to compute the atom centered descriptors introduced by Bartok et al (Phys. Rev. B, 87, 184115, 2013) based on the harmonic analysis of the atomic neighbor density function. Specifically, we focus on two types of descriptors, the smooth SO(3) power spectrum with the explicit inclusion of a radial basis and the SO(4) bispectrum obtained through mapping the radial component onto a polar angle of a four dimensional hypersphere. With these descriptors, various interatomic potentials for binary Ni-Mo alloys are obtained based on linear and neural network regression models. Numerical experiments suggest that both descriptors produce similar results in terms of accuracy. For linear regression, the smooth SO(3) power spectrum is superior to the SO(4) bispectrum when a large band limit is used. In neural network regression, a better accuracy can be achieved with even less number of expansion components for both descriptors. As such, we demonstrate that spectral neural network potentials are feasible choices for large scale atomistic simulation.


title: Monopoles and Landau-Ginzburg Models II: Floer Homology

abstract: This is the second paper in this series. Following the setup of Meng-Taubes, we define the monopole Floer homology for any pair $(Y,\omega)$, where $Y$ is a compact oriented 3-manifold with toroidal boundary and $\omega$ is a suitable closed 2-form viewed as a decoration. This construction fits into a (3+1)-topological quantum field theory and generalizes the work of Kronheimer-Mrowka for closed oriented 3-manifolds. By a theorem of Meng-Taubes and Turaev, the Euler characteristic of this Floer homology recovers the Milnor-Turaev torsion invariant of the 3-manifold.


title: $K$-theory of endomorphisms, the $\mathit{TR}$-trace, and zeta functions

abstract: We show that the characteristic polynomial and the Lefschetz zeta function are manifestations of the trace map from the $K$-theory of endomorphisms to topological restriction homology (TR). Along the way we generalize Lindenstrauss and McCarthy's map from $K$-theory of endomorphisms to topological restriction homology, defining it for any Waldhausen category with a compatible enrichment in orthogonal spectra. In particular, this extends their construction from rings to ring spectra. We also give a revisionist treatment of the original Dennis trace map from $K$-theory to topological Hochschild homology (THH) and explain its connection to traces in bicategories with shadow (also known as trace theories).


title: Autonomous Aerial Robotic Surveying and Mapping with Application to Construction Operations

abstract: In this paper we present an overview of the methods and systems that give rise to a flying robotic system capable of autonomous inspection, surveying, comprehensive multi-modal mapping and inventory tracking of construction sites with high degree of systematicity. The robotic system can operate assuming either no prior knowledge of the environment or by integrating a prior model of it. In the first case, autonomous exploration is provided which returns a high fidelity $3\textrm{D}$ map associated with color and thermal vision information. In the second case, the prior model of the structure can be used to provide optimized and repetitive coverage paths. The robot delivers its mapping result autonomously, while simultaneously being able to detect and localize objects of interest thus supporting inventory tracking tasks. The system has been field verified in a collection of environments and has been tested inside a construction project related to public housing.


title: Optical and X-ray observations of stellar flares on an active M dwarf AD Leonis with Seimei Telescope, SCAT, NICER and OISTER

abstract: We report multi-wavelength monitoring observations of an M-dwarf flare star AD Leonis with Seimei Telescope (6150--7930 {\AA}), SCAT (Spectroscopic Chuo-university Astronomical Telescope; 3700--7500 {\AA}), NICER (Neutron Star Interior Composition Explorer; 0.2--12.0 keV), and collaborations of OISTER (Optical and Infrared Synergetic Telescopes for Education and Research) program. Twelve flares are detected in total which include ten H$\alpha$, four X-ray, and four optical-continuum flares; one of them is a superflare with the total energy of $\sim$ 2.0$\times$10$^{33}$ erg. We found that (1) during the superflare, the H$\alpha$ emission line full width at 1/8 maximum dramatically increases to 14 {\AA} from 8 {\AA} in the low-resolution spectra (R$\sim$ 2000) accompanied with the large white-light flares, (2) some weak H$\alpha$/X-ray flares are not accompanied with white-light emissions, and (3) the non-flaring emissions show clear rotational modulations in X-ray and H$\alpha$ intensity in the same phase. To understand these observational features, one-dimensional hydrodynamic flare simulations are performed by using the RADYN code. As a result of simulations, we found the simulated H$\alpha$ line profiles with hard and high-energy non-thermal electron beams are consistent with that of the initial phase line profiles of the superflares, while those with more soft- and/or weak-energy beam are consistent with those in decay phases, indicating the changes in the energy fluxes injected to the lower atmosphere. Also, we found that the relation between optical continuum and H$\alpha$ intensity is nonlinear, which can be one cause of the non-white-light flares. The flare energy budget exhibits diversity in the observations and models, and more observations of stellar flares are necessary for constraining the occurrence of various emission line phenomena in stellar flares.


title: Giant dipole resonance and shape evolution in Nd isotopes within TDHF method

abstract: The isovector giant dipole resonance (IVGDR) in even-even Nd isotopes from A=124 to A=160 is studied in the framework of time-dependent Hartree-Fock (TDHF) with Skyrme forces SkI3, SVbas, SLy5 and SLy6. The dipole strength is calculated and compared with the experimental data on photon absorption cross section $\sigma_{\gamma}$. An overall agreement between them is obtained. The dipole strengths in $ ^{124-140}\text{Nd}$ and $^{152-160}\text{Nd} $ are predicted. In addition, the correlation between the quadrupole deformation parameter $\beta_{2}$ and the splitting $\Delta E/ \bar{E}_{m}$ of the giant dipole resonance (GDR) spectra is studied. The results confirm that $\Delta E/ \bar{E}_{m}$ is proportional to $\beta_{2}$. Shape phase transition in Nd isotopes is also investigated in the light of IVGDR.


title: Learning Properties of Ordered and Disordered Materials from Multi-fidelity Data

abstract: Predicting the properties of a material from the arrangement of its atoms is a fundamental goal in materials science. While machine learning has emerged in recent years as a new paradigm to provide rapid predictions of materials properties, their practical utility is limited by the scarcity of high-fidelity data. Here, we develop multi-fidelity graph networks as a universal approach to achieve accurate predictions of materials properties with small data sizes. As a proof of concept, we show that the inclusion of low-fidelity Perdew-Burke-Ernzerhof band gaps greatly enhances the resolution of latent structural features in materials graphs, leading to a 22-45\% decrease in the mean absolute errors of experimental band gap predictions. We further demonstrate that learned elemental embeddings in materials graph networks provide a natural approach to model disorder in materials, addressing a fundamental gap in the computational prediction of materials properties.


title: Weak SINDy: Galerkin-Based Data-Driven Model Selection

abstract: We present a weak formulation and discretization of the system discovery problem from noisy measurement data. This method of learning differential equations from data fits into a new class of algorithms that replace pointwise derivative approximations with linear transformations and a variance reduction technique. Our approach improves on the standard SINDy algorithm by orders of magnitude. We first show that in the noise-free regime, this so-called Weak SINDy (WSINDy) framework is capable of recovering the dynamic coefficients to very high accuracy, with the number of significant digits equal to the tolerance of the data simulation scheme. Next we show that the weak form naturally accounts for white noise by identifying the correct nonlinearities with coefficient error scaling favorably with the signal-to-noise ratio while significantly reducing the size of linear systems in the algorithm. In doing so, we combine the ease of implementation of the SINDy algorithm with the natural noise-reduction of integration to arrive at a more robust and user-friendly method of sparse recovery that correctly identifies systems in both small-noise and large-noise regimes.


title: Some Levin-Steckin's Type Inequalities for Operator Convex Functions on Hilbert Spaces

abstract: In this paper we obtain some operator versions of Levin-Steckin integral inequality.


title: Generic detection-based error-mitigation using quantum autoencoders

abstract: Efficient error-mitigation techniques demanding minimal resources is key to quantum information processing. We propose a generic protocol to mitigate quantum errors using detection-based quantum autoencoders. In our protocol, the quantum data are compressed into a latent subspace while leaving errors outside, the latter of which is then removed by a measurement and post-selection. Compared to previously developed methods, our protocol on the one hand requires no extra qubits, and on the other hand has a near-optimal denoising power, in which under reasonable requirements all errors detected outside of the latent subspace can be removed, while those inside the subspace cannot be removed by any means. Our detection-based quantum autoencoders are therefore particularly useful for near-term quantum devices in which controllable qubits are limited while noise reduction is important.


title: JigSaw: A tool for discovering explanatory high-order interactions from random forests

abstract: Machine learning is revolutionizing biology by facilitating the prediction of outcomes from complex patterns found in massive data sets. Large biological data sets, like those generated by transcriptome or microbiome studies,measure many relevant components that interact in vivo with one another in modular ways.Identifying the high-order interactions that machine learning models use to make predictions would facilitate the development of hypotheses linking combinations of measured components to outcome. By using the structure of random forests, a new algorithmic approach, termed JigSaw,was developed to aid in the discovery of patterns that could explain predictions made by the forest. By examining the patterns of individual decision trees JigSaw identifies high-order interactions between measured features that are strongly associated with a particular outcome and identifies the relevant decision thresholds. JigSaw's effectiveness was tested in simulation studies where it was able to recover multiple ground truth patterns;even in the presence of significant noise. It was then used to find patterns associated with outcomes in two real world data sets.It was first used to identify patterns clinical measurements associated with heart disease. It was then used to find patterns associated with breast cancer using metabolites measured in the blood. In heart disease, JigSaw identified several three-way interactions that combine to explain most of the heart disease records (66%) with high precision (93%). In breast cancer, three two-way interactions were recovered that can be combined to explain almost all records (92%) with good precision (79%). JigSaw is an efficient method for exploring high-dimensional feature spaces for rules that explain statistical associations with a given outcome and can inspire the generation of testable hypotheses.


title: How good is good enough for COVID19 apps? The influence of benefits, accuracy, and privacy on willingness to adopt

abstract: A growing number of contact tracing apps are being developed to complement manual contact tracing. A key question is whether users will be willing to adopt these contact tracing apps. In this work, we survey over 4,500 Americans to evaluate (1) the effect of both accuracy and privacy concerns on reported willingness to install COVID19 contact tracing apps and (2) how different groups of users weight accuracy vs. privacy. Drawing on our findings from these first two research questions, we (3) quantitatively model how the amount of public health benefit (reduction in infection rate), amount of individual benefit (true-positive detection of exposures to COVID), and degree of privacy risk in a hypothetical contact tracing app may influence American's willingness to install. Our work takes a descriptive ethics approach toward offering implications for the development of policy and app designs related to COVID19.


title: Physical Security in the Post-quantum Era: A Survey on Side-channel Analysis, Random Number Generators, and Physically Unclonable Functions

abstract: Over the past decades, quantum technology has seen consistent progress, with notable recent developments in the field of quantum computers. Traditionally, this trend has been primarily seen as a serious risk for cryptography; however, a positive aspect of quantum technology should also be stressed. In this regard, viewing this technology as a resource for honest parties rather than adversaries, it may enhance not only the security, but also the performance of specific cryptographic schemes. While considerable effort has been devoted to the design of quantum-resistant and quantum-enhanced schemes, little effort has been made to understanding their physical security. Physical security deals with the design and implementation of security measures fulfilling the practical requirements of cryptographic primitives, which are equally essential for classic and quantum ones. This survey aims to draw greater attention to the importance of physical security, with a focus on secure key generation and storage as well as secure execution. More specifically, the possibility of performing side-channel analysis in the quantum world is discussed and compared to attacks launched in the classic world. Besides, proposals for quantum random number generation and quantum physically unclonable functions are compared to their classic counterparts and further analyzed to give a better understanding of their features, advantages, and shortcomings. Finally, seen from these three perspectives, this survey provides an outlook for future research in this direction.


title: An Investigation of Why Overparameterization Exacerbates Spurious Correlations

abstract: We study why overparameterization -- increasing model size well beyond the point of zero training error -- can hurt test error on minority groups despite improving average test error when there are spurious correlations in the data. Through simulations and experiments on two image datasets, we identify two key properties of the training data that drive this behavior: the proportions of majority versus minority groups, and the signal-to-noise ratio of the spurious correlations. We then analyze a linear setting and theoretically show how the inductive bias of models towards "memorizing" fewer examples can cause overparameterization to hurt. Our analysis leads to a counterintuitive approach of subsampling the majority group, which empirically achieves low minority error in the overparameterized regime, even though the standard approach of upweighting the minority fails. Overall, our results suggest a tension between using overparameterized models versus using all the training data for achieving low worst-group error.


title: Diversifying Dialogue Generation with Non-Conversational Text

abstract: Neural network-based sequence-to-sequence (seq2seq) models strongly suffer from the low-diversity problem when it comes to open-domain dialogue generation. As bland and generic utterances usually dominate the frequency distribution in our daily chitchat, avoiding them to generate more interesting responses requires complex data filtering, sampling techniques or modifying the training objective. In this paper, we propose a new perspective to diversify dialogue generation by leveraging non-conversational text. Compared with bilateral conversations, non-conversational text are easier to obtain, more diverse and cover a much broader range of topics. We collect a large-scale non-conversational corpus from multi sources including forum comments, idioms and book snippets. We further present a training paradigm to effectively incorporate these text via iterative back translation. The resulting model is tested on two conversational datasets and is shown to produce significantly more diverse responses without sacrificing the relevance with context.


title: GPU Acceleration of Sparse Neural Networks

abstract: In this paper, we use graphics processing units(GPU) to accelerate sparse and arbitrary structured neural networks. Sparse networks have nodes in the network that are not fully connected with nodes in preceding and following layers, and arbitrary structure neural networks have different number of nodes in each layers. Sparse Neural networks with arbitrary structures are generally created in the processes like neural network pruning and evolutionary machine learning strategies. We show that we can gain significant speedup for full activation of such neural networks using graphical processing units. We do a prepossessing step to determine dependency groups for all the nodes in a network, and use that information to guide the progression of activation in the neural network. Then we compute activation for each nodes in its own separate thread in the GPU, which allows for massive parallelization. We use CUDA framework to implement our approach and compare the results of sequential and GPU implementations. Our results show that the activation of sparse neural networks lends very well to GPU acceleration and can help speed up machine learning strategies which generate such networks or other processes that have similar structure.


title: The Partial Transpose and Asymptotic Free Independence for Wishart Random Matrices: Part II

abstract: Using new combinatorial techniques, we significantly improve the previous results on asymptotic distributions and asymptotic free independence relations of partial transposes of Wishart random matrices. In particular, we give a necessary and sufficient condition for the asymptotic free independence of partial transposes of Wishart matrices with difference block sizes.


title: Characterizations of predual spaces to a class of Sobolev multiplier type spaces

abstract: We characterize preduals and K\"othe duals to a class of Sobolev multiplier type spaces. Our results fit in well with the modern theory of function spaces of harmonic analysis and are also applicable to nonlinear partial differential equations. We make use of several tools from nonlinear potential theory, weighted norm inequalities, and the theory of Banach function spaces to obtain our results.


title: Generation of Chinese-characters-like modes with transverse mode locked lasers

abstract: Spontaneous transverse mode locking to generate optical vortex arrays is already widely studied for the frequency degenerated transverse modes. While, the mode locking between transverse modes in different orders (non-frequency degenerated families) to achieve spatial stationary beam patterns is rarely reported. The theory of transverse mode locking is discussed. Concepts of general transverse mode locking (G-TML) and restricted transverse mode locking (R-TML) are mentioned. It's experimentally shown that R-TML is possible in microchip cavities with high nonlinearity. More interestingly, some Chinese characters like laser modes can be generated by microchip lasers with this special transverse mode locking effect. And various experimental results and corresponding simulations are presented.


title: Efficient Quantum Circuits for Accurate State Preparation of Smooth, Differentiable Functions

abstract: Effective quantum computation relies upon making good use of the exponential information capacity of a quantum machine. A large barrier to designing quantum algorithms for execution on real quantum machines is that, in general, it is intractably difficult to construct an arbitrary quantum state to high precision. Many quantum algorithms rely instead upon initializing the machine in a simple state, and evolving the state through an efficient (i.e. at most polynomial-depth) quantum algorithm. In this work, we show that there exist families of quantum states that can be prepared to high precision with circuits of linear size and depth. We focus on real-valued, smooth, differentiable functions with bounded derivatives on a domain of interest, exemplified by commonly used probability distributions. We further develop an algorithm that requires only linear classical computation time to generate accurate linear-depth circuits to prepare these states, and apply this to well-known and heavily-utilized functions including Gaussian and lognormal distributions. Our procedure rests upon the quantum state representation tool known as the matrix product state (MPS). By efficiently and scalably encoding an explicit amplitude function into an MPS, a high fidelity, linear-depth circuit can directly be generated. These results enable the execution of many quantum algorithms that, aside from initialization, are otherwise depth-efficient.


title: Combined explanations of $(g-2)_{\mu}$, $R_{D^{(\ast)}}$, $R_{K^{(\ast)}}$ anomalies in a two-loop radiative neutrino mass model

abstract: Motivated by the long-standing tension in the muon anomalous magnetic moment (AMM) and persistent observations of B-physics anomalies in $R_{D^{(\ast)}}$ and $R_{K^{(\ast)}}$ ratios, we construct a simple two-loop radiative neutrino mass model, and propose a combined explanations of all these apparently disjoint phenomena within this framework. Our proposed model consists of two scalar leptoquarks (LQs), a $SU(2)_L$ singlet $S_1\sim (\overline{3},1,1/3)$ and a $SU(2)_L$ triplet $S_3\sim (\overline{3},3,1/3)$ to accommodate $R_{D^{(\ast)}}$ and $R_{K^{(\ast)}}$ anomalies, respectively. The muon receives chirality-enhanced contribution towards its $g-2$ due to the presence of $S_1$ LQ that accounts for the observed deviation from the Standard Model prediction. Furthermore, we introduce a $SU(2)_L$ singlet scalar diquark $\omega\sim (\overline{6},1,2/3)$, which is necessary to break lepton number and generate neutrino mass radiatively with the aid of $S_1$ and $S_3$ LQs. We perform a detailed phenomenological analysis of this set-up and demonstrate its viability by providing benchmark points where a fit to the neutrino oscillation data together with proper explanations of the muon AMM puzzle and flavor anomalies are accomplished while simultaneously meeting all other flavor violation and collider bounds.


title: Dual-track Music Generation using Deep Learning

abstract: Music generation is always interesting in a sense that there is no formalized recipe. In this work, we propose a novel dual-track architecture for generating classical piano music, which is able to model the inter-dependency of left-hand and right-hand piano music. Particularly, we experimented with a lot of different models of neural network as well as different representations of music, and the results show that our proposed model outperforms all other tested methods. Besides, we deployed some special policies for model training and generation, which contributed to the model performance remarkably. Finally, under two evaluation methods, we compared our models with the MuseGAN project and true music.


title: Exact Asymptotics for Learning Tree-Structured Graphical Models with Side Information: Noiseless and Noisy Samples

abstract: Given side information that an Ising tree-structured graphical model is homogeneous and has no external field, we derive the exact asymptotics of learning its structure from independently drawn samples. Our results, which leverage the use of probabilistic tools from the theory of strong large deviations, refine the large deviation (error exponents) results of Tan, Anandkumar, Tong, and Willsky [IEEE Trans. on Inform. Th., 57(3):1714--1735, 2011] and strictly improve those of Bresler and Karzand [Ann. Statist., 2020]. In addition, we extend our results to the scenario in which the samples are observed in random noise. In this case, we show that they strictly improve on the recent results of Nikolakakis, Kalogerias, and Sarwate [Proc. AISTATS, 1771--1782, 2019]. Our theoretical results demonstrate keen agreement with experimental results for sample sizes as small as that in the hundreds.


title: Learning to Accelerate Heuristic Searching for Large-Scale Maximum Weighted b-Matching Problems in Online Advertising

abstract: Bipartite b-matching is fundamental in algorithm design, and has been widely applied into economic markets, labor markets, etc. These practical problems usually exhibit two distinct features: large-scale and dynamic, which requires the matching algorithm to be repeatedly executed at regular intervals. However, existing exact and approximate algorithms usually fail in such settings due to either requiring intolerable running time or too much computation resource. To address this issue, we propose \texttt{NeuSearcher} which leverages the knowledge learned from previously instances to solve new problem instances. Specifically, we design a multichannel graph neural network to predict the threshold of the matched edges weights, by which the search region could be significantly reduced. We further propose a parallel heuristic search algorithm to iteratively improve the solution quality until convergence. Experiments on both open and industrial datasets demonstrate that \texttt{NeuSearcher} can speed up 2 to 3 times while achieving exactly the same matching solution compared with the state-of-the-art approximation approaches.


title: A Social Search Model for Large Scale Social Networks

abstract: With the rise of social networks, information on the internet is no longer solely organized by web pages. Rather, content is generated and shared among users and organized around their social relations on social networks. This presents new challenges to information retrieval systems. On a social network search system, the generation of result sets not only needs to consider keyword matches, like a traditional web search engine does, but it also needs to take into account the searcher's social connections and the content's visibility settings. Besides, search ranking should be able to handle both textual relevance and the rich social interaction signals from the social network. In this paper, we present our solution to these two challenges by first introducing a social retrieval mechanism, and then investigate novel deep neural networks for the ranking problem. The retrieval system treats social connections as indexing terms, and generates meaningful results sets by biasing towards close social connections in a constrained optimization fashion. The result set is then ranked by a deep neural network that handles textual and social relevance in a two-tower approach, in which personalization and textual relevance are addressed jointly. The retrieval mechanism is deployed on Facebook and is helping billions of users finding postings from their connections efficiently. Based on the postings being retrieved, we evaluate our two-tower neutral network, and examine the importance of personalization and textual signals in the ranking problem.


title: Timescales of quantum equilibration, dissipation and fluctuation in nuclear collisions

abstract: Understanding the dynamics of equilibration processes in quantum systems as well as their interplay with dissipation and fluctuation is a major challenge in quantum many-body theory. The timescales of such processes are investigated in collisions of atomic nuclei using fully microscopic approaches. Results from time-dependent Hartree-Fock (TDHF) and time-dependent random-phase approximation (TDRPA) calculations are compared for 13 systems over a broad range of energies. The timescale for full mass equilibration ($\sim2\times10^{-20}$s) is found to be much larger than timescales for neutron-to-proton equilibration, kinetic energy and angular momentum dissipations which are on the order of $10^{-21}$s. Fluctuations of mass numbers in the fragments and correlations between their neutron and proton numbers build up within only a few $10^{-21}$s. This indicates that dissipation is basically not impacted by mass equilibration, but is mostly driven by the exchange of nucleons between the fragments.


title: Low-Latency and Fresh Content Provision in Information-Centric Vehicular Networks

abstract: In this paper, the content service provision of information-centric vehicular networks (ICVNs) is investigated from the aspect of mobile edge caching, considering the dynamic driving-related context information. To provide up-to-date information with low latency, two schemes are designed for cache update and content delivery at the roadside units (RSUs). The roadside unit centric (RSUC) scheme decouples cache update and content delivery through bandwidth splitting, where the cached content items are updated regularly in a round-robin manner. The request adaptive (ReA) scheme updates the cached content items upon user requests with certain probabilities. The performance of both proposed schemes are analyzed, whereby the average age of information (AoI) and service latency are derived in closed forms. Surprisingly, the AoI-latency trade-off does not always exist, and frequent cache update can degrade both performances. Thus, the RSUC and ReA schemes are further optimized to balance the AoI and latency. Extensive simulations are conducted on SUMO and OMNeT++ simulators, and the results show that the proposed schemes can reduce service latency by up to 80\% while guaranteeing content freshness in heavily loaded ICVNs.


title: Epitaxial Growth and Band Structure of Antiferromagnetic Mott Insulator CeOI

abstract: The van der Waals material CeOI is predicted to be a layered antiferromagnetic Mott insulator by DFT+U calculation. We successfully grow the CeOI films down to monolayer on graphene/6H-SiC(0001) substrate by using molecular beam epitaxy. Films are studied by {\it in-situ} scanning tunneling microscopy and spectroscopy, which shows a band gap of 4.4 eV. A metallic phase with composition unidentified also exists. This rare earth oxyhalide adds a new member to the two-dimensional magnetic materials.


title: Novel Family of Topological Semimetals with Butterfly-like Nodal Lines

abstract: In recent years, the exotic properties of topological semimetals (TSMs) have attracted great attention and significant efforts have been made in seeking for new topological phases and material realization. In this work, we propose a new family of TSMs which harbors an unprecedented nodal line (NL) landscape consisting of a pair of concentric intersecting coplanar ellipses (CICE) at half-filling. Meanwhile, the CICE at half-filling guarantees the presence of a second pair of CICE beyond half-filling. Both CICEs are linked at four-fold degenerate points (FDPs) at zone boundaries. In addition, we identify the generic criteria for the existence of the CICE in a time reversal invariant {\it spinless} fermion system or a spinfull system with negligible spin-orbital coupling (SOC). Consequently, 9 out of 230 space groups (SGs) are feasible for hosting CICE whose location centers in the first Brillouin zone (BZ) are identified. We provide a simplest model with SG $Pbam$ (No. 55) which exhibits CICE, and the exotic intertwined drumhead surface states, induced by double-band-inversions. Finally, we propose a series of material candidates that host butterfly-like CICE NLs, such as, ZrX$_2$ (X=P,As), GeTe$_5$Tl$_2$, CYB$_2$ and Al$_2$Y$_3$.


title: SocialTrans: A Deep Sequential Model with Social Information for Web-Scale Recommendation Systems

abstract: On social network platforms, a user's behavior is based on his/her personal interests, or influenced by his/her friends. In the literature, it is common to model either users' personal preference or their socially influenced preference. In this paper, we present a novel deep learning model SocialTrans for social recommendations to integrate these two types of preferences. SocialTrans is composed of three modules. The first module is based on a multi-layer Transformer to model users' personal preference. The second module is a multi-layer graph attention neural network (GAT), which is used to model the social influence strengths between friends in social networks. The last module merges users' personal preference and socially influenced preference to produce recommendations. Our model can efficiently fit large-scale data and we deployed SocialTrans to a major article recommendation system in China. Experiments on three data sets verify the effectiveness of our model and show that it outperforms state-of-the-art social recommendation methods.


title: Semiparametric Inference of the Youden Index and the Optimal Cutoff Point under Density Ratio Models

abstract: The Youden index is a popular summary statistic for receiver operating characteristic curve. It gives the optimal cutoff point of a biomarker to distinguish the diseased and healthy individuals. In this paper, we propose to model the distributions of a biomarker for individuals in the healthy and diseased groups via a semiparametric density ratio model. Based on this model, we use the maximum empirical likelihood method to estimate the Youden index and the optimal cutoff point. We further establish the asymptotic normality of the proposed estimators and construct valid confidence intervals for the Youden index and the corresponding optimal cutoff point. The proposed method automatically covers both cases when there is no lower limit of detection (LLOD) and when there is a fixed and finite LLOD for the biomarker. Extensive simulation studies and a real data example are used to illustrate the effectiveness of the proposed method and its advantages over the existing methods.


title: Remarks on a Tropical Key Exchange System

abstract: We consider a key-exchange protocol based on matrices over a tropical semiring which was recently proposed in \cite{grig19}. We show that a particular private parameter of that protocol can be recovered with a simple binary search, rendering it insecure.


title: It's Morphin' Time! Combating Linguistic Discrimination with Inflectional Perturbations

abstract: Training on only perfect Standard English corpora predisposes pre-trained neural networks to discriminate against minorities from non-standard linguistic backgrounds (e.g., African American Vernacular English, Colloquial Singapore English, etc.). We perturb the inflectional morphology of words to craft plausible and semantically similar adversarial examples that expose these biases in popular NLP models, e.g., BERT and Transformer, and show that adversarially fine-tuning them for a single epoch significantly improves robustness without sacrificing performance on clean data.


title: Bayesian dynamical estimation of the parameters of an SE(A)IR COVID-19 spread model

abstract: In this article, we consider a dynamic epidemiology model for the spread of the COVID-19 infection. Starting from the classical SEIR model, the model is modified so as to better describe characteristic features of the underlying pathogen and its infectious modes. In line with the large number of secondary infections not related to contact with documented infectious individuals, the model includes a cohort of asymptomatic or oligosymptomatic infectious individuals, not accounted for in the data of new daily counts of infections. A Bayesian particle filtering algorithm is used to update dynamically the relevant cohort and simultaneously estimate the transmission rate as the new data on the number of new infections and disease related death become available. The underlying assumption of the model is that the infectivity rate is dynamically changing during the epidemics, either because of a mutation of the pathogen or in response to mitigation and containment measures. The sequential Bayesian framework naturally provides a quantification of the uncertainty in the estimate of the model parameters, including the reproduction number, and of the size of the different cohorts. Moreover, we introduce a dimensionless quantity, which is the equilibrium ratio between asymptomatic and symptomatic cohort sizes, and propose a simple formula to estimate the quantity. This ratio leads naturally to another dimensionless quantity that plays the role of the basic reproduction number $R_0$ of the model. When we apply the model and particle filter algorithm to COVID-19 infection data from several counties in Northeastern Ohio and Southeastern Michigan we found the proposed reproduction number $R_0$ to have a consistent dynamic behavior within both states, thus proving to be a reliable summary of the success of the mitigation measures.


title: Compressing Recurrent Neural Networks Using Hierarchical Tucker Tensor Decomposition

abstract: Recurrent Neural Networks (RNNs) have been widely used in sequence analysis and modeling. However, when processing high-dimensional data, RNNs typically require very large model sizes, thereby bringing a series of deployment challenges. Although the state-of-the-art tensor decomposition approaches can provide good model compression performance, these existing methods are still suffering some inherent limitations, such as restricted representation capability and insufficient model complexity reduction. To overcome these limitations, in this paper we propose to develop compact RNN models using Hierarchical Tucker (HT) decomposition. HT decomposition brings strong hierarchical structure to the decomposed RNN models, which is very useful and important for enhancing the representation capability. Meanwhile, HT decomposition provides higher storage and computational cost reduction than the existing tensor decomposition approaches for RNN compression. Our experimental results show that, compared with the state-of-the-art compressed RNN models, such as TT-LSTM, TR-LSTM and BT-LSTM, our proposed HT-based LSTM (HT-LSTM), consistently achieves simultaneous and significant increases in both compression ratio and test accuracy on different datasets.


title: Building and Maintaining a Third-Party Library Supply Chain for Productive and Secure SGX Enclave Development

abstract: The big data industry is facing new challenges as concerns about privacy leakage soar. One of the remedies to privacy breach incidents is to encapsulate computations over sensitive data within hardware-assisted Trusted Execution Environments (TEE). Such TEE-powered software is called secure enclaves. Secure enclaves hold various advantages against competing for privacy-preserving computation solutions. However, enclaves are much more challenging to build compared with ordinary software. The reason is that the development of TEE software must follow a restrictive programming model to make effective use of strong memory encryption and segregation enforced by hardware. These constraints transitively apply to all third-party dependencies of the software. If these dependencies do not officially support TEE hardware, TEE developers have to spend additional engineering effort in porting them. High development and maintenance cost is one of the major obstacles against adopting TEE-based privacy protection solutions in production. In this paper, we present our experience and achievements with regard to constructing and continuously maintaining a third-party library supply chain for TEE developers. In particular, we port a large collection of Rust third-party libraries into Intel SGX, one of the most mature trusted computing platforms. Our supply chain accepts upstream patches in a timely manner with SGX-specific security auditing. We have been able to maintain the SGX ports of 159 open-source Rust libraries with reasonable operational costs. Our work can effectively reduce the engineering cost of developing SGX enclaves for privacy-preserving data processing and exchange.


title: HACK3D: Crowdsourcing the Assessment of Cybersecurity in Digital Manufacturing

abstract: Digital manufacturing (DM) cyber-physical system is vulnerable to both cyber and physical attacks. HACK3D is a series of crowdsourcing red-team-blue-team events hosted by the NYU Center for Cybersecurity to assess the strength of the security methods embedded in designs using DM. This study summarizes the lessons learned from the past three offerings of HACK3D, including ingenious ways in which skilled engineers can launch surprising attacks on DM designs not anticipated before. A key outcome is a taxonomy-guided creation of DM security benchmarks for use by the DM community.


title: Utility-aware Privacy-preserving Data Releasing

abstract: In the big data era, more and more cloud-based data-driven applications are developed that leverage individual data to provide certain valuable services (the utilities). On the other hand, since the same set of individual data could be utilized to infer the individual's certain sensitive information, it creates new channels to snoop the individual's privacy. Hence it is of great importance to develop techniques that enable the data owners to release privatized data, that can still be utilized for certain premised intended purpose. Existing data releasing approaches, however, are either privacy-emphasized (no consideration on utility) or utility-driven (no guarantees on privacy). In this work, we propose a two-step perturbation-based utility-aware privacy-preserving data releasing framework. First, certain predefined privacy and utility problems are learned from the public domain data (background knowledge). Later, our approach leverages the learned knowledge to precisely perturb the data owners' data into privatized data that can be successfully utilized for certain intended purpose (learning to succeed), without jeopardizing certain predefined privacy (training to fail). Extensive experiments have been conducted on Human Activity Recognition, Census Income and Bank Marketing datasets to demonstrate the effectiveness and practicality of our framework.


title: ICE-GAN: Identity-aware and Capsule-Enhanced GAN with Graph-based Reasoning for Micro-Expression Recognition and Synthesis

abstract: Micro-expressions are reflections of people's true feelings and motives, which attract an increasing number of researchers into the study of automatic facial micro-expression recognition. The short detection window, the subtle facial muscle movements, and the limited training samples make micro-expression recognition challenging. To this end, we propose a novel Identity-aware and Capsule-Enhanced Generative Adversarial Network with graph-based reasoning (ICE-GAN), introducing micro-expression synthesis as an auxiliary task to assist recognition. The generator produces synthetic faces with controllable micro-expressions and identity-aware features, whose long-ranged dependencies are captured through the graph reasoning module (GRM), and the discriminator detects the image authenticity and expression classes. Our ICE-GAN was evaluated on Micro-Expression Grand Challenge 2019 (MEGC2019) with a significant improvement (12.9%) over the winner and surpassed other state-of-the-art methods.


title: Diophantine approximation by negative continued fraction

abstract: We show that the growth rate of denominator $Q_n$ of the $n$-th convergent of negative expansion of $x$ and the rate of approximation: $$ \frac{\log{n}}{n}\log{\left|x-\frac{P_n}{Q_n}\right|}\rightarrow -\frac{\pi^2}{3} \quad \text{in measure.} $$ for a.e. $x$. In the course of the proof, we reprove known inspiring results that arithmetic mean of digits of negative continued fraction converges to 3 in measure, although the limit inferior is 2, and the limit superior is infinite almost everywhere.


title: Information-Theoretic Generalization Bounds for Meta-Learning and Applications

abstract: Meta-learning, or "learning to learn", refers to techniques that infer an inductive bias from data corresponding to multiple related tasks with the goal of improving the sample efficiency for new, previously unobserved, tasks. A key performance measure for meta-learning is the meta-generalization gap, that is, the difference between the average loss measured on the meta-training data and on a new, randomly selected task. This paper presents novel information-theoretic upper bounds on the meta-generalization gap. Two broad classes of meta-learning algorithms are considered that uses either separate within-task training and test sets, like MAML, or joint within-task training and test sets, like Reptile. Extending the existing work for conventional learning, an upper bound on the meta-generalization gap is derived for the former class that depends on the mutual information (MI) between the output of the meta-learning algorithm and its input meta-training data. For the latter, the derived bound includes an additional MI between the output of the per-task learning procedure and corresponding data set to capture within-task uncertainty. Tighter bounds are then developed, under given technical conditions, for the two classes via novel Individual Task MI (ITMI) bounds. Applications of the derived bounds are finally discussed, including a broad class of noisy iterative algorithms for meta-learning.


title: AutoCLINT: The Winning Method in AutoCV Challenge 2019

abstract: NeurIPS 2019 AutoDL challenge is a series of six automated machine learning competitions. Particularly, AutoCV challenges mainly focused on classification tasks on visual domain. In this paper, we introduce the winning method in the competition, AutoCLINT. The proposed method implements an autonomous training strategy, including efficient code optimization, and applies an automated data augmentation to achieve the fast adaptation of pretrained networks. We implement a light version of Fast AutoAugment to search for data augmentation policies efficiently for the arbitrarily given image domains. We also empirically analyze the components of the proposed method and provide ablation studies focusing on AutoCV datasets.


title: Chance-Constrained Trajectory Optimization for Safe Exploration and Learning of Nonlinear Systems

abstract: Learning-based control algorithms require data collection with abundant supervision for training. Safe exploration algorithms ensure the safety of this data collection process even when only partial knowledge is available. We present a new approach for optimal motion planning with safe exploration that integrates chance-constrained stochastic optimal control with dynamics learning and feedback control. We derive an iterative convex optimization algorithm that solves an \underline{Info}rmation-cost \underline{S}tochastic \underline{N}onlinear \underline{O}ptimal \underline{C}ontrol problem (Info-SNOC). The optimization objective encodes control cost for performance and exploration cost for learning, and the safety is incorporated as distributionally robust chance constraints. The dynamics are predicted from a robust regression model that is learned from data. The Info-SNOC algorithm is used to compute a sub-optimal pool of safe motion plans that aid in exploration for learning unknown residual dynamics under safety constraints. A stable feedback controller is used to execute the motion plan and collect data for model learning. We prove the safety of rollout from our exploration method and reduction in uncertainty over epochs, thereby guaranteeing the consistency of our learning method. We validate the effectiveness of Info-SNOC by designing and implementing a pool of safe trajectories for a planar robot. We demonstrate that our approach has higher success rate in ensuring safety when compared to a deterministic trajectory optimization approach.


title: Elinvar effect in $\beta-$Ti simulated by on-the-fly trained moment tensor potential

abstract: A combination of quantum mechanics calculations with machine learning (ML) techniques can lead to a paradigm shift in our ability to predict materials properties from first principles. Here we show that on-the-fly training of an interatomic potential described through moment tensors provides the same accuracy as state-of-the-art {\it ab inito} molecular dynamics in predicting high-temperature elastic properties of materials with two orders of magnitude less computational effort. Using the technique, we investigate high-temperature bcc phase of titanium and predict very weak, Elinvar, temperature dependence of its elastic moduli, similar to the behavior of the so-called GUM Ti-based alloys [T. Sato {\ it et al.}, Science {\bf 300}, 464 (2003)]. Given the fact that GUM alloys have complex chemical compositions and operate at room temperature, Elinvar properties of elemental bcc-Ti observed in the wide temperature interval 1100--1700 K is unique.


title: U-net Based Direct-path Dominance Test for Robust Direction-of-arrival Estimation

abstract: It has been noted that the identification of the time-frequency bins dominated by the contribution from the direct propagation of the target speaker can significantly improve the robustness of the direction-of-arrival estimation. However, the correct extraction of the direct-path sound is challenging especially in adverse environments. In this paper, a U-net based direct-path dominance test method is proposed. Exploiting the efficient segmentation capability of the U-net architecture, the direct-path information can be effectively retrieved from a dedicated multi-task neural network. Moreover, the training and inference of the neural network only need the input of a single microphone, circumventing the problem of array-structure dependence faced by common end-to-end deep learning based methods. Simulations demonstrate that significantly higher estimation accuracy can be achieved in high reverberant and low signal-to-noise ratio environments.


title: A First Look into DeFi Oracles

abstract: Recently emerging Decentralized Finance (DeFi) takes the promise of cryptocurrencies a step further, leveraging their decentralized networks to transform traditional financial products into trustless and transparent protocols that run without intermediaries. However, these protocols often require critical external information, like currency or commodity exchange rates, and in this respect they rely on special oracle nodes. In this paper, we present the first study of DeFi oracles deployed in practice. First, we investigate designs of mainstream DeFi platforms that rely on data from oracles. We find that these designs, surprisingly, position oracles as trusted parties with no or low accountability. Then, we present results of large-scale measurements of deployed oracles. We find and report that prices reported by oracles regularly deviate from current exchange rates, oracles are not free from operational issues, and their reports include anomalies. Finally, we compare the oracle designs and propose potential improvements.


title: Enumerative geometry via the moduli space of super Riemann surfaces

abstract: In this paper we relate volumes of moduli spaces of super Riemann surfaces to integrals over the moduli space of stable Riemann surfaces $\overline{\cal M}_{g,n}$. This allows us to prove via algebraic geometry a recursion between the volumes of moduli spaces of super hyperbolic surfaces previously proven via super geometry techniques by Stanford and Witten. The recursion between the volumes of moduli spaces of super hyperbolic surfaces is proven to be equivalent to the fact that a generating function for the intersection numbers of a natural collection of cohomology classes $\Theta_{g,n}$ with tautological classes on $\overline{\cal M}_{g,n}$ is a KdV tau function. This is analogous to Mirzakhani's proof of the Kontsevich-Witten theorem regarding a generating function for the intersection numbers of tautological classes on $\overline{\cal M}_{g,n}$ using volumes of moduli spaces of hyperbolic surfaces.


title: Semi-Supervised Dialogue Policy Learning via Stochastic Reward Estimation

abstract: Dialogue policy optimization often obtains feedback until task completion in task-oriented dialogue systems. This is insufficient for training intermediate dialogue turns since supervision signals (or rewards) are only provided at the end of dialogues. To address this issue, reward learning has been introduced to learn from state-action pairs of an optimal policy to provide turn-by-turn rewards. This approach requires complete state-action annotations of human-to-human dialogues (i.e., expert demonstrations), which is labor intensive. To overcome this limitation, we propose a novel reward learning approach for semi-supervised policy learning. The proposed approach learns a dynamics model as the reward function which models dialogue progress (i.e., state-action sequences) based on expert demonstrations, either with or without annotations. The dynamics model computes rewards by predicting whether the dialogue progress is consistent with expert demonstrations. We further propose to learn action embeddings for a better generalization of the reward function. The proposed approach outperforms competitive policy learning baselines on MultiWOZ, a benchmark multi-domain dataset.


title: Piecewise smooth stationary Euler flows with compact support via overdetermined boundary problems

abstract: We construct new stationary weak solutions of the 3D Euler equation with compact support. The solutions, which are piecewise smooth and discontinuous across a surface, are axisymmetric with swirl. The range of solutions we find is different from, and larger than, the family of smooth stationary solutions recently obtained by Gavrilov and Constantin-La-Vicol; in particular, these solutions are not localizable. A key step in the proof is the construction of solutions to an overdetermined elliptic boundary value problem where one prescribes both Dirichlet and (nonconstant) Neumann data.


title: A new formulation of Economic Model Predictive Control without terminal constraint

abstract: In this paper, it is shown that a simple formulation of Economic Model Predictive Control can be used which possesses two features that are generally viewed as mutually exclusive, namely, a rather short prediction horizon (reachability-compatible) on one side, and the absence of final constraint on the other side. The result holds for discrete-time models that are originated from continuous-time models by means of discretization. Practical stability at a small neighborhood of the optimal unknown steady-state pair is shown when some parameters increase and sampling time decreases. A commonly used example is given to illustrate the result.


title: Active- and transfer-learning applied to microscale-macroscale coupling to simulate viscoelastic flows

abstract: Active- and transfer-learning are applied to polymer flows for the multiscale discovery of effective constitutive approximations required in viscoelastic flow simulation. The result is macroscopic rheology directly connected to a microstructural model. Micro and macroscale simulations are adaptively coupled by means of Gaussian process regression to run the expensive microscale computations only as necessary. This active-learning guided multiscale method can automatically detect the inaccuracy of the learned constitutive closure and initiate simulations at new sampling points informed by proper acquisition functions, leading to an autonomic microscale-macroscale coupled system. Also, we develop a new dissipative particle dynamics model with the range of interaction cutoff between particles allowed to vary with the local strain-rate invariant, which is able to capture both the shear-thinning viscosity and the normal stress difference functions consistent with rheological experiments for aqueous polyacrylamide solutions. Our numerical experiments demonstrate the effectiveness of using active- and transfer-learning schemes to on-the-fly couple a spectral element solver and a mesoscopic particle-based simulator, and verify that the microscale-macroscale coupled model with effective constitutive closure learned from microscopic dynamics can outperform empirical constitutive models compared to experimental observations. The effective closure learned in a channel simulation is then transferred directly to the flow past a circular cylinder, where the results show that only two additional microscopic simulations are required to achieve a satisfactory constitutive model to once again close the continuum equations. This new paradigm of active- and transfer-learning for multiscale modeling is readily applicable to other microscale-macroscale coupled simulations of complex fluids and other materials.


title: A Compressive Classification Framework for High-Dimensional Data

abstract: We propose a compressive classification framework for settings where the data dimensionality is significantly higher than the sample size. The proposed method, referred to as compressive regularized discriminant analysis (CRDA) is based on linear discriminant analysis and has the ability to select significant features by using joint-sparsity promoting hard thresholding in the discriminant rule. Since the number of features is larger than the sample size, the method also uses state-of-the-art regularized sample covariance matrix estimators. Several analysis examples on real data sets, including image, speech signal and gene expression data illustrate the promising improvements offered by the proposed CRDA classifier in practise. Overall, the proposed method gives fewer misclassification errors than its competitors, while at the same time achieving accurate feature selection results. The open-source R package and MATLAB toolbox of the proposed method (named compressiveRDA) is freely available.


title: Inverse Modeling of Viscoelasticity Materials using Physics Constrained Learning

abstract: We propose a novel approach to model viscoelasticity materials using neural networks, which capture rate-dependent and nonlinear constitutive relations. However, inputs and outputs of the neural networks are not directly observable, and therefore common training techniques with input-output pairs for the neural networks are inapplicable. To that end, we develop a novel computational approach to both calibrate parametric and learn neural-network-based constitutive relations of viscoelasticity materials from indirect displacement data in the context of multi-physics interactions. We show that limited displacement data hold sufficient information to quantify the viscoelasticity behavior. We formulate the inverse computation---modeling viscoelasticity properties from observed displacement data---as a PDE-constrained optimization problem and minimize the error functional using a gradient-based optimization method. The gradients are computed by a combination of automatic differentiation and physics constrained learning. The effectiveness of our method is demonstrated through numerous benchmark problems in geomechanics and porous media transport.


title: Unified benchmarking and characterization protocol for nanomaterial-based heterogeneous photodetector technologies

abstract: Over the last few years, there has been a rapid growth towards demonstrating highly sensitive, fast photodetectors using photoactive nano-materials. As with any other developing and highly inter-disciplinary field, the existing reports exhibit a large spread in the data due to less optimized materials and non-standardized characterization protocols. This calls for a streamlined performance benchmarking requirement to accelerate technological adoption of the promising candidates. The goal of this paper is four-fold: (i) to address the key challenges to perform such benchmarking exercise; (ii) to elucidate the right figures of merit to look for, and in particular, to demonstrate that noise-equivalent-power ($N\!E\!P$) is a more reliable sensitivity metric than other commonly used ones, such as responsivity ($R$) and specific detectivity ($D^*$); (iii) to propose $N\!E\!P$ versus frequency of operation ($f$) as a single, unified benchmarking chart that could be used for apple-to-apple comparison among heterogeneous detector technologies; and (iv) to propose a simple, yet streamlined characterization protocol that can be followed while reporting photodetector performance.


title: High order mixed finite elements with mass lumping for elasticity on triangular grids

abstract: A family of conforming mixed finite elements with mass lumping on triangular grids are presented for linear elasticity. The stress field is approximated by symmetric $H({\rm div})-P_k (k\geq 3)$ polynomial tensors enriched with higher order bubbles so as to allow mass lumping, which can be viewed as the Hu-Zhang elements enriched with higher order interior bubble functions. The displacement field is approximated by $C^{-1}-P_{k-1}$ polynomial vectors enriched with higher order terms to ensure the stability condition. For both the proposed mixed elements and their mass lumping schemes, optimal error estimates are derived for the stress with $H(\rm div)$ norm and the displacement with $L^2$ norm. Numerical results confirm the theoretical analysis.


title: Eddy Current Testing of Metal Cracks Using Spin Hall Magnetoresistance Sensor and Machine Learning

abstract: Recently we have developed a spin Hall magnetoresistance (SMR) sensor which operates under AC bias and sense currents. Here we demonstrate both theoretically and experimentally that the SMR sensor is uniquely suited for eddy current testing applications because both the coil and sensor utilize AC current as the excitation source. The use of SMR sensor effectively eliminates the necessity of any demodulation or lock-in technique for detecting the eddy current, which greatly simplifies the detection system. Furthermore, we show that the combination of principal component analysis and decision tree model is effective in classifying the metal cracks. The relatively clean signals obtained by the SMR sensor greatly facilitates the subsequent signal analysis and ensures high accuracy in the classification of different types of crack features.


title: Basic Topological Concepts and a Construction of Real Numbers in Alternative Set Theory

abstract: Alternative set theory (AST) may be suitable for the ones who try to capture objects or phenomenons with some kind of indefiniteness of a border. While AST provides various notions for advanced mathematical studies, correspondence of them to that of conventional ones are not fully developed. This paper presents basic topological concepts in AST, and shows their correspondence with those of conventional ones, and isomorphicity of a system of real numbers in AST to that of conventional ones.


title: Phase Mixing of Kink MHD Waves in the Solar Corona: Viscous Dissipation and Heating

abstract: Magnetohydrodynamic (MHD) kink waves have been observed frequently in solar coronal flux tubes, which makes them a great tool for seismology of the solar corona. Here, the effect of viscosity is studied on the evolution of kink waves. To this aim, we solve the initial value problem for the incompressible linearized viscous MHD equations in a radially inhomogeneous flux tube in the limit of long wavelengths. Using a modal expansion technique the spatio-temporal behavior of the perturbations is obtained. We confirm that for large Reynolds numbers representative of the coronal plasma the decrement in the amplitude of the kink oscillations is due to the resonant absorption mechanism that converts the global transverse oscillation to rotational motions in the inhomogeneous layer of the flux tube. We show that viscosity suppresses the rate of phase mixing of the perturbations in the inhomogeneous region of the flux tube and prevents the continuous building up of small scales in the system once a sufficiently small scale is reached. The viscous dissipation function is calculated to investigate plasma heating by viscosity in the inhomogeneous layer of the flux tube. For Reynolds numbers of the order of 10^6-10^8, the energy of the kink wave is transformed into heat in two to eight periods of the kink oscillation. For larger and more realistic Reynolds numbers, heating happens, predominantly, after the global kink oscillation is damped, and no significant heating occurs during the observable transverse motion of the flux tube.


title: Stretching DNA in hard-wall potential channels

abstract: A three dimensional mesoscopic model is applied to study the properties of short DNA chains in a confining environment. The cylindrical channel is represented by a hard-wall repulsive potential incorporated in the system Hamiltonian. The macroscopic helical parameters are computed performing statistical averages over the ensemble of microscopic base pair fluctuations. The average molecule elongation, measured by the end-to-end distance, is derived as a function of the channel potential parameters both for a homogeneous and a heterogeneous chain. The overall results suggest that the mesoscopic model, with the channel potential term, yields consistent quantitative estimates for the stretching and twisting of short chains.


title: Three-dimensional self-assembly using dipolar interaction

abstract: Interaction between dipolar forces, such as permanent magnets, generally leads to the formation of one-dimensional chains and rings. We investigated whether it was possible to let dipoles self-assemble into three-dimensional structures by encapsulating them in a shell with a specific shape. We found that the condition for self-assembly of a three-dimensional crystal is satisfied when the energies of dipoles in the parallel and antiparallel states are equal. Our experiments show that the most regular structures are formed using cylinders and cuboids and not by spheroids. This simple design rule will help the self-assembly community to realize three-dimensional crystals from objects in the micrometer range, which opens up the way toward previously unknown metamaterials.


title: Diagnostics and characterization of photonic circuits by wide-field spatio-temporal imaging

abstract: The growing diffusion of integrated photonic technologies requires fast and non-invasive quality control techniques for mass-production. We present a general diagnostic technique for sub-ps imaging of photonic circuits combining wide-field optical microscopy and optical gating. The simultaneous access to multiple parameters of a photonic structure enables an unprecedented characterization of its functional design as opposed to typical single-domain techniques such as frequency or time domain reflectometry and near-field microscopy. The non-contact and non-perturbative nature of the technique makes it relevant for both planar and three-dimensional circuits, as well as for silicon, polymeric or hybrid platforms. We apply our technique to different photonic chip components fabricated by Direct Laser Writing, revealing the spatial and temporal hallmarks of fabrication imperfections causing losses or deviations from the intended device behavior. At the same time, the technique allows in situ probing of key properties of photonic devices as the local propagation constants of guided modes or the quality factor of resonant elements. Our method is relevant for both the scientific and the industrial communities as it lends itself to be scaled up to in-line quality control thanks to its non-scanning nature.


title: Combinatorics for calculating expectation values of functions in systems with evolution governed by stochastic differential equations

abstract: Stochastic differential equations are widely used in various fields; in particular, the usefulness of duality relations has been demonstrated in some models such as population models and Brownian momentum processes. In this study, a discussion based on combinatorics is made and applied to calculate the expectation values of functions in systems in which evolution is governed by stochastic differential equations. Starting with the duality theory of stochastic processes, some modifications to the interpretation and usage of time-ordering operators naturally lead to discussions on combinatorics. For demonstration, the first and second moments of the Ornstein-Uhlenbeck process are re-derived from the discussion on combinatorics. Furthermore, two numerical methods for practical applications are proposed. One method is based on a conventional exponential expansion and the Pade approximation. The other uses a resolvent of a time-evolution operator, along with the application of the Aitken series acceleration method. Both methods yield reasonable approximations. Particularly, the resolvent and Aitken acceleration show satisfactory results. These findings will provide a new way of calculating expectations numerically and directly without using time-discretization.


title: Threshold-Based Fast Successive-Cancellation Decoding of Polar Codes

abstract: Fast SC decoding overcomes the latency caused by the serial nature of the SC decoding by identifying new nodes in the upper levels of the SC decoding tree and implementing their fast parallel decoders. In this work, we first present a novel sequence repetition node corresponding to a particular class of bit sequences. Most existing special node types are special cases of the proposed sequence repetition node. Then, a fast parallel decoder is proposed for this class of node. To further speed up the decoding process of general nodes outside this class, a threshold-based hard-decision-aided scheme is introduced. The threshold value that guarantees a given error-correction performance in the proposed scheme is derived theoretically. Analysis and hardware implementation results on a polar code of length $1024$ with code rates $1/4$, $1/2$, and $3/4$ show that our proposed algorithm reduces the required clock cycles by up to $8\%$, and leads to a $10\%$ improvement in the maximum operating frequency compared to state-of-the-art decoders without tangibly altering the error-correction performance. In addition, using the proposed threshold-based hard-decision-aided scheme, the decoding latency can be further reduced by $57\%$ at $\mathrm{E_b}/\mathrm{N_0} = 5.0$~dB.


title: Properties of bounded representations for $G$-frames

abstract: Due to the importance of frame representation by a bounded operator in dynamical sampling, researchers studied the frames of the form $\{T^{i-1} f\}_{i\in \mathbb{N}}$, which $f$ belongs to separable Hilbert space $\mathcal{H}$ and $T\in B(\mathcal{H})$, and investigated the properties of $T$. Given that $g$-frames include the wide range of frames such as fusion frames, the main purpose of this paper is to study the characteristics of the operator $T$ for $g$-frames of the form $\{\Lambda T^{i-1} \in B(\mathcal{H},\mathcal{K}):i\in \mathbb{N}\}$.


title: Generating Pertinent and Diversified Comments with Topic-aware Pointer-Generator Networks

abstract: Comment generation, a new and challenging task in Natural Language Generation (NLG), attracts a lot of attention in recent years. However, comments generated by previous work tend to lack pertinence and diversity. In this paper, we propose a novel generation model based on Topic-aware Pointer-Generator Networks (TPGN), which can utilize the topic information hidden in the articles to guide the generation of pertinent and diversified comments. Firstly, we design a keyword-level and topic-level encoder attention mechanism to capture topic information in the articles. Next, we integrate the topic information into pointer-generator networks to guide comment generation. Experiments on a large scale of comment generation dataset show that our model produces the valuable comments and outperforms competitive baseline models significantly.


title: Enhancing LGMD's Looming Selectivity for UAV with Spatial-temporal Distributed Presynaptic Connections

abstract: Collision detection is one of the most challenging tasks for Unmanned Aerial Vehicles (UAVs). This is especially true for small or micro UAVs, due to their limited computational power. In nature, flying insects with compact and simple visual systems demonstrate their remarkable ability to navigate and avoid collision in complex environments. A good example of this is provided by locusts. They can avoid collisions in a dense swarm through the activity of a motion based visual neuron called the Lobula Giant Movement Detector (LGMD). The defining feature of the LGMD neuron is its preference for looming. As a flying insect's visual neuron, LGMD is considered to be an ideal basis for building UAV's collision detecting system. However, existing LGMD models cannot distinguish looming clearly from other visual cues such as complex background movements caused by UAV agile flights. To address this issue, we proposed a new model implementing distributed spatial-temporal synaptic interactions, which is inspired by recent findings in locusts' synaptic morphology. We first introduced the locally distributed excitation to enhance the excitation caused by visual motion with preferred velocities. Then radially extending temporal latency for inhibition is incorporated to compete with the distributed excitation and selectively suppress the non-preferred visual motions. Systematic experiments have been conducted to verify the performance of the proposed model for UAV agile flights. The results have demonstrated that this new model enhances the looming selectivity in complex flying scenes considerably, and has potential to be implemented on embedded collision detection systems for small or micro UAVs.


title: Day of the week submission effect for accepted papers in Physica A, PLOS ONE, Nature and Cell

abstract: The particular day of the week when an event occurs seems to have unexpected consequences. For example, the day of the week when a paper is submitted to a peer reviewed journal correlates with whether that paper is accepted. Using an econometric analysis (a mix of log-log and semi-log based on undated and panel structured data) we find that more papers are submitted to certain peer review journals on particular weekdays than others, with fewer papers being submitted on weekends. Seasonal effects, geographical information as well as potential changes over time are examined. This finding rests on a large (178 000) and reliable sample; the journals polled are broadly recognized (Nature, Cell, PLOS ONE and Physica A). Day of the week effect in the submission of accepted papers should be of interest to many researchers, editors and publishers, and perhaps also to managers and psychologists.


title: Estimating g-Leakage via Machine Learning

abstract: This paper considers the problem of estimating the information leakage of a system in the black-box scenario. It is assumed that the system's internals are unknown to the learner, or anyway too complicated to analyze, and the only available information are pairs of input-output data samples, possibly obtained by submitting queries to the system or provided by a third party. Previous research has mainly focused on counting the frequencies to estimate the input-output conditional probabilities (referred to as frequentist approach), however this method is not accurate when the domain of possible outputs is large. To overcome this difficulty, the estimation of the Bayes error of the ideal classifier was recently investigated using Machine Learning (ML) models and it has been shown to be more accurate thanks to the ability of those models to learn the input-output correspondence. However, the Bayes vulnerability is only suitable to describe one-try attacks. A more general and flexible measure of leakage is the g-vulnerability, which encompasses several different types of adversaries, with different goals and capabilities. In this paper, we propose a novel approach to perform black-box estimation of the g-vulnerability using ML. A feature of our approach is that it does not require to estimate the conditional probabilities, and that it is suitable for a large class of ML algorithms. First, we formally show the learnability for all data distributions. Then, we evaluate the performance via various experiments using k-Nearest Neighbors and Neural Networks. Our results outperform the frequentist approach when the observables domain is large.


title: Comment on "No-Reference Video Quality Assessment Based on the Temporal Pooling of Deep Features"

abstract: In Neural Processing Letters 50,3 (2019) a machine learning approach to blind video quality assessment was proposed. It is based on temporal pooling of features of video frames, taken from the last pooling layer of deep convolutional neural networks. The method was validated on two established benchmark datasets and gave results far better than the previous state-of-the-art. In this letter we report the results from our careful reimplementations. The performance results, claimed in the paper, cannot be reached, and are even below the state-of-the-art by a large margin. We show that the originally reported wrong performance results are a consequence of two cases of data leakage. Information from outside the training dataset was used in the fine-tuning stage and in the model evaluation.


title: A Weighted Difference of Anisotropic and Isotropic Total Variation for Relaxed Mumford-Shah Color and Multiphase Image Segmentation

abstract: In a class of piecewise-constant image segmentation models, we propose to incorporate a weighted difference of anisotropic and isotropic total variation (AITV) to regularize the partition boundaries in an image. In particular, we replace the total variation regularization in the Chan-Vese segmentation model and a fuzzy region competition model by the proposed AITV. To deal with the nonconvex nature of AITV, we apply the difference-of-convex algorithm (DCA), in which the subproblems can be minimized by the primal-dual hybrid gradient method with linesearch. The convergence of the DCA scheme is analyzed. In addition, a generalization to color image segmentation is discussed. In the numerical experiments, we compare the proposed models with the classic convex approaches and the two-stage segmentation methods (smoothing and then thresholding) on various images, showing that our models are effective in image segmentation and robust with respect to impulsive noises.


title: On the Grassmann Graph of Linear Codes

abstract: Let $\Gamma(n,k)$ be the Grassmann graph formed by the $k$-dimensional subspaces of a vector space of dimension $n$ over a field $\mathbb F$ and, for $t\in \mathbb{N}\setminus \{0\}$, let $\Delta_t(n,k)$ be the subgraph of $\Gamma(n,k)$ formed by the set of linear $[n,k]$-codes having minimum dual distance at least $t+1$. We show that if $|{\mathbb F}|\geq{n\choose t}$ then $\Delta_t(n,k)$ is connected and it is isometrically embedded in $\Gamma(n,k)$. This generalizes some results of [M. Kwiatkowski, M. Pankov, "On the distance between linear codes", Finite Fields Appl. 39 (2016), 251--263] and [M. Kwiatkowski, M. Pankov, A. Pasini, "The graphs of projective codes" Finite Fields Appl. 54 (2018), 15--29].


title: Synchronization of oscillators not sharing a common ground

abstract: Networks of coupled LC oscillators that do not share a common ground node are studied. Both resistive coupling and inductive coupling are considered. For networks under resistive coupling, it is shown that the oscillator-coupler interconnection has to be bilayer if the oscillator voltages are to asymptotically synchronize. Also, for bilayer architecture (when both resistive and inductive couplers are present) a method is proposed to compute a complex-valued effective Laplacian matrix that represents the overall coupling. It is proved that the oscillators display synchronous behavior if and only if the effective Laplacian has a single eigenvalue on the imaginary axis.


title: #lockdown: network-enhanced emotional profiling at the times of COVID-19

abstract: The COVID-19 pandemic forced countries all over the world to take unprecedented measures like nationwide lockdowns. To adequately understand the emotional and social repercussions, a large-scale reconstruction of how people perceived these unexpected events is necessary but currently missing. We address this gap through social media by introducing MERCURIAL (Multi-layer Co-occurrence Networks for Emotional Profiling), a framework which exploits linguistic networks of words and hashtags to reconstruct social discourse describing real-world events. We use MERCURIAL to analyse 101,767 tweets from Italy, the first country to react to the COVID-19 threat with a nationwide lockdown. The data were collected between 11th and 17th March, immediately after the announcement of the Italian lockdown and the WHO declaring COVID-19 a pandemic. Our analysis provides unique insights into the psychological burden of this crisis, focussing on: (i) the Italian official campaign for self-quarantine (#iorestoacasa}), (ii) national lockdown (#italylockdown), and (iii) social denounce (#sciacalli). Our exploration unveils evidence for the emergence of complex emotional profiles, where anger and fear (towards political debates and socio-economic repercussions) coexisted with trust, solidarity, and hope (related to the institutions and local communities). We discuss our findings in relation to mental well-being issues and coping mechanisms, like instigation to violence, grieving, and solidarity. We argue that our framework represents an innovative thermometer of emotional status, a powerful tool for policy makers to quickly gauge feelings in massive audiences and devise appropriate responses based on cognitive data.


title: On the Skewed Fractional Diffusion Advection Reaction Equation on the Interval

abstract: This article provides techniques of raising the regularity of fractional order equations and resolves fundamental questions on the one-dimensional homogeneous boundary-value problem of skewed (double-sided) fractional diffusion advection reaction equation (FDARE) with variable coefficients on the bounded interval. The existence of the true (classical) solution together with norm estimation is established and the precise regularity bound is found; also, the structure of the solution is unraveled, capturing the essence of regularity, singularity, and other features of the solution. The key analysis lies in exploring the properties of Gauss hypergeometric functions, solving coupled Abel integral equations and dominant singular integral equations, and connecting the functions from fractional Sobolev spaces to the ones from H$\ddot{\text{o}}$lderian spaces that admit integrable singularities at the endpoints.


title: Invariants of limit key polynomials

abstract: Let $\nu$ be a valuation of arbitrary rank on the polynomial ring $K[x]$ with coefficients in a field $K$. We prove comparison theorems between MacLane-Vaqui\'e key polynomials for valuations $\mu\le\nu$ and abstract key polynomials for $\nu$. Also, some results on invariants attached to limit key polynomials are obtained. In particular, if $\operatorname{char}(K)=0$ we show that all limit key polynomials of unbounded continuous MacLane chains have numerical character equal to one.


title: Critical temperature and low-energy excitations in gapped spin systems with defects

abstract: We discuss theoretically the magnetically ordered phase induced by magnetic and nonmagnetic impurities in three-dimensional and quasi-low-dimensional systems with singlet ground states separated by a gap from excited triplet states. Using ideas of the percolation theory, we estimate the transition temperature $T_N(n)$ to the N\'eel phase at a small concentration $n$ of defects, derive the density of states of low-energy elementary excitations, and examine the contribution of these excitations to the specific heat and magnetization. Our expressions for $T_N(n)$ and for the specific heat describe well available experimental findings obtained in various appropriate systems: spin-$\frac12$ dimer materials, spin-ladder compounds, spin-Peierls and Haldane chain materials. However, our expression for $T_N(n)$ differs considerably from many of those proposed before.


title: Photo style transfer with consistency losses

abstract: We address the problem of style transfer between two photos and propose a new way to preserve photorealism. Using the single pair of photos available as input, we train a pair of deep convolution networks (convnets), each of which transfers the style of one photo to the other. To enforce photorealism, we introduce a content preserving mechanism by combining a cycle-consistency loss with a self-consistency loss. Experimental results show that this method does not suffer from typical artifacts observed in methods working in the same settings. We then further analyze some properties of these trained convnets. First, we notice that they can be used to stylize other unseen images with same known style. Second, we show that retraining only a small subset of the network parameters can be sufficient to adapt these convnets to new styles.


title: Evolution of clustering structure through the momentum distributions in $^{8-10}$Be isotopes

abstract: We investigate the evolution of clustering structure through the momentum distributions in the $^{8-10}$Be isotopes. The nucleon dynamics within the inter-cluster antisymmetrization are discussed via the momentum distribution of a Brink type $\alpha$-$\alpha$ wave function. For the state with a small $\alpha$-$\alpha$ distance, we observe a significant depression with a dip structure at zero-momentum and an enhanced tail at relatively higher momentum region. In addition, we find the "cluster structure" in the intrinsic frame of momentum space, which is complementary to its significant $\alpha$-cluster dissolution in the coordinate space because of the strong antisymmetrization. For the physical $^{8-10}$Be isotopes, the Tohsaki-Horiuchi-Schuck-R{\"o}pke (THSR) wave functions are adopted. The evolution from the dilute clustering state to the compact one is demonstrated by a successive depression at the zero-momentum of nucleon distribution for the two $\alpha$-clusters within $^{8-10}$Be isotopes. For the compact $^{10}$Be nucleus, the momentum distribution of all nucleons shows significant depression at zero-momentum with a dip structure, which is found to be contributed by both the inter-cluster antisymmetrization and the $p$-orbit occupation of the valence neutrons. This study proposes a new window for the investigations of the $\alpha$-clustering effects via the low-momentum components of nuclei, which is expected to be extended to the heavier nuclear clustering states.


title: High Resolution Face Age Editing

abstract: Face age editing has become a crucial task in film post-production, and is also becoming popular for general purpose photography. Recently, adversarial training has produced some of the most visually impressive results for image manipulation, including the face aging/de-aging task. In spite of considerable progress, current methods often present visual artifacts and can only deal with low-resolution images. In order to achieve aging/de-aging with the high quality and robustness necessary for wider use, these problems need to be addressed. This is the goal of the present work. We present an encoder-decoder architecture for face age editing. The core idea of our network is to create both a latent space containing the face identity, and a feature modulation layer corresponding to the age of the individual. We then combine these two elements to produce an output image of the person with a desired target age. Our architecture is greatly simplified with respect to other approaches, and allows for continuous age editing on high resolution images in a single unified model.