title: Coexistence and interaction of spinons and magnons in an antiferromagnet with alternating antiferromagnetic and ferromagnetic quantum spin chains

abstract: In conventional quasi-one-dimensional antiferromagnets with quantum spins, magnetic excitations are carried by either magnons or spinons in different energy regimes: they do not coexist independently, nor could they interact with each other. In this Letter, by combining inelastic neutron scattering, quantum Monte Carlo simulations and Random Phase Approximation calculations, we report the discovery and discuss the physics of the coexistence of magnons and spinons and their interactions in Botallackite-Cu2(OH)3Br. This is a unique quantum antiferromagnet consisting of alternating ferromagnetic and antiferromagnetic Spin-1/2 chains with weak inter-chain couplings. Our study presents a new paradigm where one can study the interaction between two different types of magnetic quasiparticles, magnons and spinons.


title: Hyperparameter Analysis for Image Captioning

abstract: In this paper, we perform a thorough sensitivity analysis on state-of-the-art image captioning approaches using two different architectures: CNN+LSTM and CNN+Transformer. Experiments were carried out using the Flickr8k dataset. The biggest takeaway from the experiments is that fine-tuning the CNN encoder outperforms the baseline and all other experiments carried out for both architectures.


title: Neural Program Synthesis with a Differentiable Fixer

abstract: We present a new program synthesis approach that combines an encoder-decoder based synthesis architecture with a differentiable program fixer. Our approach is inspired from the fact that human developers seldom get their program correct on the first attempt, and perform iterative testing-based program fixing to get to the desired program functionality. Similarly, our approach first learns a distribution over programs conditioned on an encoding of a set of input-output examples, and then iteratively performs fix operations using the differentiable fixer. The fixer takes as input the original examples and the current program's outputs on example inputs, and generates a new distribution over the programs with the goal of reducing the discrepancies between the current program outputs and the desired example outputs. We train our architecture end-to-end on the RobustFill domain, and show that the addition of the fixer module leads to a significant improvement on synthesis accuracy compared to using beam search.


title: Gradient Descent in RKHS with Importance Labeling

abstract: Labeling cost is often expensive and is a fundamental limitation of supervised learning. In this paper, we study importance labeling problem, in which we are given many unlabeled data and select a limited number of data to be labeled from the unlabeled data, and then a learning algorithm is executed on the selected one. We propose a new importance labeling scheme that can effectively select an informative subset of unlabeled data in least squares regression in Reproducing Kernel Hilbert Spaces (RKHS). We analyze the generalization error of gradient descent combined with our labeling scheme and show that the proposed algorithm achieves the optimal rate of convergence in much wider settings and especially gives much better generalization ability in a small label noise setting than the usual uniform sampling scheme. Numerical experiments verify our theoretical findings.


title: Strong approximation of time-changed stochastic differential equations involving drifts with random and non-random integrators

abstract: The rates of strong convergence for various approximation schemes are investigated for a class of stochastic differential equations (SDEs) which involve a random time change given by an inverse subordinator. SDEs to be considered are unique in two different aspects: i) they contain two drift terms, one driven by the random time change and the other driven by a regular, non-random time variable; ii) the standard Lipschitz assumption is replaced by that with a time-varying Lipschitz bound. The difficulty imposed by the first aspect is overcome via an approach that is significantly different from a well-known method based on the so-called duality principle. On the other hand, the second aspect requires the establishment of a criterion for the existence of exponential moments of functions of the random time change.


title: Continuous-Variable Deep Quantum Neural Networks for Flexible Learning of Structured Classical Information

abstract: Quantum computation using optical modes has been well-established in its ability to construct deep neural networks. These networks have been shown to be flexible both architecturally as well as in terms of the type of data being processed. We leverage this property of the Continuous-Variable (CV) model to construct stacked single mode networks that are shown to learn structured classical information, while placing no restrictions on the size of the network, and at the same time maintaining it's complexity. The hallmark of the CV model is its ability to forge non-linear functions using a set of gates that allows it to remain completely unitary. The proposed model exemplifies that the appropriate photonic hardware can be integrated with present day optical communication systems to meet our information processing requirements. In this paper, using the Strawberry Fields software library on the MNIST dataset of hand-written digits, we demonstrate the adaptability of the network to learn classical information to fidelities of greater than 99.98%


title: New diversity form of ice polymorphism: Discovery of second hydrogen ordered phase of ice VI

abstract: More than 20 crystalline and amorphous phases have been reported for ice so far. This extraordinary polymorphism of ice arises from the geometric flexibility of hydrogen bonds and hydrogen ordering, and makes ice a unique presence with its universality in the wide fields of material and earth and planetary science. A prominent unsolved question concerning the diversity is whether a hydrogen-disordered phase of ice transforms into only one hydrogen-ordered phase, as inferred from the current phase diagram of ice, although its possible hydrogen configurations have close energies. Recent experiments on a high-pressure hydrogen-disordered phase, ice VI, revealed an unknown hydrogen-ordered form ($\beta$-XV) besides the known ordered phase, ice XV, which would be a counterexample of the question. However, due to lack of experimental evidence, it has not been clarified whether $\beta$-XV is a distinct crystalline phase. Herein we report a second hydrogen-ordered phase for ice VI, ice XIX, unambiguously demonstrated by neutron diffraction measurements. The phase boundary between ice VI and ice XIX shows that ice VI contracts upon the hydrogen ordering, which thermodynamically stabilizes ice XIX in higher-pressure region than ice XV because of its smaller volume than ice XV. The pressure-driven phase competition between hydrogen-ordered phases, also theoretically suggested in other ice polymorphs, can induce hydrogen ordering of ice in different manners. Thus, this study demonstrates a hitherto undiscovered polymorphism of ice.


title: On the role of data in PAC-Bayes bounds

abstract: The dominant term in PAC-Bayes bounds is often the Kullback--Leibler divergence between the posterior and prior. For so-called linear PAC-Bayes risk bounds based on the empirical risk of a fixed posterior kernel, it is possible to minimize the expected value of the bound by choosing the prior to be the expected posterior, which we call the oracle prior on the account that it is distribution dependent. In this work, we show that the bound based on the oracle prior can be suboptimal: In some cases, a stronger bound is obtained by using a data-dependent oracle prior, i.e., a conditional expectation of the posterior, given a subset of the training data that is then excluded from the empirical risk term. While using data to learn a prior is a known heuristic, its essential role in optimal bounds is new. In fact, we show that using data can mean the difference between vacuous and nonvacuous bounds. We apply this new principle in the setting of nonconvex learning, simulating data-dependent oracle priors on MNIST and Fashion MNIST with and without held-out data, and demonstrating new nonvacuous bounds in both cases.


title: Joint Speaker Counting, Speech Recognition, and Speaker Identification for Overlapped Speech of Any Number of Speakers

abstract: We propose an end-to-end speaker-attributed automatic speech recognition model that unifies speaker counting, speech recognition, and speaker identification on monaural overlapped speech. Our model is built on serialized output training (SOT) with attention-based encoder-decoder, a recently proposed method for recognizing overlapped speech comprising an arbitrary number of speakers. We extend SOT by introducing a speaker inventory as an auxiliary input to produce speaker labels as well as multi-speaker transcriptions. All model parameters are optimized by speaker-attributed maximum mutual information criterion, which represents a joint probability for overlapped speech recognition and speaker identification. Experiments on LibriSpeech corpus show that our proposed method achieves significantly better speaker-attributed word error rate than the baseline that separately performs overlapped speech recognition and speaker identification.


title: Pervasive Lying Posture Tracking

abstract: There exist significant gaps in research about how to design efficient in-bed lying posture tracking systems. These gaps can be articulated through several research questions as follows. First, can we design a single-sensor, pervasive, and inexpensive system that can accurately detect lying postures? Second, what computational models are most effective in the accurate detection of lying postures? Finally, what physical configuration of the sensor system is most effective for lying posture tracking? To answer these important research questions, in this article, we propose a comprehensive approach to design a sensor system that uses a single accelerometer along with machine learning algorithms for in-bed lying posture classification. We design two categories of machine learning algorithms based on deep learning and traditional classification with handcrafted features to detect lying postures. We also investigate what wearing sites are most effective in accurate detection of lying postures. We extensively evaluate the performance of the proposed algorithms on nine different body locations and four human lying postures using two datasets. Our results show that a system with a single accelerometer can be used with either deep learning or traditional classifiers to accurately detect lying postures. The best models in our approach achieve an F-Score that ranges from 95.2% to 97.8% with 0.03 to 0.05 coefficient of variation. The results also identify the thighs and chest as the most salient body sites for lying posture tracking. Our findings in this article suggest that because accelerometers are ubiquitous and inexpensive sensors, they can be a viable source of information for pervasive monitoring of in-bed postures.


title: Convolutional Gaussian Embeddings for Personalized Recommendation with Uncertainty

abstract: Most of existing embedding based recommendation models use embeddings (vectors) corresponding to a single fixed point in low-dimensional space, to represent users and items. Such embeddings fail to precisely represent the users/items with uncertainty often observed in recommender systems. Addressing this problem, we propose a unified deep recommendation framework employing Gaussian embeddings, which are proven adaptive to uncertain preferences exhibited by some users, resulting in better user representations and recommendation performance. Furthermore, our framework adopts Monte-Carlo sampling and convolutional neural networks to compute the correlation between the objective user and the candidate item, based on which precise recommendations are achieved. Our extensive experiments on two benchmark datasets not only justify that our proposed Gaussian embeddings capture the uncertainty of users very well, but also demonstrate its superior performance over the state-of-the-art recommendation models.


title: An Empirical Assessment of Global COVID-19 Contact Tracing Applications

abstract: The rapid spread of COVID-19 has made manual contact tracing difficult. Thus, various public health authorities have experimented with automatic contact tracing using mobile applications (or "apps"). These apps, however, have raised security and privacy concerns. In this paper, we propose an automated security and privacy assessment tool, COVIDGUARDIAN, which combines identification and analysis of Personal Identification Information (PII), static program analysis and data flow analysis, to determine security and privacy weaknesses. Furthermore, in light of our findings, we undertake a user study to investigate concerns regarding contact tracing apps. We hope that COVIDGUARDIAN, and the issues raised through responsible disclosure to vendors, can contribute to the safe deployment of mobile contact tracing. As part of this, we offer concrete guidelines, and highlight gaps between user requirements and app performance.


title: An underlying clock in the extreme flip-flop state transitions of the black hole transient Swift J1658.2-4242

abstract: Aims: Flip-flops are top-hat-like X-ray flux variations which occur in some transient accreting black hole binary systems and feature simultaneous changes in the spectral hardness and the Power Density Spectrum (PDS). They occur at a crucial time in the evolution of these systems, when the accretion disk emission starts to dominate over coronal emission. Flip-flops have only rarely been observed and are poorly understood. Methods: We detect 15 flip-flops in the 2018 outburst of Swift J1658.2-4242, in observations by XMM-Newton, NuSTAR, Astrosat, Swift, Insight-HXMT, INTEGRAL, and ATCA. We analyse their light curves, search for periodicities, compute their PDS, and fit their X-ray spectra, to investigate the source behaviour during flip-flop transitions, and how the interval featuring flip-flops differs from the rest of the outburst. Results: The flip-flops of Swift J1658.2-4242 are of an extreme variety, exhibiting flux differences of up to 77% within ~100s, much larger than has been seen so far. We observe radical changes in the PDS simultaneous with the sharp flux variations, featuring transitions between the Quasi-Periodic Oscillation types C and A, which have never been observed before. Changes to the PDS are delayed, but more rapid than changes in the light curve. Flip-flops occur in two intervals, separated by two weeks in which these phenomena were not seen. Transitions between the two flip-flop states occurred at random integer multiples of a fundamental period, of 2.761ks in the first interval, and 2.61ks in the second. Spectral analysis reveals the high and low flux flip-flop states to be similar, but distinct from intervals lacking flip-flops. A change in the inner temperature of the accretion disk is responsible for most of the flux difference in the flip-flops. We highlight the importance of correcting for the influence of the dust scattering halo on the X-ray spectra.


title: Particle Swarm Optimization with Velocity Restriction and Evolutionary Parameters Selection for Scheduling Problem

abstract: The article presents a study of the Particle Swarm optimization method for scheduling problem. To improve the method's performance a restriction of particles' velocity and an evolutionary meta-optimization were realized. The approach proposed uses the Genetic algorithms for selection of the parameters of Particle Swarm optimization. Experiments were carried out on test tasks of the job-shop scheduling problem. This research proves the applicability of the approach and shows the importance of tuning the behavioral parameters of the swarm intelligence methods to achieve a high performance.


title: Hidden singularities in 3D optical fields

abstract: In this article we show that in a three dimensional (3D) optical field there can exist two types of hidden singularities, one is spin density (SD) phase singularity and the other is SD vector singularity, which are both unique to 3D fields. The nature of these SD singularities is discussed and their connection with traditional optical singularities is also examined. Especially it is shown that in a 3D field with purely transverse spin density (`photonic wheels'), these two types of singularities exhibit very interesting behaviors: they are exactly mapped to each other regardless of their different physical meanings and different topological structures. Our work supplies a fundamental theory for the SD singularities and may provide a new way for further exploration of 3D optical fields.


title: FedFMC: Sequential Efficient Federated Learning on Non-iid Data

abstract: As a mechanism for devices to update a global model without sharing data, federated learning bridges the tension between the need for data and respect for privacy. However, classic FL methods like Federated Averaging struggle with non-iid data, a prevalent situation in the real world. Previous solutions are sub-optimal as they either employ a small shared global subset of data or greater number of models with increased communication costs. We propose FedFMC (Fork-Merge-Consolidate), a method that dynamically forks devices into updating different global models then merges and consolidates separate models into one. We first show the soundness of FedFMC on simple datasets, then run several experiments comparing against baseline approaches. These experiments show that FedFMC substantially improves upon earlier approaches to non-iid data in the federated learning context without using a globally shared subset of data nor increase communication costs.


title: The cyclic job-shop scheduling problem: The new subclass of the job-shop problem and applying the Simulated annealing to solve it

abstract: In the paper, the new approach to the scheduling problem are described. The approach deals with the problem of planning the cyclic production and proposes to consider such scheduling problem as the cyclic job-shop problem of the order k, where k is the number of reiterations. It was found out that planning of only one iteration of the loop is less effective than planning of the entire cycle. To the experimental research, a number of test instances of the job-shop scheduling problem by Operation Research Library were used. The Simulated Annealing was applied to solve the instances. The experiments proved that the approach proposed allows increasing the efficiency of cyclic scheduling significantly.


title: Neptune's ring arcs confined by coorbital satellites: dust orbital evolution through solar radiation

abstract: Voyager 2 images confirmed the presence of ring arcs around Neptune. These structures need a confinement mechanism to constrain their spreading due to collisions, dissipative forces, and differential keplerian motion. Here we report the results of a set of numerical simulations of the system formed by Neptune, the satellite Galatea, dust ring particles, and hypothetical co-orbital satellites. This dynamical system depicts a recent confinement mechanism formed by four co-orbital satellites being responsible for the azimuthal confinement of the arcs, while Galatea responds for their radial confinement. After the numerical simulations, the particles were divided into four groups: particles that stay in the arcs, transient particles, particles that leave the arcs to the Adams ring, and particles that collide with the co-orbital satellites. Our results showed that in all arcs the lifetime of the smaller particles is at most 50 years. After 100 years about 20% of the total amount of larger particles is still present in the arcs. From our numerical simulations, the particles should be present in all arcs after 30 years, the period between the discovery of the arcs up to now. Our results can not explain the disappearance of the leading arcs, Liberte and Courage unless the arcs are formed by different particle sizes. Analysis of the dust production, due to collisions between interplanetary debris onto the surface of the co-orbital satellites, ruled out the hypothesis that small satellites close to or in the arc the structure could be its source.


title: Open Problem: Model Selection for Contextual Bandits

abstract: In statistical learning, algorithms for model selection allow the learner to adapt to the complexity of the best hypothesis class in a sequence. We ask whether similar guarantees are possible for contextual bandit learning.


title: Fourier dimension and avoidance of linear patterns

abstract: The results in this paper are of two types. On one hand, we construct sets of large Fourier dimension that avoid nontrivial solutions of certain classes of linear equations. In particular, given any finite collection of translation-invariant linear equations of the form \begin{equation} \sum_{i=1}^v m_ix_i=m_0x_0, \; \text{ with } (m_0, m_1, \cdots, m_v) \in \mathbb N^{v+1}, m_0 = \sum_{i=1}^{v} m_i \text{ and } v \geq 2, \label{rational-eqn} \end{equation} we find a Salem set $E \subseteq [0,1]$ of dimension 1 that contains no nontrivial solution of any of these equations; in other words, there does not exist a vector $(x_0, x_1, \cdots, x_v) \in E^{v+1}$ with distinct entries that satisfies any of the given equations. Variants of this construction can also be used to obtain Salem sets that avoid solutions of translation-invariant linear equations of other kinds, for instance, when the collection of linear equations to be avoided is uncountable or has irrational coefficients. While such constructions seem to suggest that Salem sets can avoid many configurations, our second type of results offers a counterpoint. We show that a set in $\mathbb R$ whose Fourier dimension exceeds $2/(v+1)$ cannot avoid nontrivial solutions of all equations of the above form. In particular, a set of positive Fourier dimension must contain a nontrivial linear pattern of the above form for some $v$, and hence cannot be rationally independent. This is in stark contrast with known results \cite{M17} that ensure the existence of rationally independent sets of full Hausdorff dimension. The latter class of results may be viewed as quantitative evidence of the structural richness of Salem sets of positive dimension, even if the dimension is arbitrarily small.


title: Error Analysis of Symmetric Linear/Bilinear Partially Penalized Immersed Finite Element Methods for Helmholtz Interface Problems

abstract: This article presents an error analysis of the symmetric linear/bilinear partially penalized immersed finite element (PPIFE) methods for interface problems of Helmholtz equations. Under the assumption that the exact solution possesses a usual piecewise $H^2$ regularity, the optimal error bounds for the PPIFE solutions are derived in an energy norm and the usual $L^2$ norm provided that the mesh size is sufficiently small. A numerical example is conducted to validate the theoretical conclusions.


title: Robust interface-state laser in non-Hermitian micro-resonator arrays

abstract: We propose a scheme to achieve the analogous interface-state laser by dint of the interface between the two intermediate-resonator-coupled non-Hermitian resonator chains. We find that, after introducing the couplings between the two resonator chains and the intermediate resonator at the interface, the photons of the system mainly gather into the three resonators near the intermediate resonator. The phenomenon of the photon gathering towards the certain resonators is expected to construct the photon storage and even the laser generator. We reveal that the phenomenon is induced via the joint effect between the isolated intermediate resonator and two kinds of non-Hermitian skin effects. Specially, we investigate the interface-state laser in topologically trivial non-Hermitian resonator array in detail. We find that the pulsed interface-state laser can be achieved accompanying with the intermittent proliferation of the photons at the intermediate resonator when an arbitrary resonator is excited. Also, we reveal that the pulsed interface-state laser in the topologically trivial non-Hermitian resonator array is immune to the on-site defects in some cases, whose mechanism is mainly induced by the nonreciprocal couplings instead of the protection of topology. Our scheme provides a promising and excellent platform to investigate interface-state laser in the micro-resonator array.


title: Independent Innovation Analysis for Nonlinear Vector Autoregressive Process

abstract: The nonlinear vector autoregressive (NVAR) model provides an appealing framework to analyze multivariate time series obtained from a nonlinear dynamical system. However, the innovation (or error), which plays a key role by driving the dynamics, is almost always assumed to be additive. Additivity greatly limits the generality of the model, hindering analysis of general NVAR processes which have nonlinear interactions between the innovations. Here, we propose a new general framework called independent innovation analysis (IIA), which estimates the innovations from completely general NVAR. We assume mutual independence of the innovations as well as their modulation by an auxiliary variable (which is often taken as the time index and simply interpreted as nonstationarity). We show that IIA guarantees the identifiability of the innovations with arbitrary nonlinearities, up to a permutation and component-wise invertible nonlinearities. We also propose three estimation frameworks depending on the type of the auxiliary variable. We thus provide the first rigorous identifiability result for general NVAR, as well as very general tools for learning such models.


title: Memory-efficient structured convex optimization via extreme point sampling

abstract: Memory is a key computational bottleneck when solving large-scale convex optimization problems such as semidefinite programs (SDPs). In this paper, we focus on the regime in which storing an $n\times n$ matrix decision variable is prohibitive. To solve SDPs in this regime, we develop a randomized algorithm that returns a random vector whose covariance matrix is near-feasible and near-optimal for the SDP. We show how to develop such an algorithm by modifying the Frank-Wolfe algorithm to systematically replace the matrix iterates with random vectors. As an application of this approach, we show how to implement the Goemans-Williamson approximation algorithm for \textsc{MaxCut} using $\mathcal{O}(n)$ memory in addition to the memory required to store the problem instance. We then extend our approach to deal with a broader range of structured convex optimization problems, replacing decision variables with random extreme points of the feasible region.


title: A simple model of interbank trading with tiered remuneration

abstract: A negative interest rate policy is often accompanied by tiered remuneration, which allows for exemption from negative rates. This study proposes a basic model of interest rates formed in the interbank market with a tiering system. The results predicted by the model largely mirror actual market developments in late 2019, when the European Central Bank introduced, and the Switzerland National Bank modified, the tiering system.


title: Prediction of superconductivity and topological aspects in single-layer $\beta$-Bi$_{2}$Pd

abstract: Topological superconductors, characterized by topologically nontrivial states residing in a superconducting gap, are a recently discovered class of materials having Majorana Fermions. The interplay of superconductivity and topological states give rise to opportunities for achieving such topological superconductors in condensed matter systems. Up to now, several single-material topological superconductors in this form have been theoretically predicted and experimentally confirmed. Here, using the first-principles calculations, we study the superconducting single-layer $\beta$-Bi$_{2}$Pd. The electronic density of states near Fermi level of this monolayer are dominated by the Bi-p and Pd-d orbitals, forming a two-band Fermi surface with multi-class sheets. The presence of soft phonon bands, in cooperation with the electron susceptibility, account for electron-phonon superconductivity of single-layer $\beta$-Bi$_{2}$Pd. With the centrosymmetric structure, single-layer $\beta$-Bi$_{2}$Pd possesses a continuous gap over the whole Brillouin zone and topological Dirac-like states at its one-dimensional boundary. The present findings would lead to the expectation of one-dimensional topological superconductivity and Majorana bound states in monolayer candidate of $\beta$-Bi$_{2}$Pd with intrinsic full-gap superconductivity.


title: Bayesian Optimization with Missing Inputs

abstract: Bayesian optimization (BO) is an efficient method for optimizing expensive black-box functions. In real-world applications, BO often faces a major problem of missing values in inputs. The missing inputs can happen in two cases. First, the historical data for training BO often contain missing values. Second, when performing the function evaluation (e.g. computing alloy strength in a heat treatment process), errors may occur (e.g. a thermostat stops working) leading to an erroneous situation where the function is computed at a random unknown value instead of the suggested value. To deal with this problem, a common approach just simply skips data points where missing values happen. Clearly, this naive method cannot utilize data efficiently and often leads to poor performance. In this paper, we propose a novel BO method to handle missing inputs. We first find a probability distribution of each missing value so that we can impute the missing value by drawing a sample from its distribution. We then develop a new acquisition function based on the well-known Upper Confidence Bound (UCB) acquisition function, which considers the uncertainty of imputed values when suggesting the next point for function evaluation. We conduct comprehensive experiments on both synthetic and real-world applications to show the usefulness of our method.


title: Sorting-based Interactive Regret Minimization

abstract: As an important tool for multi-criteria decision making in database systems, the regret minimization query is shown to have the merits of top-k and skyline queries: it controls the output size while does not need users to provide any preferences. Existing researches verify that the regret ratio can be much decreased when interaction is available. In this paper, we study how to enhance current interactive regret minimization query by sorting mechanism. Instead of selecting the most favorite point from the displayed points for each interaction round, users sort the displayed data points and send the results to the system. By introducing sorting mechanism, for each round of interaction the utility space explored will be shrunk to some extent. Further the candidate points selection for following rounds of interaction will be narrowed to smaller data spaces thus the number of interaction rounds will be reduced. We propose two effective sorting-based algorithms namely Sorting-Simplex and Sorting-Random to find the maximum utility point based on Simplex method and randomly selection strategy respectively. Experiments on synthetic and real datasets verify our Sorting-Simplex and Sorting-Random algorithms outperform current state-of-art ones.


title: Melanoma Diagnosis with Spatio-Temporal Feature Learning on Sequential Dermoscopic Images

abstract: Existing studies for automated melanoma diagnosis are based on single-time point images of lesions. However, melanocytic lesions de facto are progressively evolving and, moreover, benign lesions can progress into malignant melanoma. Ignoring cross-time morphological changes of lesions thus may lead to misdiagnosis in borderline cases. Based on the fact that dermatologists diagnose ambiguous skin lesions by evaluating the dermoscopic changes over time via follow-up examination, in this study, we propose an automated framework for melanoma diagnosis using sequential dermoscopic images. To capture the spatio-temporal characterization of dermoscopic evolution, we construct our model in a two-stream network architecture which capable of simultaneously learning appearance representations of individual lesions while performing temporal reasoning on both raw pixels difference and abstract features difference. We collect 184 cases of serial dermoscopic image data, which consists of histologically confirmed 92 benign lesions and 92 melanoma lesions, to evaluate the effectiveness of the proposed method. Our model achieved AUC of 74.34%, which is ~8% higher than that of only using single images and ~6% higher than the widely used sequence learning model based on LSTM.


title: Two-loop renormalisation of gauge theories in $4D$ Implicit Regularisation and connections to dimensional methods

abstract: We compute the two-loop $\beta$-function of scalar and spinorial quantum electrodynamics as well as pure Yang-Mills and quantum chromodynamics using the background field method in a fully quadridimensional setup using Implicit Regularization (IREG). Moreover, a thorough comparison with dimensional approaches such as conventional dimensional regularization (CDR) and dimensional reduction (DRED) is presented. Subtleties related to Lorentz algebra contractions/symmetric integrations inside divergent integrals as well as renormalisation schemes are carefully discussed within IREG where the renormalisation constants are fully defined as basic divergent integrals to arbitrary loop order. Moreover, we confirm the hypothesis that momentum routing invariance in the loops of Feynman diagrams implemented via setting well-defined surface terms to zero deliver non-abelian gauge invariant amplitudes within IREG just as it has been proven for abelian theories.


title: Wafer-scale epitaxial growth of single orientation WS2 monolayers on sapphire

abstract: Realization of wafer-scale single-crystal films of transition metal dichalcogenides (TMDs) such as tungsten sulfide requires epitaxial growth and coalescence of oriented domains to form a continuous monolayer. The domains must be oriented in the same crystallographic direction on the substrate to avoid the formation of metallic inversion domain boundaries (IDBs) which are a common feature of layered chalcogenides. Here we demonstrate fully-coalesced single orientation tungsten sulfide monolayers on 2-inch diameter c-plane sapphire by metalorganic chemical vapor deposition using a multi-step growth process. High growth temperatures and sulfur/metal ratios were required to reduce domain misorientation and achieve epitaxial tungsten sulfide monolayers with low in-plane rotational twist (0.09 deg). Transmission electron microscopy analysis reveals that the tungsten sulfide monolayers lack IDBs but instead have translational boundaries that arise when tungsten sulfide domains with slightly off-set lattices merge together. By adjusting the monolayer growth rate, the density of translational boundaries and bilayer coverage were significantly reduced. The preferred orientation of domains is attributed to the presence of steps on the sapphire surface coupled with growth conditions promote surface diffusion and oriented attachment. The transferred tungsten sulfide monolayers show neutral and charged exciton emission at 80K with negligible defect-related luminescence. Back-gated tungsten sulfide field effect transistors exhibited mobility of 16 cm2/Vs. The results demonstrate the potential of achieving wafer-scale TMD monolayers free of inversion domains with properties approaching that of exfoliated flakes.


title: Resolving Discrepancy between Liouvillian Gap and Relaxation Time in Boundary-Dissipated Quantum Many-Body Systems

abstract: The gap of the Liouvillian spectrum gives the asymptotic decay rate of a quantum dissipative system, and therefore its inverse has been identified as the slowest relaxation time. In contrary to this common belief, we show that the relaxation time due to diffusive transports in a boundary dissipated many-body quantum system is determined not by the gap or low-lying eigenvalues of the Liouvillian but by superexponentially large expansion coefficients for Liouvillian eigenvectors with non-small eigenvalues at an initial state. This finding resolves an apparent discrepancy reported in the literature between the inverse of the Liouvillian gap and the relaxation time in dissipative many-body quantum systems.


title: Anisotropy of Electric Field Fluctuations Spectrum of Solar Wind Turbulence

abstract: To investigate the power and spectral index anisotropy in the inertial range of solar wind turbulence, we use 70 intervals of electric field data accumulated by Cluster spacecraft in the free solar wind. We compute the electric field fluctuation power spectra using wavelet analysis technique and study its spectral index variation with the change in angle between the heliocentric radial direction and the local mean magnetic field. We find clear power and spectral index anisotropy in the frequency ranging from 0.01 Hz to 0.1 Hz, with more power in parallel fluctuations than perpendicular. We also report our study of anisotropy as a function of solar activity.


title: Keep Your AI-es on the Road: Tackling Distracted Driver Detection with Convolutional Neural Networks and Targeted Data Augmentation

abstract: According to the World Health Organization, distracted driving is one of the leading cause of motor accidents and deaths in the world. In our study, we tackle the problem of distracted driving by aiming to build a robust multi-class classifier to detect and identify different forms of driver inattention using the State Farm Distracted Driving Dataset. We utilize combinations of pretrained image classification models, classical data augmentation, OpenCV based image preprocessing and skin segmentation augmentation approaches. Our best performing model combines several augmentation techniques, including skin segmentation, facial blurring, and classical augmentation techniques. This model achieves an approximately 15% increase in F1 score over the baseline, thus showing the promise in these techniques in enhancing the power of neural networks for the task of distracted driver detection.


title: Haar Measures

abstract: This article provides a concise introduction to the theory of Haar measures on locally compact Hausdorff groups. We cover the necessary preliminaries on topological groups and measure theory, the Haar correspondence, unimodularity and Haar measures on coset spaces.


title: When Is Amplification Necessary for Composition in Randomized Query Complexity?

abstract: Suppose we have randomized decision trees for an outer function $f$ and an inner function $g$. The natural approach for obtaining a randomized decision tree for the composed function $(f\circ g^n)(x^1,\ldots,x^n)=f(g(x^1),\ldots,g(x^n))$ involves amplifying the success probability of the decision tree for $g$, so that a union bound can be used to bound the error probability over all the coordinates. The amplification introduces a logarithmic factor cost overhead. We study the question: When is this log factor necessary? We show that when the outer function is parity or majority, the log factor can be necessary, even for models that are more powerful than plain randomized decision trees. Our results are related to, but qualitatively strengthen in various ways, known results about decision trees with noisy inputs.


title: A Blind Beam Tracking Scheme for Millimeter Wave Systems

abstract: Millimeter-wave is one of the technologies powering the new generation of wireless communication systems. To compensate the high path-loss, millimeter-wave devices need to use highly directional antennas. Consequently, beam misalignment causes strong performance degradation reducing the link throughput or even provoking a complete outage. Conventional solutions, e.g. IEEE 802.11ad, propose the usage of additional training sequences to track beam misalignment. These methods however introduce significant overhead especially in dynamic scenarios. In this paper we propose a beamforming scheme that can reduce this overhead. First, we propose an algorithm to design a codebook suitable for mobile scenarios. Secondly, we propose a blind beam tracking algorithm based on particle filter, which describes the angular position of the devices with a posterior density function constructed by particles. The proposed scheme reduces by more than 80% the overhead caused by additional training sequences.


title: Explorations of Non-Perturbative JT Gravity and Supergravity

abstract: Some recently proposed definitions of Jackiw-Teitelboim gravity and supergravities in terms of combinations of minimal string models are explored, with a focus on physics beyond the perturbative expansion in spacetime topology. While this formally involves solving infinite order non-linear differential equations, it is shown that the physics can be extracted to arbitrarily high accuracy in a simple controlled truncation scheme, using a combination of analytical and numerical methods. The non-perturbative spectral densities are explicitly computed and exhibited. The full spectral form factors, involving crucial non-perturbative contributions from wormhole geometries, are also computed and displayed, showing the non-perturbative details of the characteristic `slope', `dip', `ramp' and `plateau' features. It is emphasized that results of this kind can most likely be readily extracted for other types of JT gravity using the same methods.


title: Strong mechanical squeezing in a standard optomechanical system by pump modulation

abstract: Being beneficial for the amplitude modulation of the pump laser, we propose a simple yet surprisingly effective mechanical squeezing scheme in a standard optomechanical system. By merely introducing a specific kind of periodic modulation into the single-tone driving field to cool down the mechanical Bogoliubov mode, the far beyond 3-dB strong mechanical squeezing can be engineered without requiring any additional techniques. Specifically, we find that the amount of squeezing is not simply dependent on the order of magnitude of the effective optomechanical coupling but strongly on the ratio of sideband strengths for it. To maximize the mechanical squeezing, we numerically and analytically optimize this ratio in the steady-state regime, respectively. The mechanical squeezing engineered in our scheme also has strong robustness and can survive at a high bath temperature. Compared with previous schemes based on the two-tone pump technique, our scheme involves fewer external control laser source and can be extended to other quantum systems to achieve strong squeezing effect.


title: Opinion Maximization in Social Trust Networks

abstract: Social media sites are now becoming very important platforms for product promotion or marketing campaigns. Therefore, there is broad interest in determining ways to guide a site to react more positively to a product with a limited budget. However, the practical significance of the existing studies on this subject is limited for two reasons. First, most studies have investigated the issue in oversimplified networks in which several important network characteristics are ignored. Second, the opinions of individuals are modeled as bipartite states(e.g., support or not) in numerous studies, however, this setting is too strict for many real scenarios. In this study, we focus on social trust networks(STNs), which have the significant characteristics ignored in the previous studies. We generalized a famed continuous-valued opinion dynamics model for STNs, which is more consistent with real scenarios. We subsequently formalized two novel problems for solving the issue in STNs. Moreover, we developed two matrix-based methods for these two problems and experiments on real-world datasets to demonstrate the practical utility of our methods.


title: Attention Mesh: High-fidelity Face Mesh Prediction in Real-time

abstract: We present Attention Mesh, a lightweight architecture for 3D face mesh prediction that uses attention to semantically meaningful regions. Our neural network is designed for real-time on-device inference and runs at over 50 FPS on a Pixel 2 phone. Our solution enables applications like AR makeup, eye tracking and AR puppeteering that rely on highly accurate landmarks for eye and lips regions. Our main contribution is a unified network architecture that achieves the same accuracy on facial landmarks as a multi-stage cascaded approach, while being 30 percent faster.


title: Evaluating Prediction-Time Batch Normalization for Robustness under Covariate Shift

abstract: Covariate shift has been shown to sharply degrade both predictive accuracy and the calibration of uncertainty estimates for deep learning models. This is worrying, because covariate shift is prevalent in a wide range of real world deployment settings. However, in this paper, we note that frequently there exists the potential to access small unlabeled batches of the shifted data just before prediction time. This interesting observation enables a simple but surprisingly effective method which we call prediction-time batch normalization, which significantly improves model accuracy and calibration under covariate shift. Using this one line code change, we achieve state-of-the-art on recent covariate shift benchmarks and an mCE of 60.28\% on the challenging ImageNet-C dataset; to our knowledge, this is the best result for any model that does not incorporate additional data augmentation or modification of the training pipeline. We show that prediction-time batch normalization provides complementary benefits to existing state-of-the-art approaches for improving robustness (e.g. deep ensembles) and combining the two further improves performance. Our findings are supported by detailed measurements of the effect of this strategy on model behavior across rigorous ablations on various dataset modalities. However, the method has mixed results when used alongside pre-training, and does not seem to perform as well under more natural types of dataset shift, and is therefore worthy of additional study. We include links to the data in our figures to improve reproducibility, including a Python notebooks that can be run to easily modify our analysis at https://colab.research.google.com/drive/11N0wDZnMQQuLrRwRoumDCrhSaIhkqjof.


title: A Qualitative Evaluation of Language Models on Automatic Question-Answering for COVID-19

abstract: COVID-19 has resulted in an ongoing pandemic and as of 12 June 2020, has caused more than 7.4 million cases and over 418,000 deaths. The highly dynamic and rapidly evolving situation with COVID-19 has made it difficult to access accurate, on-demand information regarding the disease. Online communities, forums, and social media provide potential venues to search for relevant questions and answers, or post questions and seek answers from other members. However, due to the nature of such sites, there are always a limited number of relevant questions and responses to search from, and posted questions are rarely answered immediately. With the advancements in the field of natural language processing, particularly in the domain of language models, it has become possible to design chatbots that can automatically answer consumer questions. However, such models are rarely applied and evaluated in the healthcare domain, to meet the information needs with accurate and up-to-date healthcare data. In this paper, we propose to apply a language model for automatically answering questions related to COVID-19 and qualitatively evaluate the generated responses. We utilized the GPT-2 language model and applied transfer learning to retrain it on the COVID-19 Open Research Dataset (CORD-19) corpus. In order to improve the quality of the generated responses, we applied 4 different approaches, namely tf-idf, BERT, BioBERT, and USE to filter and retain relevant sentences in the responses. In the performance evaluation step, we asked two medical experts to rate the responses. We found that BERT and BioBERT, on average, outperform both tf-idf and USE in relevance-based sentence filtering tasks. Additionally, based on the chatbot, we created a user-friendly interactive web application to be hosted online.


title: How does this interaction affect me? Interpretable attribution for feature interactions

abstract: Machine learning transparency calls for interpretable explanations of how inputs relate to predictions. Feature attribution is a way to analyze the impact of features on predictions. Feature interactions are the contextual dependence between features that jointly impact predictions. There are a number of methods that extract feature interactions in prediction models; however, the methods that assign attributions to interactions are either uninterpretable, model-specific, or non-axiomatic. We propose an interaction attribution and detection framework called Archipelago which addresses these problems and is also scalable in real-world settings. Our experiments on standard annotation labels indicate our approach provides significantly more interpretable explanations than comparable methods, which is important for analyzing the impact of interactions on predictions. We also provide accompanying visualizations of our approach that give new insights into deep neural networks.


title: Feature Interaction Interpretability: A Case for Explaining Ad-Recommendation Systems via Neural Interaction Detection

abstract: Recommendation is a prevalent application of machine learning that affects many users; therefore, it is important for recommender models to be accurate and interpretable. In this work, we propose a method to both interpret and augment the predictions of black-box recommender systems. In particular, we propose to interpret feature interactions from a source recommender model and explicitly encode these interactions in a target recommender model, where both source and target models are black-boxes. By not assuming the structure of the recommender system, our approach can be used in general settings. In our experiments, we focus on a prominent use of machine learning recommendation: ad-click prediction. We found that our interaction interpretations are both informative and predictive, e.g., significantly outperforming existing recommender models. What's more, the same approach to interpret interactions can provide new insights into domains even beyond recommendation, such as text and image classification.


title: A High Order Flux Reconstruction Interface Tracking Method Using Preconditioned Phase Field

abstract: This paper presents a simple and highly accurate method for capturing sharp interfaces moving in divergence-free velocity fields using the high-order Flux Reconstruction approach on unstructured grids. A well-known limitation of high-order methods is their susceptibility to the Gibbs phenomenon; the appearance of spurious oscillations in the vicinity of discontinuities and steep gradients makes it difficult to accurately resolve shocks or sharp interfaces. In order to address this issue in the context of sharp interface capturing, a novel, preconditioned and localized phase field method is developed in this work. The numerical accuracy of interface normal vectors is improved by utilizing a preconditioning procedure based on the level set method with localized artificial viscosity stabilization. The developed method was implemented in the framework of the multi-platform Flux Reconstruction open-source code PyFR. Numerical tests in 2D and 3D conducted on different mesh types showed that the preconditioning procedure significantly improves accuracy. The results demonstrate the conservativeness of the proposed method and its ability to capture highly distorted interfaces with superior accuracy when compared to conventional and high-order VOF and level set methods. The high accuracy and locality of the proposed method offer a promising route to carrying out massively-parallel, high accuracy simulations of multi-phase, incompressible phenomena.


title: The Normal-Generalised Gamma-Pareto process: A novel pure-jump L\'evy process with flexible tail and jump-activity properties

abstract: Pure-jump L\'evy processes are popular classes of stochastic processes which have found many applications in finance, statistics or machine learning. In this paper, we propose a novel family of self-decomposable L\'evy processes where one can control separately the tail behavior and the jump activity of the process, via two different parameters. Crucially, we show that one can sample exactly increments of this process, at any time scale; this allows the implementation of likelihood-free Markov chain Monte Carlo algorithms for (asymptotically) exact posterior inference. We use this novel process in L\'evy-based stochastic volatility models to predict the returns of stock market data, and show that the proposed class of models leads to superior predictive performances compared to classical alternatives.


title: Optimization of Wireless Relaying With Flexible UAV-Borne Reflecting Surfaces

abstract: This paper presents a theoretical framework to analyze the performance of integrated unmanned aerial vehicle (UAV)-intelligent reflecting surface (IRS) relaying system in which IRS provides an additional degree of freedom combined with the flexible deployment of full-duplex UAV to enhance communication between ground nodes. Our framework considers three different transmission modes: {\bf (i)} UAV-only mode, {\bf (ii)} IRS-only mode, and {\bf (iii)} integrated UAV-IRS mode to achieve spectral and energy-efficient relaying. For the proposed modes, we provide exact and approximate expressions for the end-to-end outage probability, ergodic capacity, and energy efficiency (EE) in closed-form. We use the derived expressions to optimize key system parameters such as the UAV altitude and the number of elements on the IRS considering different modes. We formulate the problems in the form of fractional programming (e.g. single ratio, sum of multiple ratios or maximization-minimization of ratios) and devise optimal algorithms using quadratic transformations. Furthermore, we derive an analytic criterion to optimally select different transmission modes to maximize ergodic capacity and EE for a given number of IRS elements. Numerical results validate the derived expressions with Monte-Carlo simulations and the proposed optimization algorithms with the solutions obtained through exhaustive search. Insights are drawn related to the different communication modes, optimal number of IRS elements, and optimal UAV height.


title: On $2$-Nilpotent Multiplier of Lie Superalgebras

abstract: In this article we define the $c$-nilpotent multiplier of a finite dimensional Lie suepralgebra. We characterize the structure of $2$-nilpotent multiplier of finite dimensional nilpotent Lie superalgebras whose derived subalgebras have dimension at most one. Then we give an upper bound on the dimension of $2$-nilpotent multiplier of any finite dimensional nilpotent Lie superalgebra. Moreover, we discuses the $2$-capability of special as well as odd Heisenberg Lie superalgebras and abelian Lie superalgebras.


title: A Deep Learning Framework for Hybrid Beamforming Without Instantaneous CSI Feedback

abstract: Hybrid beamformer design plays very crucial role in the next generation millimeter-wave (mm-Wave) massive MIMO (multiple-input multiple-output) systems. Previous works assume the perfect channel state information (CSI) which results heavy feedback overhead. To lower complexity, channel statistics can be utilized such that only infrequent update of the channel information is needed. To reduce the complexity and provide robustness, in this work, we propose a deep learning (DL) framework to deal with both hybrid beamforming and channel estimation. For this purpose, we introduce three deep convolutional neural network (CNN) architectures. We assume that the base station (BS) has the channel statistics only and feeds the channel covariance matrix into a CNN to obtain the hybrid precoders. At the receiver, two CNNs are employed. The first one is used for channel estimation purposes and the another is employed to design the hybrid combiners. The proposed DL framework does not require the instantaneous feedback of the CSI at the BS. We have shown that the proposed approach has higher spectral efficiency with comparison to the conventional techniques. The trained CNN structures do not need to be re-trained due to the changes in the propagation environment such as the deviations in the number of received paths and the fluctuations in the received path angles up to 4 degrees. Also, the proposed DL framework exhibits at least 10 times lower computational complexity as compared to the conventional optimization-based approaches.


title: On the Security of Proofs of Sequential Work in a Post-Quantum World

abstract: A Proof of Sequential Work (PoSW) allows a prover to convince a resource-bounded verifier that the prover invested a substantial amount of sequential time to perform some underlying computation. PoSWs have many applications including time-stamping, blockchain design, and universally verifiable CPU benchmarks. Mahmoody, Moran, and Vadhan (ITCS 2013) gave the first construction of a PoSW in the random oracle model though the construction relied on expensive depth-robust graphs. In a recent breakthrough, Cohen and Pietrzak (EUROCRYPT 2018) gave an efficient PoSW construction that does not require expensive depth-robust graphs. In the classical parallel random oracle model, it is straightforward to argue that any successful PoSW attacker must produce a long $\mathcal{H}$-sequence and that any malicious party running in sequential time $T-1$ will fail to produce an $\mathcal{H}$-sequence of length $T$ except with negligible probability. In this paper, we prove that any quantum attacker running in sequential time $T-1$ will fail to produce an $\mathcal{H}$-sequence except with negligible probability -- even if the attacker submits a large batch of quantum queries in each round. The proof is substantially more challenging and highlights the power of Zhandry's recent compressed oracle technique (CRYPTO 2019). We further extend this result to establish post-quantum security of a non-interactive PoSW obtained by applying the Fiat-Shamir transform to Cohen and Pietrzak's efficient construction (EUROCRYPT 2018).


title: Sentiment Frames for Attitude Extraction in Russian

abstract: Texts can convey several types of inter-related information concerning opinions and attitudes. Such information includes the author's attitude towards mentioned entities, attitudes of the entities towards each other, positive and negative effects on the entities in the described situations. In this paper, we described the lexicon RuSentiFrames for Russian, where predicate words and expressions are collected and linked to so-called sentiment frames conveying several types of presupposed information on attitudes and effects. We applied the created frames in the task of extracting attitudes from a large news collection.


title: Optimization and Generalization of Regularization-Based Continual Learning: a Loss Approximation Viewpoint

abstract: Neural networks have achieved remarkable success in many cognitive tasks. However, when they are trained sequentially on multiple tasks without access to old data, their performance on early tasks tend to drop significantly. This problem is often referred to as catastrophic forgetting, a key challenge in continual learning of neural networks. The regularization-based approach is one of the primary classes of methods to alleviate catastrophic forgetting. In this paper, we provide a novel viewpoint of regularization-based continual learning by formulating it as a second-order Taylor approximation of the loss function of each task. This viewpoint leads to a unified framework that can be instantiated to derive many existing algorithms such as Elastic Weight Consolidation and Kronecker factored Laplace approximation. Based on this viewpoint, we study the optimization aspects (i.e., convergence) as well as generalization properties (i.e., finite-sample guarantees) of regularization-based continual learning. Our theoretical results indicate the importance of accurate approximation of the Hessian matrix. The experimental results on several benchmarks provide empirical validation of our theoretical findings.


title: Formulas for the eigendiscriminants of ternary and quaternary forms

abstract: A $d$-dimensional tensor $A$ of format $n\times n\times \cdots \times n$ defines naturally a rational map $\Psi$ from the projective space $\mathbb{P}^{n-1}$ to itself and its eigenscheme is then the subscheme of $\mathbb{P}^{n-1}$ of fixed points of $\Psi$. The eigendiscriminant is an irreducible polynomial in the coefficients of $A$ that vanishes for a given tensor if and only if its eigenscheme is singular. In this paper we contribute two formulas for the computation of eigendiscriminants in the cases $n=3$ and $n=4$. In particular, by restriction to symmetric tensors, we obtain closed formulas for the eigendiscriminants of plane curves and surfaces in $\mathbb{P}^3$ as the ratio of some determinants of resultant matrices.


title: Real-time Monitoring and Early Warning Analysis of Urban Railway Operation Based on Multi-parameter Vital Signs of Subway Drivers in Plateau Environment

abstract: In order to ensure the personal safety of the drivers and passengers of rail transit in plateau environment, the vital signs and train conditions of the drivers and passengers are taken as the research object, and the dynamic relationship between them is studied and analyzed. In this paper, subway drivers under normal operation conditions are taken as research objects to establish the vital signs monitoring and early warning system. The vital signs data of the subway drivers, such as heart rate (HR), respiratory rate (RR), body temperature (T) and blood oxygen saturation (SPO2) of the subway driver are collected by the head-mounted sensor, and the least mean square adaptive filtering algorithm is used to preprocess the data and eliminate the interference information. Based on the improved BP (Back Propagation) neural network algorithm, a prediction model is established to predict the vital signs of subway drivers in real-time. We use the early warning score evaluation method to measure the risk of subway drivers' vital signs, and then the necessary judgment basis can be provided to dispatchers in the control center. Experiments show that the system developed in this paper can accurately predict the evolution of subway drivers' vital signs, and timely warn the abnormal states. The predicted value of vital signs is consistent with the actual value, and the absolute error of prediction is less than 0.5 which is within the allowable range.


title: No one-hidden-layer neural network can represent multivariable functions

abstract: In a function approximation with a neural network, an input dataset is mapped to an output index by optimizing the parameters of each hidden-layer unit. For a unary function, we present constraints on the parameters and its second derivative by constructing a continuum version of a one-hidden-layer neural network with the rectified linear unit (ReLU) activation function. The network is accurately implemented because the constraints decrease the degrees of freedom of the parameters. We also explain the existence of a smooth binary function that cannot be precisely represented by any such neural network.


title: Cooling-Aware Resource Allocation and Load Management for Mobile Edge Computing Systems

abstract: Driven by explosive computation demands of Internet of Things (IoT), mobile edge computing (MEC) provides a promising technique to enhance the computation capability for mobile users. In this paper, we propose a joint resource allocation and load management mechanism in an MEC system with wireless power transfer (WPT), by jointly optimizing the transmit power for WPT, the local/edge computing load, the offloading time, and the frequencies of the central processing units (CPUs) at the access point (AP) and the users. To achieve an energy-efficient and sustainable WPT-MEC system, we minimize the total energy consumption of the AP, while meeting computation latency requirements. Cooling energy which is non-negligible, is taken into account in minimizing the energy consumption of the MEC system. By rigorously orchestrating the state-of-the-art optimization techniques, we design an iterative algorithm and obtain the optimal solution in a semi-closed form. Based on the solution, interesting properties and insights are summarized. Extensive numerical tests show that the proposed algorithm can save up to 90.4% the energy of existing benchmarks.


title: Estimating the Most Probable Transition Time for Stochastic Dynamical Systems

abstract: This work is devoted to the investigation of the most probable transition time between metastable states for stochastic dynamical systems. Such a system is modeled by a stochastic differential equation with non-vanishing Brownian noise, and is restricted in a domain with absorbing boundary. Instead of minimizing the Onsager-Machlup action functional, we examine the maximum probability that the solution process of the system stays in a neighborhood (or a tube) of a transition path, in order to characterize the most probable transition path. We first establish the exponential decay lower bound and a power law decay upper bound for the maximum of this probability. Based on these estimates, we further derive the lower and upper bounds for the most probable transition time, under suitable conditions. Finally, we illustrate our results in simple stochastic dynamical systems, and highlight the relation with some relevant works.


title: NROWAN-DQN: A Stable Noisy Network with Noise Reduction and Online Weight Adjustment for Exploration

abstract: Deep reinforcement learning has been applied more and more widely nowadays, especially in various complex control tasks. Effective exploration for noisy networks is one of the most important issues in deep reinforcement learning. Noisy networks tend to produce stable outputs for agents. However, this tendency is not always enough to find a stable policy for an agent, which decreases efficiency and stability during the learning process. Based on NoisyNets, this paper proposes an algorithm called NROWAN-DQN, i.e., Noise Reduction and Online Weight Adjustment NoisyNet-DQN. Firstly, we develop a novel noise reduction method for NoisyNet-DQN to make the agent perform stable actions. Secondly, we design an online weight adjustment strategy for noise reduction, which improves stable performance and gets higher scores for the agent. Finally, we evaluate this algorithm in four standard domains and analyze properties of hyper-parameters. Our results show that NROWAN-DQN outperforms prior algorithms in all these domains. In addition, NROWAN-DQN also shows better stability. The variance of the NROWAN-DQN score is significantly reduced, especially in some action-sensitive environments. This means that in some environments where high stability is required, NROWAN-DQN will be more appropriate than NoisyNets-DQN.


title: $N$-cluster correlations in four- and five-dimensional percolation

abstract: We study $N$-cluster correlation functions in four- and five-dimensional (4D, 5D) bond percolation by extensive Monte Carlo simulation. We reformulate the transfer Monte Carlo algorithm for percolation [Phys. Rev. E {\bf 72}, 016126 (2005)] using the disjoint-set data structure, and simulate a cylindrical geometry $L^{d-1}\times \infty$, with the linear size up to $L=512$ for 4D and $128$ for 5D. We determine with a high precision all possible $N$-cluster exponents, for $N \! =\!2$ and $3$, and the universal amplitude for a logarithmic correlation function. From the symmetric correlator with $N \! = \!2$, we obtain the correlation-length critical exponent as $1/\nu \! =\! 1.4610(12)$ for 4D and $1/\nu \! =\! 1.737 (2)$ for 5D, significantly improving over the existing results. Estimates for the other exponents and the universal logarithmic amplitude have not been reported before to our knowledge. Our work demonstrates the validity of logarithmic conformal field theory and adds to the growing knowledge for high-dimensional percolation.


title: Lipschitz fractions of a complex analytic algebra and Zariski saturation

abstract: This text is the English translation, due to Naoufal Bouchareb, of an unpublished manuscript of 1969 (the French version is available on HAL as hal-00384928) inspired by Zariski's theory of saturation. Its publication is justified by the fact that it appears now as a precursor of the recently developed study of the Lipschitz geometry (for the outer metric) of germs of complex analytic spaces. This version contains some new footnotes and an additional bibliography.


title: Robustness under control sampling of reachability in fixed time for nonlinear control systems

abstract: Under a regularity assumption we prove that reachability in fixed time for nonlinear control systems is robust under control sampling.


title: Optical nonreciprocal response and conversion in a Tavis-Cummings coupling optomechanical system

abstract: We propose a scheme to realize optical nonreciprocal response and conversion in a Tavis-Cummings coupling optomechanical system, where a single cavity mode interacts with the vibrational mode of a flexible membrane with an embedded ensemble of two-level quantum emitters. Due to the introduction of the Tavis-Cummings interaction, we find that the phases between the mechanical mode and the optical mode, as well as between the mechanical mode and the dopant mode, are correlated with each other, and further give the analytical relationship between them. By optimizing the system parameters, especially the relative phase between two paths, the optimal nonreciprocal response can be achieved. Under the frequency domain, we derive the transmission matrix of the system analytically based on the input-output relation and study the influence of the system parameters on the nonreciprocal response of the quantum input signal. Moreover, compared with the conventional optomechanical systems, the Tavis-Cummings coupling optomechanical system exhibits richer nonreciprocal conversion phenomena among the optical mode, mechanical mode, and dopant mode, which provide a new applicable way of achieving the phonon-photon transducer and the optomechanical circulator in future practice.


title: Stateless Distributed Ledgers

abstract: In public distributed ledger technologies (DLTs), such as Blockchains, nodes can join and leave the network at any time. A major challenge occurs when a new node joining the network wants to retrieve the current state of the ledger. Indeed, that node may receive conflicting information from honest and Byzantine nodes, making it difficult to identify the current state. In this paper, we are interested in protocols that are stateless, i.e., a new joining node should be able to retrieve the current state of the ledger just using a fixed amount of data that characterizes the ledger (such as the genesis block in Bitcoin). We define three variants of stateless DLTs: weak, strong, and probabilistic. Then, we analyze this property for DLTs using different types of consensus.


title: Particle production induced by vacuum decay in real time dynamics

abstract: We discuss particle production associated with vacuum decay, which changes the mass of a scalar field coupled to a background field which induces the decay. By utilizing the Stokes phenomenon, we can optimally track the time-evolution of mode function and hence calculate particle production properly. In particular, we use real time formalisms for vacuum decay in Minkowski and de Sitter spacetime together with the Stokes phenomenon method. For each case, we consider the flyover vacuum decay model and stochastic inflation, respectively. Within the real time formalism, the particle production can be viewed as that caused by nontrivial external fields. This gives us a novel perspective of the real time formalism of vacuum decay.


title: On smoothness and uniqueness of multi-solitons of the non-linear Schr{\"o}dinger equations

abstract: In this paper, we study some properties of multi-solitons for the non-linear Schr{\"o}dinger equations in R^d with general non-linearities. Multi-solitons have already been constructed in H^1, successively by Merle, by Martel and Merle, and by C{\^o}te, Martel and Merle. We show here that multi-solitons are smooth, depending on the regularity of the non-linearity. We obtain also a result of uniqueness in some class, either when the ground states are all stable, or in the mass-critical case.


title: Contrasting physical properties of the trilayer nickelates Nd$_4$Ni$_3$O$_{10}$ and Nd$_4$Ni$_3$O$_8$

abstract: We report the crystal structures and physical properties of trilayer nickelates Nd$_4$Ni$_3$O$_{10}$ and Nd$_4$Ni$_3$O$_8$. Measurements of magnetization and electrical resistivity display contrasting behaviors in the two compounds. Nd$_4$Ni$_3$O$_{10}$ shows a paramagnetic metallic behavior with a metal to metal phase transition($T^{\ast}$) at about 162 K, as revealed by both magnetic susceptibility and resistivity. Further magnetoresistance and Hall coefficient results show a negative magnetoresistance at low temperatures and the carrier type of Nd$_4$Ni$_3$O$_{10}$ is dominated by hole-type charge carriers. The significant enhancement of Hall coefficient and resistivity below $T^{\ast}$ suggest that effective charge carrier density decreases when cooling through the transition temperature. In contrast, Nd$_4$Ni$_3$O$_8$ shows an insulating behavior despite small value of resistivity at room temperature. The compound shows paramagnetic behavior, with the similar magnetic moments as in Nd$_4$Ni$_3$O$_{10}$ derived from the Curie-Weiss fitting. This may suggest that the magnetic moments in both systems are contributed by the Nd ions. By applying pressures up to about 49 GPa, the insulating behavior is still present and becomes even stronger. Our results suggest that the different Ni configurations ($Ni^{1+/2+}$ or $Ni^{2+/3+}$) and competition between localized and itinerant electrons may account for the contrasting behaviors in trilayer nickelates Nd$_4$Ni$_3$O$_{10}$ and Nd$_4$Ni$_3$O$_8$.


title: Selective Rydberg pumping via strong dipole blockade

abstract: The resonant dipole-dipole interaction between highly excited Rydberg levels dominates the interaction of neutral atoms at short distances scaling as $1/r^3$. Here we take advantage of the combined effects of strong dipole-dipole interaction and multifrequency driving fields to propose one type of selective Rydberg pumping mechanism. In the computational basis of two atoms $\{|00\rangle, |01\rangle,|10\rangle,|11\rangle\}$, this mechanism allows $|11\rangle$ to be resonantly pumped upwards to the single-excited Rydberg states while the transitions of the other three states are suppressed. From the perspective of mathematical form, we achieve an analogous F\"{o}ster resonance for ground states of neutral atoms. The performance of this selective Rydberg pumping is evaluated using the definition of fidelity for controlled-$Z$ gate, which manifests a characteristic of robustness to deviation of interatomic distance, fluctuation of F\"{o}ster resonance defect, and spontaneous emission of double-excited Rydberg states. As applications of this mechanism, we discuss in detail the preparation of the maximally entangled symmetric state for two atoms via ground-state blockade, and the maximally entangled antisymmetric state via engineered spontaneous emission, within the state-of-the-art experiments, respectively.


title: Cross-denoising Network against Corrupted Labels in Medical Image Segmentation with Domain Shift

abstract: Deep convolutional neural networks (DCNNs) have contributed many breakthroughs in segmentation tasks, especially in the field of medical imaging. However, \textit{domain shift} and \textit{corrupted annotations}, which are two common problems in medical imaging, dramatically degrade the performance of DCNNs in practice. In this paper, we propose a novel robust cross-denoising framework using two peer networks to address domain shift and corrupted label problems with a peer-review strategy. Specifically, each network performs as a mentor, mutually supervised to learn from reliable samples selected by the peer network to combat with corrupted labels. In addition, a noise-tolerant loss is proposed to encourage the network to capture the key location and filter the discrepancy under various noise-contaminant labels. To further reduce the accumulated error, we introduce a class-imbalanced cross learning using most confident predictions at the class-level. Experimental results on REFUGE and Drishti-GS datasets for optic disc (OD) and optic cup (OC) segmentation demonstrate the superior performance of our proposed approach to the state-of-the-art methods.


title: Quantum stress tensor at the Cauchy horizon of Reissner-Nordstr\"om-deSitter spacetime

abstract: The strong cosmic censorship conjecture proposes that starting from generic initial data on some Cauchy surface, the solutions of the Einstein equation should not be extendable across the boundary of the domain of dependence of that surface. For the case of the Reissner-Nordstr\"om-de Sitter spacetime this means that any perturbation should blow up sufficiently badly when approaching this boundary, called the Cauchy horizon. However, recent results indicate that for highly charged black holes classical scalar perturbations allow for a violation of strong cosmic censorship. In a recent paper arXiv:1912.06047, two of us have argued that quantum effects will restore censorship for generic values of the black hole parameters. But, due to practical limitations, the precise form of the divergence was only calculated for a small number of parameters. Here we perform a thorough parameter scan using an alternative, more efficient semi-analytic method. Our analysis confirms arXiv:1912.06047 in the sense that the quantum stress tensor is found to diverge badly generically. However, the sign of the divergence can be changed by changing the mass of the field or the spacetime parameters, leading to a drastically different type of singularity on the Cauchy horizon.


title: Enhanced photon blockade in an optomechanical system with parametric amplification

abstract: We propose a scheme to enhance the single- and two-photon blockade effect significantly in a standard optomechanical system (OMS) via optical parametric amplification (OPA). The scheme does not rely on the strong single-photon optomechanical coupling and can eliminate the disadvantages of suppressing multi-photon excitation incompletely. Through analyzing the single-photon blockade (1PB) mechanism and optimizing the system parameters, we obtain a perfect 1PB with a high occupancy probability of single-photon excitation, which means that a high quality and efficient single-photon source can be generated. Moreover, we find that not only the two-photon blockade (2PB) effect is significantly enhanced but also the region of 2PB occurring is widened when the OPA exists, where we also derive the optimal parameter condition to maximize the two-photon emission and the higher photon excitations are intensely suppressed at the same time.


title: Scaling in Decaying Turbulence at High Reynolds Numbers

abstract: The way the increment statistics of turbulent velocity fluctuations scale with the increment size is a centerpiece of turbulence theories. We report data on decaying turbulence in the Max Planck Variable Density Turbulence Tunnel (VDTT), which show an approach of the inertial range statistics toward a nontrivial shape at small scales. By correcting for the contributions of energy decay to the large-scale statistics with a model, we find the scaling exponent of the second-order velocity increment statistics to be independent of the Reynolds number and equal to $0.693\pm0.003$ for $2000\lesssim R_{\lambda} \lesssim 6000$. This is evidence of a universal inertial range at high Reynolds numbers.


title: Central limit theorem for a critical multi-type branching process in random environment

abstract: Let (Z n) n$\ge$0 with Z n = (Z n (i, j)) 1$\le$i,j$\le$p be a p multi-type critical branching process in random environment, and let M n be the expectation of Z n given a fixed environment. We prove theorems on convergence in distribution of sequences of branching processes Zn |Mn| /|Z n | > 0 and ln Zn $\sqrt$ n /|Z n | > 0. These theorems extend similar results for single-type critical branching process in random environment.


title: High electron mobility single-crystalline ZnSnN2 on ZnO (0001) substrates

abstract: Making a systematic effort, we have developed a single-crystalline ZnSnN2 on ZnO (0001) by reactive magnetron co-sputtering. Epitaxial growth was achieved at 350 C by co-sputtering from metal targets in nitrogen atmosphere, and confirmed by transmission electron microscopy (TEM) measurements. TEM verified that the layers are single-crystalline of hexagonal phase, exhibiting epitaxial relationship with the substrate. The screw-type threading dislocations originating from the interface were identified as dominant extended defects. More specifically, we report a pioneering measurement of the dislocation density in this material. Even though, there is no literature data for direct comparison, such values are typical of heteroepitaxial growth of III-nitride layers without applying defect density reduction strategies. The films demonstrated a record electron mobility. The optical bandgaps of 1.86 eV and 1.72 eV were determined for the stoichiometric and Zn-rich samples, respectively. As such, we conclude that ZnSnN2 is an earth-abundant, environmentally-friendly semiconductor and is a promising candidate for cost efficient components in electronics and photonics.


title: Monash University, UEA, UCR Time Series Extrinsic Regression Archive

abstract: Time series research has gathered lots of interests in the last decade, especially for Time Series Classification (TSC) and Time Series Forecasting (TSF). Research in TSC has greatly benefited from the University of California Riverside and University of East Anglia (UCR/UEA) Time Series Archives. On the other hand, the advancement in Time Series Forecasting relies on time series forecasting competitions such as the Makridakis competitions, NN3 and NN5 Neural Network competitions, and a few Kaggle competitions. Each year, thousands of papers proposing new algorithms for TSC and TSF have utilized these benchmarking archives. These algorithms are designed for these specific problems, but may not be useful for tasks such as predicting the heart rate of a person using photoplethysmogram (PPG) and accelerometer data. We refer to this problem as Time Series Extrinsic Regression (TSER), where we are interested in a more general methodology of predicting a single continuous value, from univariate or multivariate time series. This prediction can be from the same time series or not directly related to the predictor time series and does not necessarily need to be a future value or depend heavily on recent values. To the best of our knowledge, research into TSER has received much less attention in the time series research community and there are no models developed for general time series extrinsic regression problems. Most models are developed for a specific problem. Therefore, we aim to motivate and support the research into TSER by introducing the first TSER benchmarking archive. This archive contains 19 datasets from different domains, with varying number of dimensions, unequal length dimensions, and missing values. In this paper, we introduce the datasets in this archive and did an initial benchmark on existing models.


title: Relaxing monotonicity in endogenous selection models and application to surveys

abstract: This paper considers endogenous selection models, in particular nonparametric ones. Estimating the unconditional law of the outcomes is possible when one uses instrumental variables. Using a selection equation which is additively separable in a one dimensional unobservable has the sometimes undesirable property of instrument monotonicity. We present models which allow for nonmonotonicity and are based on nonparametric random coefficients indices. We discuss their nonparametric identification and apply these results to inference on nonlinear statistics such as the Gini index in surveys when the nonresponse is not missing at random.


title: Study of the departures from LTE in the unevolved stars infra-red spectra

abstract: We present a study of departures from Local Thermodynamic Equilibrium (LTE) in the formation of infra-red lines of Na I, Mg I, Al I, S I, K I and Sr II in unevolved stars of spectral types F,G,K and metallicities around the solar metallicity. The purpose of this investigation is to identify lines of these species that can be safely treated with the LTE approximation in the infra-red spectra of these types of stars. We employ a set of 40 stars observed with the GIANO spectrograph at the 3.5 m Telescopio Nazionale Galileo (TNG) and previously investigated by Caffau et al. We were able to identify many lines that can be treated in LTE for all the above-mentioned species, except for Sr II. The latter species can only be studied using three lines in the J-band, but all three of them display significant departures from LTE. With our small-size, but high-quality sample we can determine robustly the trends of the abundance ratios with metallicity, confirming the trends apparent from a sample that is larger by several orders of magnitude, but of lower quality in terms of resolution and S/N ratio.


title: Locally pro-p contraction groups are nilpotent

abstract: The authors have shown previously that every locally pro-p contraction group decomposes into the direct product of a p-adic analytic factor and a torsion factor. It has long been known that p-adic analytic contraction groups are nilpotent. We show here that the torsion factor is nilpotent too, and hence that every locally pro-p contraction group is nilpotent.


title: Information-Driven Path Planning for UAV with Limited Autonomy in Large-scale Field Monitoring

abstract: This paper presents a novel information-based mission planner for a drone tasked to monitor a spatially distributed dynamical phenomenon. For the sake of simplicity, the area to be monitored is discretized. The insight behind the proposed approach is that, thanks to the spatio-temporal dependencies of the observed phenomenon, one does not need to collect data on the entire area. In fact, unmeasured states can be estimated using an estimator, such as a Kalman filter. In this context the planning problem becomes the one of generating a flight path that maximizes the quality of the state estimation while satisfying the flight constraints (e.g. flight time). The first result of this paper is to formulate this problem as a special Orienteering Problem where the cost function is a measure of the quality of the estimation. This approach provides a Mixed-Integer Semi-Definite formulation to the problem which can be optimally solved for small instances. For larger instances, two heuristics are proposed which provide good sub-optimal results. To conclude, numerical simulations are shown to prove the capabilities and efficiency of the proposed path planning strategy. We believe this approach has the potential to increase dramatically the area that a drone can monitor, thus increasing the number of applications where monitoring with drones can become economically convenient.


title: High-Frequency Radar Ocean Current Mapping at Rapid Scale with Autoregressive Modeling

abstract: We use an Autoregressive (AR) approach combined with a Maximum Entropy Method (MEM) to estimate radial surface currents from coastal High-Frequency Radar (HFR) complex voltage time series. The performances of this combined AR-MEM model are investigated with synthetic HFR data and compared with the classical Doppler spectrum approach. It is shown that AR-MEM drastically improves the quality and the rate of success of the surface current estimation for short integration time. To confirm these numerical results, the same analysis is conducted with an experimental data set acquired with a 16.3 MHz HFR in Toulon. It is found that the AR-MEM technique is able to provide high-quality and high-coverage maps of surface currents even with very short integration time (about 1 minute) where the classical spectral approach can only fulfill the quality tests on a sparse coverage. Further useful application of the technique is found in the tracking of surface current at high-temporal resolution. Rapid variations of the surface current at the time scale of the minute are unveiled and shown consistent with a $f^{-5/3}$ decay of turbulent spectra.


title: A First Look at Android Applications in Google Play related to Covid-19

abstract: Due to the convenience of access-on-demand to information and business solutions, mobile apps have become an important asset in the digital world. In the context of the Covid-19 pandemic, app developers have joined the response effort in various ways by releasing apps that target different user bases (e.g., all citizens or journalists), offer different services (e.g., location tracking or diagnostic-aid), provide generic or specialized information, etc. While many apps have raised some concerns by spreading misinformation or even malware, the literature does not yet provide a clear landscape of the different apps that were developed. In this study, we focus on the Android ecosystem and investigate Covid-related Android apps. In a best-effort scenario, we attempt to systematically identify all relevant apps and study their characteristics with the objective to provide a First taxonomy of Covid-related apps, broadening the relevance beyond the implementation of contact tracing. Overall, our study yields a number of empirical insights that contribute to enlarge the knowledge on Covid-related apps: (1) Developer communities contributed rapidly to the Covid-19, with dedicated apps released as early as January 2020; (2) Covid-related apps deliver digital tools to users (e.g., health diaries), serve to broadcast information to users (e.g., spread statistics), and collect data from users (e.g., for tracing); (3) Covid-related apps are less complex than standard apps; (4) they generally do not seem to leak sensitive data; (5) in the majority of cases, Covid-related apps are released by entities with past experience on the market, mostly official government entities or public health organizations.


title: On the structure and electronic properties of Fe$_2$V$_{0.8}$W$_{0.2}$Al thin films

abstract: A very large thermoelectric figure of merit ZT = 6 at 380 K has recently been reported in Fe$_2$V$_{0.8}$W$_{0.2}$Al under thin-film form (Hinterleitner et al., Nature 576 (2019) 85). Under this form, Fe$_2$V$_{0.8}$W$_{0.2}$Al experimentally crystallizes in a disordered A2 crystal structure, different from its bulk-form structure (L21). First principles calculations of the electronic structure performed in A2-Fe$_2$V$_{0.8}$W$_{0.2}$Al supercells generated by the Special Quasi-random Structure (SQS) method are thus reported here. These calculations unambiguously indicate that A2-Fe$_2$V$_{0.8}$W$_{0.2}$Al is a ferromagnetic metal at 0 K, displaying a small Seebeck coefficient at 400 K (< 30 microV/K). The present results contradict the scenario of the occurrence of a deep pseudo-gap at the Fermi level, previously invoked to justify ZT = 6 in Fe$_2$V$_{0.8}$W$_{0.2}$Al thin films.


title: Adversarial Attacks for Multi-view Deep Models

abstract: Recent work has highlighted the vulnerability of many deep machine learning models to adversarial examples. It attracts increasing attention to adversarial attacks, which can be used to evaluate the security and robustness of models before they are deployed. However, to our best knowledge, there is no specific research on the adversarial attacks for multi-view deep models. This paper proposes two multi-view attack strategies, two-stage attack (TSA) and end-to-end attack (ETEA). With the mild assumption that the single-view model on which the target multi-view model is based is known, we first propose the TSA strategy. The main idea of TSA is to attack the multi-view model with adversarial examples generated by attacking the associated single-view model, by which state-of-the-art single-view attack methods are directly extended to the multi-view scenario. Then we further propose the ETEA strategy when the multi-view model is provided publicly. The ETEA is applied to accomplish direct attacks on the target multi-view model, where we develop three effective multi-view attack methods. Finally, based on the fact that adversarial examples generalize well among different models, this paper takes the adversarial attack on the multi-view convolutional neural network as an example to validate that the effectiveness of the proposed multi-view attacks. Extensive experimental results demonstrate that our multi-view attack strategies are capable of attacking the multi-view deep models, and we additionally find that multi-view models are more robust than single-view models.


title: Robust flow control and optimal sensor placement using deep reinforcement learning

abstract: This paper focuses on a drag-reducing control strategy on a 2D-simulated laminar flow past a cylinder. Deep reinforcement learning algorithms have been implemented to discover efficient control schemes, using two synthetic jets located on the cylinder's poles as actuators and pressure sensors in the wake of the cylinder as feedback observation. The present work focuses on the efficiency and robustness of the identified control strategy and introduces a novel algorithm (S-PPO-CMA) to optimise the sensor layout. An energy-efficient control strategy reducing drag by 18.4% at Reynolds number 120 is obtained. This control policy is shown to be robust both to the Reynolds number in the range [100,216] and to measurement noise, enduring signal to noise ratios as low as 0.2 with negligible impact on performance. Along with a systematic study on sensor number and location, the proposed sparsity-seeking algorithm has achieved a successful optimisation to a reduced 5-sensor layout while keeping state-of-the-art performance. These results highlight the interesting possibilities of reinforcement learning for active flow control and pave the way to efficient, robust and practical implementations of these control techniques in experimental or industrial systems.


title: Statistical and Algorithmic Insights for Semi-supervised Learning with Self-training

abstract: Self-training is a classical approach in semi-supervised learning which is successfully applied to a variety of machine learning problems. Self-training algorithm generates pseudo-labels for the unlabeled examples and progressively refines these pseudo-labels which hopefully coincides with the actual labels. This work provides theoretical insights into self-training algorithm with a focus on linear classifiers. We first investigate Gaussian mixture models and provide a sharp non-asymptotic finite-sample characterization of the self-training iterations. Our analysis reveals the provable benefits of rejecting samples with low confidence and demonstrates that self-training iterations gracefully improve the model accuracy even if they do get stuck in sub-optimal fixed points. We then demonstrate that regularization and class margin (i.e. separation) is provably important for the success and lack of regularization may prevent self-training from identifying the core features in the data. Finally, we discuss statistical aspects of empirical risk minimization with self-training for general distributions. We show how a purely unsupervised notion of generalization based on self-training based clustering can be formalized based on cluster margin. We then establish a connection between self-training based semi-supervision and the more general problem of learning with heterogenous data and weak supervision.


title: Towards an Adversarially Robust Normalization Approach

abstract: Batch Normalization (BatchNorm) is effective for improving the performance and accelerating the training of deep neural networks. However, it has also shown to be a cause of adversarial vulnerability, i.e., networks without it are more robust to adversarial attacks. In this paper, we investigate how BatchNorm causes this vulnerability and proposed new normalization that is robust to adversarial attacks. We first observe that adversarial images tend to shift the distribution of BatchNorm input, and this shift makes train-time estimated population statistics inaccurate. We hypothesize that these inaccurate statistics make models with BatchNorm more vulnerable to adversarial attacks. We prove our hypothesis by replacing train-time estimated statistics with statistics calculated from the inference-time batch. We found that the adversarial vulnerability of BatchNorm disappears if we use these statistics. However, without estimated batch statistics, we can not use BatchNorm in the practice if large batches of input are not available. To mitigate this, we propose Robust Normalization (RobustNorm); an adversarially robust version of BatchNorm. We experimentally show that models trained with RobustNorm perform better in adversarial settings while retaining all the benefits of BatchNorm. Code is available at \url{https://github.com/awaisrauf/RobustNorm}.