title: Deep Double-Side Learning Ensemble Model for Few-Shot Parkinson Speech Recognition

abstract: Diagnosis and therapeutic effect assessment of Parkinson disease based on voice data are very important,but its few-shot learning problem is challenging.Although deep learning is good at automatic feature extraction, it suffers from few-shot learning problem. Therefore, the general effective method is first conduct feature extraction based on prior knowledge, and then carry out feature reduction for subsequent classification. However, there are two major problems: 1) Structural information among speech features has not been mined and new features of higher quality have not been reconstructed. 2) Structural information between data samples has not been mined and new samples with higher quality have not been reconstructed. To solve these two problems, based on the existing Parkinson speech feature data set, a deep double-side learning ensemble model is designed in this paper that can reconstruct speech features and samples deeply and simultaneously. As to feature reconstruction, an embedded deep stacked group sparse auto-encoder is designed in this paper to conduct nonlinear feature transformation, so as to acquire new high-level deep features, and then the deep features are fused with original speech features by L1 regularization feature selection method. As to speech sample reconstruction, a deep sample learning algorithm is designed in this paper based on iterative mean clustering to conduct samples transformation, so as to obtain new high-level deep samples. Finally, the bagging ensemble learning mode is adopted to fuse the deep feature learning algorithm and the deep samples learning algorithm together, thereby constructing a deep double-side learning ensemble model. At the end of this paper, two representative speech datasets of Parkinson's disease were used for verification. The experimental results show that the proposed algorithm are effective.


title: Renormalization in an interpolating gauge in Yang-Mills theory

abstract: The Coulomb gauge in QCD is the only explicitly unitary gauge. But it suffers from energy-divergences which means that it is not rigorously well-defined. One way to define it unambiguously is as the limit of a gauge interpolating between the Feynman gauge and the Coulomb gauge. This interpolating gauge is characterized by a parameter theta and the Coulomb gauge is obtained in the limit theta tends to 0. We study the renormalization of this theta-gauge for all values of theta. Novel features include field mixing as well as scaling, the renormalization of the theta parameter itself, and the appearance of new counter-term structures at two-loop order.


title: In-Memory Resistive RAM Implementation of Binarized Neural Networks for Medical Applications

abstract: The advent of deep learning has considerably accelerated machine learning development. The deployment of deep neural networks at the edge is however limited by their high memory and energy consumption requirements. With new memory technology available, emerging Binarized Neural Networks (BNNs) are promising to reduce the energy impact of the forthcoming machine learning hardware generation, enabling machine learning on the edge devices and avoiding data transfer over the network. In this work, after presenting our implementation employing a hybrid CMOS - hafnium oxide resistive memory technology, we suggest strategies to apply BNNs to biomedical signals such as electrocardiography and electroencephalography, keeping accuracy level and reducing memory requirements. We investigate the memory-accuracy trade-off when binarizing whole network and binarizing solely the classifier part. We also discuss how these results translate to the edge-oriented Mobilenet~V1 neural network on the Imagenet task. The final goal of this research is to enable smart autonomous healthcare devices.


title: On the Bogoliubov theory: Casimir effect in a single weakly interacting Bose gas at zero-temperature with Neumann boundary condition

abstract: Developing Bogoliubov theory of weakly interacting Bose gas in uncompacted three-dimension space, quantum fluctuation energy of one component dilute gas of Bose-Einstein condensate (BEC) confined to two parallel plates investigated at zero-temperature in grand canonical ensemble (GCE) with Neumann boundary condition (BC). The Casimir force considered in comparison to the one with Robin BC, Dirichlet BC and periodic BC.


title: Using Fault Injection to Assess Blockchain Systems in Presence of Faulty Smart Contracts

abstract: Blockchain has become particularly popular due to its promise to support business-critical services in very different domains (e.g., retail, supply chains, healthcare). Blockchain systems rely on complex middleware, like Ethereum or Hyperledger Fabric, that allow running smart contracts, which specify business logic in cooperative applications. The presence of software defects or faults in these contracts has notably been the cause of failures, including severe security problems. In this paper, we use a software implemented fault injection (SWIFI) technique to assess the behavior of permissioned blockchain systems in the presence of faulty smart contracts. We emulate the occurrence of general software faults (e.g., missing variable initialization) and also blockchain-specific software faults (e.g., missing require statement on transaction sender) in smart contracts code to observe the impact on the overall system dependability (i.e., reliability and integrity). We also study the effectiveness of formal verification (i.e., done by solc-verify) and runtime protections (e.g., using the assert statement) mechanisms in detection of injected faults. Results indicate that formal verification as well as additional runtime protections have to complement built-in platform checks to guarantee the proper dependability of blockchain systems and applications. The work presented in this paper allows smart contract developers to become aware of possible faults in smart contracts and to understand the impact of their presence. It also provides valuable information for middleware developers to improve the behavior (e.g., overall fault tolerance) of their systems.


title: Comment on "Defining the electromagnetic potentials"

abstract: In this comment it is argued that the argument for a unique determination of the electromagnetic potentials in classical electrodynamics in [1] is flawed. To the contrary the "gauge freedom" of the electromagnetic potentials has proven as one of the most important properties in the development of modern physics, where local gauge invariance with its extension to non-Abelian gauge groups is a key feature in the formulation of the Standard Model of elementary particles in terms of a relativistic quantum field theory. [1] A. Davis, Eur. J. Phys. 41, 045202 (2020)


title: Single-Phonon Addition and Subtraction to a Mechanical Thermal State

abstract: Adding or subtracting a single quantum of excitation to a thermal state of a bosonic system has the counter-intuitive effect of approximately doubling its mean occupation. We perform the first experimental demonstration of this effect outside optics by implementing single-phonon addition and subtraction to a thermal state of a mechanical oscillator via Brillouin optomechanics in an optical whispering-gallery microresonator. Using a detection scheme that combines single-photon counting and optical heterodyne detection, we observe this doubling of the mechanical thermal fluctuations to a high precision. The capabilities of this joint click-dyne detection scheme adds a significant new dimension for optomechanical quantum science and applications.


title: Enhancing Factorization Machines with Generalized Metric Learning

abstract: Factorization Machines (FMs) are effective in incorporating side information to overcome the cold-start and data sparsity problems in recommender systems. Traditional FMs adopt the inner product to model the second-order interactions between different attributes, which are represented via feature vectors. The problem is that the inner product violates the triangle inequality property of feature vectors. As a result, it cannot well capture fine-grained attribute interactions, resulting in sub-optimal performance. Recently, the Euclidean distance is exploited in FMs to replace the inner product and has delivered better performance. However, previous FM methods including the ones equipped with the Euclidean distance all focus on the attribute-level interaction modeling, ignoring the critical intrinsic feature correlations inside attributes. Thereby, they fail to model the complex and rich interactions exhibited in the real-world data. To tackle this problem, in this paper, we propose a FM framework equipped with generalized metric learning techniques to better capture these feature correlations. In particular, based on this framework, we present a Mahalanobis distance and a deep neural network (DNN) methods, which can effectively model the linear and non-linear correlations between features, respectively. Besides, we design an efficient approach for simplifying the model functions. Experiments on several benchmark datasets demonstrate that our proposed framework outperforms several state-of-the-art baselines by a large margin. Moreover, we collect a new large-scale dataset on second-hand trading to justify the effectiveness of our method over cold-start and data sparsity problems in recommender systems.


title: Rethinking Privacy Preserving Deep Learning: How to Evaluate and Thwart Privacy Attacks

abstract: This paper investigates capabilities of Privacy-Preserving Deep Learning (PPDL) mechanisms against various forms of privacy attacks. First, we propose to quantitatively measure the trade-off between model accuracy and privacy losses incurred by reconstruction, tracing and membership attacks. Second, we formulate reconstruction attacks as solving a noisy system of linear equations, and prove that attacks are guaranteed to be defeated if condition (2) is unfulfilled. Third, based on theoretical analysis, a novel Secret Polarization Network (SPN) is proposed to thwart privacy attacks, which pose serious challenges to existing PPDL methods. Extensive experiments showed that model accuracies are improved on average by 5-20% compared with baseline mechanisms, in regimes where data privacy are satisfactorily protected.


title: Homogenization of iterated singular integrals with applications to random quasiconformal maps

abstract: We study homogenization of iterated randomized singular integrals and homeomorphic solutions to the Beltrami differential equation with a random Beltrami coefficient. More precisely, let $(F_j)_{j \geq 1}$ be a sequence of normalized homeomorphic solutions to the planar Beltrami equation $\overline{\partial} F_j (z)=\mu_j(z,\omega) \partial F_j(z),$ where the random dilatation satisfies $|\mu_j|\leq k<1$ and has locally periodic statistics, for example of the type $$\mu_j (z,\omega)=\phi(z)\sum_{n\in \mathbf{Z}^2}g(2^j z-n,X_{n}(\omega)), $$ where $g(z,\omega)$ decays rapidly in $z$, the random variables $X_{n}$ are i.i.d., and $\phi\in C^\infty_0$. We establish the almost sure and local uniform convergence as $j\to\infty$ of the maps $F_j$ to a deterministic quasiconformal limit $F_\infty$. This result is obtained as an application of our main theorem, which deals with homogenization of iterated randomized singular integrals. As a special case of our theorem, let $T_1,\ldots , T_{m}$ be translation and dilation invariant singular integrals on ${\bf R}^d, $ and consider a $d$-dimensional version of $\mu_j$, e.g., as defined above or within a more general setting. We then prove that there is a deterministic function $f$ such that almost surely as $j\to\infty$, $$ \mu_j T_{m}\mu_j\ldots T_1\mu_j\to f \quad \textrm{weakly in } L^p,\quad 1 < p < \infty\ . $$


title: Semiflexible polymer in a gliding assay: reentrant transition, role of turnover and activity

abstract: We consider a model of an extensible semiflexible filament moving in two dimensions on a motility assay of motor proteins represented explicitly as active harmonic linkers. Their heads bind stochastically to polymer segments within a capture radius, and extend along the filament in a directed fashion before detaching. Both the extension and detachment rates are load-dependent and generate an active drive on the filament. The filament undergoes a first order phase transition from open chain to spiral conformations and shows a reentrant behavior in both the active extension and the turnover, defined as the ratio of attachment-detachment rates. Associated with the phase transition, the size and shape of the polymer changes non-monotonically, and the relevant autocorrelation functions display double-exponential decay. The corresponding correlation times show a maximum signifying the dominance of spirals. The orientational dynamics captures the rotation of spirals, and its correlation time decays with activity as a power law.


title: How do SGD hyperparameters in natural training affect adversarial robustness?

abstract: Learning rate, batch size and momentum are three important hyperparameters in the SGD algorithm. It is known from the work of Jastrzebski et al. arXiv:1711.04623 that large batch size training of neural networks yields models which do not generalize well. Yao et al. arXiv:1802.08241 observe that large batch training yields models that have poor adversarial robustness. In the same paper, the authors train models with different batch sizes and compute the eigenvalues of the Hessian of loss function. They observe that as the batch size increases, the dominant eigenvalues of the Hessian become larger. They also show that both adversarial training and small-batch training leads to a drop in the dominant eigenvalues of the Hessian or lowering its spectrum. They combine adversarial training and second order information to come up with a new large-batch training algorithm and obtain robust models with good generalization. In this paper, we empirically observe the effect of the SGD hyperparameters on the accuracy and adversarial robustness of networks trained with unperturbed samples. Jastrzebski et al. considered training models with a fixed learning rate to batch size ratio. They observed that higher the ratio, better is the generalization. We observe that networks trained with constant learning rate to batch size ratio, as proposed in Jastrzebski et al., yield models which generalize well and also have almost constant adversarial robustness, independent of the batch size. We observe that momentum is more effective with varying batch sizes and a fixed learning rate than with constant learning rate to batch size ratio based SGD training.


title: Studying Attention Models in Sentiment Attitude Extraction Task

abstract: In the sentiment attitude extraction task, the aim is to identify <<attitudes>> -- sentiment relations between entities mentioned in text. In this paper, we provide a study on attention-based context encoders in the sentiment attitude extraction task. For this task, we adapt attentive context encoders of two types: (i) feature-based; (ii) self-based. Our experiments with a corpus of Russian analytical texts RuSentRel illustrate that the models trained with attentive encoders outperform ones that were trained without them and achieve 1.5-5.9% increase by F1. We also provide the analysis of attention weight distributions in dependence on the term type.


title: Packet Completion Time Minimization via Joint D2D and Cellular Communication: A Unified Network Coding Approach

abstract: This paper tackles the problem of transmitting a common content to a number of cellular users by means of instantly decodable network coding (IDNC) with the help of intermittently connected D2D links. Of particular interest are broadcasting real-time applications such as video-on-demand, where common contents may be partially received by cellular users due to packet erasures over cellular links. Specifically, we investigate the problem of packet completion time, defined as the number of transmission slots necessary to deliver a common content to all users. Drawing on graph theory, we develop an optimal packet completion time strategy by constructing a two-layer IDNC conflict graph. The higher-layer graph permits us to determine all feasible packet combinations that can be transmitted over the cellular link, while the lower-layer graph enables us to find all feasible network coded packets and identify the set of users that can generate and transmit these packets via intermittently connected D2D links. By combining the higher-layer and the lower-layer IDNC conflict graphs, we demonstrate that finding the optimal IDNC packets to minimize the packet completion time problem is equivalent to finding the maximum independent set of the two-layer IDNC conflict graph, which is known to be an NP-hard problem. We design a scheme that invokes the Bron-Kerbosch algorithm to find the optimal policy. To circumvent the high computational complexity required to reach the global optimum, we establish a polynomial-time solvable low-complexity heuristic to find an efficient sub-optimal solution. The effectiveness of our proposed scheme is verified through extensive numerical results which indicate substantial performance improvement in comparison with existing methods.


title: Knapsack Secretary with Bursty Adversary

abstract: The random-order or secretary model is one of the most popular beyond-worst case model for online algorithms. While it avoids the pessimism of the traditional adversarial model, in practice we cannot expect the input to be presented in perfectly random order. This has motivated research on ``best of both worlds'' (algorithms with good performance on both purely stochastic and purely adversarial inputs), or even better, on inputs that are a mix of both stochastic and adversarial parts. Unfortunately the latter seems much harder to achieve and very few results of this type are known. Towards advancing our understanding of designing such robust algorithms, we propose a random-order model with bursts of adversarial time steps. The assumption of burstiness of unexpected patterns is reasonable in many contexts, since changes (e.g. spike in a demand for a good) are often triggered by a common external event. We then consider the Knapsack Secretary problem in this model: there is a knapsack of size $k$ (e.g., available quantity of a good), and in each of the $n$ time steps an item comes with its value and size in $[0,1]$ and the algorithm needs to make an irrevocable decision whether to accept or reject the item. We design an algorithm that gives an approximation of $1 - \tilde{O}(\Gamma/k)$ when the adversarial time steps can be covered by $\Gamma \ge \sqrt{k}$ intervals of size $\tilde{O}(\frac{n}{k})$. In particular, setting $\Gamma = \sqrt{k}$ gives a $(1 - O(\frac{\ln^2 k}{\sqrt{k}}))$-approximation that is resistant to up to a $\frac{\ln^2 k}{\sqrt{k}}$-fraction of the items being adversarial, which is almost optimal even in the absence of adversarial items. Also, setting $\Gamma = \tilde{\Omega}(k)$ gives a constant approximation that is resistant to up to a constant fraction of items being adversarial.


title: Robust Reinforcement Learning using Least Squares Policy Iteration with Provable Performance Guarantees

abstract: This paper addresses the problem of model-free reinforcement learning for Robust Markov Decision Process (RMDP) with large state spaces. The goal of the RMDP framework is to find a policy that is robust against the parameter uncertainties due to the mismatch between the simulator model and real-world settings. We first propose the Robust Least Squares Policy Evaluation algorithm, which is a multi-step online model-free learning algorithm for policy evaluation. We prove the convergence of this algorithm using stochastic approximation techniques. We then propose Robust Least Squares Policy Iteration (RLSPI) algorithm for learning the optimal robust policy. We also give a general weighted Euclidean norm bound on the error (closeness to optimality) of the resulting policy. Finally, we demonstrate the performance of our RLSPI algorithm on some standard benchmark problems.


title: Temporal data series of COVID-19 epidemics in the USA, Asia and Europe suggests a selective sweep of SARS-CoV-2 Spike D614G variant

abstract: The COVID-19 pandemic started in Wuhan, China, and caused the worldwide spread of the RNA virus SARS-CoV-2, the causative agent of COVID-19. Because of its mutational rate, wide geographical distribution, and host response variance this coronavirus is currently evolving into an array of strains with increasing genetic diversity. Most variants apparently have neutral effects for disease spread and symptoms severity. However, in the viral Spike protein, which is responsible for host cell attachment and invasion, an emergent variant, containing the amino acid substitution D to G in position 614 (D614G), was suggested to increase viral infection capability. To test whether this variant has epidemiological impact, the temporal distributions of the SARS-CoV-2 samples bearing D or G at position 614 were compared in the USA, Asia and Europe. The epidemiological curves were compared at early and late epidemic stages. At early stages, where containment measures were still not fully implemented, the viral variants are supposed to be unconstrained and its growth curves might approximate the free viral dynamics. Our analysis shows that the D614G prevalence and the growth rates of COVID-19 epidemic curves are correlated in the USA, Asia and Europe. Our results suggest a selective sweep that can be explained, at least in part, by a propagation advantage of this variant, in other words, that the molecular level effects of D614G have sufficient impact on population transmission dynamics as to be detected by differences in rate coefficients of epidemic growth curves.


title: Speaker Independent and Multilingual/Mixlingual Speech-Driven Talking Head Generation Using Phonetic Posteriorgrams

abstract: Generating 3D speech-driven talking head has received more and more attention in recent years. Recent approaches mainly have following limitations: 1) most speaker-independent methods need handcrafted features that are time-consuming to design or unreliable; 2) there is no convincing method to support multilingual or mixlingual speech as input. In this work, we propose a novel approach using phonetic posteriorgrams (PPG). In this way, our method doesn't need hand-crafted features and is more robust to noise compared to recent approaches. Furthermore, our method can support multilingual speech as input by building a universal phoneme space. As far as we know, our model is the first to support multilingual/mixlingual speech as input with convincing results. Objective and subjective experiments have shown that our model can generate high quality animations given speech from unseen languages or speakers and be robust to noise.


title: Characterization of Quasifactors

abstract: A flow $(X,T)$ induces the flow $(2^X,T)$. Quasifactors are minimal subsystems of $(2^X, T)$ and hence orbit closures of almost periodic points for $(2^X, T)$. We study quasifactors via the almost periodic points for $(2^X,T)$.


title: Unstable Modules with the Top $k$ Squares

abstract: Unstable modules over the Steenrod algebra with only the top $k$ operations are introduced in the language of ringoids. We prove the category of such modules has homological dimension at most $k$. A pratical method, which generalizes the $\Lambda$ complex, to compute the $\mathrm{Ext}$ group from such modules to spheres is proposed. We are also able to establish several functors to relate such modules and unstable modules over the Steenrod algebra, and to describe the connections between the $\mathrm{Ext}$ groups in them.


title: Input-output framework for actuated boundary layers

abstract: This work extends the input-output approach to the study of wall-bounded shear flows manipulated using actuators common in experimental flow control studies. In particular, we adapt this powerful analytical framework to investigate the flow response to specified geometric actuation patterns (e.g., different plasma actuators) that can be applied over a range of different temporal input signals. For example, the commonly studied steady-state (time-averaged) flow response corresponds to a superposition of step responses in our modeling framework. The approach takes advantage of the linearity of the transfer function representation to construct the actuated flow field as a weighted superposition of the flow responses to point sources of varying intensity comprising the actuation model. We first validate the proposed method through comparisons with numerical and experimental studies of the time-averaged behavior of a transitional boundary layer actuated using a dielectric-barrier discharge plasma actuator operating in constricted discharge mode. The method is shown to reproduce the streamwise velocity field and the vortical structures observed downstream from the tested plasma actuator configurations. We then demonstrate that the method provides even better agreement with the steady-state response of the boundary layer subject to actuation from arrays of symmetric plasma actuators arranged in both spanwise and serpentine geometries. These results indicate the utility of this extension to the widely used input-output framework in analyzing the effects of certain actuation modalities that have shown promise in flow manipulation strategies for drag reduction. An important benefit of this analytical method is the low computational cost associated with its use in extensive parametric studies that would be cost-prohibitive using experiments or high-fidelity simulations.


title: A new benchmark problem for electromagnetic modelling of superconductors: the high-Tc superconducting dynamo

abstract: The high-Tc superconducting (HTS) dynamo is a promising device that can inject large DC supercurrents into a closed superconducting circuit. This is particularly attractive to energise HTS coils in NMR/MRI magnets and superconducting rotating machines without the need for connection to a power supply via current leads. It is only very recently that quantitatively accurate, predictive models have been developed which are capable of analysing HTS dynamos and explain their underlying physical mechanism. In this work, we propose to use the HTS dynamo as a new benchmark problem for the HTS modelling community. The benchmark geometry consists of a permanent magnet rotating past a stationary HTS coated-conductor wire in the open-circuit configuration, assuming for simplicity the 2D (infinitely long) case. Despite this geometric simplicity the solution is complex, comprising time-varying spatially-inhomogeneous currents and fields throughout the superconducting volume. In this work, this benchmark problem has been implemented using several different methods, including H-formulation-based methods, coupled H-A and T-A formulations, the Minimum Electromagnetic Entropy Production method, and integral equation and volume integral equation-based equivalent circuit methods. Each of these approaches show excellent qualitative and quantitative agreement for the open-circuit equivalent instantaneous voltage and the cumulative time-averaged equivalent voltage, as well as the current density and electric field distributions within the HTS wire at key positions during the magnet transit. A critical analysis and comparison of each of the modelling frameworks is presented, based on the following key metrics: number of mesh elements in the HTS wire, total number of mesh elements in the model, number of degrees of freedom (DOFs), tolerance settings and the approximate time taken per cycle for each model.


title: Scalable Identification of Partially Observed Systems with Certainty-Equivalent EM

abstract: System identification is a key step for model-based control, estimator design, and output prediction. This work considers the offline identification of partially observed nonlinear systems. We empirically show that the certainty-equivalent approximation to expectation-maximization can be a reliable and scalable approach for high-dimensional deterministic systems, which are common in robotics. We formulate certainty-equivalent expectation-maximization as block coordinate-ascent, and provide an efficient implementation. The algorithm is tested on a simulated system of coupled Lorenz attractors, demonstrating its ability to identify high-dimensional systems that can be intractable for particle-based approaches. Our approach is also used to identify the dynamics of an aerobatic helicopter. By augmenting the state with unobserved fluid states, a model is learned that predicts the acceleration of the helicopter better than state-of-the-art approaches. The codebase for this work is available at https://github.com/sisl/CEEM.


title: Spectral theory of dynamical systems

abstract: This is a survey on spectral theory of dynamical systems.


title: Weakly canceling operators and singular integrals

abstract: We suggest an elementary Harmonic Analysis approach to canceling and weakly canceling differential operators, which allows to extend these notions to anisotropic setting and also replace differential operators with Fourier multiplies with mild smoothness regularity. In this more general setting of anisotropic Fourier multipliers, we prove the inequality $\|f\|_{L_{\infty}} \lesssim \|Af\|_{L_1}$ if $A$ is a weakly canceling operator of order $d$ and the inequality $\|f\|_{L_2} \lesssim \|Af\|_{L_1}$ if $A$ is a canceling operator of order $\frac{d}{2}$, provided $f$ is a function in $d$ variables.


title: Comment on "Validity of path thermodynamics in reactive systems''

abstract: The paper by Malek Mansour and Garcia [Phys. Rev. E 101, 052135 (2020)] is shown to be based on misconceptions in the stochastic formulation of chemical thermodynamics in reactive systems. Their erroneous claims, asserting that entropy production cannot be correctly evaluated using path probabilities whenever the reactive system involves more than one elementary reaction leading to the same composition changes, are refuted.


title: Simulations of prominence eruption preceded with large amplitude longitudinal oscillations and draining

abstract: We present magnetohydrodynamic (MHD) simulations of the evolution from quasi-equilibrium to eruption of a prominence-forming twisted coronal flux rope under a coronal streamer. We have compared the cases with and without the formation of prominence condensations, and the case where prominence condensations form but we artificially initiate the draining of the prominence. We find that the prominence weight has a significant effect on the stability of the flux rope, and can significantly increase the loss-of-equilibrium height. The flux rope can be made to erupt earlier by initiating draining of the prominence mass. We have also performed a simulation where large amplitude longitudinal oscillations of the prominence are excited during the quasi-static phase. We find that the gravity force along the magnetic field lines is the major restoring force for the oscillations, in accordance with the ``pendulum model'', although the oscillation periods are higher (by about 10% to 40%) than estimated from the model because of the dynamic deformation of the field line dips during the oscillations. The oscillation period is also found to be slightly smaller for the lower part of the prominence in the deeper dips compared to the upper part in the shallower dips. The oscillations are quickly damped out after about 2-3 periods and are followed by prominence draining and the eventual eruption of the prominence. However we do not find a significant enhancement of the prominence draining and earlier onset of eruption with the excitation of the prominence oscillations compared to the case without.


title: Technical Note: Generating Realistic Fighting Scenes by Game Tree

abstract: Recently, there have been a lot of researches to synthesize / edit the motion of a single avatar in the virtual environment. However, there has not been so much work of simulating continuous interactions of multiple avatars such as fighting. In this paper, we propose a new method to generate a realistic fighting scene based on motion capture data. We propose a new algorithm called the temporal expansion approach which maps the continuous time action plan to a discrete causality space such that turn-based evaluation methods can be used. As a result, it is possible to use many mature algorithms available in strategy games such as the Minimax algorithm and $\alpha-\beta$ pruning. We also propose a method to generate and use an offense/defense table, which illustrates the spatial-temporal relationship of attacks and dodges, to incorporate tactical maneuvers of defense into the scene. Using our method, avatars will plan their strategies taking into account the reaction of the opponent. Fighting scenes with multiple avatars are generated to demonstrate the effectiveness of our algorithm. The proposed method can also be applied to other kinds of continuous activities that require strategy planning such as sport games.


title: Magnetic field dependent equilibration of fractional quantum Hall edge modes

abstract: Fractional conductance is measured by partitioning $\nu = 1$ edge state using gate-tunable fractional quantum Hall (FQH) liquids of filling 1/3 or 2/3 for current injection and detection. We observe two sets of FQH plateaus 1/9, 2/9, 4/9 and 1/6, 1/3, 2/3 at low and high magnetic field ends of the $\nu = 1$ plateau respectively. The findings are explained by magnetic field dependent equilibration of three FQH edge modes with conductance $e^2/3h$ arising from edge reconstruction. The results reveal remarkable enhancement of the equilibration lengths of the FQH edge modes with increasing field.


title: Bohr phenomenon for certain Subclasses of Harmonic Mappings

abstract: The Bohr phenomenon for analytic functions of the form $f(z)=\sum_{n=0}^{\infty} a_{n}z^{n}$, first introduced by Harald Bohr in 1914, deals with finding the largest radius $r_{f}$, $0<r_{f}<1$, such that the inequality $\sum_{n=0}^{\infty} |a_{n}z^{n}| \leq 1$ holds whenever the inequality $|f(z)|\leq 1 $ holds in the unit disk $\mathbb{D}=\{z \in \mathbb{C}: |z|<1\}$. The exact value of this largest radius known as Bohr radius, which has been established to be $r_{f}=1/3$. The Bohr phenomenon \cite{Abu-2010} for harmonic functions $f$ of the form $f(z)=h(z)+\overline {g(z)}$, where $h(z)=\sum_{n=0}^{\infty} a_{n}z^{n}$ and $g(z)=\sum_{n=1}^{\infty} b_{n}z^{n}$ is to find the largest radius $r_{f}$, $0<r_{f}<1$ such that $$\sum\limits_{n=1}^{\infty} (|a_{n}|+|b_{n}|) |z|^{n}\leq d(f(0),\partial f(\mathbb{D})) %\quad\mbox { for } |z|\leq r_{f}. $$ holds for $|z|\leq r_{f}$, here $d(f(0),\partial f(\mathbb{D})) $ denotes the Euclidean distance between $f(0)$ and the boundary of $f(\mathbb{D})$. In this paper, we investigate the Bohr radius for several classes of harmonic functions in the unit disk $\mathbb{D}.$


title: FaceHack: Triggering backdoored facial recognition systems using facial characteristics

abstract: Recent advances in Machine Learning (ML) have opened up new avenues for its extensive use in real-world applications. Facial recognition, specifically, is used from simple friend suggestions in social-media platforms to critical security applications for biometric validation in automated immigration at airports. Considering these scenarios, security vulnerabilities to such ML algorithms pose serious threats with severe outcomes. Recent work demonstrated that Deep Neural Networks (DNNs), typically used in facial recognition systems, are susceptible to backdoor attacks; in other words,the DNNs turn malicious in the presence of a unique trigger. Adhering to common characteristics for being unnoticeable, an ideal trigger is small, localized, and typically not a part of the main im-age. Therefore, detection mechanisms have focused on detecting these distinct trigger-based outliers statistically or through their reconstruction. In this work, we demonstrate that specific changes to facial characteristics may also be used to trigger malicious behavior in an ML model. The changes in the facial attributes maybe embedded artificially using social-media filters or introduced naturally using movements in facial muscles. By construction, our triggers are large, adaptive to the input, and spread over the entire image. We evaluate the success of the attack and validate that it does not interfere with the performance criteria of the model. We also substantiate the undetectability of our triggers by exhaustively testing them with state-of-the-art defenses.


title: $\mu \to e \gamma$ selecting scalar leptoquark solutions for the $(g-2)_{e,\mu}$ puzzles

abstract: We investigate all potentially viable scenarios that can produce the chiral enhancement required to simultaneously explain the $(g-2)_{e}$ and $(g-2)_{\mu}$ data with either a single scalar leptoquark or a pair of scalar leptoquarks. We provide classification of these scenarios in terms of their ability to satisfy the existing limits on the branching ratio for the $\mu \to e \gamma$ process. The simultaneous explanation of the $(g-2)_{e,\mu}$ discrepancies, coupled with the current experimental data, implies that the $(g-2)_e$ loops are exclusively due to the charm quark propagation whereas the $(g-2)_\mu$ loops are due to the top quark propagation. The scenarios where the $(g-2)_e$ loops are due to the top (bottom) quark propagation are, at best, approximately nine (three) orders of magnitude away from the experimental limit on the $\mu \to e \gamma$ branching ratio. All in all, there are only three particular scenarios that can pass the $\mu \to e \gamma$ test and simultaneously create large enough impact on the $(g-2)_{e,\mu}$ discrepancies when the new physics is based on the Standard Model fermion content. These are the $S_1$, $R_2$, and $S_1 \& S_3$ scenarios, where the first two are already known to be phenomenologically viable candidates with respect to all other flavor and collider data constraints. We show that the third scenario, where the right-chiral couplings to charged leptons are due to $S_1$, the left-chiral couplings to charged leptons are due to $S_3$, and the two leptoquarks mix through the Standard Model Higgs field, cannot address the $(g-2)_{e}$ and $(g-2)_{\mu}$ discrepancies at the $1\sigma$ level due to an interplay between $K_L^0 \to e^\pm \mu^\mp$, $Z \to e^+ e^-$, and $Z \to \mu^+ \mu^-$ data despite the ability of that scenario to avoid the $\mu \to e \gamma$ limit.


title: On the Moduli Space of the Octonionic Nahm's Equations

abstract: In this paper, we study some basic properties of the octonionic Nahm's equations over $[0,1]$. We prove that the moduli space of the smooth solutions to the octonionic Nahm's equations over $[0,1]$ is a star-shaped smooth manifold with a complete metric. In addition, for any commuting triples of the cotangent bundle of a complex Lie group, we construct solutions to the octonionic Nahm's equations. Moreover, we introduce extra symmetry and study a decoupled version of the octonionic Nahm's equations over $[0,1]$. We prove a Kempf-Ness theorem for the meromorphic solutions to the decoupled octonionic Nahm's equations.


title: Compact Object with a Local Dark Energy Shell

abstract: We investigate some models of compact objects in the general relativity theory with cosmological constant $\Lambda$, based on two density profiles, one of them attributed to Stewart and the other one to Durgapal and Bannerji, proposed in the literature to model "neutron stars". For them, a nonlocal equation of state with cosmological constant is obtained as a consequence of the chosen metric. In another direction, we obtain a solution for configurations with null radial pressure. The first model (based on the Stewart's density profile) turned out to be the most interesting, since surprisingly it admits the presence of dark energy in the interior of the star, in the outermost layers, for a certain range of mass-radius ratio $\gamma$. This dark energy is independent of the cosmological constant, since it is a consequence of the tangential pressure of the fluid be sufficiently negative. Still in this case, for other values of $\gamma$, all the energy conditions are satisfied. Another advantage of this model, as well as that based on the density profile of Durgapal and Bannnerji is the existence of intervals of $\gamma$ compatible with physically acceptable models for $\Lambda < 0$, $\Lambda = 0$ and $\Lambda > 0$, which also allowed us to analyze the influence of $\Lambda$ on the behavior of the fluid with respect to the energy conditions. The other configuration studied here, $P_r=0$, only allow solutions for $\Lambda<0$, in order to ensure a positive mass for the object and to satisfy all the energy conditions in a specific range of $\gamma$.


title: Defense against Adversarial Attacks in NLP via Dirichlet Neighborhood Ensemble

abstract: Despite neural networks have achieved prominent performance on many natural language processing (NLP) tasks, they are vulnerable to adversarial examples. In this paper, we propose Dirichlet Neighborhood Ensemble (DNE), a randomized smoothing method for training a robust model to defense substitution-based attacks. During training, DNE forms virtual sentences by sampling embedding vectors for each word in an input sentence from a convex hull spanned by the word and its synonyms, and it augments them with the training data. In such a way, the model is robust to adversarial attacks while maintaining the performance on the original clean data. DNE is agnostic to the network architectures and scales to large models for NLP applications. We demonstrate through extensive experimentation that our method consistently outperforms recently proposed defense methods by a significant margin across different network architectures and multiple data sets.


title: Learning and Testing Sub-groups with Heterogeneous Treatment Effects:A Sequence of Two Studies

abstract: There is strong interest in estimating how the magnitude of treatment effects of an intervention vary across sub-groups of the population of interest. In our paper, we propose a two-study approach to first propose and then test heterogeneous treatment effects. In Study 1, we use a large observational dataset to learn sub-groups with the most distinctive treatment-outcome relationships ('high/low-impact sub-groups'). We adopt a model-based recursive partitioning approach to propose the high/low impact sub-groups, and validate them by using sample-splitting. While the first study rules out noise, there is potential bias in our estimated heterogeneous treatment effects. Study 2 uses an experimental design, and here we classify our sample units based on sub-groups learned in Study 1. We then estimate treatment effects within each of the groups, thereby testing the causal hypotheses proposed in Study 1. Using patient claims data from the NBER MarketScan database, we apply our approach to estimate heterogeneous effects of a switch to a high-deductible health insurance plan on use of outpatient care by patients with a common chronic condition. We extend the method to non-parametrically learn the sub-groups in Study 1. We also compare the methods' performance to other state-of-the-art methods in the literature that make use only of the Study 2 data.


title: G2D: Generate to Detect Anomaly

abstract: In this paper, we propose a novel method for irregularity detection. Previous researches solve this problem as a One-Class Classification (OCC) task where they train a reference model on all of the available samples. Then, they consider a test sample as an anomaly if it has a diversion from the reference model. Generative Adversarial Networks (GANs) have achieved the most promising results for OCC while implementing and training such networks, especially for the OCC task, is a cumbersome and computationally expensive procedure. To cope with the mentioned challenges, we present a simple but effective method to solve the irregularity detection as a binary classification task in order to make the implementation easier along with improving the detection performance. We learn two deep neural networks (generator and discriminator) in a GAN-style setting on merely the normal samples. During training, the generator gradually becomes an expert to generate samples which are similar to the normal ones. In the training phase, when the generator fails to produce normal data (in the early stages of learning and also prior to the complete convergence), it can be considered as an irregularity generator. In this way, we simultaneously generate the irregular samples. Afterward, we train a binary classifier on the generated anomalous samples along with the normal instances in order to be capable of detecting irregularities. The proposed framework applies to different related applications of outlier and anomaly detection in images and videos, respectively. The results confirm that our proposed method is superior to the baseline and state-of-the-art solutions.


title: A Fast Stochastic Plug-and-Play ADMM for Imaging Inverse Problems

abstract: In this work we propose an efficient stochastic plug-and-play (PnP) algorithm for imaging inverse problems. The PnP stochastic gradient descent methods have been recently proposed and shown improved performance in some imaging applications over standard deterministic PnP methods. However, current stochastic PnP methods need to frequently compute the image denoisers which can be computationally expensive. To overcome this limitation, we propose a new stochastic PnP-ADMM method which is based on introducing stochastic gradient descent inner-loops within an inexact ADMM framework. We provide the theoretical guarantee on the fixed-point convergence for our algorithm under standard assumptions. Our numerical results demonstrate the effectiveness of our approach compared with state-of-the-art PnP methods.


title: Estimating Model Uncertainty of Neural Networks in Sparse Information Form

abstract: We present a sparse representation of model uncertainty for Deep Neural Networks (DNNs) where the parameter posterior is approximated with an inverse formulation of the Multivariate Normal Distribution (MND), also known as the information form. The key insight of our work is that the information matrix, i.e. the inverse of the covariance matrix tends to be sparse in its spectrum. Therefore, dimensionality reduction techniques such as low rank approximations (LRA) can be effectively exploited. To achieve this, we develop a novel sparsification algorithm and derive a cost-effective analytical sampler. As a result, we show that the information form can be scalably applied to represent model uncertainty in DNNs. Our exhaustive theoretical analysis and empirical evaluations on various benchmarks show the competitiveness of our approach over the current methods.


title: Embedding-based Retrieval in Facebook Search

abstract: Search in social networks such as Facebook poses different challenges than in classical web search: besides the query text, it is important to take into account the searcher's context to provide relevant results. Their social graph is an integral part of this context and is a unique aspect of Facebook search. While embedding-based retrieval (EBR) has been applied in eb search engines for years, Facebook search was still mainly based on a Boolean matching model. In this paper, we discuss the techniques for applying EBR to a Facebook Search system. We introduce the unified embedding framework developed to model semantic embeddings for personalized search, and the system to serve embedding-based retrieval in a typical search system based on an inverted index. We discuss various tricks and experiences on end-to-end optimization of the whole system, including ANN parameter tuning and full-stack optimization. Finally, we present our progress on two selected advanced topics about modeling. We evaluated EBR on verticals for Facebook Search with significant metrics gains observed in online A/B experiments. We believe this paper will provide useful insights and experiences to help people on developing embedding-based retrieval systems in search engines.


title: Tunable magnon-magnon coupling in synthetic antiferromagnets

abstract: In this work, we study magnon-magnon coupling in synthetic antiferromagnets (SyAFs) using microwave spectroscopy at room temperature. Two distinct spin-wave modes are clearly observed and are hybridised at degeneracy points. We provide a phenomenological model that captures the coupling phenomena and experimentally demonstrate that the coupling strength is controlled by the out-of-plane tilt angle as well as the interlayer exchange field. We numerically show that a spin-current mediated damping in SyAFs plays a role in influencing the coupling strength.


title: A Fractional $3n+1$ Conjecture

abstract: In this paper we introduce and discuss the sequence of \emph{real numbers} defined as $u_0 \in \mathbb R$ and $u_{n+1} = \Delta(u_n)$ where \begin{equation*} \Delta(x) = \begin{cases} \frac{x}{2} &\text{if } \operatorname{frac}(x)<\frac{1}{2} \\[4px] \frac{3x+1}{2} & \text{if } \operatorname{frac}(x)\geq\frac{1}{2} \end{cases} \end{equation*} This sequence is reminiscent of the famous Collatz sequence, and seems to exhibit an interesting behaviour. Indeed, we conjecture that iterating $\Delta$ will eventually either converge to zero, or loop over sequences of real numbers with integer parts $1,2,4,7,11,18,9,4,7,3,5,9,4,7,11,18,9,4,7,3,6,3,1,2,4,7,3,6,3$. We prove this conjecture for $u_0 \in [0, 100]$. Extending the proof to larger fixed values seems to be a matter of computing power. The authors pledge to offer a reward to the first person who proves or refutes the conjecture completely -- with a proof published in a serious refereed mathematical conference or journal.


title: COVID-19 in Mexico: A Network of Epidemics

abstract: Mexico, like the rest of the world, is currently facing the The COVID-19 pandemic. Given the size of its territory, the efforts to contain the disease have involved both national and regional measures. For this work, the curves of daily new cases of each municipality reported by the federal government were compared. We found that 114 municipalities form a large network of statistically dependent epidemic phenomena. Based on the network's modular structure, these 114 municipalities can be split into four distinct communities of coordinated epidemic phenomena. These clusters are not limited by geographical proximity. These findings can be helpful for public health officials for the evaluation of past strategies and the development of new directed interventions.


title: Joint Demosaicking / Rectification of Fisheye Camera Images using Multi-color Graph Laplacian Regularization

abstract: To compose a 360 image from a rig with multiple fisheye cameras, a conventional processing pipeline first performs demosaicking on each fisheye camera's Bayer-patterned grid, then translates demosaicked pixels from the camera grid to a rectified image grid---thus performing two image interpolation steps in sequence. Hence interpolation errors can accumulate, and acquisition noise in the captured pixels can pollute neighbors in two consecutive processing stages. In this paper, we propose a joint processing framework that performs demosaicking and grid-to-grid mapping simultaneously---thus limiting noise pollution to one interpolation. Specifically, we first obtain a reverse mapping function from a regular on-grid location in the rectified image to an irregular off-grid location in the camera's Bayer-patterned image. For each pair of adjacent pixels in the rectified grid, we estimate its gradient using the pair's neighboring pixel gradients in three colors in the Bayer-patterned grid. We construct a similarity graph based on the estimated gradients, and interpolate pixels in the rectified grid directly via graph Laplacian regularization (GLR). Experiments show that our joint method outperforms several competing local methods that execute demosaicking and rectification in sequence, by up to 0.52 dB in PSNR and 0.086 in SSIM on the publicly available dataset, and by up to 5.53dB in PSNR and 0.411 in SSIM on the in-house constructed dataset.


title: Dynamical invariants and quantization of the one-dimensional time-dependent, damped, and driven harmonic oscillator

abstract: In this paper, it is proposed a quantization procedure for the one-dimensional harmonic oscillator with time-dependent frequency, time-dependent driven force, and time-dependent dissipative term. The method is based on the construction of dynamical invariants previously proposed by the authors, in which fundamental importance is given to the linear invariants of the oscillator.


title: From Predictions to Decisions: Using Lookahead Regularization

abstract: Machine learning is a powerful tool for predicting human-related outcomes, from credit scores to heart attack risks. But when deployed, learned models also affect how users act in order to improve outcomes, whether predicted or real. The standard approach to learning is agnostic to induced user actions and provides no guarantees as to the effect of actions. We provide a framework for learning predictors that are both accurate and promote good actions. For this, we introduce look-ahead regularization which, by anticipating user actions, encourages predictive models to also induce actions that improve outcomes. This regularization carefully tailors the uncertainty estimates governing confidence in this improvement to the distribution of model-induced actions. We report the results of experiments on real and synthetic data that show the effectiveness of this approach.


title: Dynamic Symbolic Execution of Higher-Order Functions

abstract: The effectiveness of concolic testing deteriorates as the size of programs increases. A promising way out is to test programs modularly, e.g., on a per function or class basis. Alas, this idea hits a roadblock in modern programming languages In modern languages, components expect functions, objects, and even classes as inputs. The crux of the problem is that existing concolic testing techniques cannot faithfully capture the complex interactions between a higher-order program and its inputs in order to distill it in a first-order formula that an SMT solver can work with. In this paper, we take the first step towards solving the problem; we offer a design, semantics, and prototype for concolic testing of higher-order functions. Inspired by work on higher-order symbolic execution, our model constructs inputs for higher-order functions with a canonical shape. This enables the concolic tester to keep track of which pieces of the control-flow path of the higher-order function depend on the shape of its input and which do not. The concolic tester encodes the pieces that do not depend on the shape of the input as a first-order formula. Subsequently, similar to a first-order concolic tester, it leverages an SMT solver to produce another input with the same shape but that explores a different control-flow path of the higher-order function. As a separate dimension, the concolic tester iteratively explores the canonical shapes for the input and, investigating all the ways a higher-order function can interact with its input, searching for bugs. To validate our design, we prove that if a higher-order function has a bug, our concolic tester will eventually construct an input that triggers the bug. Using our design as a blueprint, we implement a prototype concolic tester and confirm that it discovers bugs in a variety of higher-order programs from the literature.


title: Indivisibility of Heegner cycles over Shimura curves and Selmer groups

abstract: In this article, we show that the Abel-Jacobi images of the Heegner cycles over the Shimura curves constructed by Nekovar, Besser and the theta elements contructed by Chida-Hsieh form a bipartite Euler system in the sense of Howard. As an application of this, we deduce a converse to Gross-Zagier-Kolyvagin type theorem for higher weight modular forms generalizing works of Wei Zhang and Skinner for modular forms of weight two. That is, we show that if the rank of certain residual Selmer group is one, then the Abel-Jacobi image of the Heegner cycle is non-zero in the residual Selmer group.


title: Bayesian Updating and Sequential Testing: Overcoming Inferential Limitations of Screening Tests

abstract: Bayes' Theorem confers inherent limitations on the accuracy of screening tests as a function of disease prevalence. We have shown in previous work that a testing system can tolerate significant drops in prevalence, up until a certain well-defined point known as the $prevalence$ $threshold$, below which the reliability of a positive screening test drops precipitously. Herein, we establish a mathematical model to determine whether sequential testing overcomes the aforementioned Bayesian limitations and thus improves the reliability of screening tests. We show that for a desired positive predictive value of $\rho$ that approaches $k$, the number of positive test iterations $n_i$ needed is: $ n_i =\lim_{\rho \to k}\left\lceil\frac{ln\left[\frac{\rho(\phi-1)}{\phi(\rho-1)}\right]}{ln\left[\frac{a}{1-b}\right]}\right\rceil$ where $n_i$ = number of testing iterations necessary to achieve $\rho$, the desired positive predictive value, a = sensitivity, b = specificity, $\phi$ = disease prevalence and $k$ = constant. Based on the aforementioned derivation, we provide reference tables for the number of test iterations needed to obtain a $\rho(\phi)$ of 50, 75, 95 and 99$\%$ as a function of various levels of sensitivity, specificity and disease prevalence.


title: MDR Cluster-Debias: A Nonlinear WordEmbedding Debiasing Pipeline

abstract: Existing methods for debiasing word embeddings often do so only superficially, in that words that are stereotypically associated with, e.g., a particular gender in the original embedding space can still be clustered together in the debiased space. However, there has yet to be a study that explores why this residual clustering exists, and how it might be addressed. The present work fills this gap. We identify two potential reasons for which residual bias exists and develop a new pipeline, MDR Cluster-Debias, to mitigate this bias. We explore the strengths and weaknesses of our method, finding that it significantly outperforms other existing debiasing approaches on a variety of upstream bias tests but achieves limited improvement on decreasing gender bias in a downstream task. This indicates that word embeddings encode gender bias in still other ways, not necessarily captured by upstream tests.


title: BRUL\`E: Barycenter-Regularized Unsupervised Landmark Extraction

abstract: Unsupervised retrieval of image features is vital for many computer vision tasks where the annotation is missing or scarce. In this work, we propose a new unsupervised approach to detect the landmarks in images, validating it on the popular task of human face key-points extraction. The method is based on the idea of auto-encoding the wanted landmarks in the latent space while discarding the non-essential information (and effectively preserving the interpretability). The interpretable latent space representation (the bottleneck containing nothing but the wanted key-points) is achieved by a new two-step regularization approach. The first regularization step evaluates transport distance from a given set of landmarks to some average value (the barycenter by Wasserstein distance). The second regularization step controls deviations from the barycenter by applying random geometric deformations synchronously to the initial image and to the encoded landmarks. We demonstrate the effectiveness of the approach both in unsupervised and semi-supervised training scenarios using 300-W, CelebA, and MAFL datasets. The proposed regularization paradigm is shown to prevent overfitting, and the detection quality is shown to improve beyond the state-of-the-art face models.


title: The defect of toral Laplace eigenfunctions and Arithmetic Random Waves

abstract: We study the defect (or "signed area") distribution of toral Laplace eigenfunctions restricted to shrinking balls of radius above the Planck scale, in either random Gaussian scenario ("Arithmetic Random Waves"), or deterministic eigenfunctions averaged w.r.t. the spatial variable. In either scenario we exploit the associated symmetry of the eigenfunctions to show that the expectation (Gaussian or spatial) vanishes. Our principal results concern the high energy limit behaviour of the defect variance.


title: Accelerating Safe Reinforcement Learning with Constraint-mismatched Policies

abstract: We consider the problem of reinforcement learning when provided with (1) a baseline control policy and (2) a set of constraints that the learner must satisfy. The baseline policy can arise from demonstration data or a teacher agent and may provide useful cues for learning, but it might also be sub-optimal for the task at hand, and is not guaranteed to satisfy the specified constraints, which might encode safety, fairness or other application-specific requirements. In order to safely learn from baseline policies, we propose an iterative policy optimization algorithm that alternates between maximizing expected return on the task, minimizing distance to the baseline policy, and projecting the policy onto the constraint-satisfying set. We analyze our algorithm theoretically and provide a finite-time convergence guarantee. In our experiments on five different control tasks, our algorithm consistently outperforms several state-of-the-art baselines, achieving 10 times fewer constraint violations and 40% higher reward on average.


title: The Importance of Category Labels in Grammar Induction with Child-directed Utterances

abstract: Recent progress in grammar induction has shown that grammar induction is possible without explicit assumptions of language-specific knowledge. However, evaluation of induced grammars usually has ignored phrasal labels, an essential part of a grammar. Experiments in this work using a labeled evaluation metric, RH, show that linguistically motivated predictions about grammar sparsity and use of categories can only be revealed through labeled evaluation. Furthermore, depth-bounding as an implementation of human memory constraints in grammar inducers is still effective with labeled evaluation on multilingual transcribed child-directed utterances.


title: An Optimal Elimination Algorithm for Learning a Best Arm

abstract: We consider the classic problem of $(\epsilon,\delta)$-PAC learning a best arm where the goal is to identify with confidence $1-\delta$ an arm whose mean is an $\epsilon$-approximation to that of the highest mean arm in a multi-armed bandit setting. This problem is one of the most fundamental problems in statistics and learning theory, yet somewhat surprisingly its worst-case sample complexity is not well understood. In this paper, we propose a new approach for $(\epsilon,\delta)$-PAC learning a best arm. This approach leads to an algorithm whose sample complexity converges to \emph{exactly} the optimal sample complexity of $(\epsilon,\delta)$-learning the mean of $n$ arms separately and we complement this result with a conditional matching lower bound. More specifically:


title: Training (Overparametrized) Neural Networks in Near-Linear Time

abstract: The slow convergence rate and pathological curvature issues of first-order gradient methods for training deep neural networks, initiated an ongoing effort for developing faster $\mathit{second}$-$\mathit{order}$ optimization algorithms beyond SGD, without compromising the generalization error. Despite their remarkable convergence rate ($\mathit{independent}$ of the training batch size $n$), second-order algorithms incur a daunting slowdown in the $\mathit{cost}$ $\mathit{per}$ $\mathit{iteration}$ (inverting the Hessian matrix of the loss function), which renders them impractical. Very recently, this computational overhead was mitigated by the works of [ZMG19,CGH+19}, yielding an $O(mn^2)$-time second-order algorithm for training two-layer overparametrized neural networks of polynomial width $m$. We show how to speed up the algorithm of [CGH+19], achieving an $\tilde{O}(mn)$-time backpropagation algorithm for training (mildly overparametrized) ReLU networks, which is near-linear in the dimension ($mn$) of the full gradient (Jacobian) matrix. The centerpiece of our algorithm is to reformulate the Gauss-Newton iteration as an $\ell_2$-regression problem, and then use a Fast-JL type dimension reduction to $\mathit{precondition}$ the underlying Gram matrix in time independent of $M$, allowing to find a sufficiently good approximate solution via $\mathit{first}$-$\mathit{order}$ conjugate gradient. Our result provides a proof-of-concept that advanced machinery from randomized linear algebra -- which led to recent breakthroughs in $\mathit{convex}$ $\mathit{optimization}$ (ERM, LPs, Regression) -- can be carried over to the realm of deep learning as well.


title: On the initiation and sustenance of flow-induced vibration of cylinders: insights from force partitioning

abstract: The focus of this work is to dissect the physical mechanisms that drive and sustain flow-induced, transverse vibrations of cylinders. The influence of different mechanisms is quantified by using a method to partition the fluid dynamic force on the cylinder into distinct, physically relevant components. In conjunction with this force partitioning, calculations of the energy extracted by the oscillating body from the flow are used to make a direct connection between the phenomena responsible for force generation and their effect on driving flow-induced oscillations. These tools are demonstrated in a study of the effect of cylinder shape on flow-induced vibrations. Relatively small increases in cylinder aspect-ratio are found to have a significant influence on the amplitude of oscillation, resulting in a large drop in oscillation amplitude at reduced velocities that correspond to the upper range of the synchronization regime. By mapping out the energy transfer between the fluid and structure as a function of aspect-ratio, we identify the existence of a low-amplitude stationary state as the cause of the drop in amplitude. Partitioning the fluid dynamic forces on cylinders of varying aspect-ratio then allows us to uncover the physical mechanisms behind the appearance of the underlying bifurcation. The analysis also suggests that while vortex shedding in the wake is necessary to initiate oscillations, it is the vorticity associated with the boundary layer over the cylinder that is responsible for the sustenance of flow-induced vibrations.


title: On the Theory of Transfer Learning: The Importance of Task Diversity

abstract: We provide new statistical guarantees for transfer learning via representation learning--when transfer is achieved by learning a feature representation shared across different tasks. This enables learning on new tasks using far less data than is required to learn them in isolation. Formally, we consider $t+1$ tasks parameterized by functions of the form $f_j \circ h$ in a general function class $\mathcal{F} \circ \mathcal{H}$, where each $f_j$ is a task-specific function in $\mathcal{F}$ and $h$ is the shared representation in $\mathcal{H}$. Letting $C(\cdot)$ denote the complexity measure of the function class, we show that for diverse training tasks (1) the sample complexity needed to learn the shared representation across the first $t$ training tasks scales as $C(\mathcal{H}) + t C(\mathcal{F})$, despite no explicit access to a signal from the feature representation and (2) with an accurate estimate of the representation, the sample complexity needed to learn a new task scales only with $C(\mathcal{F})$. Our results depend upon a new general notion of task diversity--applicable to models with general tasks, features, and losses--as well as a novel chain rule for Gaussian complexities. Finally, we exhibit the utility of our general framework in several models of importance in the literature.


title: Necessity of ventilation for mitigating virus transmission quantified simply

abstract: To mitigate the SARS-CoV-2 pandemic, officials have employed social distancing and stay-at-home measures, with increased attention to room ventilation emerging only more recently. Effective distancing practices for open spaces can be ineffective for poorly ventilated spaces, both of which are commonly filled with turbulent air. This is typical for indoor spaces that use mixing ventilation. While turbulence initially reduces the risk of infection near a virion-source, it eventually increases the exposure risk for all occupants in a space without ventilation. To complement detailed models aimed at precision, minimalist frameworks are useful to facilitate order of magnitude estimates for how much ventilation provides safety, particularly when circumstances require practical decisions with limited options. Applying basic principles of transport and diffusion, we estimate the time-scale for virions injected into a room of turbulent air to infect an occupant, distinguishing cases of low vs. high initial virion mass loads and virion-destroying vs. virion-reflecting walls. We consider the effect of an open window as a proxy for ventilation. When the airflow is dominated by isotropic turbulence, the minimum area needed to ensure safety depends only on the ratio of total viral load to threshold load for infection. The minimalist estimates here convey simply that the equivalent of ventilation by modest sized open window in classrooms and workplaces significantly improves safety.

categories: physics.soc-ph nlin.CD physics.ao-ph physics.flu-dyn


title: A numerical framework for elastic surface matching, comparison, and interpolation

abstract: Surface comparison and matching is a challenging problem in computer vision. While reparametrization-invariant Sobolev metrics provide meaningful elastic distances and point correspondences via the geodesic boundary value problem, solving this problem numerically tends to be difficult. Square root normal fields (SRNF) considerably simplify the computation of certain elastic distances between parametrized surfaces. Yet they leave open the issue of finding optimal reparametrizations, which induce elastic distances between unparametrized surfaces. This issue has concentrated much effort in recent years and led to the development of several numerical frameworks. In this paper, we take an alternative approach which bypasses the direct estimation of reparametrizations: we relax the geodesic boundary constraint using an auxiliary parametrization-blind varifold fidelity metric. This reformulation has several notable benefits. By avoiding altogether the need for reparametrizations, it provides the flexibility to deal with simplicial meshes of arbitrary topologies and sampling patterns. Moreover, the problem lends itself to a coarse-to-fine multi-resolution implementation, which makes the algorithm scalable to large meshes. Furthermore, this approach extends readily to higher-order feature maps such as square root curvature fields and is also able to include surface textures in the matching problem. We demonstrate these advantages on several examples, synthetic and real.


title: Towards Understanding Label Smoothing

abstract: Label smoothing regularization (LSR) has a great success in training deep neural networks by stochastic algorithms such as stochastic gradient descent and its variants. However, the theoretical understanding of its power from the view of optimization is still rare. This study opens the door to a deep understanding of LSR by initiating the analysis. In this paper, we analyze the convergence behaviors of stochastic gradient descent with label smoothing regularization for solving non-convex problems and show that an appropriate LSR can help to speed up the convergence by reducing the variance. More interestingly, we proposed a simple yet effective strategy, namely Two-Stage LAbel smoothing algorithm (TSLA), that uses LSR in the early training epochs and drops it off in the later training epochs. We observe from the improved convergence result of TSLA that it benefits from LSR in the first stage and essentially converges faster in the second stage. To the best of our knowledge, this is the first work for understanding the power of LSR via establishing convergence complexity of stochastic methods with LSR in non-convex optimization. We empirically demonstrate the effectiveness of the proposed method in comparison with baselines on training ResNet models over benchmark data sets.


title: Counterfactually Guided Off-policy Transfer in Clinical Settings

abstract: Domain shift, encountered when using a trained model for a new patient population, creates significant challenges for sequential decision making in healthcare since the target domain may be both data-scarce and confounded. In this paper, we propose a method for off-policy transfer by modeling the underlying generative process with a causal mechanism. We use informative priors from the source domain to augment counterfactual trajectories in the target in a principled manner. We demonstrate how this addresses data-scarcity in the presence of unobserved confounding. The causal parametrization of our sampling procedure guarantees that counterfactual quantities can be estimated from scarce observational target data, maintaining intuitive stability properties. Policy learning in the target domain is further regularized via the source policy through KL-divergence. Through evaluation on a simulated sepsis treatment task, our counterfactual policy transfer procedure significantly improves the performance of a learned treatment policy when assumptions of "no-unobserved confounding" are relaxed.


title: A Novel Method for ECG Signal Classification via One-Dimensional Convolutional Neural Network

abstract: This paper presents an end-to-end ECG signal classification method based on a novel segmentation strategy via 1D Convolutional Neural Networks (CNN) to aid the classification of ECG signals. The ECG segmentation strategy named R-R-R strategy (i.e., retaining ECG data between the R peaks just before and after the current R peak) for segmenting the original ECG data into segments in order to train and test the 1D CNN models. The novel strategy mimics physicians in scanning ECG to a greater extent, and maximizes the inherent information of ECG segments. The performance of the classification models for 5-class and 6-class are verified with ECG signals from 48 records of the MIT-BIH arrhythmia database. As the heartbeat types are divided into 5 classes (i.e., normal beat, left bundle branch block beat, right bundle branch block beat, ventricular ectopic beat, and paced beat) in the MIT-BIH, the best classification accuracy, the area under the curve (AUC), the sensitivity and the F1-score reach 99.24%, 0.9994, 0.99 and 0.99, respectively. As the heartbeat types are divided into 6 classes (i.e., normal beat, left bundle branch block beat, right bundle branch block beat, ventricular ectopic beat, paced beat and other beats) in the MIT-BIH, the beat classification accuracy, the AUC, the sensitivity, and the F1-score reach 97.02%, 0.9966, 0.97, and 0.97, respectively. Meanwhile, according to the recommended practice from the Association for Advancement of Medical Instrumentation (AAMI), the heartbeat types are divided into 5 classes (i.e., normal beat, supraventricular ectopic beats, ventricular ectopic beats, fusion beats, and unclassifiable beats), the beat classification accuracy, the sensitivity, and the F1-score reach 97.45%, 0.97, and 0.97, respectively. The experimental results show that the proposed method achieves better performance than the state-of-the-art methods.


title: For the Thrill of it All: A bridge among Linux, Robot Operating System, Android and Unmanned Aerial Vehicles

abstract: Civilian Unmanned Aerial Vehicles (UAVs) are becoming more accessible for domestic use. Currently, UAV manufacturer DJI dominates the market, and their drones have been used for a wide range of applications. Model lines such as the Phantom can be applied for autonomous navigation where Global Positioning System (GPS) signals are not reliable, with the aid of Simultaneous Localization and Mapping (SLAM), such as monocular Visual SLAM. In this work, we propose a bridge among different systems, such as Linux, Robot Operating System (ROS), Android, and UAVs as an open-source framework, where the gimbal camera recording can be streamed to a remote server, supporting the implementation of an autopilot. Finally, we present some experimental results showing the performance of the video streaming validating the framework.


title: Securing Smart Home Edge Devices against Compromised Cloud Servers

abstract: Smart home IoT systems often rely on cloud-based servers for communication between components. Although there exists a body of work on IoT security, most of it focuses on securing clients (i.e., IoT devices). However, cloud servers can also be compromised. Existing approaches do not typically protect smart home systems against compromised cloud servers. This paper presents FIDELIUS: a runtime system for secure cloud-based storage and communication even in the presence of compromised servers. FIDELIUS's design is tailored for smart home systems that have intermittent Internet access. In particular, it supports local control of smart home devices in the event that communication with the cloud is lost, and provides a consistency model using transactions to mitigate inconsistencies that can arise due to network partitions. We have implemented FIDELIUS, developed a smart home benchmark that uses FIDELIUS, and measured FIDELIUS's performance and power consumption. Our experiments show that compared to the commercial Particle.io framework, FIDELIUS reduces more than 50% of the data communication time and increases battery life by 2X. Compared to PyORAM, an alternative (ORAM-based) oblivious storage implementation, FIDELIUS has 4-7X faster access times with 25-43X less data transferred.


title: Adversarial Transfer of Pose Estimation Regression

abstract: We address the problem of camera pose estimation in visual localization. Current regression-based methods for pose estimation are trained and evaluated scene-wise. They depend on the coordinate frame of the training dataset and show a low generalization across scenes and datasets. We identify the dataset shift an important barrier to generalization and consider transfer learning as an alternative way towards a better reuse of pose estimation models. We revise domain adaptation techniques for classification and extend them to camera pose estimation, which is a multi-regression task. We develop a deep adaptation network for learning scene-invariant image representations and use adversarial learning to generate such representations for model transfer. We enrich the network with self-supervised learning and use the adaptability theory to validate the existence of scene-invariant representation of images in two given scenes. We evaluate our network on two public datasets, Cambridge Landmarks and 7Scene, demonstrate its superiority over several baselines and compare to the state of the art methods.


title: Complexity of actions over perfect fields

abstract: Let $G$ be a connected reductive group over a perfect field $k$ acting on an algebraic variety $X$ and let $P$ be a minimal parabolic subgroup of $G$. For $k$-spherical $G$-varieties we prove finiteness result for $P$-orbits that contain $k$-points. This is a consequence of an equality on $P$-complexities of $X$ and of any $P$-invariant $k$-dense subvariety in $X$, which generalizes a corresponding result of E.B.Vinberg in the case of algebraically closed field $k$. Also we introduce an action of the restricted Weyl group $W$ on the set of $k$-dense $P$-invariant closed subvarieties of $X$ of maximal $P$-complexity and $k$-rank in the case of ${\rm char}\ k =0$ and on the set of all $k$-dense $P$-orbits in the case of real spherical variety which generalizes the action on $B$-orbits introduced by F.Knop in the algebraically closed field case. We also introduce a little Weyl group related with this action and describe its generators in terms of the generators of $W$ which generalize the description of M.Brion in algebraically closed field case.


title: Finite groups with some restriction on the vanishing set

abstract: Let $ x $ be an element of a finite group $ G $ and denote the order of $ x $ by $ \mathrm{ord}(x) $. We consider a finite group $ G $ such that $ \gcd(\mathrm{ord}(x),\mathrm{ord}(y))\leqslant 2 $ for any two vanishing elements $ x $ and $ y $ contained in distinct conjugacy classes. We show that such a group $ G $ is solvable. When $ G $ with the property above is supersolvable, we show that $ G $ has a normal metabelian $ 2 $-complement.


title: Nondestructive femtosecond laser lithography of Ni nanocavities by controlled thermo-mechanical spallation at the nanoscale

abstract: We present a new approach to femtosecond direct laser writing lithography to pattern nanocavities in ferromagnetic thin films. To demonstrate the concept we irradiated 300~nm thin nickel films by single intense femtosecond laser pulses through the glass substrate and created complex surface landscapes at the nickel-air interface. Using a fluence above the ablation threshold the process is destructive and irradiation leads to the formation of 200~nm thin flakes of nickel around the ablation crater as seen by electron microscopy. By progressively lowering the peak laser fluence, slightly below the ablation threshold the formation of closed spallation cavities is demonstrated by interferometric microscopy. Systematic studies by electron and optical interferometric microscopies enabled us to gain an understanding of the thermo-mechanical mechanism leading to spallation at the solid-molten interface, a conclusion supported by molecular dynamics simulations. We achieved a control of the spallation process that enabled the fabrication of closed spallation nanocavities and their periodic arrangements. Due to their topology closed magnetic nanocavities can support unique couplings of multiple excitations (magnetic, optical, acoustic, spintronic). Thereby, they offer a unique physics playground, before unavailable, for magnetism, magneto-photonic and magneto-acoustic applications.

categories: cond-mat.mtrl-sci cond-mat.mes-hall physics.app-ph physics.optics


title: On the Divergence of Decentralized Non-Convex Optimization

abstract: We study a generic class of decentralized algorithms in which $N$ agents jointly optimize the non-convex objective $f(u):=1/N\sum_{i=1}^{N}f_i(u)$, while only communicating with their neighbors. This class of problems has become popular in modeling many signal processing and machine learning applications, and many efficient algorithms have been proposed. However, by constructing some counter-examples, we show that when certain local Lipschitz conditions (LLC) on the local function gradient $\nabla f_i$'s are not satisfied, most of the existing decentralized algorithms diverge, even if the global Lipschitz condition (GLC) is satisfied, where the sum function $f$ has Lipschitz gradient. This observation raises an important open question: How to design decentralized algorithms when the LLC, or even the GLC, is not satisfied? To address the above question, we design a first-order algorithm called Multi-stage gradient tracking algorithm (MAGENTA), which is capable of computing stationary solutions with neither the LLC nor the GLC. In particular, we show that the proposed algorithm converges sublinearly to certain $\epsilon$-stationary solution, where the precise rate depends on various algorithmic and problem parameters. In particular, if the local function $f_i$'s are $Q$th order polynomials, then the rate becomes $\mathcal{O}(1/\epsilon^{Q-1})$. Such a rate is tight for the special case of $Q=2$ where each $f_i$ satisfies LLC. To our knowledge, this is the first attempt that studies decentralized non-convex optimization problems with neither the LLC nor the GLC.


title: A note on fitting a generalized Moody diagram for wall modeled Large Eddy Simulations

abstract: Motivated by the needs of wall modeled Large Eddy Simulation (LES), we introduce fits to numerical solutions of the Reynolds Averaged Navier-Stokes equations in their simplest near-wall, boundary layer approximation including a mixing-length model. We formulate the problem such that independent dimensionless variables are those directly available in LES. We provide practical fits for the dependent variable, fits that encompass a smooth transition between the viscous sublayer and inertial logarithmic layer, and then progress first considering moderate pressure gradients as well as roughness effects under the assumption that the mixing-length is not affected by the pressure gradient. An alternative fit based on the empirical wall model of Nickels (J. Fluid Mech. vol.512, pp. 217-239, 2004) is also provided, taking into account possible effects of pressure gradient on turbulence near-wall structure. We then consider the case of general pressure gradients, both favorable and adverse, up to conditions of separation, for both smooth and rough surfaces. The proposed fitting functions constitute a generalized Moody chart, comply with analytical solutions valid in various asymptotic regimes, and obviate the need for numerical iterative solution methods or near-wall numerical integration of ordinary differential equations during LES.


title: Spatial Variations in the Physico-chemical Variables and Macrobenthic Invertebrate Assemblage of a Tropical River in Nigeria

abstract: The spatial variation in the physico-chemical variables and macrobenthic invertebrates assemblage of a stretch of Ethiope River, Nigeria were evaluated for 6 months at five study stations. The results showed that temperature, dissolved oxygen and bicarbonates were similar across the study stations. The highest values of conductivity and total dissolved solids were recorded at station 1. The physico-chemical variables showed no significant different (P < 0.05) in the study stations. The abundance of the macrobenthic invertebrates comprises 61 taxa in 34 families, and the highest and least values occurred at stations 3 and 1 respectively. The Diptera which accounted for 52.77% of the overall abundance was the dominant group encountered, while the Decapoda (10.97%) which was prevalent in station 1 and the Ephemeroptera (8.05%) which was common in stations 2, 3 and 4 constituted the subdominant group. Over 68% of the oligochaetes recorded were restricted to station 3 except Dero limnosa and Nais sp that occurred in all the study stations. The overall abundance of the macrobenthic invertebrates was not significantly different (p < 0.05) among the study stations. Based on the canonical correspondence analyses, total dissolved solids, biochemical oxygen demand, bicarbonates and pH influenced the macrobenthic invertebrate assemblage. The study stretch of Ethiope River was reasonably free from gross pollution as indicated by the presence of Ephemeroptera, Tricoptera, Odonata and Decapoda at the study sites. However, there were indications of organic contamination as shown by the preponderance of naidid oligochaetes and certain dipteran species including the chironomids. This study revealed a high diversity of macrobenthic invertebrates, and this was attributed to the relative spatial homogeneity of the physico-chemical variables recorded at the study stations.


title: A Stackelberg Security Investment Game for Voltage Stability of Power Systems

abstract: We formulate a Stackelberg game between an attacker and a defender of a power system. The attacker attempts to alter the load setpoints of the power system covertly and intelligently, so that the voltage stability margin of the grid is reduced, driving the entire system towards a voltage collapse. The defender, or the system operator, aims to compensate for this reduction by retuning the reactive power injection to the grid by switching on control devices, such as a bank of shunt capacitors. A modified Backward Induction method is proposed to find a cost-based Stackelberg equilibrium (CBSE) of the game, which saves the players' costs while providing the optimal allocation of both players' investment resources under budget and covertness constraints. We analyze the proposed game extensively for the IEEE 9-bus power system model and present an example of its performance for the IEEE 39-bus power system model. It is demonstrated that the defender is able to maintain system stability unless its security budget is much lower than the attacker's budget.


title: Exact Partitioning of High-order Planted Models with a Tensor Nuclear Norm Constraint

abstract: We study the problem of efficient exact partitioning of the hypergraphs generated by high-order planted models. A high-order planted model assumes some underlying cluster structures, and simulates high-order interactions by placing hyperedges among nodes. Example models include the disjoint hypercliques, the densest subhypergraphs, and the hypergraph stochastic block models. We show that exact partitioning of high-order planted models (a NP-hard problem in general) is achievable through solving a computationally efficient convex optimization problem with a tensor nuclear norm constraint. Our analysis provides the conditions for our approach to succeed on recovering the true underlying cluster structures, with high probability.


title: Emulating UAV Motion by Utilizing Robotic Arm for mmWave Wireless Channel Characterization

abstract: In this paper, millimeter wave (mmWave) wireless channel characteristics (Doppler spread and path loss modeling) for Unmanned Aerial Vehicles (UAVs) assisted communication is analyzed and studied by emulating the real UAV motion using a robotic arm. The motion considers the actual turbulence caused by the wind gusts to the UAV in the atmosphere, which is statistically modeled by the widely used Dryden wind model. The frequency under consideration is 28 GHz in an anechoic chamber setting. A total of 11 distance points from 3.5 feet to 23.5 feet in increments of 2 feet were considered in this experiment. At each distance point, 3 samples of data were collected for better inference purposes. In this emulated environment, it was found out that the average Doppler spread at these different distances was around -20 Hz and +20 Hz at the noise floor of -60 dB. On the other hand, the path loss exponent was found to be 1.843. This study presents and lays out a novel framework of emulating UAV motion for mmWave communication systems, which will pave the way out for future design and implementation of next generation UAV-assisted wireless communication systems.


title: Illuminating Invisible Grain Boundaries in Coalesced Single-Orientation WS2 Monolayer Films

abstract: Engineering atomic-scale defects is crucial for realizing wafer-scale, single-crystalline transition metal dichalcogenide monolayers for electronic devices. However, connecting atomic-scale defects to larger morphologies poses a significant challenge. Using electron microscopy and atomistic simulations, we provide insights into WS2 crystal growth mechanisms, providing a direct link between synthetic conditions and the microstructure. Dark-field TEM imaging of coalesced monolayer WS2 films illuminates defect arrays that atomic-resolution STEM imaging identifies as translational grain boundaries. Imaging reveals the films to have nearly a single orientation with imperfectly stitched domains. Through atomic-resolution imaging and ReaxFF reactive force field-based molecular dynamics simulations, we observe two types of translational mismatch and discuss their atomic structures and origin. Our results indicate that the mismatch results from relatively fast growth rates. Through statistical analysis of >1300 facets, we demonstrate that the macrostructural features are constructed from nanometer-scale building blocks, describing the system across sub-{\AA}ngstrom to multi-micrometer length scales.


title: fault: A Python Embedded Domain-Specific Language For Metaprogramming Portable Hardware Verification Components

abstract: While hardware generators have drastically improved design productivity, they have introduced new challenges for the task of verification. To effectively cover the functionality of a sophisticated generator, verification engineers require tools that provide the flexibility of metaprogramming. However, flexibility alone is not enough; components must also be portable in order to encourage the proliferation of verification libraries as well as enable new methodologies. This paper introduces fault, a Python embedded hardware verification language that aims to empower design teams to realize the full potential of generators.


title: Affordable Modular Autonomous Vehicle Development Platform

abstract: Road accidents are estimated to be the ninth leading cause of death across all age groups globally. 1.25 million people die annually from road accidents and Africa has the highest rate of road fatalities [1]. Research shows that three out of five road accidents are caused by driver-related behavioral factors [2]. Self-driving technology has the potential of saving lives lost to these preventable road accidents. Africa accounts for the majority of road fatalities and as such would benefit immensely from this technology. However, financial constraints prevent viable experimentation and research into self-driving technology in Africa. This paper describes the design of RollE, an affordable modular autonomous vehicle development platform. It is capable of driving via remote control for data collection and also capable of autonomous driving using a convolutional neural network. This system is aimed at providing students and researchers with an affordable autonomous vehicle to develop and test self-driving car technology.


title: Collective Learning by Ensembles of Altruistic Diversifying Neural Networks

abstract: Combining the predictions of collections of neural networks often outperforms the best single network. Such ensembles are typically trained independently, and their superior `wisdom of the crowd' originates from the differences between networks. Collective foraging and decision making in socially interacting animal groups is often improved or even optimal thanks to local information sharing between conspecifics. We therefore present a model for co-learning by ensembles of interacting neural networks that aim to maximize their own performance but also their functional relations to other networks. We show that ensembles of interacting networks outperform independent ones, and that optimal ensemble performance is reached when the coupling between networks increases diversity and degrades the performance of individual networks. Thus, even without a global goal for the ensemble, optimal collective behavior emerges from local interactions between networks. We show the scaling of optimal coupling strength with ensemble size, and that networks in these ensembles specialize functionally and become more `confident' in their assessments. Moreover, optimal co-learning networks differ structurally, relying on sparser activity, a wider range of synaptic weights, and higher firing rates - compared to independently trained networks. Finally, we explore interactions-based co-learning as a framework for expanding and boosting ensembles.


title: Non-invasive single-shot recovery of point-spread function of a memory effect based scattering imaging system

abstract: Accessing the point-spread function (PSF) of a complex optical system is important for a variety of imaging applications. However, placing an invasive point source is often impractical, and estimating it blindly with multiple frames is slow and requires a complex non-linear optimization. Here, we introduce a simple single-shot method to non-invasively recover the accurate PSF of an isoplanatic imaging system, in the context of multiple light scattering. Our approach is based on the reconstruction of any unknown sparse hidden object using the autocorrelation imaging technique, followed by a deconvolution with a blur kernel derived from the statistics of a speckle pattern. A deconvolution on the camera image then retrieves the accurate PSF of the system, enabling further imaging applications. We demonstrate numerically and experimentally the effectiveness of this approach compared to previous deconvolution techniques.


title: Time resolved multi-photon effects in the fluorescence spectra of two-level systems at rest and in motion

abstract: We study the time-resolved fluorescence spectrum in two-level systems interacting with an incident coherent field, both in the weak and intermediate coupling regimes. For a single two-level system in the intermediate coupling case, as time flows, the spectrum develops distinct features, that are not captured by a semi-classical treatment of the incident field. Specifically, for a field on resonance with the atomic transition energy, the usual Mollow spectrum is replaced by a four peak structure, and for a frequency that is half of the atomic transition energy, the time-dependent spectrum develops a second harmonic peak with a superimposed Mollow triplet. In the long-time limit, our description recovers results previously found in the literature. After analyzing why a different behavior is observed in the quantum and classical dynamics, the reason for the occurrence of a second harmonic signal in a two-level system is explained via a symmetry analysis of the total (electron and photon) system, and in terms of a three level system operating in limiting regimes. We find an increased second harmonic signal in an array of two-level systems, suggesting a superradiance-like enhancement for multiple two-level systems in cavity setups. Finally, initial explorative results are presented for two-level model atoms entering and exiting a cavity, which hint at an interesting interplay between cavity-photon screening and atomic dynamics effects.

categories: quant-ph cond-mat.mes-hall physics.atom-ph physics.optics