title: Are Social Networks Watermarking Us or Are We (Unawarely) Watermarking Ourself?

abstract: In the last decade, Social Networks (SNs) have deeply changed many aspects of society, and one of the most widespread behaviours is the sharing of pictures. However, malicious users often exploit shared pictures to create fake profiles leading to the growth of cybercrime. Thus, keeping in mind this scenario, authorship attribution and verification through image watermarking techniques are becoming more and more important. In this paper, firstly, we investigate how 13 most popular SNs treat the uploaded pictures, in order to identify a possible implementation of image watermarking techniques by respective SNs. Secondly, on these 13 SNs, we test the robustness of several image watermarking algorithms. Finally, we verify whether a method based on the Photo-Response Non-Uniformity (PRNU) technique can be successfully used as a watermarking approach for authorship attribution and verification of pictures on SNs. The proposed method is robust enough in spite of the fact that the pictures get downgraded during the uploading process by SNs. The results of our analysis on a real dataset of 8,400 pictures show that the proposed method is more effective than other watermarking techniques and can help to address serious questions about privacy and security on SNs.


title: Note on the classification of the orientation reversing homeomorphisms of finite order of surfaces

abstract: The aim of this note is to stablish the topological classification of finite period orientation reversing autohomeomorphims of a closed oriented surface when the period is 2q, with q even. The classification of periodic orientation reversing autohomeomorphims of a closed oriented surface has been made by Kazuo Yokoyama in Complete classification of periodic maps on compact surfaces, Tokyo J. Math. 15 (1992), no. 2, 247--279, and by the author in Classification of the orientation reversing homeomorphisms of finite order of surfaces, Topology and its applications 62 (1995) 145--162 (reference [1] of this paper) following different approaches. In [1] there are some errors for the case considered in this note: orientation reversing homeomorphims of period multiple of 4. The errors have been pointed out by Weibiao Wang of the School of Mathematical Sciences of Peking University and Chao Wang of the School of Mathematical Sciences of East China Normal University in Shanghai. The approach to this problem in [1] is useful and in Section 3 we obtain the classification for the case when the orientation reversing homemorphism has period multiple of 4 following the ideas of [1]. The results in [1] has been used in references [2] and [3]. The last Section include the corrections to these articles following Section 3.


title: Hyperbolic limits of Cantor set complements in the sphere

abstract: Let $M$ be a hyperbolic 3-manifold with no rank two cusps admitting an embedding in $\mathbb S^3$. Then, if $M$ admits an exhaustion by $\pi_1$-injective sub-manifolds there exists cantor sets $C_n\subset \mathbb S^3$ such that $N_n=\mathbb S^3\setminus C_n$ is hyperbolic and $N_n\rightarrow M$ geometrically.


title: Identifying Causal Structure in Dynamical Systems

abstract: Mathematical models are fundamental building blocks in the design of dynamical control systems. As control systems are becoming increasingly complex and networked, approaches for obtaining such models based on first principles reach their limits. Data-driven methods provide an alternative. However, without structural knowledge, these methods are prone to finding spurious correlations in the training data, which can hamper generalization capabilities of the obtained models. This can significantly lower control and prediction performance when the system is exposed to unknown situations. A preceding causal identification can prevent this pitfall. In this paper, we propose a method that identifies the causal structure of control systems. We design experiments based on the concept of controllability, which provides a systematic way to compute input trajectories that steer the system to specific regions in its state space. We then analyze the resulting data leveraging powerful techniques from causal inference and extend them to control systems. Further, we derive conditions that guarantee the discovery of the true causal structure of the system. Experiments on a robot arm demonstrate reliable causal identification from real-world data and enhanced generalization capabilities.


title: Privacy threats in intimate relationships

abstract: This article provides an overview of intimate threats: a class of privacy threats that can arise within our families, romantic partnerships, close friendships, and caregiving relationships. Many common assumptions about privacy are upended in the context of these relationships, and many otherwise effective protective measures fail when applied to intimate threats. Those closest to us know the answers to our secret questions, have access to our devices, and can exercise coercive power over us. We survey a range of intimate relationships and describe their common features. Based on these features, we explore implications for both technical privacy design and policy, and offer design recommendations for ameliorating intimate privacy risks.


title: Enforcing Predictive Invariance across Structured Biomedical Domains

abstract: Many biochemical applications such as molecular property prediction require models to generalize beyond their training domains (environments). Moreover, natural environments in these tasks are structured, defined by complex descriptors such as molecular scaffolds or protein families. Therefore, most environments are either never seen during training, or contain only a single training example. To address these challenges, we propose a new regret minimization (RGM) algorithm and its extension for structured environments. RGM builds from invariant risk minimization (IRM) by recasting simultaneous optimality condition in terms of predictive regret, finding a representation that enables the predictor to compete against an oracle with hindsight access to held-out environments. The structured extension adaptively highlights variation due to complex environments via specialized domain perturbations. We evaluate our method on multiple applications: molecular property prediction, protein homology and stability prediction and show that RGM significantly outperforms previous state-of-the-art baselines.


title: Pairing, quasi-spin and seniority

abstract: We present our concise notes for the lectures and tutorials on pairing, quasi-spin and seniority delivered at SERB school on Role of Symmetries in Nuclear Physics, AMITY University, $2019$. Starting with some generic features of residual nucleon-nucleon interactions, we provide detailed derivation of the matrix elements for the $\delta$-interaction which is the basis for the standard pairing Hamiltonian. The eigen values for standard pairing Hamiltonian are then obtained within the quasi-spin formalism. The algebra involving quasi-spin operators is performed explicitly using the annihilation and creation operators for single nucleon together with the application of Wicks theorem. These techniques are expected to be helpful in deriving the mean-field equations for the $Hartree-Fock$, $Bardeen-Cooper-Schrieffer$ and $Hartree-Fock$ Bogoliubov theories.


title: Micron-scale SABRE-enhanced NV-NMR Spectroscopy

abstract: Optically-probed nitrogen-vacancy (NV) quantum defects in diamond can detect nuclear magnetic resonance (NMR) signals with high-spectral resolution from micron-scale sample volumes of about 10 picoliters. However, a key challenge for NV-NMR is detecting samples at millimolar concentrations. Here, we demonstrate an improvement in NV-NMR proton concentration sensitivity of about $10^5$ over thermal polarization by hyperpolarizing sample proton spins through signal amplification by reversible exchange (SABRE), enabling micron-scale NMR of small molecule sample concentrations as low as 1 millimolar in picoliter volumes. The SABRE-enhanced NV-NMR technique may enable detection and chemical analysis of low concentration molecules and their dynamics in complex micron-scale systems such as single-cells.


title: Accounting for the large radial tension in Morris-Thorne wormholes

abstract: It is well known that a Morris-Thorne wormhole can only be held open by violating the null energy condition, physically realizable by the use of "exotic matter." Unfortunately, even a small or moderately-sized wormhole would have a radial tension equal to that of the interior of a massive neutron star. So outside a neutron-star setting, such an outcome is problematical at best, calling for more than an appeal to exotic matter whose introduction had a completely different objective and with possibly different outcomes. The purpose of this paper is to account for the enormous radial tension in three ways: (1) directly invoking noncommutative geometry, an offshoot of string theory, (2) appealing to noncommutative geometry in conjunction with $f(R)$ modified gravity, and (3) determining the possible effect of a small extra dimension.


title: Unconstrained Online Optimization: Dynamic Regret Analysis of Strongly Convex and Smooth Problems

abstract: The regret bound of dynamic online learning algorithms is often expressed in terms of the variation in the function sequence ($V_T$) and/or the path-length of the minimizer sequence after $T$ rounds. For strongly convex and smooth functions, , Zhang et al. establish the squared path-length of the minimizer sequence ($C^*_{2,T}$) as a lower bound on regret. They also show that online gradient descent (OGD) achieves this lower bound using multiple gradient queries per round. In this paper, we focus on unconstrained online optimization. We first show that a preconditioned variant of OGD achieves $O(C^*_{2,T})$ with one gradient query per round. We then propose online optimistic Newton (OON) method for the case when the first and second order information of the function sequence is predictable. The regret bound of OON is captured via the quartic path-length of the minimizer sequence ($C^*_{4,T}$), which can be much smaller than $C^*_{2,T}$. We finally show that by using multiple gradients for OGD, we can achieve an upper bound of $O(\min\{C^*_{2,T},V_T\})$ on regret.


title: A computer simulation protocol to assess the accuracy of a Radio Stereometric Analysis (RSA) image processor according to the ISO-5725

abstract: Radio-Stereometric-Analysis and x-ray fluoroscopy are radiological techniques that require dedicated software to process data. The accurate calibration of these software is therefore critical. The aim of this work is to produce a protocol for evaluating the softwares' accuracy according to the ISO-5725. A series of computer simulations of the radiological setup and images were employed. The noise level of the images was also changed to evaluate the accuracy with different image qualities. The protocol was tested on a custom software developed by the authors. Radiological scene reconstruction accuracy was of (0.092 +- 0.14) mm for tube position, and (0.38 +- 0.31) mm / (2.09 +- 1.39) deg for detectors oriented in a direction other than the source-detector direction. In the source-detector direction the accuracy was of (2.68 +- 3.08) mm for tube position, and of (0.16 +- 0.27) mm / (0.075 +- 1.16) deg for the detectors. These disparate results are widely discussed in the literature. Model positioning and orientation was also highly accurate: (0.22 +- 0.46) mm / (0.26 +- 0.22) deg. Accuracy was not affected by the noise level. The protocol was able to assess the accuracy of the RSA system. It was also useful to detect and fix hidden bugs. It was also useful to detect and resolve hidden bugs in the software, and in optimizing the algorithms.


title: Non Proportional Odds Models are Widely Dispensable -- Sparser Modeling based on Parametric and Additive Location-Shift Approaches

abstract: The potential of location-shift models to find adequate models between the proportional odds model and the non-proportional odds model is investigated. It is demonstrated that these models are very useful in ordinal modeling. While proportional odds models are often too simple, non proportional odds models are typically unnecessary complicated and seem widely dispensable. The class of location-shift models is also extended to allow for smooth effects. The additive location-shift model contains two functions for each explanatory variable, one for the location and one for dispersion. It is much sparser than hard-to-handle additive models with category-specific covariate functions but more flexible than common vector generalized additive models.


title: A multi-scale model of virus pandemic: Heterogeneous interactive entities in a globally connected world

abstract: This paper is devoted to the multidisciplinary modelling of a pandemic initiated by an aggressive virus, specifically the so-called \textit{SARS--CoV--2 Severe Acute Respiratory Syndrome, corona virus n.2}. The study is developed within a multiscale framework accounting for the interaction of different spatial scales, from the small scale of the virus itself and cells, to the large scale of individuals and further up to the collective behaviour of populations. An interdisciplinary vision is developed thanks to the contributions of epidemiologists, immunologists and economists as well as those of mathematical modellers. The first part of the contents is devoted to understanding the complex features of the system and to the design of a modelling rationale. The modelling approach is treated in the second part of the paper by showing both how the virus propagates into infected individuals, successfully and not successfully recovered, and also the spatial patterns, which are subsequently studied by kinetic and lattice models. The third part reports the contribution of research in the fields of virology, epidemiology, immune competition, and economy focused also on social behaviours. Finally, a critical analysis is proposed looking ahead to research perspectives.


title: Local Stackelberg equilibrium seeking in generalized aggregative games

abstract: We propose a two-layer, semi-decentralized algorithm to compute a local solution to the Stackelberg equilibrium problem in aggregative games with coupling constraints. Specifically, we focus on a single-leader, multiple-follower problem, and after equivalently recasting the Stackelberg game as a mathematical program with complementarity constraints (MPCC), we iteratively convexify a regularized version of the MPCC as inner problem, whose solution generates a sequence of feasible descent directions for the original MPCC. Thus, by pursuing a descent direction at every outer iteration, we establish convergence to a local Stackelberg equilibrium. Finally, the proposed algorithm is tested on a numerical case study involving a hierarchical instance of the charging coordination of Plug-in Electric Vehicles (PEVs).


title: Radiative pion photoproduction in covariant chiral perturbation theory

abstract: We present a calculation of radiative pion photoproduction in the framework of covariant chiral perturbation theory with explicit $\Delta(1232)$ degrees of freedom. The analysis is performed employing the small scale expansion scheme adjusted for the $\Delta$ region. Depending on the channel, we include contributions up to next-to-next-to-leading order. We fit the available experimental data for the reaction $ \gamma p\to\gamma p\pi^0 $ and extract the value of the $\Delta^+$ magnetic moment. Errors from the truncation of the small scale expansion are estimated using the Bayesian approach. We compare our results both with the previous studies within the $\delta$-expansion scheme and with the $\Delta$-less theory. We also give predictions for radiative charged-pion photoproduction.


title: Bitcoin covenants unchained

abstract: Covenants are linguistic primitives that extend the Bitcoin script language, allowing transactions to constrain the scripts of the redeeming ones. Advocated as a way of improving the expressiveness of Bitcoin contracts while preserving the simplicity of the UTXO design, various forms of covenants have been proposed over the years. A common drawback of the existing descriptions is the lack of formalization, making it difficult to reason about properties and supported use cases. In this paper we propose a formal model of covenants, which can be implemented with minor modifications to Bitcoin. We use our model to specify some complex Bitcoin contracts, and we discuss how to exploit covenants to design high-level language primitives for Bitcoin contracts.


title: A Robust Attentional Framework for License Plate Recognition in the Wild

abstract: Recognizing car license plates in natural scene images is an important yet still challenging task in realistic applications. Many existing approaches perform well for license plates collected under constrained conditions, eg, shooting in frontal and horizontal view-angles and under good lighting conditions. However, their performance drops significantly in an unconstrained environment that features rotation, distortion, occlusion, blurring, shading or extreme dark or bright conditions. In this work, we propose a robust framework for license plate recognition in the wild. It is composed of a tailored CycleGAN model for license plate image generation and an elaborate designed image-to-sequence network for plate recognition. On one hand, the CycleGAN based plate generation engine alleviates the exhausting human annotation work. Massive amount of training data can be obtained with a more balanced character distribution and various shooting conditions, which helps to boost the recognition accuracy to a large extent. On the other hand, the 2D attentional based license plate recognizer with an Xception-based CNN encoder is capable of recognizing license plates with different patterns under various scenarios accurately and robustly. Without using any heuristics rule or post-processing, our method achieves the state-of-the-art performance on four public datasets, which demonstrates the generality and robustness of our framework. Moreover, we released a new license plate dataset, named "CLPD", with 1200 images from all 31 provinces in mainland China. The dataset can be available from: https://github.com/wangpengnorman/CLPD_dataset.


title: Long distance adiabatic wireless energy transfer via multiple coils coupling

abstract: Recently, the wireless energy transfer model can be described as the Schrodinger equation [Annals of Physics, 2011, 326(3): 626-633; Annals of Physics, 2012, 327(9): 2245-2250]. Therefore, wireless energy transfer can be designed by coherent quantum control techniques, which can achieve efficient and robust energy transfer from transmitter to receiver device. In this paper, we propose a novel design of wireless energy transfer which obtains the longer distance, efficient and robust schematic of power transfer, via multiple states triangle crossing pattern. After our calculations, we demonstrate that our design can provide much longer transfer distance with relatively smaller decreasing in the transfer efficiency.


title: Robust watermarking with double detector-discriminator approach

abstract: In this paper we present a novel deep framework for a watermarking - a technique of embedding a transparent message into an image in a way that allows retrieving the message from a (perturbed) copy, so that copyright infringement can be tracked. For this technique, it is essential to extract the information from the image even after imposing some digital processing operations on it. Our framework outperforms recent methods in the context of robustness against not only spectrum of attacks (e.g. rotation, resizing, Gaussian smoothing) but also against compression, especially JPEG. The bit accuracy of our method is at least 0.86 for all types of distortions. We also achieved 0.90 bit accuracy for JPEG while recent methods provided at most 0.83. Our method retains high transparency and capacity as well. Moreover, we present our double detector-discriminator approach - a scheme to detect and discriminate if the image contains the embedded message or not, which is crucial for real-life watermarking systems and up to now was not investigated using neural networks. With this, we design a testing formula to validate our extended approach and compared it with a common procedure. We also present an alternative method of balancing between image quality and robustness on attacks which is easily applicable to the framework.


title: The Zoltar forecast archive: a tool to facilitate standardization and storage of interdisciplinary prediction research

abstract: Forecasting has emerged as an important component of informed, data-driven decision-making in a wide array of fields. We introduce a new data model for probabilistic predictions that encompasses a wide range of forecasting settings. This framework clearly defines the constituent parts of a probabilistic forecast and proposes one approach for representing these data elements. The data model is implemented in Zoltar, a new software application that stores forecasts using the data model and provides standardized API access to the data. In one real-time case study, an instance of the Zoltar web application was used to store, provide access to, and evaluate real-time forecast data on the order of 10$^7$ rows, provided by over 20 international research teams from academia and industry making forecasts of the COVID-19 outbreak in the US. Tools and data infrastructure for probabilistic forecasts, such as those introduced here, will play an increasingly important role in ensuring that future forecasting research adheres to a strict set of rigorous and reproducible standards.


title: Learning to Model Opponent Learning

abstract: Multi-Agent Reinforcement Learning (MARL) considers settings in which a set of coexisting agents interact with one another and their environment. The adaptation and learning of other agents induces non-stationarity in the environment dynamics. This poses a great challenge for value function-based algorithms whose convergence usually relies on the assumption of a stationary environment. Policy search algorithms also struggle in multi-agent settings as the partial observability resulting from an opponent's actions not being known introduces high variance to policy training. Modelling an agent's opponent(s) is often pursued as a means of resolving the issues arising from the coexistence of learning opponents. An opponent model provides an agent with some ability to reason about other agents to aid its own decision making. Most prior works learn an opponent model by assuming the opponent is employing a stationary policy or switching between a set of stationary policies. Such an approach can reduce the variance of training signals for policy search algorithms. However, in the multi-agent setting, agents have an incentive to continually adapt and learn. This means that the assumptions concerning opponent stationarity are unrealistic. In this work, we develop a novel approach to modelling an opponent's learning dynamics which we term Learning to Model Opponent Learning (LeMOL). We show our structured opponent model is more accurate and stable than naive behaviour cloning baselines. We further show that opponent modelling can improve the performance of algorithmic agents in multi-agent settings.


title: Whitham equations and phase shifts for the Korteweg-deVries equation

abstract: The semi-classical Korteweg-deVries equation for step-like data is considered with a small parameter in front of the highest derivative. Using perturbation analysis Whitham theory is constructed to higher order. This allows the order one phase and the complete leading order solution to be obtained; the results are confirmed by extensive numerical calculations.

categories: nlin.PS math-ph math.MP nlin.SI physics.flu-dyn


title: A classification of the abelian minimal closed normal subgroups of locally compact second-countable groups

abstract: We classify the locally compact second-countable (l.c.s.c.) groups $A$ that are abelian and topologically characteristically simple. All such groups $A$ occur as the monolith of some soluble l.c.s.c. group $G$ of derived length at most $3$; with known exceptions (specifically, when $A$ is $\mathbb{Q}^n$ or its dual for some $n \in \mathbb{N}$), we can take $G$ to be compactly generated. This amounts to a classification of the possible isomorphism types of abelian chief factors of l.c.s.c. groups, which is of particular interest for the theory of compactly generated locally compact groups.


title: Self-supervising Fine-grained Region Similarities for Large-scale Image Localization

abstract: The task of large-scale retrieval-based image localization is to estimate the geographical location of a query image by recognizing its nearest reference images from a city-scale dataset. However, the general public benchmarks only provide noisy GPS labels associated with the training images, which act as weak supervisions for learning image-to-image similarities. Such label noise prevents deep neural networks from learning discriminative features for accurate localization. To tackle this challenge, we propose to self-supervise image-to-region similarities in order to fully explore the potential of difficult positive images alongside their sub-regions. The estimated image-to-region similarities can serve as extra training supervision for improving the network in generations, which could in turn gradually refine the fine-grained similarities to achieve optimal performance. Our proposed self-enhanced image-to-region similarity labels effectively deal with the training bottleneck in the state-of-the-art pipelines without any additional parameters or manual annotations in both training and inference. Our method outperforms state-of-the-arts on the standard localization benchmarks by noticeable margins and shows excellent generalization capability on multiple image retrieval datasets.


title: Dissecting the Strong-lensing Galaxy Cluster MS 0440.5+0204. I. The Mass Density Profile

abstract: We present a parametric strong lensing modeling of the galaxy cluster MS\,0440.5+0204 (located at $z$ = 0.19). We have performed a strong lensing mass reconstruction of the cluster using three different models. The first model uses the image positions of four multiple imaged systems (providing 26 constraints). The second one combines strong lensing constraints with dynamical information (velocity dispersion) of the cluster. The third one uses the mass calculated from weak lensing as an additional constraint. Our three models reproduce equally well the image positions of the arcs, with a root-mean-square image equal to $\approx$0.5$\arcsec$. However, in the third model, the inclusion of the velocity dispersion and the weak-lensing mass allows us to obtain better constraints in the scale radius and the line-of-sight velocity dispersion of the mass profile. For this model, we obtain $r_s$ = 132$^{+30}_{-32}$ kpc, $\sigma_s$ = 1203$^{+46}_{-47}$ km s$^{-1}$, M$_{200}$ = 3.1$^{+0.6}_{-0.6}$ $\times10^{14}$\,M$_{\odot}$, and a high concentration, $c_{200}$ = 9.9$^{+2.2}_{-1.4}$. Finally, we used our derived mass profile to calculate the mass up to 1.5 Mpc. We compare it with X-ray estimates previously reported, finding a good agreement.


title: Two-photon atomic level widths at finite temperatures

abstract: The thermal two-photon level broadening of the excited energy levels in the hydrogen and H-like helium is evaluated via the imaginary part of thermal two-loop self-energy correction for bound electron. All the derivations are presented in the framework of rigorous quantum electrodynamic theory at finite temperatures and are applicable for the H-like ions. On this basis, we found a contribution to the level broadening induced by the blackbody radiation which is fundamentally different from the usual line broadening caused by the stimulated two-photon decay and the Raman scattering of thermal photons. Numerical calculations of the two-loop thermal correction to the two-photon width for the $2s$ state in hydrogen and singly ionized helium atoms show that the effect could significantly exceed the higher-order relativistic and radiative QED corrections commonly included in the calculations. In addition, the thermal two-loop self-energy correction significantly exceeds the "ordinary" stimulated one-photon depopulation rate at the relevant laboratory temperatures. In this work, detailed analysis and the corresponding comparison of the effect with the existing laboratory measurements in H-like ions are carried out.


title: Sparse representation for damage identification of structural systems

abstract: Identifying damage of structural systems is typically characterized as an inverse problem which might be ill-conditioned due to aleatory and epistemic uncertainties induced by measurement noise and modeling error. Sparse representation can be used to perform inverse analysis for the case of sparse damage. In this paper, we propose a novel two-stage sensitivity analysis-based framework for both model updating and sparse damage identification. Specifically, an $\ell_2$ Bayesian learning method is firstly developed for updating the intact model and uncertainty quantification so as to set forward a baseline for damage detection. A sparse representation pipeline built on a quasi-$\ell_0$ method, e.g., Sequential Threshold Least Squares (STLS) regression, is then presented for damage localization and quantification. Additionally, Bayesian optimization together with cross validation is developed to heuristically learn hyperparameters from data, which saves the computational cost of hyperparameter tuning and produces more reliable identification result. The proposed framework is verified by three examples, including a 10-story shear-type building, a complex truss structure, and a shake table test of an eight-story steel frame. Results show that the proposed approach is capable of both localizing and quantifying structural damage with high accuracy.

categories: stat.AP cs.LG cs.NA cs.SY eess.SY math.NA physics.data-an


title: An Attacker Modeling Framework for the Assessment of Cyber-Physical Systems Security

abstract: Characterizing attacker behavior with respect to Cyber-Physical Systems is important to assuring the security posture and resilience of these systems. Classical cyber vulnerability assessment approaches rely on the knowledge and experience of cyber-security experts to conduct security analyses and can be inconsistent where the experts' knowledge and experience are lacking. This paper proposes a flexible attacker modeling framework that aids in the security analysis process by simulating a diverse set of attacker behaviors to predict attack progression and provide consistent system vulnerability analysis. The model proposes an expanded architecture of vulnerability databases to maximize its effectiveness and consistency in detecting CPS vulnerabilities while being compatible with existing vulnerability databases. The model has the power to be implemented and simulated against an actual or virtual CPS. Execution of the attacker model is demonstrated against a simulated industrial control system architecture, resulting in a probabilistic prediction of attacker behavior.


title: Study of the usability of LinkedIn: a social media platform meant to connect employers and employees

abstract: Social network platforms have increased and become very popular in the last decade; they allow people to create an online account to then interact with others creating a complicated net of connections. LinkedIn is one of the most used social media platform, created and used for professional purposes. Here, indeed, the user can either apply for job positions or join professional communities to deepen his own knowledge and expertise and be always up to date in the interested field. The primary objectives of this paper are assessing LinkedIn's usability, by using both user and expert evaluation and giving recommendations for the developer to improve this social network. This has been achieved through different steps; initially, feedbacks have been collected, via questionnaire, from direct users. Later, the usability issues, which have been underlined by users in the questionnaire, have been explored, by simulating user's problem-solving process, through Walkthrough. Finally, the overall usability of LinkedIn application has been measured by using SUS (System Usability Scale).


title: Robust nonlinear observer design based on impulsive dissipativity

abstract: The paper considers the design of a nonlinear dissipative impulsive observer based on non-periodic discrete-time measurements. Sufficient conditions are derived for (i) exponential convergence of the observer in absence of measurement uncertainty, and (ii) input-to-state stability (ISS) with respect to measurement uncertainty, by combining notions from impulsive and dissipative systems theory. The conditions mainly include constraints on the minimum and maximum time between measurements depending on system characteristics, the correction gain and the desired ISS gain. A representative case example is used to illustrate the theoretical assessments.


title: Multivariate Functional Singular Spectrum Analysis Over Different Dimensional Domains

abstract: In this work, we develop multivariate functional singular spectrum analysis (MFSSA) over different dimensional domains which is the functional extension of multivariate singular spectrum analysis (MSSA). In the following, we provide all of the necessary theoretical details supporting the work as well as the implementation strategy that contains the recipes needed for the algorithm. We provide a simulation study showcasing the better performance in reconstruction accuracy of a multivariate functional time series (MFTS) signal found using MFSSA as compared to other approaches and we give a real data study showing how MFSSA enriches analysis using intraday temperature curves and remote sensing images of vegetation. MFSSA is available for use through the Rfssa R package.


title: On summatory arithmetic functions and a Volterra Integral equation

abstract: We obtain asymptotic results for well known summatory arithmetic functions, such as $\psi(x),$ and establish connections to new summatory functions. A new Volterra integral equation is offered, which is solved by summatory arithmetic functions. We conclude with some further integral formulas and provide number theoretic formulas as applications.


title: Gender-Based Homophily in Research: A Large-Scale Study of Man-Woman Collaboration

abstract: We examined the male-female collaboration practices of all internationally visible Polish university professors (N = 25,463) based on their Scopus-indexed publications from 2009-2018 (158,743 journal articles). We merged a national registry of 99,935 scientists (with full administrative and biographical data) with the Scopus publication database, using probabilistic and deterministic record linkage. Our unique biographical, administrative, publication, and citation database (The Polish Science Observatory) included all professors with at least a doctoral degree employed in 85 research-involved universities. We determined what we term an individual publication portfolio for every professor, and we examined the respective impacts of biological age, academic position, academic discipline, average journal prestige, and type of institution on the same-sex collaboration ratio. The gender homophily principle (publishing predominantly with scientists of the same sex) was found to apply to male scientists - but not to females. The majority of male scientists collaborate solely with males; most female scientists, in contrast, do not collaborate with females at all. Across all age groups studied, all-female collaboration is marginal, while all-male collaboration is pervasive. Gender homophily in research-intensive institutions proved stronger for males than for females. Finally, we used a multi-dimensional fractional logit regression model to estimate the impact of gender and other individual-level and institutional-level independent variables on gender homophily in research collaboration.


title: An Efficient $k$-modes Algorithm for Clustering Categorical Datasets

abstract: Mining clusters from data is an important endeavor in many applications. The $k$-means method is a popular, efficient, and distribution-free approach for clustering numerical-valued data, but does not apply for categorical-valued observations. The $k$-modes method addresses this lacuna by replacing the Euclidean with the Hamming distance and the means with the modes in the $k$-means objective function. We provide a novel, computationally efficient implementation of $k$-modes, called OTQT. We prove that OTQT finds updates to improve the objective function that are undetectable to existing $k$-modes algorithms. Although slightly slower per iteration due to algorithmic complexity, OTQT is always more accurate per iteration and almost always faster (and only barely slower on some datasets) to the final optimum. Thus, we recommend OTQT as the preferred, default algorithm for $k$-modes optimization.


title: Memory-Efficient Learning of Stable Linear Dynamical Systems for Prediction and Control

abstract: Learning a stable Linear Dynamical System (LDS) from data involves creating models that both minimize reconstruction error and enforce stability of the learned representation. We propose a novel algorithm for learning stable LDSs. Using a recent characterization of stable matrices, we present an optimization method that ensures stability at every step and iteratively improves the reconstruction error using gradient directions derived in this paper. When applied to LDSs with inputs, our approach---in contrast to current methods for learning stable LDSs---updates both the state and control matrices, expanding the solution space and allowing for models with lower reconstruction error. We apply our algorithm in simulations and experiments to a variety of problems, including learning dynamic textures from image sequences and controlling a robotic manipulator. Compared to existing approaches, our proposed method achieves an orders-of-magnitude improvement in reconstruction error and superior results in terms of control performance. In addition, it is provably more memory-efficient, with an O(n^2) space complexity compared to O(n^4) of competing alternatives, thus scaling to higher-dimensional systems when the other methods fail.

categories: cs.LG cs.RO cs.SY eess.SY math.OC stat.ML


title: Covariant functors commuting with direct limits

abstract: In this work we state conditions on a covariant right exact functor so that it commutes with direct limits. These conditions are related to the commutativity of the functor under direct limits of projective modules. We prove that if the functor commutes with direct limits of projective modules, then the functor commutes with direct limits.


title: Horizons in a binary black hole merger I: Geometry and area increase

abstract: Recent advances in numerical relativity have revealed how marginally trapped surfaces behave when black holes merge. It is now known that interesting topological features emerge during the merger, and marginally trapped surfaces can have self-intersections. This paper presents the most detailed study yet of the physical and geometric aspects of this scenario. For the case of a head-on collision of non-spinning black holes, we study in detail the world tube formed by the evolution of marginally trapped surfaces. In the first of this two-part study, we focus on geometrical properties of the dynamical horizons, i.e. the world tube traced out by the time evolution of marginally outer trapped surfaces. We show that even the simple case of a head-on collision of non-spinning black holes contains a rich variety of geometric and topological properties and is generally more complex than considered previously in the literature. The dynamical horizons are shown to have mixed signature and are not future marginally trapped everywhere. We analyze the area increase of the marginal surfaces along a sequence which connects the two initially disjoint horizons with the final common horizon. While the area does increase overall along this sequence, it is not monotonic. We find short durations of anomalous area change which, given the connection of area with entropy, might have interesting physical consequences. We investigate the possible reasons for this effect and show that it is consistent with existing proofs of the area increase law.


title: Horizons in a binary black hole merger II: Fluxes, multipole moments and stability

abstract: We study in detail the dynamics and stability of marginally trapped surfaces during a binary black hole merger. This is the second in a two-part study. The first part studied the basic geometric aspects of the world tubes traced out by the marginal surfaces and the status of the area increase law. Here we continue and study the dynamics of the horizons during the merger, again for the head-on collision of two non-spinning black holes. In particular we follow the spectrum of the stability operator during the course of the merger for all the horizons present in the problem and implement systematic spectrum statistics for its analysis. We also study more physical aspects of the merger, namely the fluxes of energy which cross the horizon and cause the area to change. We construct a natural coordinate system on the horizon and decompose the various fields appearing in the flux, primarily the shear of the outgoing null normal, in spin weighted spherical harmonics. For each of the modes we extract the decay rates as the final black hole approaches equilibrium. The late part of the decay is consistent with the expected quasi-normal mode frequencies, while the early part displays a much steeper fall-off. Similarly, we calculate the decay of the horizon multipole moments, again finding two different regimes. Finally, seeking an explanation for this behavior, motivated by the membrane paradigm interpretation, we attempt to identify the different dynamical timescales of the area increase. This leads to the definition of a ``slowness parameter'' for predicting the onset of transition from a faster to a slower decay.


title: Learning and Optimization of Blackbox Combinatorial Solvers in Neural Networks

abstract: The use of blackbox solvers inside neural networks is a relatively new area which aims to improve neural network performance by including proven, efficient solvers for complex problems. Existing work has created methods for learning networks with these solvers as components while treating them as a blackbox. This work attempts to improve upon existing techniques by optimizing not only over the primary loss function, but also over the performance of the solver itself by using Time-cost Regularization. Additionally, we propose a method to learn blackbox parameters such as which blackbox solver to use or the heuristic function for a particular solver. We do this by introducing the idea of a hyper-blackbox which is a blackbox around one or more internal blackboxes.


title: Some examples of K3 surfaces with infinite automorphism group which preserves an elliptic pencil

abstract: We give more details to our examples in [9] of K3 surfaces over C such that they have infinite automorphism group but it preserves some elliptic pencil of the K3


title: Soliton solutions and their dynamics in reverse-space and reverse-space-time nonlocal discrete derivative nonlinear Schr\"odinger equations

abstract: In this paper, we introduce the reverse-space and reverse-space-time nonlocal discrete derivative nonlinear Schr\"odinger (DNLS) equations through the nonlocal symmetry reductions of the semi-discrete Gerdjikov-Ivanov equation. The muti-soliton solutions of two types of nonlocal discrete derivative nonlinear Schr\"odinger equations are derived by means of the Hirota bilinear method and reduction approach. We also investigate the dynamics of soliton solutions and reveal the rich soliton structures in the reverse-space and reverse-space-time nonlocal discrete DNLS equations. Our investigation shows that the solitons of these nonlocal equations often breathe and periodically collapse for some soliton parameters, but remain nonsingular for other range of parameters.


title: The Convergence Indicator: Improved and completely characterized parameter bounds for actual convergence of Particle Swarm Optimization

abstract: Particle Swarm Optimization (PSO) is a meta-heuristic for continuous black-box optimization problems. In this paper we focus on the convergence of the particle swarm, i.e., the exploitation phase of the algorithm. We introduce a new convergence indicator that can be used to calculate whether the particles will finally converge to a single point or diverge. Using this convergence indicator we provide the actual bounds completely characterizing parameter regions that lead to a converging swarm. Our bounds extend the parameter regions where convergence is guaranteed compared to bounds induced by converging variance which are usually used in the literature. To evaluate our criterion we describe a numerical approximation using cubic spline interpolation. Finally we provide experiments showing that our concept, formulas and the resulting convergence bounds represent the actual behavior of PSO.


title: Polar foliations on symmetric spaces and the mean curvature flow

abstract: In this paper, we study polar foliations on simply connected symmetric spaces with non-negative curvature. We will prove that all such foliations are isoparametric as defined by Heintze, Liu and Olmos. We will also prove a splitting theorem which reduces the study of such foliations to polar foliations in compact simply connected symmetric spaces. Moreover, we will show that solutions to mean curvature flow of regular leaves in such foliations are always ancient solutions. This generalizes part of the results of Liu and Terng for the mean curvature flow of isoparametric submanifolds in spheres.


title: The dark universe future and singularities: the account of thermal and quantum effects

abstract: The knowledge of the universe future is of fundamental importance for any advanced civilization. We study the future of singular dark universe where thermal effects due to the Hawking radiation on the apparent horizon of the FRW universe are taken in consideration. It is shown that dark universe which ends up at finite-time Type I and Type III singularity or infinite-time Little Rip singularity transits to finite-time Type II singularity due to account of thermal effects. On the same time, the Type II and IV singular universe does not change its qualitative behavior. The combined account of quantum and thermal effects shows that depending on specific features of the universe only one of effects is dominant. When (conformal matter) quantum effects are dominant, the future singularity is usually removed while for dominant thermal effects the universe final state is the Type II singularity.


title: Neural Lyapunov Redesign

abstract: Learning controllers merely based on a performance metric has been proven effective in many physical and non-physical tasks in both control theory and reinforcement learning. However, in practice, the controller must guarantee some notion of safety to ensure that it does not harm either the agent or the environment. Stability is a crucial notion of safety, whose violation can certainly cause unsafe behaviors. Lyapunov functions are effective tools to assess stability in nonlinear dynamical systems. In this paper, we combine an improving Lyapunov function with automatic controller synthesis in an iterative fashion to obtain control policies with large safe regions. We propose a two-player collaborative algorithm that alternates between estimating a Lyapunov function and deriving a controller that gradually enlarges the stability region of the closed-loop system. We provide theoretical results on the class of systems that can be treated with the proposed algorithm and empirically evaluate the effectiveness of our method using an exemplary dynamical system.


title: Terahertz signatures of ultrafast Dirac fermion relaxation at the surface of topological insulators at room temperature

abstract: Topologically-protected surface states present rich physics and promising spintronic, optoelectronic and photonic applications that require a proper understanding of their ultrafast carrier dynamics. Here, we investigate these dynamics in topological insulators (TIs) of the bismuth and antimony chalcogenide family, where we isolate the response of Dirac fermions at the surface from the response of bulk carriers by combining photoexcitation with below-bandgap terahertz (THz) photons with TI samples with varying Fermi level, including one sample with the Fermi level located within the bandgap. We identify distinctly faster relaxation of charge carriers in the topologically-protected Dirac surface states (few hundred femtoseconds), compared to bulk carriers (few picoseconds). In agreement with such fast cooling dynamics, we observe THz harmonic generation without any saturation effects for increasing incident fields, unlike graphene which exhibits strong saturation. This opens up promising avenues for increased THz nonlinear conversion efficiencies, and high-bandwidth optoelectronic and spintronic information and communication applications.


title: SONIA: A Symmetric Blockwise Truncated Optimization Algorithm

abstract: This work presents a new algorithm for empirical risk minimization. The algorithm bridges the gap between first- and second-order methods by computing a search direction that uses a second-order-type update in one subspace, coupled with a scaled steepest descent step in the orthogonal complement. To this end, partial curvature information is incorporated to help with ill-conditioning, while simultaneously allowing the algorithm to scale to the large problem dimensions often encountered in machine learning applications. Theoretical results are presented to confirm that the algorithm converges to a stationary point in both the strongly convex and nonconvex cases. A stochastic variant of the algorithm is also presented, along with corresponding theoretical guarantees. Numerical results confirm the strengths of the new approach on standard machine learning problems.


title: ValNorm Quantifies Semantics to Reveal Consistent Valence Biases Across Languages and Over Centuries

abstract: Word embeddings learn implicit biases from linguistic regularities captured by word co-occurrence statistics. By extending methods that quantify human-like biases in word embeddings, we introduceValNorm, a novel intrinsic evaluation task and method to quantify the valence dimension of affect in human-rated word sets from social psychology. We apply ValNorm on static word embeddings from seven languages (Chinese, English, German, Polish, Portuguese, Spanish, and Turkish) and from historical English text spanning 200 years. ValNorm achieves consistently high accuracy in quantifying the valence of non-discriminatory, non-social group word sets. Specifically, ValNorm achieves a Pearson correlation of r=0.88 for human judgment scores of valence for 399 words collected to establish pleasantness norms in English. In contrast, we measure gender stereotypes using the same set of word embeddings and find that social biases vary across languages. Our results indicate that valence associations of non-discriminatory, non-social group words represent widely-shared associations, in seven languages and over 200 years.


title: Contextual Bandits with Side-Observations

abstract: We investigate contextual bandits in the presence of side-observations across arms in order to design recommendation algorithms for users connected via social networks. Users in social networks respond to their friends' activity, and hence provide information about each other's preferences. In our model, when a learning algorithm recommends an article to a user, not only does it observe his/her response (e.g. an ad click), but also the side-observations, i.e., the response of his neighbors if they were presented with the same article. We model these observation dependencies by a graph $\mathcal{G}$ in which nodes correspond to users, and edges correspond to social links. We derive a problem/instance-dependent lower-bound on the regret of any consistent algorithm. We propose an optimization (linear programming) based data-driven learning algorithm that utilizes the structure of $\mathcal{G}$ in order to make recommendations to users and show that it is asymptotically optimal, in the sense that its regret matches the lower-bound as the number of rounds $T\to\infty$. We show that this asymptotically optimal regret is upper-bounded as $O\left(|\chi(\mathcal{G})|\log T\right)$, where $|\chi(\mathcal{G})|$ is the domination number of $\mathcal{G}$. In contrast, a naive application of the existing learning algorithms results in $O\left(N\log T\right)$ regret, where $N$ is the number of users.


title: Self-Supervised Dynamic Networks for Covariate Shift Robustness

abstract: As supervised learning still dominates most AI applications, test-time performance is often unexpected. Specifically, a shift of the input covariates, caused by typical nuisances like background-noise, illumination variations or transcription errors, can lead to a significant decrease in prediction accuracy. Recently, it was shown that incorporating self-supervision can significantly improve covariate shift robustness. In this work, we propose Self-Supervised Dynamic Networks (SSDN): an input-dependent mechanism, inspired by dynamic networks, that allows a self-supervised network to predict the weights of the main network, and thus directly handle covariate shifts at test-time. We present the conceptual and empirical advantages of the proposed method on the problem of image classification under different covariate shifts, and show that it significantly outperforms comparable methods.


title: Hodge theory of degenerations, (II): vanishing cohomology and geometric applications

abstract: We study the weighted spectrum and vanishing cohomology for several classes of isolated hypersurface singularities, and how they contribute to the limiting mixed Hodge structure of a smoothing. Applications are given to several types of singularities arising in KSBA and GIT compactifications and mirror symmetry, including nodes on odd-dimensional hypersurfaces, $k$-log-canonical and $k$-rational singularities, and singularities with Calabi-Yau tail.


title: A Mathematical Picture Language Project

abstract: The mathematical picture language project that we began in 2016 has already yielded interesting results. We also point out areas of mathematics and physics where we hope that it will prove useful in the future.


title: Detecting Emergent Intersectional Biases: Contextualized Word Embeddings Contain a Distribution of Human-like Biases

abstract: With the starting point that implicit human biases are reflected in the statistical regularities of language, it is possible to measure biases in English static word embeddings. State-of-the-art neural language models generate dynamic word embeddings dependent on the context in which the word appears. Current methods measure pre-defined social and intersectional biases that appear in particular contexts defined by sentence templates. Dispensing with templates, we introduce the Contextualized Embedding Association Test (CEAT), that can summarize the magnitude of overall bias in neural language models by incorporating a random-effects model. Experiments on social and intersectional biases show that CEAT finds evidence of all tested biases and provides comprehensive information on the variance of effect magnitudes of the same bias in different contexts. All the models trained on English corpora that we study contain biased representations. Furthermore, we develop two methods, Intersectional Bias Detection (IBD) and Emergent Intersectional Bias Detection (EIBD), to automatically identify the intersectional biases and emergent intersectional biases from static word embeddings in addition to measuring them in contextualized word embeddings. We present the first algorithmic bias detection findings on how intersectional group members are strongly associated with unique emergent biases that do not overlap with the biases of their constituent minority identities. IBD and EIBD achieve high accuracy when detecting the intersectional and emergent biases of African American females and Mexican American females. Our results indicate that biases at the intersection of race and gender associated with members of multiple minority groups, such as African American females and Mexican American females, have the highest magnitude across all neural language models.


title: Study of the ground state energies of some nuclei using hybrid model

abstract: The quark-quark QQ interaction as a perturbed term to the nucleon-nucleon interaction NN without any coupling between them is studied in a hybrid model. This model is used to calculate the ground-state energies of 2H1 and 4He2 nuclei. In a semi-relativistic framework, this model is encouraged for light nuclei and the instanton induced interaction by using the QQ potential and the NN interaction for a small scale around the hadron boundaries. This hybrid model depends on two theories, the one-boson exchange potential OBEP and the Cornell-dressed potential CDP for QQ. A small effect of quark-quark interaction is obtained on the values of the ground state energies, around 6.7 for 2H1 and 1.2 for 4He2 by using the considered hybrid model.


title: Tearing modes in partially ionized plasmas

abstract: In many astrophysical environments the plasma is only partially ionized, and therefore the interaction of charged and neutral particles may alter both the triggering of reconnection and its subsequent dynamical evolution. We derive the tearing mode maximum growth rate for partially ionized plasmas in the cases of weak and strong coupling between the plasma and the neutrals. In addition, critical scalings for current sheet aspect ratios are presented in terms of Lundquist number and ion-neutral collision frequencies. In the decoupled regime the standard tearing mode is recovered with a small correction depending on the ion-neutral collision frequency; in the intermediate regime collisions with neutrals are shown to stabilize current sheets, resulting in larger critical aspect ratios for ideal tearing to occur. Nonetheless, the additional electron-neutral collisions, hidden in the definition of the Lundquist number, can shrink the critical aspect ratios below the fully ionized case. In the coupled regime, the growth rate depends on the density ratio between ions and neutrals through the collision frequency between these two species. These provide critical aspect ratios for which the tearing mode instability transitions from slow to ideal, that depend on the neutral-ion density ratio.


title: Solitons and cavitons in a nonlocal Whitham equation

abstract: Solitons and cavitons (localized solutions with singularities) for the nonlocal Whitham equations are studied. The equation of a fourth order with a parameter in front of fourth derivative for traveling waves is reduced to a reversible Hamiltonian system defined on a two-sheeted four-dimensional space. Solutions of the system which stay on one sheet represent smooth solutions of the equation but those which perform transitions through the branching plane represent solutions with jumps. Using analytic and numerical methods we found many types of homoclinic (and periodic as well) orbits to the equilibria both with a monotone asymptotics and oscillating ones. They correspond to solitons and cavitons of the initial equation. The presence of majority such solutions displays the very complicated dynamics of the system.


title: New Edgeworth-type expansions with finite sample guarantees

abstract: We establish higher-order nonasymptotic expansions for a difference between probability distributions of sums of i.i.d. random vectors in a Euclidean space. The derived bounds are uniform over two classes of sets: the set of all Euclidean balls and the set of all half-spaces. These results allow to account for an impact of higher-order moments or cumulants of the considered distributions; the obtained error terms depend on a sample size and a dimension explicitly. The new inequalities outperform accuracy of the normal approximation in existing Berry-Esseen inequalities under very general conditions. Under some symmetry assumptions on the probability distribution of random summands, the obtained results are optimal in terms of the ratio between the dimension and the sample size. The new technique which we developed for establishing nonasymptotic higher-order expansions can be interesting by itself. Using the new higher-order inequalities, we study accuracy of the nonparametric bootstrap approximation and propose a bootstrap score test under possible model misspecification. The results of the paper also include explicit error bounds for general elliptic confidence regions for an expected value of the random summands, and optimality of the Gaussian anti-concentration inequality over the set of all Euclidean balls.


title: Frank-Wolfe optimization for deep networks

abstract: Deep neural networks is today one of the most popular choices in classification, regression and function approximation. However, the training of such deep networks is far from trivial as there are often millions of parameters to tune. Typically, one use some optimization method that hopefully converges towards some minimum. The most popular and successful methods are based on gradient descent. In this paper, another optimization method, Frank-Wolfe optimization, is applied to a small deep network and compared to gradient descent. Although the optimization does converge, it does so slowly and not close to the speed of gradient descent. Further, in a stochastic setting, the optimization becomes very unstable and does not seem to converge unless one uses a line search approach.


title: Analytical Mechanics Allows Novel Vistas on Mathematical Epidemic Dynamics Modelling

abstract: This contribution aims to shed light on mathematical epidemic dynamics modelling from the viewpoint of analytical mechanics. To set the stage, it recasts the basic SIR model of mathematical epidemic dynamics in an analytical mechanics setting. Thereby, it considers two possible re-parameterizations of the basic SIR model. On the one hand, it is proposed to re-scale time, while on the other hand, to transform the coordinates, i.e.\ the independent variables. In both cases, Hamilton's equations in terms of a suited Hamiltonian as well as Hamilton's principle in terms of a suited Lagrangian are considered in minimal and extended phase and state space coordinates, respectively. The corresponding Legendre transformations relating the various options for the Hamiltonians and Lagrangians are detailed. Ultimately, this contribution expands on a multitude of novel vistas on mathematical epidemic dynamics modelling that emerge from the analytical mechanics viewpoint. As result, it is believed that interesting and relevant new research avenues open up when exploiting in depth the analogies between analytical mechanics and mathematical epidemic dynamics modelling.


title: Tuning a variational autoencoder for data accountability problem in the Mars Science Laboratory ground data system

abstract: The Mars Curiosity rover is frequently sending back engineering and science data that goes through a pipeline of systems before reaching its final destination at the mission operations center making it prone to volume loss and data corruption. A ground data system analysis (GDSA) team is charged with the monitoring of this flow of information and the detection of anomalies in that data in order to request a re-transmission when necessary. This work presents $\Delta$-MADS, a derivative-free optimization method applied for tuning the architecture and hyperparameters of a variational autoencoder trained to detect the data with missing patches in order to assist the GDSA team in their mission.


title: Combinatorial Black-Box Optimization with Expert Advice

abstract: We consider the problem of black-box function optimization over the boolean hypercube. Despite the vast literature on black-box function optimization over continuous domains, not much attention has been paid to learning models for optimization over combinatorial domains until recently. However, the computational complexity of the recently devised algorithms are prohibitive even for moderate numbers of variables; drawing one sample using the existing algorithms is more expensive than a function evaluation for many black-box functions of interest. To address this problem, we propose a computationally efficient model learning algorithm based on multilinear polynomials and exponential weight updates. In the proposed algorithm, we alternate between simulated annealing with respect to the current polynomial representation and updating the weights using monomial experts' advice. Numerical experiments on various datasets in both unconstrained and sum-constrained boolean optimization indicate the competitive performance of the proposed algorithm, while improving the computational time up to several orders of magnitude compared to state-of-the-art algorithms in the literature.


title: Linear Quadratic Graphon Field Games

abstract: Linear quadratic graphon field games (LQ-GFGs) are defined to be LQ games which involve a large number of agents that are weakly coupled via a weighted undirected graph on which each node represents an agent. The links of the graph correspond to couplings between the agents' dynamics, as well as between the individual cost functions, which each agent attempts to minimize. We formulate limit LQ-GFG problems based on the assumption that these graphs lie in a sequence which converges to a limit graphon. First, under a finite-rank assumption on the limit graphon, the existence and uniqueness of solutions to the formulated limit LQ-GFG problem is established. Second, based upon the solutions to the limit LQ-GFG problem, epsilon-Nash equilibria are constructed for the corresponding game problems with a very large but finite number of players. This result is then generalized to the case with random initial conditions. It is to be noted that LQ-GFG problems are distinct from the class of graphon mean field game (GMFG) problems where a population is hypothesized to be associated with each node of the graph [Caines and Huang CDC 2018, 2019].


title: Generative Adversarial Phonology: Modeling unsupervised phonetic and phonological learning with neural networks

abstract: Training deep neural networks on well-understood dependencies in speech data can provide new insights into how they learn internal representations. This paper argues that acquisition of speech can be modeled as a dependency between random space and generated speech data in the Generative Adversarial Network architecture and proposes a methodology to uncover the network's internal representations that correspond to phonetic and phonological properties. The Generative Adversarial architecture is uniquely appropriate for modeling phonetic and phonological learning because the network is trained on unannotated raw acoustic data and learning is unsupervised without any language-specific assumptions or pre-assumed levels of abstraction. A Generative Adversarial Network was trained on an allophonic distribution in English. The network successfully learns the allophonic alternation: the network's generated speech signal contains the conditional distribution of aspiration duration. The paper proposes a technique for establishing the network's internal representations that identifies latent variables that correspond to, for example, presence of [s] and its spectral properties. By manipulating these variables, we actively control the presence of [s] and its frication amplitude in the generated outputs. This suggests that the network learns to use latent variables as an approximation of phonetic and phonological representations. Crucially, we observe that the dependencies learned in training extend beyond the training interval, which allows for additional exploration of learning representations. The paper also discusses how the network's architecture and innovative outputs resemble and differ from linguistic behavior in language acquisition, speech disorders, and speech errors, and how well-understood dependencies in speech data can help us interpret how neural networks learn their representations.


title: Recent progress in the $L_p$ theory for elliptic and parabolic equations with discontinuous coefficients

abstract: In this paper, we review some results over the last 10-15 years on elliptic and parabolic equations with discontinuous coefficients. We begin with an approach given by N. V. Krylov to parabolic equations in the whole space with VMO$_x$ coefficients. We then discuss some subsequent development including elliptic and parabolic equations with coefficients which are allowed to be merely measurable in one or two space directions, weighted $L_p$ estimates with Muckenhoupt ($A_p$) weights, non-local elliptic and parabolic equations, as well as fully nonlinear elliptic and parabolic equations.


title: Scalar absorption: Black holes versus wormholes

abstract: We study the absorption of massless scalar waves in a geometry that interpolates between the Schwarzschild solution and a wormhole that belongs to the Morris-Thorne class of solutions. In the middle of the interpolation branch, this geometry describes a regular black hole. We use the partial wave approach to compute the scalar absorption cross section in this geometry. Our results show that black holes and wormholes present distinctive absorption spectra. We conclude, for instance, that the wormhole results are characterized by the existence of quasibound states which generate Breit-Wigner-like resonances in the absorption spectrum.


title: Generative Design of Hardware-aware DNNs

abstract: To efficiently run DNNs on the edge/cloud, many new DNN inference accelerators are being designed and deployed frequently. To enhance the resource efficiency of DNNs, model quantization is a widely-used approach. However, different accelerator/HW has different resources leading to the need for specialized quantization strategy of each HW. Moreover, using the same quantization for every layer may be sub-optimal, increasing the designspace of possible quantization choices. This makes manual-tuning infeasible. Recent work in automatically determining quantization for each layer is driven by optimization methods such as reinforcement learning. However, these approaches need re-training the RL for every new HW platform. We propose a new way for autonomous quantization and HW-aware tuning. We propose a generative model, AQGAN, which takes a target accuracy as the condition and generates a suite of quantization configurations. With the conditional generative model, the user can autonomously generate different configurations with different targets in inference time. Moreover, we propose a simplified HW-tuning flow, which uses the generative model to generate proposals and execute simple selection based on the HW resource budget, whose process is fast and interactive. We evaluate our model on five of the widely-used efficient models on the ImageNet dataset. We compare with existing uniform quantization and state-of-the-art autonomous quantization methods. Our generative model shows competitive achieved accuracy, however, with around two degrees less search cost for each design point. Our generative model shows the generated quantization configuration can lead to less than 3.5% error across all experiments.


title: Conditional Neural Architecture Search

abstract: Designing resource-efficient Deep Neural Networks (DNNs) is critical to deploy deep learning solutions over edge platforms due to diverse performance, power, and memory budgets. Unfortunately, it is often the case a well-trained ML model does not fit to the constraint of deploying edge platforms, causing a long iteration of model reduction and retraining process. Moreover, a ML model optimized for platform-A often may not be suitable when we deploy it on another platform-B, causing another iteration of model retraining. We propose a conditional neural architecture search method using GAN, which produces feasible ML models for different platforms. We present a new workflow to generate constraint-optimized DNN models. This is the first work of bringing in condition and adversarial technique into Neural Architecture Search domain. We verify the method with regression problems and classification on CIFAR-10. The proposed workflow can successfully generate resource-optimized MLP or CNN-based networks.


title: An Efficient Semi-smooth Newton Augmented Lagrangian Method for Elastic Net

abstract: Feature selection is an important and active research area in statistics and machine learning. The Elastic Net is often used to perform selection when the features present non-negligible collinearity or practitioners wish to incorporate additional known structure. In this article, we propose a new Semi-smooth Newton Augmented Lagrangian Method to efficiently solve the Elastic Net in ultra-high dimensional settings. Our new algorithm exploits both the sparsity induced by the Elastic Net penalty and the sparsity due to the second order information of the augmented Lagrangian. This greatly reduces the computational cost of the problem. Using simulations on both synthetic and real datasets, we demonstrate that our approach outperforms its best competitors by at least an order of magnitude in terms of CPU time. We also apply our approach to a Genome Wide Association Study on childhood obesity.


title: The Critical Role of Thermal Fluctuations for Electrocatalytic Metal Surface Properties and CO Binding Trends

abstract: This work addresses a longstanding theoretical discrepancy using Density Functional Theory (DFT) with experimental observations of CO binding trends on electrocatalytically relevant metals for the CO2 reduction reaction (CO2RR). By introducing thermal fluctuations using appropriate statistical mechanical NVT and NPT ensembles, we show that DFT with universal dispersion interactions yields qualitatively better metal surface strain trends and CO binding energetics, consistently predicts the correct site preference for all metals due to thermally induced surface distortions that preferentially exposes the undercoordinated atop site for Cu(111) and Pt(111), and for the weak binding Ag(111) and Au(111) surfaces at finite temperatures shows CO-metal interactions that are a mixture of chemisorbed and physisorbed species. This study better places theory as an equal partner to experimental heterogeneous catalysis by demonstrating the need to fully account for finite temperature fluctuations to make contact with surface science experiments.


title: Regularization of Inverse Problems by Neural Networks

abstract: Inverse problems arise in a variety of imaging applications including computed tomography, non-destructive testing, and remote sensing. The characteristic features of inverse problems are the non-uniqueness and instability of their solutions. Therefore, any reasonable solution method requires the use of regularization tools that select specific solutions and at the same time stabilize the inversion process. Recently, data-driven methods using deep learning techniques and neural networks demonstrated to significantly outperform classical solution methods for inverse problems. In this chapter, we give an overview of inverse problems and demonstrate the necessity of regularization concepts for their solution. We show that neural networks can be used for the data-driven solution of inverse problems and review existing deep learning methods for inverse problems. In particular, we view these deep learning methods from the perspective of regularization theory, the mathematical foundation of stable solution methods for inverse problems. This chapter is more than just a review as many of the presented theoretical results extend existing ones.


title: Laplacian-Level Quantum Hydrodynamic Theory for Plasmonics

abstract: An accurate description of the optical response of subwavelength metallic particles and nanogap structures is a key problem of plasmonics. Quantum hydrodynamic theory (QHT) has emerged as a powerful method to calculate the optical response of metallic nanoparticles (NPs) since it takes into account nonlocality and spill-out effects. Nevertheless, the absorption spectra of metallic NPs obtained with conventional QHT, i.e., incorporating Thomas-Fermi (TF) and von Weizs\"acker (vW) kinetic energy (KE) contributions, can be affected by several spurious resonances at energies higher than the main localized surface plasmon (LSP). These peaks are not present in reference time-dependent density-functional-theory (TD-DFT) spectra, where, instead, only a broad shoulder exists. Moreover, we show here that these peaks incorrectly reduce the LSP peak intensity and have a strong dependence on the simulation domain size so that a proper calculation of QHT absorption spectra can be problematic. In this article, we introduce a more general QHT method accounting for KE contributions depending on the Laplacian of the electronic density ($q$), thus, beyond the gradient-only dependence of the TFvW functional. We show that employing a KE functional with a term proportional to $q^2$ results in an absorption spectrum free of spurious peaks, with LSP resonance of correct intensity and numerically stable Bennett state. Finally, we present a novel Laplacian-level KE energy functional that is very accurate for the description of the optical properties of NPs with different sizes as well as for dimers.


title: Response to a comment on Dessert et al. "The dark matter interpretation of the 3.5 keV line is inconsistent with blank-sky observations"

abstract: The dark matter explanation of the 3.5 keV line is strongly disfavored by our work in Dessert et al. 2020. Boyarsky et al. 2020 questions that conclusion: modeling additional background lines is claimed to weaken the limit sufficiently to re-allow a dark matter interpretation. We respond as follows. 1) A more conservative limit is obtained by modeling additional lines; this point appeared in its entirety in our work in Dessert et al., though we also showed that the inclusion of such lines is not necessary. 2) Despite suggestions in Boyarsky et al., even the more conservative limits strongly disfavor a decaying dark matter origin of the 3.5 keV line.


title: The food seeking behavior of slime mold: a macroscopic approach

abstract: Starting from a particle model we derive a macroscopic aggregation-diffusion equation for the evolution of slime mold under the assumption of propagation of chaos in the large particle limit. We analyze properties of the macroscopic model in the stationary case and study the behavior of the slime mold between food sources. The efficient numerical simulation of the aggregation-diffusion equation allows for a detailed analysis of the interplay between the different regimes drift, interaction and diffusion.


title: Proximal Gradient Temporal Difference Learning: Stable Reinforcement Learning with Polynomial Sample Complexity

abstract: In this paper, we introduce proximal gradient temporal difference learning, which provides a principled way of designing and analyzing true stochastic gradient temporal difference learning algorithms. We show how gradient TD (GTD) reinforcement learning methods can be formally derived, not by starting from their original objective functions, as previously attempted, but rather from a primal-dual saddle-point objective function. We also conduct a saddle-point error analysis to obtain finite-sample bounds on their performance. Previous analyses of this class of algorithms use stochastic approximation techniques to prove asymptotic convergence, and do not provide any finite-sample analysis. We also propose an accelerated algorithm, called GTD2-MP, that uses proximal ``mirror maps'' to yield an improved convergence rate. The results of our theoretical analysis imply that the GTD family of algorithms are comparable and may indeed be preferred over existing least squares TD methods for off-policy learning, due to their linear complexity. We provide experimental results showing the improved performance of our accelerated gradient TD methods.


title: IP Geolocation Underestimates Regressive Economic Patterns in MOOC Usage

abstract: Massive open online courses (MOOCs) promise to make rigorous higher education accessible to everyone, but prior research has shown that registrants tend to come from backgrounds of higher socioeconomic status. We study geographically granular economic patterns in about 76,000 U.S. registrations for about 600 HarvardX and MITx courses between 2012 and 2018, identifying registrants' locations using both IP geolocation and user-reported mailing addresses. By either metric, we find higher registration rates among postal codes with greater prosperity or population density. However, we also find evidence of bias in IP geolocation: it makes greater errors, both geographically and economically, for users from more economically distressed areas; it disproportionately places users in prosperous areas; and it underestimates the regressive pattern in MOOC registration. Researchers should use IP geolocation in MOOC studies with care, and consider the possibility of similar economic biases affecting its other academic, commercial, and legal uses.


title: Stable and Efficient Policy Evaluation

abstract: Policy evaluation algorithms are essential to reinforcement learning due to their ability to predict the performance of a policy. However, there are two long-standing issues lying in this prediction problem that need to be tackled: off-policy stability and on-policy efficiency. The conventional temporal difference (TD) algorithm is known to perform very well in the on-policy setting, yet is not off-policy stable. On the other hand, the gradient TD and emphatic TD algorithms are off-policy stable, but are not on-policy efficient. This paper introduces novel algorithms that are both off-policy stable and on-policy efficient by using the oblique projection method. The empirical experimental results on various domains validate the effectiveness of the proposed approach.


title: Visual Prediction of Priors for Articulated Object Interaction

abstract: Exploration in novel settings can be challenging without prior experience in similar domains. However, humans are able to build on prior experience quickly and efficiently. Children exhibit this behavior when playing with toys. For example, given a toy with a yellow and blue door, a child will explore with no clear objective, but once they have discovered how to open the yellow door, they will most likely be able to open the blue door much faster. Adults also exhibit this behavior when entering new spaces such as kitchens. We develop a method, Contextual Prior Prediction, which provides a means of transferring knowledge between interactions in similar domains through vision. We develop agents that exhibit exploratory behavior with increasing efficiency, by learning visual features that are shared across environments, and how they correlate to actions. Our problem is formulated as a Contextual Multi-Armed Bandit where the contexts are images, and the robot has access to a parameterized action space. Given a novel object, the objective is to maximize reward with few interactions. A domain which strongly exhibits correlations between visual features and motion is kinemetically constrained mechanisms. We evaluate our method on simulated prismatic and revolute joints.


title: Fast and Powerful Conditional Randomization Testing via Distillation

abstract: We consider the problem of conditional independence testing: given a response Y and covariates (X,Z), we test the null hypothesis that Y is independent of X given Z. The conditional randomization test (CRT) was recently proposed as a way to use distributional information about X|Z to exactly (non-asymptotically) control Type-I error using any test statistic in any dimensionality without assuming anything about Y|(X,Z). This flexibility in principle allows one to derive powerful test statistics from complex prediction algorithms while maintaining statistical validity. Yet the direct use of such advanced test statistics in the CRT is prohibitively computationally expensive, especially with multiple testing, due to the CRT's requirement to recompute the test statistic many times on resampled data. We propose the distilled CRT, a novel approach to using state-of-the-art machine learning algorithms in the CRT while drastically reducing the number of times those algorithms need to be run, thereby taking advantage of their power and the CRT's statistical guarantees without suffering the usual computational expense. In addition to distillation, we propose a number of other tricks like screening and recycling computations to further speed up the CRT without sacrificing its high power and exact validity. Indeed, we show in simulations that all our proposals combined lead to a test that has similar power to the most powerful existing CRT implementations but requires orders of magnitude less computation, making it a practical tool even for large data sets. We demonstrate these benefits on a breast cancer dataset by identifying biomarkers related to cancer stage.


title: Description of mesoscale pattern formation in shallow convective cloud fields by using time-dependent Ginzburg-Landau and Swift-Hohenberg stochastic equations

abstract: The time-dependent Ginzburg-Landau equation and the Swift-Hohenberg equation, both added with a stochastic term, are proposed to describe cloud pattern formation and cloud regime phase transitions of shallow convective clouds organized in mesoscale systems. The starting point is the Hottovy-Stechmann linear spatio-temporal stochastic model for tropical precipitation, used to describe the dynamics of water vapor and tropical convection. By taking into account that shallow stratiform clouds are close to a self-organized criticallity and that water vapor content is the order parameter, it is observed that sources must have non-linear terms in the equation to include the dynamical feedback due to precipitation and evaporation. The inclusion of this non-linearity leads to a kind of time-dependent Ginzburg-Landau stochastic equation, originally used to describe superconductivity phases. By performing numerical simulations, pattern formation is observed, specially for cellular convective phases. These patterns are much better compared with real satellite observations than the pure linear model. This is done by comparing the spatial Fourier transform of real and numerical cloud fields. Finally, by considering fluctuation terms for the turbulent eddy diffusion we arrive to a Hohenberg-Swift equation. The obtained patterns are much more organized that the patterns obtained from the Ginzburg-Landau equation in the case of closed cellular and roll convection.


title: Simulation of Conventional Droop Controller for Islanding DGs

abstract: A microgrid is a new concept that has changed the power systems dramatically. It is a combination of Distributed Generation Resources (DGR) like Biomass, PV systems, Wind energy, Fuel cell, Diesel Generator, and so on with different types of loads (residential or commercial). Microgrids can work in two modes: autonomous and Interconnected. In the Islanding situation, the loads will be supported by DGR and without connecting to upstream utility grids. Controlling power electronic Interfaces between sources and loads has been an important task between the researchers. Several different strategies have been presented by researchers. Droop control strategy is one of the which has its pros and cons. In this paper, the conventional droop strategy has been explained in detail and formulated. The Simulation results are taken from MATLAB/SIMULINK to show the capability of the control strategy.


title: Advertising for Demographically Fair Outcomes

abstract: Online advertising on platforms such as Google or Facebook has become an indispensable outreach tool, including for applications where it is desirable to engage different demographics in an equitable fashion, such as hiring, housing, civic processes, and public health outreach efforts. Somewhat surprisingly, the existing online advertising ecosystem provides very little support for advertising to (and recruiting) a demographically representative cohort. We study the problem of advertising for demographic representativeness from both an empirical and algorithmic perspective. In essence, we seek fairness in the outcome or conversions generated by the advertising campaigns. We first present detailed empirical findings from real-world experiments for recruiting for civic processes, using which we show that methods using Facebook-inferred features are too inaccurate for achieving equity in outcomes, while targeting via custom audiences based on a list of registered voters segmented on known attributes has much superior accuracy. This motivates us to consider the algorithmic question of optimally segmenting the list of individuals with known attributes into a few custom campaigns and allocating budgets to them so that we cost-effectively achieve outcome parity with the population on the maximum possible number of demographics. Under the assumption that a platform can reasonably enforce proportionality in spend across demographics, we present efficient exact and approximation algorithms for this problem. We present simulation results on our datasets to show the efficacy of these algorithms in achieving demographic parity.


title: Simulating quantum transport with ultracold atoms and interaction effects

abstract: Quantum transport can be simulated with ultracold atoms by employing spin superpositions of fermions interacting with spin-dependent potentials. Here we first extend this scheme to an arbitrary number of spin components so as to allow simulating transport through a multiterminal quantum dot and derive a current formula in terms of a spin rotation matrix and potential phase shifts. We then show that a Fano resonance manifests itself in measuring a linear conductance at zero temperature in the case of two spin components. We also study how a weak interparticle interaction in bulk affects quantum transport in one dimension with the bosonization and renormalization techniques. In particular, we find that the conductance vanishes for an attractive interaction due to a bulk spin gap, while it is enhanced for a repulsive interaction by a power law with lowering the temperature or the chemical potential difference.


title: Enhancing Facial Data Diversity with Style-based Face Aging

abstract: A significant limiting factor in training fair classifiers relates to the presence of dataset bias. In particular, face datasets are typically biased in terms of attributes such as gender, age, and race. If not mitigated, bias leads to algorithms that exhibit unfair behaviour towards such groups. In this work, we address the problem of increasing the diversity of face datasets with respect to age. Concretely, we propose a novel, generative style-based architecture for data augmentation that captures fine-grained aging patterns by conditioning on multi-resolution age-discriminative representations. By evaluating on several age-annotated datasets in both single- and cross-database experiments, we show that the proposed method outperforms state-of-the-art algorithms for age transfer, especially in the case of age groups that lie in the tails of the label distribution. We further show significantly increased diversity in the augmented datasets, outperforming all compared methods according to established metrics.


title: Online Advertising Security: Issues, Taxonomy, and Future Directions

abstract: Online advertising has become the backbone of the Internet economy by revolutionizing business marketing. It provides a simple and efficient way for advertisers to display their advertisements to specific individual users, and over the last couple of years has contributed to an explosion in the income stream for several web-based businesses. For example, Google's income from advertising grew 51.6% between 2016 and 2018, to $136.8 billion. This exponential growth in advertising revenue has motivated fraudsters to exploit the weaknesses of the online advertising model to make money, and researchers to discover new security vulnerabilities in the model, to propose countermeasures and to forecast future trends in research. Motivated by these considerations, this paper presents a comprehensive review of the security threats to online advertising systems. We begin by introducing the motivation for online advertising system, explain how it differs from traditional advertising networks, introduce terminology, and define the current online advertising architecture. We then devise a comprehensive taxonomy of attacks on online advertising to raise awareness among researchers about the vulnerabilities of online advertising ecosystem. We discuss the limitations and effectiveness of the countermeasures that have been developed to secure entities in the advertising ecosystem against these attacks. To complete our work, we identify some open issues and outline some possible directions for future research towards improving security methods for online advertising systems.


title: Safety Challenges for Autonomous Vehicles in the Absence of Connectivity

abstract: Autonomous vehicles (AVs) are promoted as a technology that will create a future with effortless driving and virtually no traffic accidents. AV companies claim that, when fully developed, the technology will eliminate 94% of all accidents that are caused by human error. These AVs will likely avoid the large number of crashes caused by impaired, distracted or reckless drivers. But there remains a significant proportion of crashes for which no driver is directly responsible. In particular, the absence of connectivity of an AV with its neighboring vehicles (V2V) and the infrastructure (I2V) leads to a lack of information that can induce such crashes. Since AV designs today do not require such connectivity, these crashes would persist in the future. Using prototypical examples motivated by the NHTSA pre-crash scenario typology, we show that fully autonomous vehicles cannot guarantee safety in the absence of connectivity. Combining theoretical models and empirical data, we also argue that such hazardous scenarios will occur with a significantly high probability. This suggests that incorporating connectivity is an essential step on the path towards safe AV technology.


title: Logarithmic correction to resistance

abstract: We study the trace of the incipient infinite oriented branching random walk in $\mathbb{Z}^d \times \mathbb{Z}_+$ when the dimension is $d = 6$. Under suitable moment assumptions, we show that the electrical resistance between the root and level $n$ is $O(n \log^{-\xi}n )$ for a $\xi > 0$ that does not depend on details of the model.


title: Bi-$s^*$-Concave Distributions

abstract: We introduce new shape-constrained classes of distribution functions on R, the bi-$s^*$-concave classes. In parallel to results of D\"umbgen, Kolesnyk, and Wilke (2017) for what they called the class of bi-log-concave distribution functions, we show that every $s$-concave density $f$ has a bi-$s^*$-concave distribution function $F$ for $s^*\leq s/(s+1)$. Confidence bands building on existing nonparametric bands, but accounting for the shape constraint of bi-$s^*$-concavity, are also considered. The new bands extend those developed by D\"umbgen et al. (2017) for the constraint of bi-log-concavity. We also make connections between bi-$s^*$-concavity and finiteness of the Cs\"org\H{o} - R\'ev\'esz constant of $F$ which plays an important role in the theory of quantile processes.


title: Inequalities of Chebyshev-P\'olya-Szeg\"o Type via Generalized Proportional Fractional Integral Operators

abstract: This study is an example of a solid connection between fractional analysis and inequality theory, and includes new inequalities of the P\'{o}lya-Szeg% \"{o}-Chebyshev type obtained with the help of Generalized Proportional Fractional integral operators. The results have been performed by using Generalized Proportional Fractional integral operators, some classical inequalities such as AM-GM inequality, Cauchy-Schwarz inequality and Taylor series expansion of exponential function. The findings give new approaches to some types of inequalities that have involving the product of two functions in inequality theory.