title: Expertise and Dynamics within Crowdsourced Musical Knowledge Curation: A Case Study of the Genius Platform

abstract: Many platforms collect crowdsourced information primarily from volunteers. As this type of knowledge curation has become widespread, contribution formats vary substantially and are driven by diverse processes across differing platforms. Thus, models for one platform are not necessarily applicable to others. Here, we study the temporal dynamics of Genius, a platform primarily designed for user-contributed annotations of song lyrics. A unique aspect of Genius is that the annotations are extremely local -- an annotated lyric may just be a few lines of a song -- but also highly related, e.g., by song, album, artist, or genre. We analyze several dynamical processes associated with lyric annotations and their edits, which differ substantially from models for other platforms. For example, expertise on song annotations follows a "U shape" where experts are both early and late contributors with non-experts contributing intermediately; we develop a user utility model that captures such behavior. We also find several contribution traits appearing early in a user's lifespan of contributions that distinguish (eventual) experts from non-experts. Combining our findings, we develop a model for early prediction of user expertise.


title: NeuroCard: One Cardinality Estimator for All Tables

abstract: Query optimizers rely on accurate cardinality estimates to produce good execution plans. Despite decades of research, existing cardinality estimators are inaccurate for complex queries, due to making lossy modeling assumptions and not capturing inter-table correlations. In this work, we show that it is possible to learn the correlations across all tables in a database without any independence assumptions. We present NeuroCard, a join cardinality estimator that builds a single neural density estimator over an entire database. Leveraging join sampling and modern deep autoregressive models, NeuroCard makes no inter-table or inter-column independence assumptions in its probabilistic modeling. NeuroCard achieves orders of magnitude higher accuracy than the best prior methods (a new state-of-the-art result of 8.5$\times$ maximum error on JOB-light), scales to dozens of tables, while being compact in space (several MBs) and efficient to construct or update (seconds to minutes).


title: Suffocating Fire Sales

abstract: Fire sales are among the major drivers of market instability in modern financial systems. Due to iterated distressed selling and the associated price impact, initial shocks to some institutions can be amplified dramatically through the network induced by portfolio overlaps. In this paper, we develop a mathematical framework that allows us to investigate central characteristics that drive or hinder the propagation of distress. We investigate single systems as well as ensembles of systems that are alike, where similarity is measured in terms of the empirical distribution of all defining properties of a system. This asymptotic approach ensures a great deal of robustness to statistical uncertainty and temporal fluctuations. A characterization of those systems that are resilient to small shocks emerges, and we provide criteria that regulators might exploit in order to assess the stability of a financial system. We illustrate the application of these criteria for some exemplary configurations in the context of capital requirements and test the applicability of our results for systems of moderate size by Monte Carlo simulations.


title: Rotating and charged Taub-NUT-(A)dS spacetimes on a 3-brane

abstract: We construct novel solutions to the effective Einstein equation with four dimensional cosmological constant on a 3-brane in Randall-Sundrum II scenario. The charged solution is obtained by assuming the existence of localized Maxwell fields on the 3-brane. Timelike and null circular geodesics in the neutral rotating braneworld spacetime with NUT parameter are discussed, and we find that such geodesics cannot occur on the equatorial plane. On non-equatorial planes, timelike circular geodesics can occur for the negative tidal charge, but we cannot find numerical results to support the existence of non-equatorial null circular geodesics.


title: Nearly nondestructive thermometry of labeled cold atoms and application to isotropic laser cooling

abstract: We have designed and implemented a straightforward method to deterministically measure the temperature of the selected segment of a cold atom ensemble, and we have also developed an upgrade in the form of nondestructive thermometry. The essence is to monitor the thermal expansion of the targeted cold atoms after labeling them through manipulating the internal states, and the nondestructive property relies upon the nearly lossless detection via driving a cycling transition. For cold atoms subject to isotropic laser cooling, this method has the unique capability of addressing only the atoms on the optical detection axis within the enclosure, which is exactly the part we care about in major applications such as atomic clock or quantum sensing. Furthermore, our results confirm the sub-Doppler cooling features in isotropic laser cooling, and we have investigated the relevant cooling properties. Meanwhile, we have applied the recently developed optical configuration with the cooling laser injection in the form of hollow beams, which helps to enhance the cooling performance and accumulate more cold atoms in the central regions.


title: Constructing congruent number elliptic curves using 2-descent

abstract: A positive integer that is the area of some rational right triangle is called a congruent number. In an algebraic point of view, being a congruent number means satisfying a system of equations. As early as the 1800s, it is understood that if $n$ is a congruent number, then the equation $nm^2 = uv(u^2 - v^2)$ has a solution in $\mathbb{Z}$. Using the relation between congruent numbers and elliptic curves $E_n: y^2 = x^3 - n^2 x$ which was established in the 1900s, we will prove that the converse of this two century-old result holds as well. In addition to this, we present another proof of the converse using the method of 2-descent. Towards the end of this paper, we demonstrate how one can use our proof to construct subfamilies of $E_n$ with rank at least 2 and 3.


title: Super-resolved multispectral lensless microscopy via angle-tilted, wavelength-multiplexed ptychographic modulation

abstract: We report an angle-tilted, wavelength-multiplexed ptychographic modulation approach for multispectral lensless on-chip microscopy. In this approach, we illuminate the specimen with lights at 5 wavelengths simultaneously. A prism is added at the illumination path for spectral dispersion. Lightwaves at different wavelengths, thus, hit the specimen at slightly different incident angles, breaking the ambiguities in mixed state ptychographic reconstruction. At the detection path, we place a thin diffuser in-between the specimen and the monochromatic image sensor for encoding the spectral information into 2D intensity measurements. By scanning the sample to different x-y positions, we acquire a sequence of monochromatic images for reconstructing the 5 complex object profiles at the 5 wavelengths. An up-sampling procedure is integrated into the recovery process to bypass the resolution limit imposed by the imager pixel size. We demonstrate a half-pitch resolution of 0.55 microns using an image sensor with 1.85-micron pixel size. We also demonstrate quantitative and high-quality multispectral reconstructions of stained tissue sections for digital pathology applications.


title: Minimax Dynamics of Optimally Balanced Spiking Networks of Excitatory and Inhibitory Neurons

abstract: Excitation-inhibition (E-I) balance is ubiquitously observed in the cortex. Recent studies suggest an intriguing link between balance on fast timescales, tight balance, and efficient information coding with spikes. We further this connection by taking a principled approach to optimal balanced networks of excitatory (E) and inhibitory (I) neurons. By deriving E-I spiking neural networks from greedy spike-based optimizations of constrained minimax objectives, we show that tight balance arises from correcting for deviations from the minimax optima. We predict specific neuron firing rates in the network by solving the minimax problem, going beyond statistical theories of balanced networks. Finally, we design minimax objectives for reconstruction of an input signal, associative memory, and storage of manifold attractors, and derive from them E-I networks that perform the computation. Overall, we present a novel normative modeling approach for spiking E-I networks, going beyond the widely-used energy minimizing networks that violate Dale's law. Our networks can be used to model cortical circuits and computations.


title: Inflation with scalar-tensor theory of gravity

abstract: The latest released data from Planck in 2018, put up tighter constraints on inflationary parameters. In the present article, the in-built symmetry of the non-minimally coupled scalar-tensor theory of gravity is used to fix the coupling parameter, the functional Brans-Dicke parameter, and the potential of the theory. It is found that all the three different power-law potentials and one exponential, pass these constraints comfortably, and also gracefully exit from inflation.


title: Sparse Gaussian Process Based On Hat Basis Functions

abstract: Gaussian process is one of the most popular non-parametric Bayesian methodologies for modeling the regression problem. It is completely determined by its mean and covariance functions. And its linear property makes it relatively straightforward to solve the prediction problem. Although Gaussian process has been successfully applied in many fields, it is still not enough to deal with physical systems that satisfy inequality constraints. This issue has been addressed by the so-called constrained Gaussian process in recent years. In this paper, we extend the core ideas of constrained Gaussian process. According to the range of training or test data, we redefine the hat basis functions mentioned in the constrained Gaussian process. Based on hat basis functions, we propose a new sparse Gaussian process method to solve the unconstrained regression problem. Similar to the exact Gaussian process and Gaussian process with Fully Independent Training Conditional approximation, our method obtains satisfactory approximate results on open-source datasets or analytical functions. In terms of performance, the proposed method reduces the overall computational complexity from $O(n^{3})$ computation in exact Gaussian process to $O(nm^{2})$ with $m$ hat basis functions and $n$ training data points.


title: On lifting modules which do not satisfy the finite internal exchange property

abstract: In this paper, we consider the open problem: does any lifting module satisfy the finite internal exchange property? We give characterizations for the square of a hollow and uniform module to be lifting, and solve the above problem negatively as an application of this result.


title: Transactive Control of Electric Railways Using Dynamic Market Mechanisms

abstract: Electricity demand of electric railways is a relatively unexplored source of flexibility in demand response applications in power systems. In this paper, we propose a transactive control based optimization framework for coordinating the power grid network and the train network. This is accomplished by coordinating dispatchable distributed energy resources and demand profiles of trains using a two-step optimization. A railway based dynamic market mechanism (rDMM) is proposed for the dispatch of distributed energy resources (DER) in the power network along the electric railway using an iterative negotiation process, and generates profiles of electricity prices, and constitutes the first step. The train dispatch attempts minimize the operational costs of trains that ply along the railway, while subject to constraints on their acceleration profiles, route schedules, and the train dynamics, and generates demand profiles of trains and constitutes the second step. The rDMM seeks to optimize the operational costs of the underlying DERs while ensuring power balance. Together, they form an overall framework that yields the desired transactions between the railway and power grid infrastructures. This overall optimization approach is validated using simulation studies of the Southbound Amtrak service along the Northeast Corridor (NEC) in the United States, which shows a 25% reduction in energy costs when compared to standard trip optimization based on minimum work, and a 75% reduction in energy costs when compared to the train cost calculated using a field dataset.


title: Ratios of Hahn--Exton $q$-Bessel functions and $q$-Lommel polynomials

abstract: In 1993 Delest and F\'edou showed that a generating function for connected skew shapes is given as a ratio $J_{\nu+1}/J_{\nu}$ of the Hahn--Exton $q$-Bessel functions when a parameter $\nu$ is zero. They conjectured that when $\nu$ is a nonnegative integer the coefficients of the generating function are rational functions whose numerator and denominator are polynomials in $q$ with nonnegative integer coefficients, which is a $q$-analog of Kishore's 1963 result on Bessel functions. The first main result of this paper is a proof of the conjecture of Delest and F\'edou. The second main result is a refinement of the result of Delest and F\'edou: a generating function for connected skew shapes with bounded diagonals is given as a ratio of $q$-Lommel polynomials introduced by Koelink and Swarttouw. It is also shown that the ratio $J_{\nu+1}/J_{\nu}$ has two different continued fraction expressions, which give respectively a generating function for moments of orthogonal polynomials of type $R_I$ and a generating function for moments of usual orthogonal polynomials. Orthogonal polynomial techniques due to Flajolet and Viennot are used.


title: Surface geometry determined temperature-dependent band structure evolutions in organic halide perovskite single crystals

abstract: In this study, different electronic structure evolutions of perovskite single crystals are found via angle-resolved photoelectron spectroscopy (ARPES): (i) unchanged top valence band (VB) dispersions under different temperatures can be found in the CH3NH3PbI3, (ii) phase transitions induced the evolution of top VB dispersions, and even a top VB splitting with Rashba effects can be observed in the CH3NH3PbBr3. Combined with low-energy electron diffraction (LEED), metastable atom electron spectroscopy (MAES), and DFT calculation, we confirm different band structure evolutions observed in these two perovskite single crystals are originated from the cleaved top surface layers, where the different surface geometries with CH3NH3+-I in CH3NH3PbI3 and Pb-Br in CH3NH3PbBr3 are responsible for finding band dispersion change and appearing of the Rashba-type splitting. Such findings suggest that the top surface layer in organic halide perovskites should be carefully considered to create functional interfaces for developing perovskite devices.


title: Classification and Recognition of Encrypted EEG Data Neural Network

abstract: With the rapid development of Machine Learning technology applied in electroencephalography (EEG) signals, Brain-Computer Interface (BCI) has emerged as a novel and convenient human-computer interaction for smart home, intelligent medical and other Internet of Things (IoT) scenarios. However, security issues such as sensitive information disclosure and unauthorized operations have not received sufficient concerns. There are still some defects with the existing solutions to encrypted EEG data such as low accuracy, high time complexity or slow processing speed. For this reason, a classification and recognition method of encrypted EEG data based on neural network is proposed, which adopts Paillier encryption algorithm to encrypt EEG data and meanwhile resolves the problem of floating point operations. In addition, it improves traditional feed-forward neural network (FNN) by using the approximate function instead of activation function and realizes multi-classification of encrypted EEG data. Extensive experiments are conducted to explore the effect of several metrics (such as the hidden neuron size and the learning rate updated by improved simulated annealing algorithm) on the recognition results. Followed by security and time cost analysis, the proposed model and approach are validated and evaluated on public EEG datasets provided by PhysioNet, BCI Competition IV and EPILEPSIAE. The experimental results show that our proposal has the satisfactory accuracy, efficiency and feasibility compared with other solutions.


title: Chiral Light Emission from a Sphere Revealed by Nanoscale Relative Phase Mapping

abstract: Circularly polarized light (CPL) is currently receiving much attention as a key ingredient for next-generation information technologies, such as quantum communication and encryption. CPL photon generation for such applications is commonly realized by coupling achiral optical quantum emitters to chiral nanoantennas. Here, we explore a different strategy consisting in exciting a nanosphere -- the ultimate symmetric structure -- to produce all-directional CPL emission. Specifically, we demonstrate chiral emission from a silicon nanosphere induced by an electron beam based on two different strategies: dissolving the degeneracy of orthogonal dipole modes, and interference of electric and magnetic modes. We prove these concepts by visualizing the phase and polarization using a newly developed polarimetric four-dimensional cathodoluminescence method. Besides their fundamental interest, our results support the use of free-electron-induced light emission from spherically symmetric systems as a versatile platform for the generation of chiral light with on-demand control over the phase and degree of polarization.


title: Quantifier elimination for o-minimal structures expanded by a valuational cut

abstract: Let $R$ be an o-minimal expansion of a group in a language in which $\textrm{Th}(R)$ eliminates quantifiers, and let $C$ be a predicate for a valuational cut in $R$. We identify a condition that implies quantifier elimination for $\textrm{Th}(R,C)$ in the language of $R$ expanded by $C$ and a small number of constants, and which, in turn, is implied by $\textrm{Th}(R,C)$ having quantifier elimination and being universally axiomatizable. The condition applies for example in the case when $C$ is a convex subring of an o-minimal field $R$ and its residue field is o-minimal.


title: Room-temperature quantum spin Hall phase in laser-patterned few-layer 1T'- MoS2

abstract: The quantum-spin-Hall (QSH) phase of 2D topological insulators has attracted increased attention since the onset of 2D materials research. While large bulk gaps with vanishing edge gaps in atomically thin layers have been reported, verifications of the QSH phase by resistance measurements are comparatively few. This is partly due to the poor uniformity of the bulk gap induced by the substrate over a large sample area and/or defects induced by oxidation. Here, we report the observation of the QSH phase at room-temperature in the 1T'-phase of few-layer MoS2 patterned onto the 2H semiconducting phase using low-power and short-time laser beam irradiation. Two different resistance measurements reveal hallmark transport conductance values, ~e2/2h and e2/4h, as predicted by the theory. Magnetic-field dependence, scanning tunneling spectra, and calculations support the emergence of the room-temperature QSH phase. Although further experimental verification is still desirable, our results provide feasible application to room-temperature topological devices.


title: Harmonic Analysis and Gamma Functions on Symplectic Groups

abstract: Over a $p$-adic local field $F$ of characteristic zero, we develop a new type of harmonic analysis on an extended symplectic group $G={\mathbb G}_m\times{\mathrm Sp}_{2n}$. It is associated to the Langlands $\gamma$-functions attached to any irreducible admissible representations $\chi\otimes\pi$ of $G(F)$ and the standard representation $\rho$ of the dual group $G^\vee({\mathbb C})$, and confirms a series of the conjectures in the local theory of the Braverman-Kazhdan proposal for the case under consideration. Meanwhile, we develop a new type of harmonic analysis on ${\rm GL}_1(F)$, which is associated to a $\gamma$-function $\beta_\psi(\chi_s)$ (a product of $n+1$ certain abelian $\gamma$-functions). Our work on ${\rm GL}_1(F)$ plays an indispensable role in the development of our work on $G(F)$. These two types of harmonic analyses both specialize to the well-known local theory developed in Tate's thesis when $n=0$. The approach is to use the compactification of ${\rm Sp}_{2n}$ in the Grassmannian variety of ${\rm Sp}_{4n}$, with which we are able to utilize the well developed local theory of Piatetski-Shapiro and Rallis and many other works) on the doubling local zeta integrals for the standard $L$-functions of ${\rm Sp}_{2n}$. The method can be viewed as an extension of the work of Godement-Jacquet for the standard $L$-function of ${\rm GL}_n$ and is expected to work for all classical groups. We will consider the archimedean local theory and the global theory in our future work.


title: "Solutocapillary Marangoni flow induced in waterbody by solute source"

abstract: The aim of this paper is to experimentally and analytically study the solutocapillary flow induced in a waterbody due to the presence of a solute source on its surface and the mixing induced by this flow of the solutes and gases dissolved at and near the surface into the waterbody. According to the analytic solution, the induced flow is analogous to a doublet flow in the sense that the flow is directed towards the source within a conical region with its vertex at the source, and outside the conical region the flow moves away from the source. The half cone angle for a negative source increases from $\sim$60 degrees with increasing source strength and Schmidt number reaching values greater than 80 degrees. When the cone angle is large, the outflow is restricted to a thin annular boundary layer region. These analytic results are in agreement with our experimental data obtained by the PIV (Particle Image Velocimetry) and PLIF (planar laser-induced fluorescence) techniques. As the solute gradient at the surface gives rise to the force that drives the flow, when the solute diffusion coefficient is reduced the flow becomes stronger and persists longer because the solute gradient is maintained for a longer time and distance. In experiments, the flow changes direction into the waterbody and the surface flow stops when the solute induced surface tension gradient driving the flow becomes comparable to the surface tension gradients that exist on the surface due to temperature gradients.


title: Automation of the AST3 optical sky survey from Dome~A, Antarctica

abstract: The 0.5\,m Antarctic Survey Telescopes (AST3) were designed for time-domain optical/infrared astronomy. They are located in Dome~A, Antarctica, where they can take advantage of the continuous dark time during winter. Since the site is unattended in winter, everything for the operation, from observing to data reduction, had to be fully automated. Here, we present a brief overview of the AST3 project and some of its unique characteristics due to its location in Antarctica. We summarise the various components of the survey, including the customized hardware and software, that make complete automation possible.


title: Emotion Recognition in Audio and Video Using Deep Neural Networks

abstract: Humans are able to comprehend information from multiple domains for e.g. speech, text and visual. With advancement of deep learning technology there has been significant improvement of speech recognition. Recognizing emotion from speech is important aspect and with deep learning technology emotion recognition has improved in accuracy and latency. There are still many challenges to improve accuracy. In this work, we attempt to explore different neural networks to improve accuracy of emotion recognition. With different architectures explored, we find (CNN+RNN) + 3DCNN multi-model architecture which processes audio spectrograms and corresponding video frames giving emotion prediction accuracy of 54.0% among 4 emotions and 71.75% among 3 emotions using IEMOCAP[2] dataset.


title: Shapley Supercluster Survey: mapping the dark matter distribution

abstract: We present a 23deg$^2$ weak gravitational lensing survey of the Shapley supercluster core and its surroundings using $gri$ VST images as part of the Shapley Supercluster Survey (ShaSS). This study reveals the overall matter distribution over a region containing 11 clusters at $z{\sim}0.048$ that are all interconnected, as well as several ongoing cluster-cluster interactions. Galaxy shapes have been measured by using the Kaiser-Squires-Broadhurst method for the $g$- and $r$-band images and background galaxies were selected via the $gri$ colour-colour diagram. This technique has allowed us to detect all of the clusters, either in the $g$-band or $r$-band images, although at different $\sigma$ levels, indicating that the underlying dark matter distribution is tightly correlated with the number density of the member galaxies. The deeper $r$-band images have traced the five interacting clusters in the supercluster core as a single coherent structure, confirmed the presence of a filament extending North from the core, and have revealed a background cluster at $z{\sim}0.17$. We have measured the masses of the four richest clusters (A3556, A3558, A3560 and A3562) in the two-dimensional shear pattern, assuming a spherical Navarro-Frenk-White (NFW) profile and obtaining a total mass of $\mathcal{M}_{\rm ShaSS,WL}{=}1.56^{+0.81}_{-0.55}{\times}10^{15\,}{\rm M}_{\odot}$, which is consistent with dynamical and X-ray studies. Our analysis provides further evidence of the ongoing dynamical evolution in the ShaSS region.


title: An Embarrassingly Simple Approach for Trojan Attack in Deep Neural Networks

abstract: With the widespread use of deep neural networks (DNNs) in high-stake applications, the security problem of the DNN models has received extensive attention. In this paper, we investigate a specific security problem called trojan attack, which aims to attack deployed DNN systems relying on the hidden trigger patterns inserted by malicious hackers. We propose a training-free attack approach which is different from previous work, in which trojaned behaviors are injected by retraining model on a poisoned dataset. Specifically, we do not change parameters in the original model but insert a tiny trojan module (TrojanNet) into the target model. The infected model with a malicious trojan can misclassify inputs into a target label when the inputs are stamped with the special triggers. The proposed TrojanNet has several nice properties including (1) it activates by tiny trigger patterns and keeps silent for other signals, (2) it is model-agnostic and could be injected into most DNNs, dramatically expanding its attack scenarios, and (3) the training-free mechanism saves massive training efforts comparing to conventional trojan attack methods. The experimental results show that TrojanNet can inject the trojan into all labels simultaneously (all-label trojan attack) and achieves 100% attack success rate without affecting model accuracy on original tasks. Experimental analysis further demonstrates that state-of-the-art trojan detection algorithms fail to detect TrojanNet attack. The code is available at https://github.com/trx14/TrojanNet.


title: Emergence of Long-Range Correlations in Random Networks

abstract: We perform an analytical analysis of the long-range degree correlation of the giant component in an uncorrelated random network by employing generating functions. By introducing a characteristic length, we find that a pair of nodes in the giant component is negatively degree-correlated within the characteristic length and uncorrelated otherwise. At the critical point, where the giant component becomes fractal, the characteristic length diverges and the negative long-range degree correlation emerges. We further propose a correlation function for degrees of the $l$-distant node pairs, which behaves as an exponentially decreasing function of distance in the off-critical region. The correlation function obeys a power-law with an exponential cutoff near the critical point. The Erd\H{o}s-R\'{e}nyi random graph is employed to confirm this critical behavior.


title: Parametric amplifier for Bell measurement in continuous-variable quantum state teleportation

abstract: A parametric amplifier is in essence a linear four-port device, which couples and linearly mixes two inputs before amplifying and sending them to two output ports. Here, we show that for quadrature-phase amplitudes, a parametric amplifier can replace beam splitters to play the role of mixer. We apply this idea to a continuous-variable quantum state teleportation scheme in which a parametric amplifier replaces a beam splitter in Bell measurement. We show that this scheme is loss-tolerant in the Bell measurement process and thus demonstrate the advantage of PA over BS in the applications in quantum measurement.


title: Load-balanced Service Function Chaining in Edge Computing over FiWi Access Networks for Internet of Things

abstract: Service function chaining (SFC) is promising to implement flexible and scalable virtual network infrastructure for the Internet of Things (IoT). Edge computing is envisioned to be an effective solution to process huge amount of IoT application data. In order to uniformly provide services to IoT applications among the distributed edge computing nodes (ECNs), we present a unified SFC orchestration framework based on the coordination of SDN and NFV, which provides a synergic edge cloud platform by exploiting the connectivity of FiWi access networks. In addition, we study the VNF deployment problem under our synergic framework, and we formulate it as a mixed-integer nonlinear programming (MINLP) problem jointly considering the load balancing of networking and computing for chaining VNFs. We also propose two approximation optimal deployment algorithms named Greedy-Bisection Multi-Path (GBMP) and KSP MultiPath (KSMP) taking advantage of the multi-instance virtual network functions (VNFs) deployed in ECNs and the multipath capacity in FiWi access networks. Extensive simulations are conducted in two types of IoT application scenarios in the EC over FiWi access networks. The numerical results show that our proposed algorithms are superior to single path and ECMP based deployment algorithms in terms of load balancing, service acceptance ratio, and network utilization in both two typical scenarios.


title: Low-rank tensor methods for Markov chains with applications to tumor progression models

abstract: Continuous-time Markov chains describing interacting processes exhibit a state space that grows exponentially in the number of processes. This state-space explosion renders the computation or storage of the time-marginal distribution, which is defined as the solution of a certain linear system, infeasible using classical methods. We consider Markov chains whose transition rates are separable functions, which allows for an efficient low-rank tensor representation of the operator of this linear system. Typically, the right-hand side also has low-rank structure, and thus we can reduce the cost for computation and storage from exponential to linear. Previously known iterative methods also allow for low-rank approximations of the solution but are unable to guarantee that its entries sum up to one as required for a probability distribution. We derive a convergent iterative method using low-rank formats satisfying this condition. We also perform numerical experiments illustrating that the marginal distribution is well approximated with low rank.


title: Notes on unitary theta representations of compact groups

abstract: We continue our work on understanding Howe correspondences by using theta representations from p-adic groups to compact groups. We prove some results for unitary theta representations of compact groups with respect to the induction and restriction functors.


title: Structure of the ground and excited states in $_{\Lambda}^{9}$Be nucleus

abstract: We investigate properties of bound and resonance states in the $_{\Lambda}^{9}$Be nucleus. To reveal the nature of these states, we use a three-cluster $2\alpha+\Lambda$ microscopic model. The model incorporates Gaussian and oscillator basis functions and reduces a three-cluster Schr\"{o}dinger equation to a two-body like many-channel problem with the two-cluster subsystems ($_{\Lambda}^{5}$He and $^8$Be) being in a bound or a pseudo-bound state. Influence of the cluster polarization on the energy and widths of resonance states in $_{\Lambda}^{9}$Be and on elastic and inelastic $_{\Lambda}^{5}$He+$\alpha$ scattering is analyzed.


title: Learning Bounds for Risk-sensitive Learning

abstract: In risk-sensitive learning, one aims to find a hypothesis that minimizes a risk-averse (or risk-seeking) measure of loss, instead of the standard expected loss. In this paper, we propose to study the generalization properties of risk-sensitive learning schemes whose optimand is described via optimized certainty equivalents (OCE): our general scheme can handle various known risks, e.g., the entropic risk, mean-variance, and conditional value-at-risk, as special cases. We provide two learning bounds on the performance of empirical OCE minimizer. The first result gives an OCE guarantee based on the Rademacher average of the hypothesis space, which generalizes and improves existing results on the expected loss and the conditional value-at-risk. The second result, based on a novel variance-based characterization of OCE, gives an expected loss guarantee with a suppressed dependence on the smoothness of the selected OCE. Finally, we demonstrate the practical implications of the proposed bounds via exploratory experiments on neural networks.


title: The unboundedness of Hausdorff operators on Quasi-Banach spaces

abstract: In this note, we show that the Hausdorff operator $H_{\Phi}$ is unbounded on a large family of Quasi-Banach spaces, unless $H_{\Phi}$ is a zero operator.


title: The Social Contract for AI

abstract: Like any technology, AI systems come with inherent risks and potential benefits. It comes with potential disruption of established norms and methods of work, societal impacts and externalities. One may think of the adoption of technology as a form of social contract, which may evolve or fluctuate in time, scale, and impact. It is important to keep in mind that for AI, meeting the expectations of this social contract is critical, because recklessly driving the adoption and implementation of unsafe, irresponsible, or unethical AI systems may trigger serious backlash against industry and academia involved which could take decades to resolve, if not actually seriously harm society. For the purpose of this paper, we consider that a social contract arises when there is sufficient consensus within society to adopt and implement this new technology. As such, to enable a social contract to arise for the adoption and implementation of AI, developing: 1) A socially accepted purpose, through 2) A safe and responsible method, with 3) A socially aware level of risk involved, for 4) A socially beneficial outcome, is key.


title: Non-convex Min-Max Optimization: Applications, Challenges, and Recent Theoretical Advances

abstract: The min-max optimization problem, also known as the saddle point problem, is a classical optimization problem which is also studied in the context of zero-sum games. Given a class of objective functions, the goal is to find a value for the argument which leads to a small objective value even for the worst case function in the given class. Min-max optimization problems have recently become very popular in a wide range of signal and data processing applications such as fair beamforming, training generative adversarial networks (GANs), and robust machine learning, to just name a few. The overarching goal of this article is to provide a survey of recent advances for an important subclass of min-max problem, where the minimization and maximization problems can be non-convex and/or non-concave. In particular, we will first present a number of applications to showcase the importance of such min-max problems; then we discuss key theoretical challenges, and provide a selective review of some exciting recent theoretical and algorithmic advances in tackling non-convex min-max problems. Finally, we will point out open questions and future research directions.


title: Expanding phenomena over higher dimensional matrix rings

abstract: In this paper, we study the expanding phenomena in the setting of higher dimensional matrix rings. More precisely, we obtain a sum-product estimate for large subsets and show that x+yz, x(y+z) are moderate expanders over the matrix ring, and xy + z + t is strong expander over the matrix rings. These results generalize recent results of Y.D. Karabulut, D. Koh, T. Pham, C-Y. Shen, and the second listed author.


title: Anomalous Motion Detection on Highway Using Deep Learning

abstract: Research in visual anomaly detection draws much interest due to its applications in surveillance. Common datasets for evaluation are constructed using a stationary camera overlooking a region of interest. Previous research has shown promising results in detecting spatial as well as temporal anomalies in these settings. The advent of self-driving cars provides an opportunity to apply visual anomaly detection in a more dynamic application yet no dataset exists in this type of environment. This paper presents a new anomaly detection dataset - the Highway Traffic Anomaly (HTA) dataset - for the problem of detecting anomalous traffic patterns from dash cam videos of vehicles on highways. We evaluate state-of-the-art deep learning anomaly detection models and propose novel variations to these methods. Our results show that state-of-the-art models built for settings with a stationary camera do not translate well to a more dynamic environment. The proposed variations to these SoTA methods show promising results on the new HTA dataset.


title: A Matrix Generalization of the Hardy-Littlewood-P\'olya Rearrangement Inequality and Its Applications

abstract: We prove a generalization of the Hardy-Littlewood-P\'olya rearrangement inequality to positive definite matrices. The inequality can be seen as a commutation principle in the sense of Iusem and Seeger. An important instrument in the proof is a first-order perturbation formula for a certain spectral function, which could be of independent interests. The inequality is then extended to rectangular matrices. Using our main results, we derive new inequalities for several distance-like functions encountered in various signal processing or machine learning applications.


title: Classifying degraded images over various levels of degradation

abstract: Classification for degraded images having various levels of degradation is very important in practical applications. This paper proposes a convolutional neural network to classify degraded images by using a restoration network and an ensemble learning. The results demonstrate that the proposed network can classify degraded images over various levels of degradation well. This paper also reveals how the image-quality of training data for a classification network affects the classification performance of degraded images.


title: Almost and weakly almost periodic functions on the unitary groups of von Neumann algebras

abstract: Let $M\subset B(\mathcal H)$ be a von Neumann algebra acting on the Hilbert space $\mathcal H$. We prove that $M$ is finite if and only if, for every $x\in M$ and for all vectors $\xi,\eta\in\mathcal H$, the coefficient function $u\mapsto \langle uxu^*\xi|\eta\rangle$ is weakly almost periodic on the topological group $U_M$ of unitaries in $M$ (equipped with the weak or strong operator topology). The main device is the unique invariant mean on the $C^*$-algebra $\operatorname{WAP}(U_M)$ of weakly almost periodic functions on $U_M$. Next, we prove that every coefficient function $u\mapsto \langle uxu^*\xi|\eta\rangle$ is almost periodic if and only if $M$ is a direct sum of a diffuse, abelian von Neumann algebra and finite-dimensional factors. Incidentally, we prove that if $M$ is a diffuse von Neumann algebra, then its unitary group is minimally almost periodic.


abstract: Toeplitz matrices for the study of the fractional Laplacian on a bounded interval. In this work we get a deep link between (--$\Delta$) $\alpha$ ]0,1[ the fractional Laplacian on the interval ]0, 1[ and T N ($\Phi$ $\alpha$) the Toeplitz matrices of symbol $\Phi$ $\alpha$ : $\theta$ $\rightarrow$ |1 -- e i$\theta$ | 2$\alpha$ when N goes to the infinity and for $\alpha$ $\in$]0, 1 2 [$\cup$] 1 2 , 1[. In the second part of the paper we provide a Green function for the fractional equation (--$\Delta$) $\alpha$ ]0,1[ ($\psi$) = f for $\alpha$ $\in$]0, 1 2 [ and f a sufficiently smooth function on [0, 1]. The interest is that this Green's function is the same as the Laplacian operator of order 2n, n $\in$ N. Mathematical Subject Classification (2000) Primary 35S05, 35S10,35S11 ; Secondary 47G30.


title: Conservative MOND from first principles

abstract: The primary argument levelled against Milgrom's MOND is that it has no theoretical support, even though considerable effort has been expended in attempting to provide it. Against that criticism, MOND irrefutably enjoys an expanding portfolio of success and so is almost certainly tapping into something fundamental. But what? Over roughly the same period that MOND has been a topic of controversy, Baryshev, Sylos Labini and others have been claiming, with equal controversy in earlier years, that, on medium scales at least, material in the universe is distributed in a quasi-fractal $D\approx 2$ fashion. There is a link: if the idea of a quasi-fractal $D\approx 2$ universe on medium scales is taken seriously, then there is an associated characteristic mass surface density, $\Sigma_F$ say, and an associated characteristic acceleration scale $a_F = 4\pi G \,\Sigma_F$. The whole success of MOND is predicated upon the idea of a critical acceleration scale, $a_0$. It is an obvious step to make the association $a_0 \sim a_F$ and then to consider the MOND critical acceleration boundary simply as a marker for a characteristic mass surface density boundary separating 'galaxy' from an environment characterized by $\Sigma_F$. This provides a route to the synthesis of conservative MOND from first principles. The radial acceleration relation (RAR) for conservative MOND when applied to the SPARC sample is the unity line. There is no mass discrepancy.


title: GNNGuard: Defending Graph Neural Networks against Adversarial Attacks

abstract: Deep learning methods for graphs achieve remarkable performance across a variety of domains. However, recent findings indicate that small, unnoticeable perturbations of graph structure can catastrophically reduce performance of even the strongest and most popular Graph Neural Networks (GNNs). Here, we develop GNNGuard, a general algorithm to defend against a variety of training-time attacks that perturb the discrete graph structure. GNNGuard can be straight-forwardly incorporated into any GNN. Its core principle is to detect and quantify the relationship between the graph structure and node features, if one exists, and then exploit that relationship to mitigate negative effects of the attack.GNNGuard learns how to best assign higher weights to edges connecting similar nodes while pruning edges between unrelated nodes. The revised edges allow for robust propagation of neural messages in the underlying GNN. GNNGuard introduces two novel components, the neighbor importance estimation, and the layer-wise graph memory, and we show empirically that both components are necessary for a successful defense. Across five GNNs, three defense methods, and five datasets,including a challenging human disease graph, experiments show that GNNGuard outperforms existing defense approaches by 15.3% on average. Remarkably, GNNGuard can effectively restore state-of-the-art performance of GNNs in the face of various adversarial attacks, including targeted and non-targeted attacks, and can defend against attacks on heterophily graphs.


title: A VIKOR and TOPSIS focused reanalysis of the MADM methods based on logarithmic normalization

abstract: Decision and policy-makers in multi-criteria decision-making analysis take into account some strategies in order to analyze outcomes and to finally make an effective and more precise decision. Among those strategies, the modification of the normalization process in the multiple-criteria decision-making algorithm is still a question due to the confrontation of many normalization tools. Normalization is the basic action in defining and solving a MADM problem and a MADM model. Normalization is the first, also necessary, step in solving, i.e. the application of a MADM method. It is a fact that the selection of normalization methods has a direct effect on the results. One of the latest normalization methods introduced is the Logarithmic Normalization (LN) method. This new method has a distinguished advantage, reflecting in that a sum of the normalized values of criteria always equals 1. This normalization method had never been applied in any MADM methods before. This research study is focused on the analysis of the classical MADM methods based on logarithmic normalization. VIKOR and TOPSIS, as the two famous MADM methods, were selected for this reanalysis research study. Two numerical examples were checked in both methods, based on both the classical and the novel ways based on the LN. The results indicate that there are differences between the two approaches. Eventually, a sensitivity analysis is also designed to illustrate the reliability of the final results.


title: Group Decision Support for agriculture planning by a combination of Mathematical Model and Collaborative Tool

abstract: Decision making in the Agriculture domain can be a complex task. The land area allocated to each crop should be fixed every season according to several parameters: prices, demand, harvesting periods, seeds, ground, season etc... The decision to make becomes more difficult when a group of farmers must fix the price and all parameters all together. Generally, optimization models are useful for farmers to find no dominated solutions, but it remains difficult if the farmers have to agree on one solution. We combine two approaches in order to support a group of farmers engaged in this kind of decision making process. We firstly generate a set of no dominated solutions thanks to a centralized optimization model. Based on this set of solution we then used a Group Decision Support System called GRUS for choosing the best solution for the group of farmers. The combined approach allows us to determine the best solution for the group in a consensual way. This combination of approaches is very innovative for the Agriculture. This approach has been tested in laboratory in a previous work. In the current work the same experiment has been conducted with real business (farmers) in order to benefit from their expertise. The two experiments are compared.


title: ForMIC: Foraging via Multiagent RL with Implicit Communication

abstract: Multi-agent foraging (MAF) involves distributing a team of agents to search an environment and extract resources from it. Nature provides several examples of highly effective foragers, where individuals within the foraging collective use biological markers (e.g., pheromones) to communicate critical information to others via the environment. In this work, we propose ForMIC, a distributed reinforcement learning MAF approach that endows agents with implicit communication abilities via their shared environment. However, learning efficient policies with stigmergic interactions is highly nontrivial, since agents need to perform well to send each other useful signals, but also need to sense others' signals to perform well. In this work, we develop several key learning techniques for training policies with stigmergic interactions, where such a circular dependency is present. By relying on clever curriculum learning design, action filtering, and the introduction of non-learning agents to increase the agent density at training time at low computational cost, we develop a minimal learning framework that leads to the stable training of efficient stigmergic policies. We present simulation results which demonstrate that our learned policy outperforms existing state-of-the-art MAF algorithms in a set of experiments that vary team size, number and placement of resources, and key environmental dynamics not seen at training time.


title: Intelligent Decision Support System for Updating Control Plans

abstract: In the current competitive environment, it is crucial for manufacturers to make the best decisions in the shortest time, in order to optimize the efficiency and effectiveness of the manufacturing systems. These decisions reach from the strategic level to tactical and operational production planning and control. In this context, elaborating intelligent decisions support systems (DSS) that are capable of integrating a wide variety of models along with data and knowledge resources has become promising. This paper proposes an intelligent DSS for quality control planning. The DSS is a recommender system (RS) that helps the decision maker to select the best control scenario using two different approaches. The first is a manual choice using a multi-criteria decision making method. The second is an automatic recommendation based on case-based reasoning (CBR) technique. Furthermore, the proposed RS makes it possible to continuously update the control plans in order to be adapted to the actual process quality situation. In so doing, CBR is used for learning the required knowledge in order to improve the decision quality. A numerical application is performed in a real case study in order to illustrate the feasibility and practicability of the proposed DSS.


title: On symmetries of iterates of rational functions

abstract: Let $A$ be a rational function of degree $n\geq 2$. Let us denote by $ G(A)$ the group of M\"obius transformations $\sigma$ such that $ A\circ \sigma=\nu_{\sigma} \circ A$ for some M\"obius transformations $\nu_{\sigma}$, and by $\Sigma(A)$ and ${\rm Aut}(A)$ the subgroups of $ G(A)$ consisting of $\sigma$ such that $ A\circ \sigma= A$ and $ A\circ \sigma= \sigma \circ A$, correspondingly. In this paper, we study sequences of the above groups arising from iterating $A$. In particular, we show that if $A$ is not conjugate to $z^{\pm n},$ then the orders of the groups $ G(A^{\circ k})$, $k\geq 2,$ are finite and uniformly bounded in terms of $n$ only. We also prove a number of results about the groups $\Sigma_{\infty}(A)=\cup_{k=1}^{\infty} \Sigma(A^{\circ k})$ and ${\rm Aut}_{\infty}(A)=\cup_{k=1}^{\infty} {\rm Aut}(A^{\circ k})$, which are especially interesting from the dynamical perspective.


title: Selection of an Integrated Security Area for locating a State Military Organization (SMO) based on group decision system: a multicriteria approach

abstract: Over the past few years there has been growing concern among authorities over crimes committed worldwide. In Brazil it is no different. High crime rates have encouraged government authorities involved in public safety to identify solutions to minimize crimes. In this context, one way to plan and manage security is in the division of neighborhoods in ISA (Integrated Security Areas). Each ISA has a neighborhood conglomerates taking into account their geolocation. From this it becomes possible to maximize security management and combat crime. Based on that, one of the main points that generate great discussion at the governmental level is the choice of a certain integrated security area for the installation of a certain police battalion. This choice involves multiple decision makers since several hierarchies are involved. Thus, this paper aims to identify the best ISA to deploy a police battalion using group decision techniques and tools. For this work the Group Decision Support System (GDSS) called GRoUp Support (GRUS) was used from two main Vote techniques: Condorcet and Borda. With this it was possible to identify the best ISA taking into account the pre-established criteria.


title: Solution Subset Selection for Final Decision Making in Evolutionary Multi-Objective Optimization

abstract: In general, a multi-objective optimization problem does not have a single optimal solution but a set of Pareto optimal solutions, which forms the Pareto front in the objective space. Various evolutionary algorithms have been proposed to approximate the Pareto front using a pre-specified number of solutions. Hundreds of solutions are obtained by their single run. The selection of a single final solution from the obtained solutions is assumed to be done by a human decision maker. However, in many cases, the decision maker does not want to examine hundreds of solutions. Thus, it is needed to select a small subset of the obtained solutions. In this paper, we discuss subset selection from a viewpoint of the final decision making. First we briefly explain existing subset selection studies. Next we formulate an expected loss function for subset selection. We also show that the formulated function is the same as the IGD plus indicator. Then we report experimental results where the proposed approach is compared with other indicator-based subset selection methods.


title: Fine-Grained Analysis of Stability and Generalization for Stochastic Gradient Descent

abstract: Recently there are a considerable amount of work devoted to the study of the algorithmic stability and generalization for stochastic gradient descent (SGD). However, the existing stability analysis requires to impose restrictive assumptions on the boundedness of gradients, strong smoothness and convexity of loss functions. In this paper, we provide a fine-grained analysis of stability and generalization for SGD by substantially relaxing these assumptions. Firstly, we establish stability and generalization for SGD by removing the existing bounded gradient assumptions. The key idea is the introduction of a new stability measure called on-average model stability, for which we develop novel bounds controlled by the risks of SGD iterates. This yields generalization bounds depending on the behavior of the best model, and leads to the first-ever-known fast bounds in the low-noise setting using stability approach. Secondly, the smoothness assumption is relaxed by considering loss functions with Holder continuous (sub)gradients for which we show that optimal bounds are still achieved by balancing computation and stability. To our best knowledge, this gives the first-ever-known stability and generalization bounds for SGD with even non-differentiable loss functions. Finally, we study learning problems with (strongly) convex objectives but non-convex loss functions.


title: Global Aspects of Doubled Geometry and Pre-rackoid

abstract: The integration problem of a C-bracket and a Vaisman (metric, pre-DFT) algebroid which are geometric structures of double field theory (DFT) is analyzed. We introduce a notion of a pre-rackoid as a global group-like object for an infinitesimal algebroid structure. We propose that several realizations of pre-rackoid structures. One realization is that elements of a pre-rackoid are defined by cotangent paths along doubled foliations in a para-Hermitian manifold. Another realization is proposed as a formal exponential map of the algebroid of DFT. We show that the pre-rackoid reduces to a rackoid that is the integration of the Courant algebroid when the strong constraint of DFT is imposed. Finally, for a physical application, we exhibit an implementation of the (pre-)rackoid in a three-dimensional topological sigma model.


title: Survey on Deep Multi-modal Data Analytics: Collaboration, Rivalry and Fusion

abstract: With the development of web technology, multi-modal or multi-view data has surged as a major stream for big data, where each modal/view encodes individual property of data objects. Often, different modalities are complementary to each other. Such fact motivated a lot of research attention on fusing the multi-modal feature spaces to comprehensively characterize the data objects. Most of the existing state-of-the-art focused on how to fuse the energy or information from multi-modal spaces to deliver a superior performance over their counterparts with single modal. Recently, deep neural networks have exhibited as a powerful architecture to well capture the nonlinear distribution of high-dimensional multimedia data, so naturally does for multi-modal data. Substantial empirical studies are carried out to demonstrate its advantages that are benefited from deep multi-modal methods, which can essentially deepen the fusion from multi-modal deep feature spaces. In this paper, we provide a substantial overview of the existing state-of-the-arts on the filed of multi-modal data analytics from shallow to deep spaces. Throughout this survey, we further indicate that the critical components for this field go to collaboration, adversarial competition and fusion over multi-modal spaces. Finally, we share our viewpoints regarding some future directions on this field.


title: Lower Bounds and a Near-Optimal Shrinkage Estimator for Least Squares using Random Projections

abstract: In this work, we consider the deterministic optimization using random projections as a statistical estimation problem, where the squared distance between the predictions from the estimator and the true solution is the error metric. In approximately solving a large scale least squares problem using Gaussian sketches, we show that the sketched solution has a conditional Gaussian distribution with the true solution as its mean. Firstly, tight worst case error lower bounds with explicit constants are derived for any estimator using the Gaussian sketch, and the classical sketching is shown to be the optimal unbiased estimator. For biased estimators, the lower bound also incorporates prior knowledge about the true solution. Secondly, we use the James-Stein estimator to derive an improved estimator for the least squares solution using the Gaussian sketch. An upper bound on the expected error of this estimator is derived, which is smaller than the error of the classical Gaussian sketch solution for any given data. The upper and lower bounds match when the SNR of the true solution is known to be small and the data matrix is well conditioned. Empirically, this estimator achieves smaller error on simulated and real datasets, and works for other common sketching methods as well.


title: Optimal Transport for Conditional Domain Matching and Label Shift

abstract: We address the problem of unsupervised domain adaptation under the setting of generalized target shift (joint class-conditional and label shifts). For this framework, we theoretically show that, for good generalization, it is necessary to learn a latent representation in which both marginals and class-conditional distributions are aligned across domains. For this sake, we propose a learning problem that minimizes importance weighted loss in the source domain and a Wasserstein distance between weighted marginals. For a proper weighting, we provide an estimator of target label proportion by blending mixture estimation and optimal matching by optimal transport. This estimation comes with theoretical guarantees of correctness under mild assumptions. Our experimental results show that our method performs better on average than competitors across a range domain adaptation problems including \emph{digits},\emph{VisDA} and \emph{Office}. Code for this paper is available at \url{https://github.com/arakotom/mars_domain_adaptation}.


title: Filter design for small target detection on infrared imagery using normalized-cross-correlation layer

abstract: In this paper, we introduce a machine learning approach to the problem of infrared small target detection filter design. For this purpose, similarly to a convolutional layer of a neural network, the normalized-cross-correlational (NCC) layer, which we utilize for designing a target detection/recognition filter bank, is proposed. By employing the NCC layer in a neural network structure, we introduce a framework, in which supervised training is used to calculate the optimal filter shape and the optimum number of filters required for a specific target detection/recognition task on infrared images. We also propose the mean-absolute-deviation NCC (MAD-NCC) layer, an efficient implementation of the proposed NCC layer, designed especially for FPGA systems, in which square root operations are avoided for real-time computation. As a case study we work on dim-target detection on mid-wave infrared imagery and obtain the filters that can discriminate a dim target from various types of background clutter, specific to our operational concept.


title: On the approximation of vorticity fronts by the Burgers-Hilbert equation

abstract: This paper proves that the motion of small-slope vorticity fronts in the two-dimensional incompressible Euler equations is approximated on cubically nonlinear timescales by a Burgers-Hilbert equation derived by Biello and Hunter (2010) using formal asymptotic expansions. The proof uses a modified energy method to show that the contour dynamics equations for vorticity fronts in the Euler equations and the Burgers-Hilbert equation are both approximated by the same cubically nonlinear asymptotic equation. The contour dynamics equations for Euler vorticity fronts are also derived.


title: COVID-19 Vaccine Acceptance in the US and UK in the Early Phase of the Pandemic: AI-Generated Vaccines Hesitancy for Minors, and the Role of Governments

abstract: This study presents survey results of the public's willingness to get vaccinated against COVID-19 during an early phase of the pandemic and examines factors that could influence vaccine acceptance based on a between-subjects design. A representative quota sample of 572 adults in the US and UK participated in an online survey. First, the participants' medical use tendencies and initial vaccine acceptance were assessed; then, short vignettes were provided to evaluate their changes in attitude towards COVID-19 vaccines. For data analysis, ANOVA and post hoc pairwise comparisons were used. The participants were more reluctant to vaccinate their children than themselves and the elderly. The use of artificial intelligence (AI) in vaccine development did not influence vaccine acceptance. Vignettes that explicitly stated the high effectiveness of vaccines led to an increase in vaccine acceptance. Our study suggests public policies emphasizing the vaccine effectiveness against the virus could lead to higher vaccination rates. We also discuss the public's expectations of governments concerning vaccine safety and present a series of implications based on our findings.


title: Sharp Strichartz estimates for the Schr\"odinger equation on the sphere

abstract: In this contribution we investigate the Schr\"ordinger equation associated to the Laplacian on the sphere in the form of sharp Strichartz estimates. We will provided simple proofs for our main theorems using purely the $L^2\rightarrow L^p$ spectral estimates for the operator norm of the spectral projections (associated to the spherical harmonics) proved in [8]. A sharp index of regularity is established for the initial data in spheres of arbitrary dimension $d\geq 2$.


title: Horn problem for quasi-hermitian Lie groups

abstract: In this paper, we prove some convexity results associated to orbit projection of non-compact real reductive Lie groups.


title: Improved Complexities for Stochastic Conditional Gradient Methods under Interpolation-like Conditions

abstract: We analyze stochastic conditional gradient methods for constrained optimization problems arising in over-parametrized machine learning. We show that one could leverage the interpolation-like conditions satisfied by such models to obtain improved oracle complexities. Specifically, when the objective function is convex, we show that the conditional gradient method requires $\mathcal{O}(\epsilon^{-2})$ calls to the stochastic gradient oracle to find an $\epsilon$-optimal solution. Furthermore, by including a gradient sliding step, we show that the number of calls reduces to $\mathcal{O}(\epsilon^{-1.5})$.


title: Triple-pomeron amplitude in the effective action approach

abstract: In the effective action approach the imaginary part of the triple pomeron amplitude is calculated. The found dependence on the longitudinal momentum transfer $\e$ is found to separate as a simple factor $1/|\e|$. This result is used to calculate the high-mass diffraction on a hadron and double scattering cross-section off a composite target}


title: $\mathbb{Z}_2\times \mathbb{Z}_2$-graded supersymmetry: $2$-d sigma models

abstract: We propose a natural $\mathbb{Z}_2 \times \mathbb{Z}_2$-graded generalisation of $d=2$, $\mathcal{N}=(1,1)$ supersymmetry and construct a $\mathbb{Z}_2^2$-space realisation thereof. Due to the grading, the supercharges close with respect to, in the classical language, a commutator rather than an anticommutator. This is then used to build classical (linear and non-linear) sigma models that exhibit this novel supersymmetry via mimicking standard superspace methods. The fields in our models are bosons, right-handed and left-handed Majorana-Weyl spinors, and exotic bosons. The bosons commute with all the fields, the spinors belong to different sectors that cross commute rather than anticommute, while the exotic boson anticommute with the spinors. As a particular example of one of the models, we present a `double-graded' version of supersymmetric sine-Gordon theory.


title: MetaCURE: Meta Reinforcement Learning with Empowerment-Driven Exploration

abstract: Meta reinforcement learning (meta-RL) extracts knowledge from previous tasks and achieves fast adaptation to new tasks. Despite recent progress, efficient exploration in meta-RL remains a key challenge in sparse-reward tasks, as it requires quickly finding informative task-relevant experiences in both meta-training and adaptation. To address this challenge, we explicitly model an exploration policy learning problem for meta-RL, which is separated from exploitation policy learning, and introduce a novel empowerment-driven exploration objective, which aims to maximize information gain for task identification. We derive a corresponding intrinsic reward and develop a new off-policy meta-RL framework, which efficiently learns separate context-aware exploration and exploitation policies by sharing the knowledge of task inference. Experimental evaluation shows that our meta-RL method significantly outperforms state-of-the-art baselines on various sparse-reward MuJoCo locomotion tasks and more complex sparse-reward Meta-World tasks.


title: On the convergence of series of dependent random variables

abstract: Given a sequence $(X_n)$ of symmetrical random variables taking values in a Hilbert space, an interesting open problem is to determine the conditions under which the series $\sum_{n=1}^\infty X_n$ is almost surely convergent. For independent random variables, it is well-known that if $\sum_{n=1}^\infty \mathbb{E}(\|X_n\|^2) <\infty$, then $\sum_{n=1}^\infty X_n$ converges almost surely. This has been extended to some cases of dependent variables (namely negatively associated random variables) but in the general setting of dependent variables, the problem remains open. This paper considers the case where each variable $X_n$ is given as a linear combination $a_{n,1}Z_1+ \ldots +a_{n,n}Z_n$ where $(Z_n)$ is a sequence of independent symmetrical random variables of unit variance and $(a_{n,k})$ are constants. For Gaussian random variables, this is the general setting. We obtain a sufficient condition for the almost sure convergence of $\sum_{n=1}^\infty X_n$ which is also sufficient for the almost sure convergence of $\sum_{n=1}^\infty \pm X_n$ for all (non-random) changes of sign. The result is based on an important bound of the mean of the random variable $\sup(\|X_1 + \ldots +X_k\|: 1\leq k \leq n)$ which extends the classical L\'evy's inequality and has some independent interest.


title: Faster Wasserstein Distance Estimation with the Sinkhorn Divergence

abstract: The squared Wasserstein distance is a natural quantity to compare probability distributions in a non-parametric setting. This quantity is usually estimated with the plug-in estimator, defined via a discrete optimal transport problem which can be solved to $\epsilon$-accuracy by adding an entropic regularization of order $\epsilon$ and using for instance Sinkhorn's algorithm. In this work, we propose instead to estimate it with the Sinkhorn divergence, which is also built on entropic regularization but includes debiasing terms. We show that, for smooth densities, this estimator has a comparable sample complexity but allows higher regularization levels, of order $\epsilon^{1/2}$, which leads to improved computational complexity bounds and a strong speedup in practice. Our theoretical analysis covers the case of both randomly sampled densities and deterministic discretizations on uniform grids. We also propose and analyze an estimator based on Richardson extrapolation of the Sinkhorn divergence which enjoys improved statistical and computational efficiency guarantees, under a condition on the regularity of the approximation error, which is in particular satisfied for Gaussian densities. We finally demonstrate the efficiency of the proposed estimators with numerical experiments.


title: Neural gradients are near-lognormal: improved quantized and sparse training

abstract: While training can mostly be accelerated by reducing the time needed to propagate neural gradients back throughout the model, most previous works focus on the quantization/pruning of weights and activations. These methods are often not applicable to neural gradients, which have very different statistical properties. Distinguished from weights and activations, we find that the distribution of neural gradients is approximately lognormal. Considering this, we suggest two closed-form analytical methods to reduce the computational and memory burdens of neural gradients. The first method optimizes the floating-point format and scale of the gradients. The second method accurately sets sparsity thresholds for gradient pruning. Each method achieves state-of-the-art results on ImageNet. To the best of our knowledge, this paper is the first to (1) quantize the gradients to 6-bit floating-point formats, or (2) achieve up to 85% gradient sparsity -- in each case without accuracy degradation. Reference implementation accompanies the paper.


title: Some complete $\omega$-powers of a one-counter language, for any Borel class of finite rank

abstract: We prove that, for any natural number n $\ge$ 1, we can find a finite alphabet $\Sigma$ and a finitary language L over $\Sigma$ accepted by a one-counter automaton, such that the $\omega$-power L $\infty$ := {w 0 w 1. .. $\in$ $\Sigma$ $\omega$ | $\forall$i $\in$ $\omega$ w i $\in$ L} is $\Pi$ 0 n-complete. We prove a similar result for the class $\Sigma$ 0 n .


title: A Generalization of Bellman's Equation with Application to Path Planning, Obstacle Avoidance and Invariant Set Estimation

abstract: The standard Dynamic Programming (DP) formulation can be used to solve Multi-Stage Optimization Problems (MSOP's) with additively separable objective functions. In this paper we consider a larger class of MSOP's with monotonically backward separable objective functions; additively separable functions being a special case of monotonically backward separable functions. We propose a necessary and sufficient condition, utilizing a generalization of Bellman's equation, for a solution of a MSOP, with a monotonically backward separable cost function, to be optimal. Moreover, we show that this proposed condition can be used to efficiently compute optimal solutions for two important MSOP's; the optimal path for Dubin's car with obstacle avoidance, and the maximal invariant set for discrete time systems.


title: 3 kW passive-gain-enabled metalized Raman fiber amplifier based on passive gain

abstract: Raman fiber lasers (RFLs) are currently promising and versatile light sources for a variety of applications. So far, operations of high power and brightness-enhanced RFLs have absorbed enormous interests along with rapid progress. Nevertheless, the stable Raman lasing at high power levels remains challenged by the thermal effects. In an effort to realize more effective thermal management in high power RFLs, here we demonstrate, for the first time, an all-fiberized RFA employing metal-coated passive fiber enabling high power lasing. By employing aluminum to the cladding of graded-index (GRIN) passive fiber, the thermal abstraction of the laser devices is more sufficient to support low-temperature operation. The maximum output power reaches 3.083 kW at 1130 nm with a conversion efficiency of 78.7%. To the best of our knowledge, this is the first Raman laser generation based on metal-coated passive fiber. Meanwhile, it is also the highest power attained in the fields of all kinds of Raman lasers based on merely nonlinear gain.


title: Dissimilarity Mixture Autoencoder for Deep Clustering

abstract: The dissimilarity mixture autoencoder (DMAE) is a neural network model for feature-based clustering that incorporates a flexible dissimilarity function and can be integrated into any kind of deep learning architecture. It internally represents a dissimilarity mixture model (DMM) that extends classical methods like K-Means, Gaussian mixture models, or Bregman clustering to any convex and differentiable dissimilarity function through the reinterpretation of probabilities as neural network representations. DMAE can be integrated with deep learning architectures into end-to-end models, allowing the simultaneous estimation of the clustering and neural network's parameters. Experimental evaluation was performed on image and text clustering benchmark datasets showing that DMAE is competitive in terms of unsupervised classification accuracy and normalized mutual information. The source code with the implementation of DMAE is publicly available at: https://github.com/juselara1/dmae


title: Binary DAD-Net: Binarized Driveable Area Detection Network for Autonomous Driving

abstract: Driveable area detection is a key component for various applications in the field of autonomous driving (AD), such as ground-plane detection, obstacle detection and maneuver planning. Additionally, bulky and over-parameterized networks can be easily forgone and replaced with smaller networks for faster inference on embedded systems. The driveable area detection, posed as a two class segmentation task, can be efficiently modeled with slim binary networks. This paper proposes a novel binarized driveable area detection network (binary DAD-Net), which uses only binary weights and activations in the encoder, the bottleneck, and the decoder part. The latent space of the bottleneck is efficiently increased (x32 -> x16 downsampling) through binary dilated convolutions, learning more complex features. Along with automatically generated training data, the binary DAD-Net outperforms state-of-the-art semantic segmentation networks on public datasets. In comparison to a full-precision model, our approach has a x14.3 reduced compute complexity on an FPGA and it requires only 0.9MB memory resources. Therefore, commodity SIMD-based AD-hardware is capable of accelerating the binary DAD-Net.


title: Mass sensitivity of gravimetric satellites

abstract: Frequency-domain expressions are found for gradiometer and satellite-to-satellite tracking measurements of a point source on the surface of the Earth. The maximum signal-to-noise ratio as a function of noise in the measurement apparatus is computed, and from that the minimum detectable point mass is inferred. A point mass of magnitude M_3=100 Gt gives a signal-to-noise ratio of 3 when a GOCE-like gradiometer passes directly over the mass. On the satellite-to-satellite tracking mission GRACE-FO M_3=1.3 Gt for the microwave instrument and M_3=0.5 Gt for the laser ranging interferometer. The sensitivity of future GRACE-like missions with different orbital parameters and improved accelerometer sensitivity is explored, and the optimum spacecraft separation for detecting point-like sources is found. The future-mission benefit of improving the accelerometer sensitivity for measurement of non-gravitational disturbances is shown by the resulting reduction of M_3 to as small as 7 Mt for 500 km orbital altitude and optimized satellite separation of 900 km.


title: Multicenter solutions in Eddington-inspired Born-Infeld gravity

abstract: We find multicenter (Majumdar-Papapetrou type) solutions of Eddington-inspired Born-Infeld gravity coupled to electromagnetic fields governed by a Born-Infeld-like Lagrangian. We construct the general solution for an arbitrary number of centers in equilibrium and then discuss the properties of their one-particle configurations, including the existence of bounces and the regularity (geodesic completeness) of these spacetimes. Our method can be used to construct multicenter solutions in other theories of gravity.


title: Derivative-free global minimization for a class of multiple minima problems

abstract: We prove that the finite-difference based derivative-free descent (FD-DFD) methods have a capability to find the global minima for a class of multiple minima problems. Our main result shows that, for a class of multiple minima objectives that is extended from strongly convex functions with Lipschitz-continuous gradients, the iterates of FD-DFD converge to the global minimizer $x_*$ with the linear convergence $\|x_{k+1}-x_*\|_2^2\leqslant\rho^k \|x_1-x_*\|_2^2$ for a fixed $0<\rho<1$ and any initial iteration $x_1\in\mathbb{R}^d$ when the parameters are properly selected. Since the per-iteration cost, i.e., the number of function evaluations, is fixed and almost independent of the dimension $d$, the FD-DFD algorithm has a complexity bound $\mathcal{O}(\log\frac{1}{\epsilon})$ for finding a point $x$ such that the optimality gap $\|x-x_*\|_2^2$ is less than $\epsilon>0$. Numerical experiments in various dimensions from $5$ to $500$ demonstrate the benefits of the FD-DFD method.


title: On a discrete transform of homogeneous decomposition spaces

abstract: We introduce almost diagonal matrices in the setting of (anisotropic) discrete homogeneous Triebel-Lizorkin type spaces and homogeneous modulation spaces, and it is shown that the class of almost diagonal matrices is closed under matrix multiplication. We then connect the results to the continuous setting and show that the "change of frame" matrix for a pair of time-frequency frames, with suitable decay properties, is almost diagonal. As an application of this result, we consider a construction of compactly supported frame expansions for homogeneous decomposition spaces of Triebel-Lizorkin type and for the associated modulation spaces.


title: Computing Large-Scale Matrix and Tensor Decomposition with Structured Factors: A Unified Nonconvex Optimization Perspective

abstract: The proposed article aims at offering a comprehensive tutorial for the computational aspects of structured matrix and tensor factorization. Unlike existing tutorials that mainly focus on {\it algorithmic procedures} for a small set of problems, e.g., nonnegativity or sparsity-constrained factorization, we take a {\it top-down} approach: we start with general optimization theory (e.g., inexact and accelerated block coordinate descent, stochastic optimization, and Gauss-Newton methods) that covers a wide range of factorization problems with diverse constraints and regularization terms of engineering interest. Then, we go `under the hood' to showcase specific algorithm design under these introduced principles. We pay a particular attention to recent algorithmic developments in structured tensor and matrix factorization (e.g., random sketching and adaptive step size based stochastic optimization and structure-exploiting second-order algorithms), which are the state of the art---yet much less touched upon in the literature compared to {\it block coordinate descent} (BCD)-based methods. We expect that the article to have an educational values in the field of structured factorization and hope to stimulate more research in this important and exciting direction.


title: Infinite Feature Selection: A Graph-based Feature Filtering Approach

abstract: We propose a filtering feature selection framework that considers subsets of features as paths in a graph, where a node is a feature and an edge indicates pairwise (customizable) relations among features, dealing with relevance and redundancy principles. By two different interpretations (exploiting properties of power series of matrices and relying on Markov chains fundamentals) we can evaluate the values of paths (i.e., feature subsets) of arbitrary lengths, eventually go to infinite, from which we dub our framework Infinite Feature Selection (Inf-FS). Going to infinite allows to constrain the computational complexity of the selection process, and to rank the features in an elegant way, that is, considering the value of any path (subset) containing a particular feature. We also propose a simple unsupervised strategy to cut the ranking, so providing the subset of features to keep. In the experiments, we analyze diverse settings with heterogeneous features, for a total of 11 benchmarks, comparing against 18 widely-known comparative approaches. The results show that Inf-FS behaves better in almost any situation, that is, when the number of features to keep are fixed a priori, or when the decision of the subset cardinality is part of the process.


title: Extracting N-ary Cross-sentence Relations using Constrained Subsequence Kernel

abstract: Most of the past work in relation extraction deals with relations occurring within a sentence and having only two entity arguments. We propose a new formulation of the relation extraction task where the relations are more general than intra-sentence relations in the sense that they may span multiple sentences and may have more than two arguments. Moreover, the relations are more specific than corpus-level relations in the sense that their scope is limited only within a document and not valid globally throughout the corpus. We propose a novel sequence representation to characterize instances of such relations. We then explore various classifiers whose features are derived from this sequence representation. For SVM classifier, we design a Constrained Subsequence Kernel which is a variant of Generalized Subsequence Kernel. We evaluate our approach on three datasets across two domains: biomedical and general domain.


title: Pinning properties of FeSeTe thin film through multifrequency measurements of the surface impedance

abstract: We present high frequency measurements of the vortex dynamics of a FeSe$_x$Te$_{1-x}$ ($x=0.5$) thin film grown on a CaF$_2$ substrate and with a critical temperature $T_c\simeq18\;$K, performed by means of a dual frequency dielectric resonator at 16.4 GHz and 26.6 GHz. We extract and discuss various important vortex parameters related to the pinning properties of the sample, such as the characteristic frequency $\nu_c$, the pinning constant $k_p$ and the pinning barrier height $U$ relevant for creep phenomena. We find that the vortex system is in the single-vortex regime, and that pinning attains relatively high values in terms of $k_p$, indicating significant pinning at the high frequencies here studied. The pinning barrier energy $U$ is quite small and exhibits a non-monotonous temperature dependence with a maximum near 12 K. This result is discussed in terms of core pinning of small portion of vortices of size $\propto\xi^3$ jumping out of the pinning wells over very small distances, a process which is favoured in the high frequency, short ranged vortex oscillations here explored.


title: Low MHD turbulence: the role of boundaries

abstract: In this short review, we present the main known features of MHD Turbulence at Low Magnetic Reynolds number, for which the flow isn't intense nor electrically conductive enough to disturb an externally applied magnetic field. The emphasis is deliberately placed on the very specific physical mechanisms of these flows, rather than their numerical modelling. We also focus on homogeneous magnetic fields which have received most attention. Since the basic properties of these flows have been thoroughly reviewed a number of times, this review is deliberately biased towards flows in bounded domains, in which the tendency to two-dimensionality observed in MHD flows casts the boundaries of the domain into a leading role.


title: A dual based semismooth Newton method for a class of sparse Tikhonov regularization

abstract: It is well known that Tikhonov regularization is one of the most commonly used methods for solving ill-posed problems. One of the most widely applied approaches is based on constructing a new dataset whose sample size is greater than the original one. The enlarged sample size may bring additional computational difficulties. In this paper, we aim to make full use of Tikhonov regularization and develop a dual based semismooth Newton (DSSN) method without destroying the structure of dataset. From the point of view of theory, we will show that \blue{the DSSN method is a globally convergent method with at least R-superlinear rate of convergence.} In the numerical computation aspect, we evaluate the performance of the DSSN method by solving a class of sparse Tikhonov regularization with high-dimensional datasets.


title: Estimation of Skill Distributions

abstract: In this paper, we study the problem of learning the skill distribution of a population of agents from observations of pairwise games in a tournament. These games are played among randomly drawn agents from the population. The agents in our model can be individuals, sports teams, or Wall Street fund managers. Formally, we postulate that the likelihoods of game outcomes are governed by the Bradley-Terry-Luce (or multinomial logit) model, where the probability of an agent beating another is the ratio between its skill level and the pairwise sum of skill levels, and the skill parameters are drawn from an unknown skill density of interest. The problem is, in essence, to learn a distribution from noisy, quantized observations. We propose a simple and tractable algorithm that learns the skill density with near-optimal minimax mean squared error scaling as $n^{-1+\varepsilon}$, for any $\varepsilon>0$, when the density is smooth. Our approach brings together prior work on learning skill parameters from pairwise comparisons with kernel density estimation from non-parametric statistics. Furthermore, we prove minimax lower bounds which establish minimax optimality of the skill parameter estimation technique used in our algorithm. These bounds utilize a continuum version of Fano's method along with a covering argument. We apply our algorithm to various soccer leagues and world cups, cricket world cups, and mutual funds. We find that the entropy of a learnt distribution provides a quantitative measure of skill, which provides rigorous explanations for popular beliefs about perceived qualities of sporting events, e.g., soccer league rankings. Finally, we apply our method to assess the skill distributions of mutual funds. Our results shed light on the abundance of low quality funds prior to the Great Recession of 2008, and the domination of the industry by more skilled funds after the financial crisis.


title: Engineering two-qubit mixed states with weak measurements

abstract: It is known that protocols based on weak measurements can be used to steer quantum systems into pre-designated pure states. Here we show that weak-measurement-based steering protocols can be harnessed for on-demand engineering of $\textit{mixed}$ states. In particular, through a continuous variation of the protocol parameters, one can guide a classical target state to a discorded one, and further on, towards an entangled target state.


title: On energy gap phenomena of the Whitney sphere and related problems

abstract: In this paper, we study Lagrangian submanifolds satisfying ${\rm \nabla^*} T=0$ introduced by Zhang \cite{Zh} in the complex space forms $N(4c)(c=0\ or \ 1)$, where $T ={\rm \nabla^*}\tilde{h}$ and $\tilde{h}$ is the Lagrangian trace-free second fundamental form. We obtain some Simons' type integral inequalities and rigidity theorems for such Lagrangian submanifolds. Moreover we study Lagrangian submanifolds in $\mathbb{C}^n$ satisfying $\nabla^*\nabla^*T=0$ and introduce a flow method related to them.


title: Dimensionality reduction via path integration for computing mRNA distributions

abstract: Inherent stochasticity in gene expression leads to distributions of mRNA copy numbers in a population of identical cells. These distributions are determined primarily by the multitude of states of a gene promoter, each driving transcription at a different rate. In an era where single-cell mRNA copy number data are more and more available, there is an increasing need for fast computations of mRNA distributions. In this paper, we present a method for computing separate distributions for each species of mRNA molecules, i. e. mRNAs that have been either partially or fully processed post-transcription. The method involves the integration over all possible realizations of promoter states, which we cast into a set of linear ordinary differential equations of dimension $M\times n_j$, where $M$ is the number of available promoter states and $n_j$ is the mRNA copy number of species $j$ up to which one wishes to compute the probability distribution. This approach is superior to solving the Master equation (ME) directly in two ways: a) the number of coupled differential equations in the ME approach is $M\times\Lambda_1\times\Lambda_2\times ...\times\Lambda_L$, where $\Lambda_j$ is the cutoff for the probability of the $j^{\text{th}}$ species of mRNA; and b) the ME must be solved up to the cutoffs $\Lambda_j$, which are {\it ad hoc} and must be selected {\it a priori}. In our approach, the equation for the probability to observe $n$ mRNAs of any species depends only on the the probability of observing $n-1$ mRNAs of that species, thus yielding a correct probability distribution up to an arbitrary $n$. To demonstrate the validity of our derivations, we compare our results with Gillespie simulations for ten randomly selected system parameters.


title: The space of ergodic measures for Lorenz attractors

abstract: For every $r\in\mathbb{N}_{\geq 2}\cup\{\infty\}$, we show that the space of ergodic measures is path connected with dense periodic measures for $C^r$-generic geometric Lorenz attractors introduced by Guckenheimer and Williams, while it is not connected for $C^r$-dense Lorenz attractors. This verifies a conjecture proposed by C. Bonatti in $C^r$-topology for Lorenz attractors. In particular, a $C^r$-connecting lemma ($r\geq2$) for Lorenz attractors has been proved. In $C^1$-topology, we obtain same properties for singular hyperbolic attractors in higher dimensions.


title: Heterotic orbifolds, reduced rank and SO(2n+1) characters

abstract: The moduli space of the maximally supersymmetric heterotic string in d-dimensional Minkowski space contains various components characterized by the rank of the gauge symmetries of the vacua they parametrize. We develop an approach for describing in a unified way continuous Wilson lines which parametrize a component of the moduli space, together with discrete deformations responsible for the switch from one component to the other. Applied to a component that contains vacua with SO(2n+1) gauge-symmetry factors, our approach yields a description of all backgrounds of the component in terms of free-orbifold models. The orbifold generators turn out to act symmetrically or asymmetrically on the internal space, with or without discrete torsion. Our derivations use extensively affine characters of SO(2n+1). As a by-product, we find a peculiar orbifold description of the heterotic string in ten dimensions, where all gauge degrees of freedom arise as twisted states, while the untwisted sector reduces to the gravitational degrees of freedom.


title: Neural Networks Fail to Learn Periodic Functions and How to Fix It

abstract: Previous literature offers limited clues on how to learn a periodic function using modern neural networks. We start with a study of the extrapolation properties of neural networks; we prove and demonstrate experimentally that the standard activations functions, such as ReLU, tanh, sigmoid, along with their variants, all fail to learn to extrapolate simple periodic functions. We hypothesize that this is due to their lack of a "periodic" inductive bias. As a fix of this problem, we propose a new activation, namely, $x + \sin^2(x)$, which achieves the desired periodic inductive bias to learn a periodic function while maintaining a favorable optimization property of the ReLU-based activations. Experimentally, we apply the proposed method to temperature and financial data prediction.


title: Satellite-based estimates of decline and rebound in China's CO$_2$ emissions during COVID-19 pandemic

abstract: Changes in CO$_2$ emissions during the COVID-19 pandemic have been estimated from indicators on activities like transportation and electricity generation. Here, we instead use satellite observations together with bottom-up information to track the daily dynamics of CO$_2$ emissions during the pandemic. Unlike activity data, our observation-based analysis can be independently evaluated and can provide more detailed insights into spatially-explicit changes. Specifically, we use TROPOMI observations of NO$_2$ to deduce ten-day moving averages of NO$_x$ and CO$_2$ emissions over China, differentiating emissions by sector and province. Between January and April 2020, China's CO$_2$ emissions fell by 11.5% compared to the same period in 2019, but emissions have since rebounded to pre-pandemic levels owing to the fast economic recovery in provinces where industrial activity is concentrated.


title: Discrete and continuum fundamental solutions describing heat conduction in 1D harmonic crystal: Discrete-to-continuum limit and slow-and-fast motions decoupling

abstract: In the recent paper by Sokolov et al. (Int. J. of Heat and Mass Transfer 176, 2021, 121442) ballistic heat propagation in 1D harmonic crystal is considered and the properties of the exact discrete solution and the solution of the ballistic heat equation introduced by Krivtsov are numerically compared. The aim of this note is to demonstrate that the latter continuum fundamental solution can be formally obtained as the slow time-varying component of the large-time asymptotics for the exact discrete solution on a moving point of observation.


title: AutoGAN-Distiller: Searching to Compress Generative Adversarial Networks

abstract: The compression of Generative Adversarial Networks (GANs) has lately drawn attention, due to the increasing demand for deploying GANs into mobile devices for numerous applications such as image translation, enhancement and editing. However, compared to the substantial efforts to compressing other deep models, the research on compressing GANs (usually the generators) remains at its infancy stage. Existing GAN compression algorithms are limited to handling specific GAN architectures and losses. Inspired by the recent success of AutoML in deep compression, we introduce AutoML to GAN compression and develop an AutoGAN-Distiller (AGD) framework. Starting with a specifically designed efficient search space, AGD performs an end-to-end discovery for new efficient generators, given the target computational resource constraints. The search is guided by the original GAN model via knowledge distillation, therefore fulfilling the compression. AGD is fully automatic, standalone (i.e., needing no trained discriminators), and generically applicable to various GAN models. We evaluate AGD in two representative GAN tasks: image translation and super resolution. Without bells and whistles, AGD yields remarkably lightweight yet more competitive compressed models, that largely outperform existing alternatives. Our codes and pretrained models are available at https://github.com/TAMU-VITA/AGD.


title: Reducing the total cost of ownership in radio access networks by using renewable energy resources

abstract: Increasing electricity prices motivates the mobile network operators to find new energy-efficient solutions for radio access networks (RANs). In this study, we focus on a specific type of RAN where the stand-alone solar panels are used as alternative energy sources to the electrical grid energy. First, we describe this hybrid energy based radio access network (HEBRAN) and formulate an optimization problem which aims to reduce the total cost of ownership of this network. Then, we propose a framework that provides a cost-efficient algorithm for choosing the proper size for the solar panels and batteries of a HEBRAN and two novel switch on/off algorithms which regulate the consumption of grid electricity during the operation of the network. In addition, we create a reduced model of the HEBRAN optimization problem to solve it in a mixed integer linear programming (MILP) solver. The results show that our algorithms outperform the MILP solution and classical switch on/off methods. Moreover, our findings show that migrating to a HEBRAN system is feasible and has cost-benefits for mobile network operators.