title: Small Lefschetz Fibrations on Simply-Connected $4$-Manifolds

abstract: We consider simply-connected $4$-manifolds admitting Lefschetz fibrations over the $2$-sphere. We explicitly construct nonhyperelliptic and hyperelliptic Lefschetz fibrations of genus $4$ on simply-connected $4$-manifolds which are exotic symplectic $4$-manifolds in the homeomorphism classes of $\mathbb{C}P^{2}\#8\overline{\mathbb{C} P^{2}}$ and $\mathbb{C} P^{2}\#9\overline{\mathbb{C} P^{2}}$, respectively. From these, we provide upper bounds for the minimal number of singular fibers of such fibrations. In addition, we prove that this number is equal to $18$ for $g=3$ when such fibrations are hyperelliptic. Moreover, we discuss these numbers for higher genera.


title: A Design Process of Visual Analytics Applications using Conceptual Graph

abstract: State-of-the-art visual analytics techniques in application domains are often designed by VA professionals over qualitative requirement collected from end users. These VA techniques may not leverage users' domain knowledge about how to achieve their analytical goals. In this position paper, we propose a user-driven design process of VA applications centered around a new concept called analytical representation (AR). AR features a formal abstraction of user requirement and their desired analytical trails for certain VA application, and is independent of the actual visualization design. A conceptual graph schema is introduced to define the AR abstraction, which can be created manually or constructed by semi-automated tools. Designing VA applications with AR provides a shared opportunity for both optimal analysis blueprint from the perspective of end users and optimal visualization/algorithm from the perspective of VA designers. We demonstrate the usage of the design process in two case studies.


title: Simultaneously Transmitting And Reflecting (STAR) RIS Aided Wireless Communications

abstract: The novel concept of simultaneously transmitting and reflecting (STAR) reconfigurable intelligent surfaces (RISs) is investigated, where the incident wireless signal is divided into transmitted and reflected signals passing into both sides of the space surrounding the surface, thus facilitating a full-space manipulation of signal propagation. Based on the introduced basic signal model of `STAR', three practical operating protocols for STAR-RISs are proposed, namely energy splitting (ES), mode switching (MS), and time switching (TS). Moreover, a STAR-RIS aided downlink communication system is considered for both unicast and multicast transmission, where a multi-antenna base station (BS) sends information to two users, i.e., one on each side of the STAR-RIS. A power consumption minimization problem for the joint optimization of the active beamforming at the BS and the passive transmission and reflection beamforming at the STAR-RIS is formulated for each of the proposed operating protocols, subject to communication rate constraints of the users. For ES, the resulting highly-coupled non-convex optimization problem is solved by an iterative algorithm, which exploits the penalty method and successive convex approximation. Then, the proposed penalty-based iterative algorithm is extended to solve the mixed-integer non-convex optimization problem for MS. For TS, the optimization problem is decomposed into two subproblems, which can be consecutively solved using state-of-the-art algorithms and convex optimization techniques. Finally, our numerical results reveal that: 1) the TS and ES operating protocols are generally preferable for unicast and multicast transmission, respectively; and 2) the required power consumption for both scenarios is significantly reduced by employing the proposed STAR-RIS instead of conventional reflecting/transmiting-only RISs.


title: A Large-scale Study on Unsupervised Outlier Model Selection: Do Internal Strategies Suffice?

abstract: Given an unsupervised outlier detection task, how should one select a detection algorithm as well as its hyperparameters (jointly called a model)? Unsupervised model selection is notoriously difficult, in the absence of hold-out validation data with ground-truth labels. Therefore, the problem is vastly understudied. In this work, we study the feasibility of employing internal model evaluation strategies for selecting a model for outlier detection. These so-called internal strategies solely rely on the input data (without labels) and the output (outlier scores) of the candidate models. We setup (and open-source) a large testbed with 39 detection tasks and 297 candidate models comprised of 8 detectors and various hyperparameter configurations. We evaluate 7 different strategies on their ability to discriminate between models w.r.t. detection performance, without using any labels. Our study reveals room for progress -- we find that none would be practically useful, as they select models only comparable to a state-of-the-art detector (with random configuration).


title: Random periodic solutions of non-autonomous stochastic differential equations

abstract: In this paper, we study the existence of random periodic solutions for nonlinear stochastic differential equations with additive white noise. We extend the input-to-state characteristic operator of the system to the non-autonomous stochastic differential equation via the pull-back of the discretised stochastic differential equation. We then use the completeness of the measurable function space which we construct skillfully and the Banach fixed point theorem to prove the existence of a fixed point of the gain operator. And we prove that the image for the input-to-state characteristic operator at this fixed point is a random periodic solution for the forward stochastic flow generated by the non-autonomous stochastic differential equation. Finally, we present some examples.


title: Exponential stability of c0-semigroup via Lyapunov inequality in Banach space

abstract: We give a relation between the exponential stability of $ C_{0}- $semigroup $ \textbf{T}=\left\lbrace T(t) \right\rbrace_{t\geq 0} $ and the solutions of Lyapunov inequality \( \left\langle QAx,x\right\langle +\left\langle Qx,Ax\right\langle \leq -||x||^{2}, \) in $ B^{+}(X,X^{*}) $, with $ X $ is a Banach space. The solutions of this inequality characterizes, the boundedness of the resolvent $ R(\lambda,A) $ inside and outside of the left half-plane $ \Re\lambda\geq 0 $, and also the left invertibility of the $ C_{0}- $semigroup T.


title: Efficiency of the oxygenic photosynthesis on Earth-like planets in the habitable zone

abstract: Oxygenic photosynthesis is the most important biochemical process in Earth biosphere and likely very common on other habitable terrestrial planets, given the general availability of its input chemical ingredients and of light as source of energy. It is therefore important to evaluate the effective possibility of oxygenic photosynthesis on planets around stars as a function of their spectral type and the planet-star separation. We aim at estimating the photon flux, the exergy and the exergetic efficiency of the radiation in the wavelength range useful for the oxygenic photosynthesis as a function of the host star effective temperature and planet-star separation. We compute analytically these quantities and compare our results with the estimates for the small sample of known Earth-like planets. We find that exergy is an increasing function of the star effective temperature, within the range 2600-7200 K. It depends both on the star-planet separation and the star effective temperature. Biospheres on exoplanets around cool stars might be generally light-limited. So far, we have not observed terrestrial planets comparable to Earth in terms of useful photon flux, exergy and exergetic efficiency.


title: Human-Centric Issues in eHealth App Development and Usage: A Preliminary Assessment

abstract: Health-related mobile applications are known as eHealth apps. These apps make people more aware of their health, help during critical situations, provide home-based disease management, and monitor/support personalized care through sensing/interaction. eHealth app usage is rapidly increasing with a large number of new apps being developed. Unfortunately, many eHealth apps do not successfully adopt Human-Centric Issues (HCI) in the app development process and its deployment stages, leading them to become ineffective and not inclusive of diverse end-users. This paper provides an initial assessment of key human factors related to eHealth apps by literature review, existing guidelines analysis, and user studies. Preliminary results suggest that Usability, Accessibility, Reliability, Versatility, and User Experience are essential HCIs for eHealth apps, and need further attention from researchers and practitioners. Therefore, outcomes of this research will look to amend support for users, developers, and stakeholders of eHealth apps in the form of improved actionable guidelines, best practice examples, and evaluation techniques. The research also aims to trial the proposed solutions on real-world projects.


title: Group invariant solutions and Conservation laws of the nonlinear Gardner-Kawahara equation

abstract: The present article studies the potential form of the nonlinear Gardner-Kawahara equation through the perspective of Lie symmetry analysis. Lie symmetry analysis was used to investigate abundant group-invariant solutions of the nonlinear Gardner-Kawahara equation. This method is used to provide geometric vector fields, as well as their commutative and adjoint relations. In this article, we have obtained the exact solution of the nonlinear Gardner-Kawahara equation in explicit form by different significant methods. Numerical simulation is used to explain the physical relevance of invariant solutions in 3D and 2D graphs. Finally, by the conservation law multiplier, the complete set of local conservation laws of the equation for the arbitrary constant coefficients is well constructed with a detailed derivation. The conserved currents discovered in this study can help us better comprehend some of the physical processes that the underlying equations predict.


title: Transceiver Noise Characterization based on Perturbations

abstract: In this paper, we discuss a new technique for measuring transceiver noise, skew, and for the detection of uncompensated transceiver impairments. The method consists on the introduction of frequency domain notch or notches at the transmitter, which allows to estimate of the Signal-to-Noise and Distortion Ratio (SNDR) at different stages over the transmission chain. The proposed technique requires the detection of the signal spectrum using either: a modem receiver, an Optical Spectrum Analyzer (OSA), an oscilloscope, or an Electrical Spectrum Analyzer (ESA), depending on the stage where the spectrum is measured and requiring minimal processing of the received signal. Our analysis is focused on Ciena's WaveLogic Ai commercial transceiver and a 95 Gbaud DAC. We demonstrate that symmetrically placed frequency domain notches can be used to mitiguate the influence of crosstalk on the SNDR estimates. Finally, we show how a single notch spectrum can be used to detect and compensate for impairments, and we perform skew estimation as an example.


title: Graph Contrastive Clustering

abstract: Recently, some contrastive learning methods have been proposed to simultaneously learn representations and clustering assignments, achieving significant improvements. However, these methods do not take the category information and clustering objective into consideration, thus the learned representations are not optimal for clustering and the performance might be limited. Towards this issue, we first propose a novel graph contrastive learning framework, which is then applied to the clustering task and we come up with the Graph Constrastive Clustering~(GCC) method. Different from basic contrastive clustering that only assumes an image and its augmentation should share similar representation and clustering assignments, we lift the instance-level consistency to the cluster-level consistency with the assumption that samples in one cluster and their augmentations should all be similar. Specifically, on the one hand, the graph Laplacian based contrastive loss is proposed to learn more discriminative and clustering-friendly features. On the other hand, a novel graph-based contrastive learning strategy is proposed to learn more compact clustering assignments. Both of them incorporate the latent category information to reduce the intra-cluster variance while increasing the inter-cluster variance. Experiments on six commonly used datasets demonstrate the superiority of our proposed approach over the state-of-the-art methods.


title: A note on $\mathfrak{su}(2)$ models and the biorthogonality of generating functions of Krawtchouk polynomials

abstract: Eigenvalue problems on irreducible $\mathfrak{su}(2)$ modules and their adjoints are considered in the Bargmann, Barut-Girardello and finite difference models. The biorthogonality relations that arise between the corresponding generating functions of the Krawtchouk polynomials are sorted out. A link with Pad\'e approximation is made.


title: Aggregated Contextual Transformations for High-Resolution Image Inpainting

abstract: State-of-the-art image inpainting approaches can suffer from generating distorted structures and blurry textures in high-resolution images (e.g., 512x512). The challenges mainly drive from (1) image content reasoning from distant contexts, and (2) fine-grained texture synthesis for a large missing region. To overcome these two challenges, we propose an enhanced GAN-based model, named Aggregated COntextual-Transformation GAN (AOT-GAN), for high-resolution image inpainting. Specifically, to enhance context reasoning, we construct the generator of AOT-GAN by stacking multiple layers of a proposed AOT block. The AOT blocks aggregate contextual transformations from various receptive fields, allowing to capture both informative distant image contexts and rich patterns of interest for context reasoning. For improving texture synthesis, we enhance the discriminator of AOT-GAN by training it with a tailored mask-prediction task. Such a training objective forces the discriminator to distinguish the detailed appearances of real and synthesized patches, and in turn, facilitates the generator to synthesize clear textures. Extensive comparisons on Places2, the most challenging benchmark with 1.8 million high-resolution images of 365 complex scenes, show that our model outperforms the state-of-the-art by a significant margin in terms of FID with 38.60% relative improvement. A user study including more than 30 subjects further validates the superiority of AOT-GAN. We further evaluate the proposed AOT-GAN in practical applications, e.g., logo removal, face editing, and object removal. Results show that our model achieves promising completions in the real world. We release code and models in https://github.com/researchmm/AOT-GAN-for-Inpainting.


title: A structure-preserving parametric finite element method for surface diffusion

abstract: We propose a structure-preserving parametric finite element method (SP-PFEM) for discretizing the surface diffusion of a closed curve in two dimensions (2D) or surface in three dimensions (3D). Here the "structure-preserving" refers to preserving the two fundamental geometric structures of the surface diffusion flow: (i) the conservation of the area/volume enclosed by the closed curve/surface, and (ii) the decrease of the perimeter/total surface area of the curve/surface. For simplicity of notations, we begin with the surface diffusion of a closed curve in 2D and present a weak (variational) formulation of the governing equation. Then we discretize the variational formulation by using the backward Euler method in time and piecewise linear parametric finite elements in space, with a proper approximation of the unit normal vector by using the information of the curves at the current and next time step. The constructed numerical method is shown to preserve the two geometric structures and also enjoys the good property of asymptotic equal mesh distribution. The proposed SP-PFEM is "weakly" implicit (or almost semi-implicit) and the nonlinear system at each time step can be solved very efficiently and accurately by the Newton's iterative method. The SP-PFEM is then extended to discretize the surface diffusion of a closed surface in 3D. Extensive numerical results, including convergence tests, structure-preserving property and asymptotic equal mesh distribution, are reported to demonstrate the accuracy and efficiency of the proposed SP-PFEM for simulating surface diffusion in 2D and 3D.


title: Deep Feature CycleGANs: Speaker Identity Preserving Non-parallel Microphone-Telephone Domain Adaptation for Speaker Verification

abstract: With the increase in the availability of speech from varied domains, it is imperative to use such out-of-domain data to improve existing speech systems. Domain adaptation is a prominent pre-processing approach for this. We investigate it for adapt microphone speech to the telephone domain. Specifically, we explore CycleGAN-based unpaired translation of microphone data to improve the x-vector/speaker embedding network for Telephony Speaker Verification. We first demonstrate the efficacy of this on real challenging data and then, to improve further, we modify the CycleGAN formulation to make the adaptation task-specific. We modify CycleGAN's identity loss, cycle-consistency loss, and adversarial loss to operate in the deep feature space. Deep features of a signal are extracted from an auxiliary (speaker embedding) network and, hence, preserves speaker identity. Our 3D convolution-based Deep Feature Discriminators (DFD) show relative improvements of 5-10% in terms of equal error rate. To dive deeper, we study a challenging scenario of pooling (adapted) microphone and telephone data with data augmentations and telephone codecs. Finally, we highlight the sensitivity of CycleGAN hyper-parameters and introduce a parameter called probability of adaptation.


title: Optimal Selection for Good Polynomials of Degree up to Five

abstract: Good polynomials are the fundamental objects in the Tamo-Barg constructions of Locally Recoverable Codes (LRC). In this paper we classify all good polynomials up to degree $5$, providing explicit bounds on the maximal number $\ell$ of sets of size $r+1$ where a polynomial of degree $r+1$ is constant, up to $r=4$. This directly provides an explicit estimate (up to an error term of $O(\sqrt{q})$, with explict constant) for the maximal length and dimension of a Tamo-Barg LRC. Moreover, we explain how to construct good polynomials achieving these bounds. Finally, we provide computational examples to show how close our estimates are to the actual values of $\ell$, and we explain how to obtain the best possible good polynomials in degree $5$.


title: A Bayesian Machine Learning Algorithm for Predicting ENSO Using Short Observational Time Series

abstract: A simple and efficient Bayesian machine learning (BML) training and forecasting algorithm, which exploits only a 20-year short observational time series and an approximate prior model, is developed to predict the Ni\~no 3 sea surface temperature (SST) index. The BML forecast significantly outperforms model-based ensemble predictions and standard machine learning forecasts. Even with a simple feedforward neural network, the BML forecast is skillful for 9.5 months. Remarkably, the BML forecast overcomes the spring predictability barrier to a large extent: the forecast starting from spring remains skillful for nearly 10 months. The BML algorithm can also effectively utilize multiscale features: the BML forecast of SST using SST, thermocline, and wind burst improves on the BML forecast using just SST by at least 2 months. Finally, the BML algorithm also reduces the forecast uncertainty of neural networks and is robust to input perturbations.


title: Unsupervised Domain Adaptation with Global and Local Graph Neural Networks in Limited Labeled Data Scenario: Application to Disaster Management

abstract: Identification and categorization of social media posts generated during disasters are crucial to reduce the sufferings of the affected people. However, lack of labeled data is a significant bottleneck in learning an effective categorization system for a disaster. This motivates us to study the problem as unsupervised domain adaptation (UDA) between a previous disaster with labeled data (source) and a current disaster (target). However, if the amount of labeled data available is limited, it restricts the learning capabilities of the model. To handle this challenge, we utilize limited labeled data along with abundantly available unlabeled data, generated during a source disaster to propose a novel two-part graph neural network. The first-part extracts domain-agnostic global information by constructing a token level graph across domains and the second-part preserves local instance-level semantics. In our experiments, we show that the proposed method outperforms state-of-the-art techniques by $2.74\%$ weighted F$_1$ score on average on two standard public dataset in the area of disaster management. We also report experimental results for granular actionable multi-label classification datasets in disaster domain for the first time, on which we outperform BERT by $3.00\%$ on average w.r.t weighted F$_1$. Additionally, we show that our approach can retain performance when very limited labeled data is available.


title: Monte Carlo Simulation of SDEs using GANs

abstract: Generative adversarial networks (GANs) have shown promising results when applied on partial differential equations and financial time series generation. We investigate if GANs can also be used to approximate one-dimensional Ito stochastic differential equations (SDEs). We propose a scheme that approximates the path-wise conditional distribution of SDEs for large time steps. Standard GANs are only able to approximate processes in distribution, yielding a weak approximation to the SDE. A conditional GAN architecture is proposed that enables strong approximation. We inform the discriminator of this GAN with the map between the prior input to the generator and the corresponding output samples, i.e. we introduce a `supervised GAN'. We compare the input-output map obtained with the standard GAN and supervised GAN and show experimentally that the standard GAN may fail to provide a path-wise approximation. The GAN is trained on a dataset obtained with exact simulation. The architecture was tested on geometric Brownian motion (GBM) and the Cox-Ingersoll-Ross (CIR) process. The supervised GAN outperformed the Euler and Milstein schemes in strong error on a discretisation with large time steps. It also outperformed the standard conditional GAN when approximating the conditional distribution. We also demonstrate how standard GANs may give rise to non-parsimonious input-output maps that are sensitive to perturbations, which motivates the need for constraints and regularisation on GAN generators.


title: Input Validation with Symbolic Execution

abstract: Symbolic execution has always been plagued by the inability to handle programs that require highly structured inputs. Most often, the symbolic execution engine gets overwhelmed by the sheer number of infeasible paths and fails to explore enough feasible paths to gain any respectable coverage. In this paper, we propose a system, InVaSion, that attempts to solve this problem for forking-based symbolic execution engines. We propose an input specification language (ISL) that is based on a finite-state automaton but includes guarded transitions, a set of registers and a set of commands to update the register states. We demonstrate that our language is expressive enough to handle complex input specifications, like the Tiff image format, while not requiring substantial human effort; even the Tiff image specification could be specified in our language with an automaton of about 35 states. InVaSion translates the given program and the input specification into a non-deterministic program and uses symbolic execution to instantiate the non-determinism. This allows our tool to work with any forking-based symbolic execution engine and with no requirement of any special theory solver. Over our set of benchmarks, on an average, InVaSion was able to increase branch coverage from 24.97% to 67.84% over baseline KLEE.


title: Semi matrix-free twogrid shifted Laplacian preconditioner for the Helmholtz equation with near optimal shifts

abstract: Due to its significance in terms of wave phenomena a considerable effort has been put into the design of preconditioners for the Helmholtz equation. One option to derive a preconditioner is to apply a multigrid method on a shifted operator. In such an approach, the wavenumber is shifted by some imaginary value. This step is motivated by the observation that the shifted problem can be more efficiently handled by iterative solvers when compared to the standard Helmholtz equation. However, up to now, it is not obvious what the best strategy for the choice of the shift parameter is. It is well known that a good shift parameter depends sensitively on the wavenumber and the discretization parameters such as the order and the mesh size. Therefore, we study the choice of a near optimal complex shift such that an FGMRES solver converges with fewer iterations. Our goal is to provide a map which returns the near optimal shift for the preconditioner depending on the wavenumber and the mesh size. In order to compute this map, a data driven approach is considered: We first generate many samples, and in a second step, we perform a nonlinear regression on this data. With this representative map, the near optimal shift can be obtained by a simple evaluation. Our preconditioner is based on a twogrid V-cycle applied to the shifted problem, allowing us to implement a semi matrix-free method. The performance of our preconditioned FGMRES solver is illustrated by several benchmark problems with heterogeneous wavenumbers in two and three space dimensions.


title: COHORTNEY: Non-Parametric Clustering of Event Sequences

abstract: Cohort analysis is a pervasive activity in web analytics. One divides users into groups according to specific criteria and tracks their behavior over time. Despite its extensive use, academic circles do not discuss cohort analysis to evaluate user behavior online. This work introduces an unsupervised non-parametric approach to group Internet users based on their activities. In comparison, canonical methods in marketing and engineering-based techniques underperform. COHORTNEY is the first machine learning-based cohort analysis algorithm with a robust theoretical explanation.


title: Rapid measurement of the local pressure amplitude in microchannel acoustophoresis using motile cells

abstract: Acoustic microfluidics (or acoustofluidics) provides a non-contact and label-free means to manipulate and interrogate bioparticles. Owing to their biocompatibility and precision, acoustofluidic approaches have enabled innovations in various areas of biomedical research. Future breakthroughs will rely on translation of these techniques from academic labs to clinical and industrial settings. Here, accurate characterization and standardization of device performance is crucial. Versatile, rapid, and widely accessible performance quantification is needed. We propose a field quantification method using motile Chlamydomonas reinhardtii algae cells. We previously reported qualitative mapping of acoustic fields using living microswimmers as active probes. In the present study, we extend our approach to achieve the challenging quantitative in situ measurement of the acoustic energy density. C. reinhardtii cells continuously swim in an imposed force field and dynamically redistribute as the field changes. This behavior allows accurate and complete, real-time performance monitoring, which can be easily applied and adopted within the acoustofluidics and broader microfluidics research communities. Additionally, the approach relies only on standard bright-field microscopy to assess the field under numerous conditions within minutes. We benchmark the method against conventional passive-particle tracking, achieving agreement within 1 % for field strengths from 0 to 100 J m-3 (0 to ~1 MPa).


title: Cell cycle length and long-time behaviour of an age-size model

abstract: We consider an age-size structured cell population model based on the cell cycle length. The model is described by a first order partial differential equation with initial-boundary conditions. Using the theory of semigroups of positive operators we establish new criteria for an asynchronous exponential growth of solutions to such equations. We discuss the question of exponential size growth of cells. We study in detail a constant size growth model and a model with target size division. We also present versions of the model when the population is heterogeneous.


title: Sexism detection: The first corpus in Algerian dialect with a code-switching in Arabic/ French and English

abstract: In this paper, an approach for hate speech detection against women in Arabic community on social media (e.g. Youtube) is proposed. In the literature, similar works have been presented for other languages such as English. However, to the best of our knowledge, not much work has been conducted in the Arabic language. A new hate speech corpus (Arabic\_fr\_en) is developed using three different annotators. For corpus validation, three different machine learning algorithms are used, including deep Convolutional Neural Network (CNN), long short-term memory (LSTM) network and Bi-directional LSTM (Bi-LSTM) network. Simulation results demonstrate the best performance of the CNN model, which achieved F1-score up to 86\% for the unbalanced corpus as compared to LSTM and Bi-LSTM.


title: Mixture of orthogonal sequences made from extended time-stretched pulses enables measurement of involuntary voice fundamental frequency response to pitch perturbation

abstract: Auditory feedback plays an essential role in the regulation of the fundamental frequency of voiced sounds. The fundamental frequency also responds to auditory stimulation other than the speaker's voice. We propose to use this response of the fundamental frequency of sustained vowels to frequency-modulated test signals for investigating involuntary control of voice pitch. This involuntary response is difficult to identify and isolate by the conventional paradigm, which uses step-shaped pitch perturbation. We recently developed a versatile measurement method using a mixture of orthogonal sequences made from a set of extended time-stretched pulses (TSP). In this article, we extended our approach and designed a set of test signals using the mixture to modulate the fundamental frequency of artificial signals. For testing the response, the experimenter presents the modulated signal aurally while the subject is voicing sustained vowels. We developed a tool for conducting this test quickly and interactively. We make the tool available as an open-source and also provide executable GUI-based applications. Preliminary tests revealed that the proposed method consistently provides compensatory responses with about 100 ms latency, representing involuntary control. Finally, we discuss future applications of the proposed method for objective and non-invasive auditory response measurements.


title: A Dynamics Perspective of Pursuit-Evasion Games of Intelligent Agents with the Ability to Learn

abstract: Pursuit-evasion games are ubiquitous in nature and in an artificial world. In nature, pursuer(s) and evader(s) are intelligent agents that can learn from experience, and dynamics (i.e., Newtonian or Lagrangian) is vital for the pursuer and the evader in some scenarios. To this end, this paper addresses the pursuit-evasion game of intelligent agents from the perspective of dynamics. A bio-inspired dynamics formulation of a pursuit-evasion game and baseline pursuit and evasion strategies are introduced at first. Then, reinforcement learning techniques are used to mimic the ability of intelligent agents to learn from experience. Based on the dynamics formulation and reinforcement learning techniques, the effects of improving both pursuit and evasion strategies based on experience on pursuit-evasion games are investigated at two levels 1) individual runs and 2) ranges of the parameters of pursuit-evasion games. Results of the investigation are consistent with nature observations and the natural law - survival of the fittest. More importantly, with respect to the result of a pursuit-evasion game of agents with baseline strategies, this study achieves a different result. It is shown that, in a pursuit-evasion game with a dynamics formulation, an evader is not able to escape from a slightly faster pursuer with an effective learned pursuit strategy, based on agile maneuvers and an effective learned evasion strategy.


title: High-Level Synthesis of Security Properties via Software-Level Abstractions

abstract: High-level synthesis (HLS) is a key component for the hardware acceleration of applications, especially thanks to the diffusion of reconfigurable devices in many domains, from data centers to edge devices. HLS reduces development times by allowing designers to raise the abstraction level and use automated methods for hardware generation. Since security concerns are becoming more and more relevant for data-intensive applications, we investigate how to abstract security properties and use HLS for their integration with the accelerator functionality. We use the case of dynamic information flow tracking, showing how classic software-level abstractions can be efficiently used to hide implementation details to the designers.


title: Uplink Coverage in Heterogeneous mmWave Cellular Networks with Clustered Users

abstract: A K-tier heterogeneous mmWave uplink cellular network with clustered user equipments (UEs) is considered in this paper. In particular, UEs are assumed to be clustered around small-cell base stations (BSs) according to a Gaussian distribution, leading to the Thomas cluster process based modeling. Specific and practical line-of-sight (LOS) and non-line-of-sight (NLOS) models are adopted with different parameters for different tiers. The probability density functions (PDFs) and complementary cumulative distribution functions (CCDFs) of different distances from UEs to BSs are characterized. Coupled association strategy and largest long-term averaged biased received power criterion are considered, and general expressions for association probabilities are provided. Following the identification of the association probabilities, the Laplace transforms of the inter-cell interference and the intra-cluster interference are characterized. Using tools from stochastic geometry, general expressions of the SINR coverage probability are provided. As extensions, fractional power control is incorporated into the analysis, tractable closed-form expressions are provided for special cases, and average ergodic spectral efficiency is analyzed. Via numerical and simulation results, analytical characterizations are confirmed and the impact of key system and network parameters on the performance is identified.


title: Compiler Infrastructure for Specializing Domain-Specific Memory Templates

abstract: Specialized hardware accelerators are becoming important for more and more applications. Thanks to specialization, they can achieve high performance and energy efficiency but their design is complex and time consuming. This problem is exacerbated when large amounts of data must be processed, like in modern big data and machine learning applications. The designer has not only to optimize the accelerator logic but also produce efficient memory architectures. To simplify this process, we propose a multi-level compilation flow that specializes a domain-specific memory template to match data, application, and technology requirements.


title: MR-Contrast-Aware Image-to-Image Translations with Generative Adversarial Networks

abstract: Purpose A Magnetic Resonance Imaging (MRI) exam typically consists of several sequences that yield different image contrasts. Each sequence is parameterized through multiple acquisition parameters that influence image contrast, signal-to-noise ratio, acquisition time, and/or resolution. Depending on the clinical indication, different contrasts are required by the radiologist to make a diagnosis. As MR sequence acquisition is time consuming and acquired images may be corrupted due to motion, a method to synthesize MR images with adjustable contrast properties is required. Methods Therefore, we trained an image-to-image generative adversarial network conditioned on the MR acquisition parameters repetition time and echo time. Our approach is motivated by style transfer networks, whereas the "style" for an image is explicitly given in our case, as it is determined by the MR acquisition parameters our network is conditioned on. Results This enables us to synthesize MR images with adjustable image contrast. We evaluated our approach on the fastMRI dataset, a large set of publicly available MR knee images, and show that our method outperforms a benchmark pix2pix approach in the translation of non-fat-saturated MR images to fat-saturated images. Our approach yields a peak signal-to-noise ratio and structural similarity of 24.48 and 0.66, surpassing the pix2pix benchmark model significantly. Conclusion Our model is the first that enables fine-tuned contrast synthesis, which can be used to synthesize missing MR contrasts or as a data augmentation technique for AI training in MRI.


title: On negative dependence inequalities and maximal scores in round-robin tournaments

abstract: We extend Huber's (1963) inequality for the joint distribution function of negative dependent scores in round-robin tournaments. As a byproduct, this extension implies convergence in probability of the maximal score in round-robin tournaments in a more general setting.


title: Stellar collisions in flattened and rotating Pop. III star clusters

abstract: Fragmentation often occurs in disk-like structures, both in the early Universe and in the context of present-day star formation. Supermassive black holes (SMBHs) are astrophysical objects whose origin is not well understood; they weigh millions of solar masses and reside in the centers of galaxies. An important formation scenario for SMBHs is based on collisions and mergers of stars in a massive cluster, in which the most massive star moves to the center of the cluster due to dynamical friction. This increases the rate of collisions and mergers since massive stars have larger collisional cross sections. This can lead to runaway growth of a very massive star which may collapse to become an intermediate-mass black hole. Here we investigate the dynamical evolution of Miyamoto-Nagai models that allow us to describe dense stellar clusters, including flattening and different degrees of rotation. We find that the collisions in these clusters depend mostly on the number of stars and the initial stellar radii for a given radial size of the cluster. By comparison, rotation seems to affect the collision rate by at most $20\%$. For flatness, we compared spherical models with systems that have a scale height of about $10\%$ of their radial extent, in this case finding a change in the collision rate of less than $25\%$. Overall, we conclude that the parameters only have a minor effect on the number of collisions. Our results also suggest that rotation helps to retain more stars in the system, reducing the number of escapers by a factor of $2-3$ depending on the model and the specific realization. After two million years, a typical lifetime of a very massive star, we find that about $630$ collisions occur in typical models with $N=10^4$, $R=100$ $\rm~R_\odot$ and a half-mass radius of $0.1$ $\rm~pc$, leading to a mass of about $6.3\times10^3$ $\rm~M_\odot$ for the most massive object.


title: Discrete Differential Calculus on (Co-)Simplicial Complexes and Generalized (Co-)Homology

abstract: Let $V$ be a finite set. Let $\mathcal{K}$ be a simplicial complex with its vertices in $V$. In this paper, we discuss some differential calculus on $V$. We construct some generalized homology groups of $\mathcal{K}$ by using the differential calculus on $V$. Moreover, we define a co-simplicial complex to be the complement of a simplicial complex in the complete hypergraph on $V$. Let $\mathcal{L}$ be a co-simplicial complex with its vertices in $V$. We construct some generalized cohomology groups of $\mathcal{L}$ by using the differential calculus on $V$.


title: Sums of polynomial-type exceptional units modulo $n$

abstract: Let $f(x)\in\mathbb{Z}[x]$ be a nonconstant polynomial. Let $n, k$ and $c$ be integers such that $n\ge 1$ and $k\ge 2$. An integer $a$ is called an $f$-exunit in the ring $\mathbb{Z}_n$ of residue classes modulo $n$ if $\gcd(f(a),n)=1$. In this paper, we use the principle of cross-classification to derive an explicit formula for the number ${\mathcal N}_{k,f,c}(n)$ of solutions $(x_1,...,x_k)$ of the congruence $x_1+...+x_k\equiv c\pmod n$ with all $x_i$ being $f$-exunits in the ring $\mathbb{Z}_n$. This extends a recent result of Anand {\it et al.} [On a question of $f$-exunits in $\mathbb{Z}/{n\mathbb{Z}}$, {\it Arch. Math. (Basel)} {\bf 116} (2021), 403-409]. We derive a more explicit formula for ${\mathcal N}_{k,f,c}(n)$ when $f(x)$ is linear or quadratic.


title: Few-Shot Keyword Spotting in Any Language

abstract: We introduce a few-shot transfer learning method for keyword spotting in any language. Leveraging open speech corpora in nine languages, we automate the extraction of a large multilingual keyword bank and use it to train an embedding model. With just five training examples, we fine-tune the embedding model for keyword spotting and achieve an average F1 score of 0.75 on keyword classification for 180 new keywords unseen by the embedding model in these nine languages. This embedding model also generalizes to new languages. We achieve an average F1 score of 0.65 on 5-shot models for 260 keywords sampled across 13 new languages unseen by the embedding model. We investigate streaming accuracy for our 5-shot models in two contexts: keyword spotting and keyword search. Across 440 keywords in 22 languages, we achieve an average streaming keyword spotting accuracy of 87.4% with a false acceptance rate of 4.3%, and observe promising initial results on keyword search.


title: Atomistic insights into the degradation of halide perovskites: a reactive force field molecular dynamics study

abstract: Halide perovskites make efficient solar cells due to their exceptional optoelectronic properties, but suffer from several stability issues. The characterization of the degradation processes is challenging because of the limitations in the spatio-temporal resolution in experiments and the absence of efficient computational methods to study the reactive processes. Here, we present the first effort in developing reactive force fields for large scale molecular dynamics simulations of the phase instability and the defect-induced degradation reactions in inorganic CsPbI$_{3}$. We find that the phase transitions are driven by a combination of the anharmonicity of the perovskite lattice with the thermal entropy. At relatively low temperatures, the Cs cations tend to move away from the preferential positions with good contacts with the surrounding metal halide framework, potentially causing its conversion to a non-perovskite phase. Our simulations of defective structures reveal that, although both iodine vacancies and interstitials are very mobile in the perovskite lattice, the vacancies have a detrimental effect on the stability, initiating the decomposition reactions of perovskites to PbI$_{2}$. Our work puts ReaxFF forward as an effective computational framework to study reactive processes in halide perovskites.


title: Data-driven Contact Network Models of COVID-19 Reveal Trade-offs between Costs and Infections for Optimal Local Containment Policies

abstract: While several non-pharmacological measures have been implemented for a few months in an effort to slow the coronavirus disease (COVID-19) pandemic in the United States, the disease remains a danger in a number of counties as restrictions are lifted to revive the economy. Making a trade-off between economic recovery and infection control is a major challenge confronting many hard-hit counties. Understanding the transmission process and quantifying the costs of local policies are essential to the task of tackling this challenge. Here, we investigate the dynamic contact patterns of the populations from anonymized, geo-localized mobility data and census and demographic data to create data-driven, agent-based contact networks. We then simulate the epidemic spread with a time-varying contagion model in ten large metropolitan counties in the United States and evaluate a combination of mobility reduction, mask use, and reopening policies. We find that our model captures the spatial-temporal and heterogeneous case trajectory within various counties based on dynamic population behaviors. Our results show that a decision-making tool that considers both economic cost and infection outcomes of policies can be informative in making decisions of local containment strategies for optimal balancing of economic slowdown and virus spread.


title: Effects of mesoporous SiO2-CaO nanospheres on the murine peritoneal macrophages -- Candida albicans interface

abstract: The use of nanoparticles for intracellular drug delivery could reduce the toxicity and side effects of the drug but, the uptake of these nanocarriers could induce adverse effects on cells and tissues after their incorporation. Macrophages play a central role in host defense and are responsible for in vivo nanoparticle trafficking. Assessment of their defense capacity against pathogenic micro-organisms after nanoparticle uptake, is necessary to prevent infections associated with nanoparticle therapies. In this study, the effects of hollow mesoporous SiO2-CaO nanospheres labeled with fluorescein isothiocyanate (FITC-NanoMBGs) on the function of peritoneal macrophages was assessed by measuring their ability to phagocytize Candida albicans expressing a red fluorescent protein. Two macrophage-fungus ratios (MOI 1 and MOI 5) were used and two experimental strategies were carried out: a) pretreatment of macrophages with FITC-NanoMBGs and subsequent fungal infection; b) competition assays after simultaneous addition of fungus and nanospheres. Macrophage pro-inflammatory phenotype markers (CD80 expression and interleukin 6 secretion) were also evaluated. Significant decreases of CD80+ macrophage percentage and interleukin 6 secretion were observed after 30 min, indicating that the simultaneous incorporation of NanoMBG and fungus favors the macrophage noninflammatory phenotype. The present study evidences that the uptake of these nanospheres in all the studied conditions does not alter the macrophage function. Moreover, intracellular FITCNanoMBGs induce a transitory increase of the fungal phagocytosis by macrophages at MOI 1 and after a short time of interaction. In the competition assays, as the intracellular fungus quantity increased, the intracellular FITC-NanoMBG content decreased in a MOI- and timedependent manner...


title: Multiscale porosity in mesoporous bioglass 3D-printed scaffolds for bone regeneration

abstract: In order to increase the bone forming ability of MBG-PCL composite scaffold, microporosity was created in the struts of 3D-printed MBG-PCL scaffolds for the manufacturing of a construct with a multiscale porosity consisting of meso-, micro- and macro-pores. 3D-printing imparted macroporosity while the microporosity was created by porogen removal from the struts, and the MBG particles were responsible for the mesoporosity. The scaffolds were 3D-printed using a mixture of PCL, MBG and phosphate buffered saline (PBS) particles, subsequently leached out. Microporous-PCL (pPCL) as a negative control, microporous MBG-PCL (pMBG-PCL) and non-microporous-MBG-PCL (MBG-PCL) were investigated. Scanning electron microscopy, mercury intrusion porosimetry and micro-computed tomography demonstrated that the PBS removal resulted in the formation of micropores inside the struts with porosity of around 30% for both pPCL and pMBG-PCL, with both constructs displaying an overall porosity of 80-90%. In contrast, the MBG-PCL group had a microporosity of 6% and an overall porosity of 70%. Early mineralisation was found in the pMBG-PCL post-leaching out and this resulted in the formation a more homogeneous calcium phosphate layer when using a biomimetic mineralisation assay. Mechanical properties ranged from 5 to 25 MPa for microporous and non-microporous specimens, hence microporosity was the determining factor affecting compressive properties. MC3T3-E1 metabolic activity was increased in the pMBG-PCL along with an increased production of RUNX2. Therefore, the microporosity within a 3D-printed bioceramic composite construct may result in additional physical and biological benefits.


title: A surrogate loss function for optimization of $F_\beta$ score in binary classification with imbalanced data

abstract: The $F_\beta$ score is a commonly used measure of classification performance, which plays crucial roles in classification tasks with imbalanced data sets. However, the $F_\beta$ score cannot be used as a loss function by gradient-based learning algorithms for optimizing neural network parameters due to its non-differentiability. On the other hand, commonly used loss functions such as the binary cross-entropy (BCE) loss are not directly related to performance measures such as the $F_\beta$ score, so that neural networks optimized by using the loss functions may not yield optimal performance measures. In this study, we investigate a relationship between classification performance measures and loss functions in terms of the gradients with respect to the model parameters. Then, we propose a differentiable surrogate loss function for the optimization of the $F_\beta$ score. We show that the gradient paths of the proposed surrogate $F_\beta$ loss function approximate the gradient paths of the large sample limit of the $F_\beta$ score. Through numerical experiments using ResNets and benchmark image data sets, it is demonstrated that the proposed surrogate $F_\beta$ loss function is effective for optimizing $F_\beta$ scores under class imbalances in binary classification tasks compared with other loss functions.


title: Casimir Puzzle and Casimir Conundrum: Discovery and Search for Resolution

abstract: We review complicated problems in the Lifshitz theory describing the Casimir force between real material plates made of metals and dielectrics including different approaches to their resolution. It has been shown that both for metallic plates with perfect crystal lattices and for any dielectric plates the Casimir entropy calculated in the framework of the Lifshitz theory violates the Nernst heat theorem when the well approved dielectric functions are used in computations. The respective theoretical Casimir forces are excluded by the measurement data of numerous precision experiments. In the literature this situation received the names of the Casimir puzzle and the Casimir conundrum for the cases of metallic and dielectric plates, respectively. The review presents a summary of the main facts on this subject on both theoretical and experimental sides. Next, we discuss the main approaches proposed in the literature in order to bring the Lifshitz theory in agreement with the measurement data and with the laws of thermodynamics. Special attention is paid to the recently suggested spatially nonlocal Drude-like response functions which take into account the relaxation properties of conduction electrons, as does the standard Drude model, but lead to the theoretical results in agreement with both thermodynamics and the measurement data through the alternative response to quantum fluctuations off the mass shell. Further advances and trends in this field of research are discussed.


title: On the Influence of Charging Stations Spatial Distribution on Aerial Wireless Networks

abstract: Using drones for cellular coverage enhancement is a recent technology that has shown a great potential in various practical scenarios. However, one of the main challenges that limits the performance of drone-enabled wireless networks is the limited flight time. In particular, due to the limited on-board battery size, the drone needs to frequently interrupt its operation and fly back to a charging station to recharge/replace its battery. In addition, the charging station might be responsible to recharge multiple drones. Given that the charging station has limited capacity, it can only serve a finite number of drones simultaneously. Hence, in order to accurately capture the influence of the battery limitation on the performance, it is required to analyze the dynamics of the time spent by the drones at the charging stations. In this paper, we use tools from queuing theory and stochastic geometry to study the influence of each of the charging stations limited capacity and spatial density on the performance of a drone-enabled wireless network.


title: Disentangling Dynamical Quantum Coherences in the Fenna-Matthews-Olson Complex

abstract: In the primary step of light-harvesting, the energy of a photon is captured in antenna chlorophyll as an exciton. Its efficient conversion to stored chemical potential occurs in the special pair reaction center, which has to be reached by down-hill ultrafast excited state energy transport. The interaction between the chromophores leads to spatial delocalization and quantum coherence effects, the importance of which depends on the coupling between the chlorophylls in relation to the intensity of the fluctuations and reorganization dynamics of the protein matrix, or bath. The latter induce uncorrelated modulations of the site energies, and thus quantum decoherence, and localization of the exciton. Current consensus is that under physiological conditions quantum decoherence occurs on the 10 fs time scale, and quantum coherence plays little role for the observed picosecond energy transfer dynamics. In this work, we reaffirm this from a different point of view by finding that the true onset of electronic quantum coherence only occurs at extremely low temperatures of ~20 K. We have directly determined the exciton coherence times by two-dimensional electronic spectroscopy of the Fenna-Matthew-Olson complex over an extensive temperature range with a supporting theoretical modelling. At 20 K, electronic coherences persist out to 200 fs (close to the antenna) and marginally up to 500 fs at the reaction-center side. It decays markedly faster with modest increases in temperature to become irrelevant above 150 K. This temperature dependence also allows disentangling the previously reported long-lived beatings. We show that they result from mixing vibrational coherences in the electronic ground state ...


title: Evidence for spin-polarized bound states in semiconductor-superconductor-ferromagnetic insulator islands

abstract: We report Coulomb blockade transport studies of semiconducting InAs nanowires grown with epitaxial superconducting Al and ferromagnetic insulator EuS on overlapping facets. Comparing experiment to a theoretical model, we associate cotunneling features in even-odd bias spectra with spin-polarized Andreev levels. Results are consistent with zero-field spin splitting exceeding the induced superconducting gap. Energies of subgap states are tunable on either side of zero via electrostatic gates.


title: EFT and the SUSY Index on the 2nd Sheet

abstract: The counting of BPS states in four-dimensional ${\cal N}=1$ theories has attracted a lot of attention in recent years. For superconformal theories, these states are in one-to-one correspondence with local operators in various short representations. The generating function for this counting problem has branch cuts and hence several Cardy-like limits, which are analogous to high-temperature limits. Particularly interesting is the second sheet, which has been shown to capture the microstates and phases of supersymmetric black holes in AdS$_5$. Here we present a 3d Effective Field Theory (EFT) approach to the high-temperature limit on the second sheet. We use the EFT to derive the behavior of the index at orders $\beta^{-2},\beta^{-1},\beta^0$. We also make a conjecture for $O(\beta)$, where we argue that the expansion truncates up to exponentially small corrections. An important point is the existence of vector multiplet zero modes, unaccompanied by massless matter fields. The runaway of Affleck-Harvey-Witten is however avoided by a non-perturbative confinement mechanism. This confinement mechanism guarantees that our results are robust.


title: Growth and helicity of non-centrosymmetric Cu$_2$OSeO$_3$ crystals

abstract: We have grown Cu$_2$OSeO$_3$ single crystals with an optimized chemical vapor transport technique by using SeCl$_4$ as a transport agent. Our optimized growth method allows to selectively produce large high quality single crystals. The method is shown to consistently produce Cu$_2$OSeO$_3$ crystals of maximum size 8 mm x 7 mm x 4 mm with a transport duration of around three weeks. We found this method, with SeCl$_4$ as transport agent, more efficient and simple compared to the commonly used growth techniques reported in literature with HCl gas as transport agent. The Cu$_2$OSeO$_3$ crystals have very high quality and the absolute structure are fully determined by simple single crystal x-ray diffraction. We observed both type of crystals with left- and right-handed chiralities. Our magnetization and ferromagnetic resonance data show the same magnetic phase diagram as reported earlier.


title: ECAPA-TDNN Embeddings for Speaker Diarization

abstract: Learning robust speaker embeddings is a crucial step in speaker diarization. Deep neural networks can accurately capture speaker discriminative characteristics and popular deep embeddings such as x-vectors are nowadays a fundamental component of modern diarization systems. Recently, some improvements over the standard TDNN architecture used for x-vectors have been proposed. The ECAPA-TDNN model, for instance, has shown impressive performance in the speaker verification domain, thanks to a carefully designed neural model. In this work, we extend, for the first time, the use of the ECAPA-TDNN model to speaker diarization. Moreover, we improved its robustness with a powerful augmentation scheme that concatenates several contaminated versions of the same signal within the same training batch. The ECAPA-TDNN model turned out to provide robust speaker embeddings under both close-talking and distant-talking conditions. Our results on the popular AMI meeting corpus show that our system significantly outperforms recently proposed approaches.


title: Factorization for entropy production of the Eikonal equation and regularity

abstract: The Eikonal equation arises naturally in the limit of the second order Aviles-Giga functional whose $\Gamma$-convergence is a long standing challenging problem. The theory of entropy solutions of the Eikonal equation plays a central role in the variational analysis of this problem. Establishing fine structures of entropy solutions of the Eikonal equation, e.g. concentration of entropy measures on $\mathcal{H}^1$-rectifiable sets in $2$D, is arguably the key missing part for a proof of the full $\Gamma$-convergence of the Aviles-Giga functional. In the first part of this work, for $p\in \left(1,\frac{4}{3}\right]$ we establish an $L^p$ version of the main theorem of Ghiraldin and Lamy [Comm. Pure Appl. Math. 73 (2020), no. 2, 317-349]. Specifically we show that if $m$ is a solution to the Eikonal equation, then $m\in B^{\frac{1}{3}}_{3p,\infty,loc}$ is equivalent to all entropy productions of $m$ being in $L^p_{loc}$. This result also shows that as a consequence of a weak form of the Aviles-Giga conjecture (namely the conjecture that all solutions to the Eikonal equation whose entropy productions are in $L^p_{loc}$ are rigid) - the rigidity/flexibility threshold of the Eikonal equation is exactly the space $ B^{\frac{1}{3}}_{3,\infty,loc}$. In the second part of this paper, under the assumption that all entropy productions are in $L^p_{loc}$, we establish a factorization formula for entropy productions of solutions of the Eikonal equation in terms of the two Jin-Kohn entropies. A consequence of this formula is control of all entropy productions by the Jin-Kohn entropies in the $L^p$ setting - this is a strong extension of an earlier result of the authors [Annales de l'Institut Henri Poincar\'{e}. Analyse Non Lin\'{e}aire 35 (2018), no. 2, 481-516].


title: Neural Representations of Cryo-EM Maps and a Graph-Based Interpretation

abstract: Advances in imagery at atomic and near-atomic resolution, such as cryogenic electron microscopy (cryo-EM), have led to an influx of high resolution images of proteins and other macromolecular structures to data banks worldwide. Producing a protein structure from the discrete voxel grid data of cryo-EM maps involves interpolation into the continuous spatial domain. We present a novel data format called the neural cryo-EM map, which is formed from a set of neural networks that accurately parameterize cryo-EM maps and provide native, spatially continuous data for density and gradient. As a case study of this data format, we create graph-based interpretations of high resolution experimental cryo-EM maps. Normalized cryo-EM map values interpolated using the non-linear neural cryo-EM format are more accurate, consistently scoring less than 0.01 mean absolute error, than a conventional tri-linear interpolation, which scores up to 0.12 mean absolute error. Our graph-based interpretations of 115 experimental cryo-EM maps from 1.15 to 4.0 Angstrom resolution provide high coverage of the underlying amino acid residue locations, while accuracy of nodes is correlated with resolution. The nodes of graphs created from atomic resolution maps (higher than 1.6 Angstroms) provide greater than 99% residue coverage as well as 85% full atomic coverage with a mean of than 0.19 Angstrom root mean squared deviation (RMSD). Other graphs have a mean 84% residue coverage with less specificity of the nodes due to experimental noise and differences of density context at lower resolutions. This work may be generalized for transforming any 3D grid-based data format into non-linear, continuous, and differentiable format for the downstream geometric deep learning applications.


title: Modeling ADHD in Drosophila: Investigating the Effects of Glucose on Dopamine Production Demonstrated by Locomotion

abstract: Hyperactivity is one of the hallmakrs of ADHD. Aberrant dopamine signaling is a major theme in ADHD and dopamine production is directly linked to the intensity and persistence of hyperactive conduct. The strength and persistence of hyperactivity responses in Drosophila to startle stimuli were measured in a study to determine the effects of sugar on dopamine development. A total of four experimental groups, namely 1%,3%, and 5% glucose, as well as a control group were taken for the diet of Drosophila, and these four different amounts of glucose were introduced to the growth medium where Drosophila was cultured. The movements of Drosophila in the four treatment groups were captured using a camera. This experiment was carried out five times, each time using a different batch of Drosophila. Each group's average velocity over time was also reported. The web adaptation of Drosophila Activity Monitor(DAM) was used to analyze the captured movies from the camera. Furthermore, when it came to hyperactivity persistence, all four treatment classes were statistically different (p0.05). Since the strength and persistence of hyperactive behavior are directly correlated to dopamine output, this study shows that higher glucose intake is associated with more hyperactivity, for both the intensity({\Delta}V) and persistence.


title: Algorithms for Difference-of-Convex (DC) Programs Based on Difference-of-Moreau-Envelopes Smoothing

abstract: In this paper we consider minimization of a difference-of-convex (DC) function with and without linear constraints. We first study a smooth approximation of a generic DC function, termed difference-of-Moreau-envelopes (DME) smoothing, where both components of the DC function are replaced by their respective Moreau envelopes. The resulting smooth approximation is shown to be Lipschitz differentiable, capture stationary points, local, and global minima of the original DC function, and enjoy some growth conditions, such as level-boundedness and coercivity, for broad classes of DC functions. We then develop four algorithms for solving DC programs with and without linear constraints based on the DME smoothing. In particular, for a smoothed DC program without linear constraints, we show that the classic gradient descent method as well as an inexact variant can obtain a stationary solution in the limit with a convergence rate of $\mathcal{O}(K^{-1/2})$, where $K$ is the number of proximal evaluations of both components. Furthermore, when the DC program is explicitly constrained in an affine subspace, we combine the smoothing technique with the augmented Lagrangian function and derive two variants of the augmented Lagrangian method (ALM), named LCDC-ALM and composite LCDC-ALM, focusing on different structures of the DC objective function. We show that both algorithms find an $\epsilon$-approximate stationary solution of the original DC program in $\mathcal{O}(\epsilon^{-2})$ iterations. Comparing to existing methods designed for linearly constrained weakly convex minimization, the proposed ALM-based algorithms can be applied to a broader class of problems, where the objective contains a nonsmooth concave component. Finally, numerical experiments are presented to demonstrate the performance of the proposed algorithms.


title: Adversarial Joint Training with Self-Attention Mechanism for Robust End-to-End Speech Recognition

abstract: Lately, the self-attention mechanism has marked a new milestone in the field of automatic speech recognition (ASR). Nevertheless, its performance is susceptible to environmental intrusions as the system predicts the next output symbol depending on the full input sequence and the previous predictions. Inspired by the extensive applications of the generative adversarial networks (GANs) in speech enhancement and ASR tasks, we propose an adversarial joint training framework with the self-attention mechanism to boost the noise robustness of the ASR system. Generally, it consists of a self-attention speech enhancement GAN and a self-attention end-to-end ASR model. There are two highlights which are worth noting in this proposed framework. One is that it benefits from the advancement of both self-attention mechanism and GANs; while the other is that the discriminator of GAN plays the role of the global discriminant network in the stage of the adversarial joint training, which guides the enhancement front-end to capture more compatible structures for the subsequent ASR module and thereby offsets the limitation of the separate training and handcrafted loss functions. With the adversarial joint optimization, the proposed framework is expected to learn more robust representations suitable for the ASR task. We execute systematic experiments on the corpus AISHELL-1, and the experimental results show that on the artificial noisy test set, the proposed framework achieves the relative improvements of 66% compared to the ASR model trained by clean data solely, 35.1% compared to the speech enhancement & ASR scheme without joint training, and 5.3% compared to multi-condition training.


title: A Note on Consistent Rotation Maps of Graph Cartesian Products

abstract: Given two regular graphs with consistent rotation maps, we produce a constructive method for a consistent rotation map on their Cartesian product. This method will be given as a simple set of rules of addition and table look ups. We assume that the combinatorial construction of both consistent rotation maps has occurred before we construct the Cartesian product.


title: Convergence Analysis of the Rank-Restricted Soft SVD Algorithm

abstract: The soft SVD is a robust matrix decomposition algorithm and a key component of matrix completion methods. However, computing the soft SVD for large sparse matrices is often impractical using conventional numerical methods for the SVD due to large memory requirements. The Rank-Restricted Soft SVD (RRSS) algorithm introduced by Hastie et al. addressed this issue by sequentially computing low-rank SVDs that easily fit in memory. We analyze the convergence of the standard RRSS algorithm and we give examples where the standard algorithm does not converge. We show that convergence requires a modification of the standard algorithm, and is related to non-uniqueness of the SVD. Our modification specifies a consistent choice of sign for the left singular vectors of the low-rank SVDs in the iteration. Under these conditions, we prove linear convergence of the singular vectors using a technique motivated by alternating subspace iteration. We then derive a fixed point iteration for the evolution of the singular values and show linear convergence to the soft thresholded singular values of the original matrix. This last step requires a perturbation result for fixed point iterations which may be of independent interest.


title: Thalamocortical contribution to solving credit assignment in neural systems

abstract: Animal brains evolved to optimize behavior in dynamically changing environments, selecting actions that maximize future rewards. A large body of experimental work indicates that such optimization changes the wiring of neural circuits, appropriately mapping environmental input onto behavioral outputs. A major unsolved scientific question is how optimal wiring adjustments, which must target the connections responsible for rewards, can be accomplished when the relation between sensory inputs, action taken, environmental context with rewards is ambiguous. The computational problem of properly targeting cues, contexts and actions that lead to reward is known as structural, contextual and temporal credit assignment respectively. In this review, we survey prior approaches to these three types of problems and advance the notion that the brain's specialized neural architectures provide efficient solutions. Within this framework, the thalamus with its cortical and basal ganglia interactions serve as a systems-level solution to credit assignment. Specifically, we propose that thalamocortical interaction is the locus of meta-learning where the thalamus provides cortical control functions that parametrize the cortical activity association space. By selecting among these control functions, the basal ganglia hierarchically guide thalamocortical plasticity across two timescales to enable meta-learning. The faster timescale establishes contextual associations to enable rapid behavioral flexibility while the slower one enables generalization to new contexts. Incorporating different thalamic control functions under this framework clarifies how thalamocortical-basal ganglia interactions may simultaneously solve the three credit assignment problems.


title: Towards a tensor-classification of Harish-Chandra modules: The case ${\rm SL}_2(\mathbb R)$

abstract: We consider the category of Harish-Chandra modules for ${\rm SL}_2(\mathbb R)$ as a module over the category of finite-dimensional representations of ${\rm SL}(2)$ with respect to the tensor product. In this note we use classical results about principal series to obtain a classification of $\otimes$-submodules of the category of Harish-Chandra modules of ${\rm SL}_2(\mathbb R)$. The resulting classification recovers the classical classification of irreducible Harish-Chandra modules. Our methods are expected to generalize to arbitrary reductive pairs and more general base fields.


title: Explicit physics-informed neural networks for non-linear upscaling closure: the case of transport in tissues

abstract: In this work, we use a combination of formal upscaling and data-driven machine learning for explicitly closing a nonlinear transport and reaction process in a multiscale tissue. The classical effectiveness factor model is used to formulate the macroscale reaction kinetics. We train a multilayer perceptron network using training data generated by direct numerical simulations over microscale examples. Once trained, the network is used for numerically solving the upscaled (coarse-grained) differential equation describing mass transport and reaction in two example tissues. The network is described as being explicit in the sense that the network is trained using macroscale concentrations and gradients of concentration as components of the feature space. Network training and solutions to the macroscale transport equations were computed for two different tissues. The two tissue types (brain and liver) exhibit markedly different geometrical complexity and spatial scale (cell size and sample size). The upscaled solutions for the average concentration are compared with numerical solutions derived from the microscale concentration fields by a posteriori averaging. There are two outcomes of this work of particular note: 1) we find that the trained network exhibits good generalizability, and it is able to predict the effectiveness factor with high fidelity for realistically-structured tissues despite the significantly different scale and geometry of the two example tissue types; and 2) the approach results in an upscaled PDE with an effectiveness factor that is predicted (implicitly) via the trained neural network. This latter result emphasizes our purposeful connection between conventional averaging methods with the use of machine learning for closure; this contrasts with some machine learning methods for upscaling where the exact form of the macroscale equation remains unknown.


title: Exploring the Role of BERT Token Representations to Explain Sentence Probing Results

abstract: Several studies have been carried out on revealing linguistic features captured by BERT. This is usually achieved by training a diagnostic classifier on the representations obtained from different layers of BERT. The subsequent classification accuracy is then interpreted as the ability of the model in encoding the corresponding linguistic property. Despite providing insights, these studies have left out the potential role of token representations. In this paper, we provide a more in-depth analysis on the representation space of BERT in search for distinct and meaningful subspaces that can explain the reasons behind these probing results. Based on a set of probing tasks and with the help of attribution methods we show that BERT tends to encode meaningful knowledge in specific token representations (which are often ignored in standard classification setups), allowing the model to detect syntactic and semantic abnormalities, and to distinctively separate grammatical number and tense subspaces.


title: "Forget" the Forget Gate: Estimating Anomalies in Videos using Self-contained Long Short-Term Memory Networks

abstract: Abnormal event detection is a challenging task that requires effectively handling intricate features of appearance and motion. In this paper, we present an approach of detecting anomalies in videos by learning a novel LSTM based self-contained network on normal dense optical flow. Due to their sigmoid implementations, standard LSTM's forget gate is susceptible to overlooking and dismissing relevant content in long sequence tasks like abnormality detection. The forget gate mitigates participation of previous hidden state for computation of cell state prioritizing current input. In addition, the hyperbolic tangent activation of standard LSTMs sacrifices performance when a network gets deeper. To tackle these two limitations, we introduce a bi-gated, light LSTM cell by discarding the forget gate and introducing sigmoid activation. Specifically, the LSTM architecture we come up with fully sustains content from previous hidden state thereby enabling the trained model to be robust and make context-independent decision during evaluation. Removing the forget gate results in a simplified and undemanding LSTM cell with improved performance effectiveness and computational efficiency. Empirical evaluations show that the proposed bi-gated LSTM based network outperforms various LSTM based models verifying its effectiveness for abnormality detection and generalization tasks on CUHK Avenue and UCSD datasets.


title: Biasing topological charge injection in topological matter

abstract: We explore the interplay between topologies in the momentum and real spaces to formulate a thermodynamic description of nonequilibrium injection of topological charges under external bias. We show that the edge modes engendered by the momentum-space topology can play a functional role of connecting the external reservoirs to the bulk transport of topological charges in the real space. We illustrate our general results with two examples: the spin-torque injection of skyrmions in an electrically-biased integer quantum Hall system, and the vortex injection in a topological $p\,+\,i\,p$ superconductor coupled to heat reservoirs. Based on the universal fractional entropy of the Majorana zero modes bound to the vortices, their controllable injection proposed in this work could provide a route for creating and manipulating Majorana fermions.


title: On the spectral problem of the quantum KdV hierarchy

abstract: The spectral problem for the quantum dispersionless Korteweg-de Vries (KdV) hierarchy, aka the quantum Hopf hierarchy, is solved by Dubrovin. In this article, following Dubrovin, we study Buryak-Rossi's quantum KdV hierarchy. In particular, we prove a symmetry property and a non-degeneracy property for the quantum KdV Hamiltonians. On the basis of this we construct a complete set of common eigenvectors. The analysis underlying this spectral problem implies certain vanishing identities for combinations of characters of the symmetric group. We also comment on the geometry of the spectral curves of the quantum KdV hierarchy and we give a representation of the quantum dispersionless KdV Hamiltonians in terms of multiplication operators in the class algebra of the symmetric group.


title: Do We Need Anisotropic Graph Neural Networks?

abstract: Common wisdom in the graph neural network (GNN) community dictates that anisotropic models -- in which messages sent between nodes are a function of both the source and target node -- are required to achieve state-of-the-art performance. Benchmarks to date have demonstrated that these models perform better than comparable isotropic models -- where messages are a function of the source node only. In this work we provide empirical evidence challenging this narrative: we propose an isotropic GNN, which we call Efficient Graph Convolution (EGC), that consistently outperforms comparable anisotropic models, including the popular GAT or PNA architectures by using spatially-varying adaptive filters. In addition to raising important questions for the GNN community, our work has significant real-world implications for efficiency. EGC achieves higher model accuracy, with lower memory consumption and latency, along with characteristics suited to accelerator implementation, while being a drop-in replacement for existing architectures. As an isotropic model, it requires memory proportional to the number of vertices in the graph ($\mathcal{O}(V)$); in contrast, anisotropic models require memory proportional to the number of edges ($\mathcal{O}(E)$). We demonstrate that EGC outperforms existing approaches across 6 large and diverse benchmark datasets, and conclude by discussing questions that our work raise for the community going forward. Code and pretrained models for our experiments are provided at https://github.com/shyam196/egc.


title: Training Deep Normalizing Flow Models in Highly Incomplete Data Scenarios with Prior Regularization

abstract: Deep generative frameworks including GANs and normalizing flow models have proven successful at filling in missing values in partially observed data samples by effectively learning -- either explicitly or implicitly -- complex, high-dimensional statistical distributions. In tasks where the data available for learning is only partially observed, however, their performance decays monotonically as a function of the data missingness rate. In high missing data rate regimes (e.g., 60% and above), it has been observed that state-of-the-art models tend to break down and produce unrealistic and/or semantically inaccurate data. We propose a novel framework to facilitate the learning of data distributions in high paucity scenarios that is inspired by traditional formulations of solutions to ill-posed problems. The proposed framework naturally stems from posing the process of learning from incomplete data as a joint optimization task of the parameters of the model being learned and the missing data values. The method involves enforcing a prior regularization term that seamlessly integrates with objectives used to train explicit and tractable deep generative frameworks such as deep normalizing flow models. We demonstrate via extensive experimental validation that the proposed framework outperforms competing techniques, particularly as the rate of data paucity approaches unity.


title: The cross section of the process $e^+e^- \to p\bar{p}$ in the vicinity of charmonium $\psi(3770)$ including three-gluon and $D$-meson loop contributions

abstract: The total cross section of the process $e^+e^- \to p\bar{p}$ is calculated within the energy range close to the mass of $\psi(3770)$ charmonium state. It was shown that the main contribution to this cross section comes from three gluon mechanism which is also responsible of the large phase with respect to the Born amplitude. This phase provides the characteristic dip behaviour of the cross section in contrast to the usual Breit-Wigner peak shape. OZI-allowed mechanism with D-mesons in the intermediate state was also estimated and gives relatively small contribution to the cross section and to the phase.


title: Real Lie groups and o-minimality

abstract: We characterize, up to Lie isomorphism, the real Lie groups that are definable in an o-minimal expansion of the real field.


title: High Temperature Superconductivity in a Lightly Doped Quantum Spin Liquid

abstract: We have performed density-matrix renormalization group studies of a square lattice $t$-$J$ model with small hole doping, $\delta\ll 1$, on long 4 and 6 leg cylinders. We include frustration in the form of a second-neighbor exchange coupling, $J_2 = J_1/2$, such that the undoped ($\delta=0$) "parent" state is a quantum spin liquid. In contrast to the relatively short range superconducting (SC) correlations that have been observed in recent studies of the 6-leg cylinder in the absence of frustration, we find power law SC correlations with a Luttinger exponent, $K_{sc} \approx 1$, consistent with a strongly diverging SC susceptibility, $\chi \sim T^{-(2-K_{sc})}$ as the temperature $T\to 0$. The spin-spin correlations - as in the undoped state - fall exponentially suggesting that the SC "pairing" correlations evolve smoothly from the insulating parent state.


title: Constructions of New q-Cryptomorphisms

abstract: In the theory of classical matroids, there are several known equivalent axiomatic systems that define a matroid, which are described as matroid cryptomorphisms. A q-matroid is a q-analogue of a matroid where subspaces play the role of the subsets in the classical theory. In this article we establish cryptomorphisms of q-matroids. In doing so we highlight the difference between classical theory and its q-analogue. We introduce a comprehensive set of q-matroid axiom systems and show cryptomorphisms between them and existing axiom systems of a q-matroid. These axioms are described as the rank, closure, basis, independence, dependence, circuit, hyperplane, flat, open space, spanning space, non-spanning space, and bi-colouring axioms.


title: The final orbital separation in common envelope evolution

abstract: In the majority of population synthesis calculations of close binary stars, the common envelope (CE) phase is modeled using a standard prescription based upon the conservation of energy, known as the alpha prescription. In this prescription, the orbital separation of the secondary and giant core at the end of the CE phase is taken to be the orbital separation when the envelope becomes unbound. However, recent observations of planetary nebulae with binary cores (BPNe), believed to be the immediate products of CE evolution, indicate orbital periods that are significantly shorter than predicted by population synthesis models using the alpha prescription. We argue that unbinding the envelope provides a necessary, but not sufficient, condition to escape a merger during CE evolution. The spiral-in of the secondary must also be halted. This requires the additional dynamical constraint that the frictional torque on the secondary be reduced to approximately zero. In this paper, we undertake a preliminary examination of the effect of adding this dynamical constraint in population synthesis calculations of BPNe. We assume that the frictional torque will be sufficiently reduced when the secondary enters a region within the giant where the mass-radius profile is flat. We crudely estimate the location of this region as a function of the core mass based upon existing stellar models of AGB stars between 1 and 7 solar masses. We calculate a theoretical orbital period distribution of BPNe using a population synthesis code that incorporates this dynamical constraint along with the alpha prescription.


title: Medical Entity Disambiguation Using Graph Neural Networks

abstract: Medical knowledge bases (KBs), distilled from biomedical literature and regulatory actions, are expected to provide high-quality information to facilitate clinical decision making. Entity disambiguation (also referred to as entity linking) is considered as an essential task in unlocking the wealth of such medical KBs. However, existing medical entity disambiguation methods are not adequate due to word discrepancies between the entities in the KB and the text snippets in the source documents. Recently, graph neural networks (GNNs) have proven to be very effective and provide state-of-the-art results for many real-world applications with graph-structured data. In this paper, we introduce ED-GNN based on three representative GNNs (GraphSAGE, R-GCN, and MAGNN) for medical entity disambiguation. We develop two optimization techniques to fine-tune and improve ED-GNN. First, we introduce a novel strategy to represent entities that are mentioned in text snippets as a query graph. Second, we design an effective negative sampling strategy that identifies hard negative samples to improve the model's disambiguation capability. Compared to the best performing state-of-the-art solutions, our ED-GNN offers an average improvement of 7.3% in terms of F1 score on five real-world datasets.


title: Explanatory models in neuroscience: Part 2 -- constraint-based intelligibility

abstract: Computational modeling plays an increasingly important role in neuroscience, highlighting the philosophical question of how computational models explain. In the context of neural network models for neuroscience, concerns have been raised about model intelligibility, and how they relate (if at all) to what is found in the brain. We claim that what makes a system intelligible is an understanding of the dependencies between its behavior and the factors that are causally responsible for that behavior. In biological systems, many of these dependencies are naturally "top-down": ethological imperatives interact with evolutionary and developmental constraints under natural selection. We describe how the optimization techniques used to construct NN models capture some key aspects of these dependencies, and thus help explain why brain systems are as they are -- because when a challenging ecologically-relevant goal is shared by a NN and the brain, it places tight constraints on the possible mechanisms exhibited in both kinds of systems. By combining two familiar modes of explanation -- one based on bottom-up mechanism (whose relation to neural network models we address in a companion paper) and the other on top-down constraints, these models illuminate brain function.


title: Explanatory models in neuroscience: Part 1 -- taking mechanistic abstraction seriously

abstract: Despite the recent success of neural network models in mimicking animal performance on visual perceptual tasks, critics worry that these models fail to illuminate brain function. We take it that a central approach to explanation in systems neuroscience is that of mechanistic modeling, where understanding the system is taken to require fleshing out the parts, organization, and activities of a system, and how those give rise to behaviors of interest. However, it remains somewhat controversial what it means for a model to describe a mechanism, and whether neural network models qualify as explanatory. We argue that certain kinds of neural network models are actually good examples of mechanistic models, when the right notion of mechanistic mapping is deployed. Building on existing work on model-to-mechanism mapping (3M), we describe criteria delineating such a notion, which we call 3M++. These criteria require us, first, to identify a level of description that is both abstract but detailed enough to be "runnable", and then, to construct model-to-brain mappings using the same principles as those employed for brain-to-brain mapping across individuals. Perhaps surprisingly, the abstractions required are those already in use in experimental neuroscience, and are of the kind deployed in the construction of more familiar computational models, just as the principles of inter-brain mappings are very much in the spirit of those already employed in the collection and analysis of data across animals. In a companion paper, we address the relationship between optimization and intelligibility, in the context of functional evolutionary explanations. Taken together, mechanistic interpretations of computational models and the dependencies between form and function illuminated by optimization processes can help us to understand why brain systems are built they way they are.


title: Producing Useful Work in a Cycle by Absorbing Heat from a Single Thermal Reservoir: An Investigation on a Locally Nonchaotic Energy Barrier

abstract: In the current research, we investigate the concept of spontaneously nonequilibrium dimension (SND), and show that a SND-based system can break the second law of thermodynamics. The main characteristic of the SND is the inherent nonequilibrium particle crossing ratio. A locally nonchaotic energy barrier is employed to form the model system. On the one hand, when the barrier width is much smaller than the mean free path of the particles, the system cannot reach thermodynamic equilibrium; on the other hand, the nonequilibrium particle distribution allows for production of useful work in a cycle by absorbing heat from a single thermal reservoir. Such system performance is demonstrated by a Monte Carlo simulation. It should be attributed to the unbalanced cross-influence of the thermally correlated thermodynamic forces, incompatible with the conventional framework of statistical mechanics. No Maxwell's demon is involved. Similar effects may be achieved by a number of variants, e.g., when the barrier is switchable or there are distributed nonchaotic traps.


title: An alternative transformation factor in the framework of the relativistic aberration of light

abstract: In the present study, we analyze in combination the principles of special relativity and the phenomenon of the aberration of light, deriving a system of equations that allows establishing the relationship between the angles commonly involved in this phenomenon. As a consequence, a transformation factor is obtained that generates two solutions, one of them with the same values as the Lorentz factor. This suggests that due to relativistic aberration, an apparent double image of celestial objects could be obtained. On the other hand, its functional form does not establish a limit to the speed of the reference frames with inertial movement.


title: Exponentiated Gradient Reweighting for Robust Training Under Label Noise and Beyond

abstract: Many learning tasks in machine learning can be viewed as taking a gradient step towards minimizing the average loss of a batch of examples in each training iteration. When noise is prevalent in the data, this uniform treatment of examples can lead to overfitting to noisy examples with larger loss values and result in poor generalization. Inspired by the expert setting in on-line learning, we present a flexible approach to learning from noisy examples. Specifically, we treat each training example as an expert and maintain a distribution over all examples. We alternate between updating the parameters of the model using gradient descent and updating the example weights using the exponentiated gradient update. Unlike other related methods, our approach handles a general class of loss functions and can be applied to a wide range of noise types and applications. We show the efficacy of our approach for multiple learning settings, namely noisy principal component analysis and a variety of noisy classification problems.


title: Mitigating Gradient-based Adversarial Attacks via Denoising and Compression

abstract: Gradient-based adversarial attacks on deep neural networks pose a serious threat, since they can be deployed by adding imperceptible perturbations to the test data of any network, and the risk they introduce cannot be assessed through the network's original training performance. Denoising and dimensionality reduction are two distinct methods that have been independently investigated to combat such attacks. While denoising offers the ability to tailor the defense to the specific nature of the attack, dimensionality reduction offers the advantage of potentially removing previously unseen perturbations, along with reducing the training time of the network being defended. We propose strategies to combine the advantages of these two defense mechanisms. First, we propose the cascaded defense, which involves denoising followed by dimensionality reduction. To reduce the training time of the defense for a small trade-off in performance, we propose the hidden layer defense, which involves feeding the output of the encoder of a denoising autoencoder into the network. Further, we discuss how adaptive attacks against these defenses could become significantly weak when an alternative defense is used, or when no defense is used. In this light, we propose a new metric to evaluate a defense which measures the sensitivity of the adaptive attack to modifications in the defense. Finally, we present a guideline for building an ordered repertoire of defenses, a.k.a. a defense infrastructure, that adjusts to limited computational resources in presence of uncertainty about the attack strategy.


title: Towards Self-Adaptive Metric Learning On the Fly

abstract: Good quality similarity metrics can significantly facilitate the performance of many large-scale, real-world applications. Existing studies have proposed various solutions to learn a Mahalanobis or bilinear metric in an online fashion by either restricting distances between similar (dissimilar) pairs to be smaller (larger) than a given lower (upper) bound or requiring similar instances to be separated from dissimilar instances with a given margin. However, these linear metrics learned by leveraging fixed bounds or margins may not perform well in real-world applications, especially when data distributions are complex. We aim to address the open challenge of "Online Adaptive Metric Learning" (OAML) for learning adaptive metric functions on the fly. Unlike traditional online metric learning methods, OAML is significantly more challenging since the learned metric could be non-linear and the model has to be self-adaptive as more instances are observed. In this paper, we present a new online metric learning framework that attempts to tackle the challenge by learning an ANN-based metric with adaptive model complexity from a stream of constraints. In particular, we propose a novel Adaptive-Bound Triplet Loss (ABTL) to effectively utilize the input constraints and present a novel Adaptive Hedge Update (AHU) method for online updating the model parameters. We empirically validate the effectiveness and efficacy of our framework on various applications such as real-world image classification, facial verification, and image retrieval.


title: A Fast Algorithm for Scanning Transmission Electron Microscopy (STEM) Imaging and 4D-STEM Diffraction Simulations

abstract: Scanning transmission electron microscopy (STEM) is an extremely versatile method for studying materials on the atomic scale. Many STEM experiments are supported or validated with electron scattering simulations. However, using the conventional multislice algorithm to perform these simulations can require extremely large calculation times, particularly for experiments with millions of probe positions as each probe position must be simulated independently. Recently, the PRISM algorithm was developed to reduce calculation times for large STEM simulations. Here, we introduce a new method for STEM simulation: partitioning of the STEM probe into "beamlets," given by a natural neighbor interpolation of the parent beams. This idea is compatible with PRISM simulations and can lead to even larger improvements in simulation time, as well requiring significantly less computer RAM. We have performed various simulations to demonstrate the advantages and disadvantages of partitioned PRISM STEM simulations. We find that this new algorithm is particularly useful for 4D-STEM simulations of large fields of view. We also provide a reference implementation of the multislice, PRISM and partitioned PRISM algorithms.