title: Length scale formation in the Landau levels of quasicrystals

abstract: Exotic tiling patterns of quasicrystals have motivated extensive studies of quantum phenomena such as critical states and phasons. Nevertheless, the systematic understanding of the Landau levels of quasicrystals in the presence of the magnetic field has not been established yet. One of the main obstacles is the complication of the quasiperiodic tilings without periodic length scales, thus it has been thought that the system cannot possess any universal features of the Landau levels. In this paper, contrary to these assertions, we develop a generic theory of the Landau levels for quasicrystals. Focusing on the two dimensional quasicrystals with rotational symmetries, we highlight that quasiperiodic tilings induce anomalous Landau levels where electrons are localized near the rotational symmetry centers. Interestingly, the localization length of these Landau levels has a universal dependence on n for quasicrystals with n-fold rotational symmetry. Furthermore, macroscopically degenerate zero energy Landau levels are present due to the chiral symmetry of the rhombic tilings. In this case, each Landau level forms an independent island where electrons are trapped at given fields, but with field control, the interference between the islands gives rise to an abrupt change in the local density of states. Our work provide a general scheme to understand the electron localization behavior of the Landau levels in quasicrystals.


title: Probing the Wind Component of Radio Emission in Luminous High-Redshift Quasars

abstract: We discuss a probe of the contribution of wind-related shocks to the radio emission in otherwise radio-quiet quasars. Given 1) the non-linear correlation between UV and X-ray luminosity in quasars, 2) that such correlation leads to higher likelihood of radiation-line-driven winds in more luminous quasars, and 3) that luminous quasars are more abundant at high redshift, deep radio observations of high-redshift quasars are needed to probe potential contributions from accretion disk winds. We target a sample of 50 $z\simeq 1.65$ color-selected quasars that span the range of expected accretion disk wind properties as traced by broad CIV emission. 3-GHz observations with the Very Large Array to an rms of $\approx10\mu$Jy beam$^{-1}$ probe to star formation rates of $\approx400\,M_{\rm Sun}\,{\rm yr}^{-1}$, leading to 22 detections. Supplementing these pointed observations are survey data of 388 sources from the LOFAR Two-metre Sky Survey Data Release 1 that reach comparable depth (for a typical radio spectral index), where 123 sources are detected. These combined observations reveal a radio detection fraction that is a non-linear function of \civ\ emission-line properties and suggest that the data may require multiple origins of radio emission in radio-quiet quasars. We find evidence for radio emission from weak jets or coronae in radio-quiet quasars with low Eddingtion ratios, with either (or both) star formation and accretion disk winds playing an important role in optically luminous quasars and correlated with increasing Eddington ratio. Additional pointed radio observations are needed to fully establish the nature of radio emission in radio-quiet quasars.


title: Stability and bifurcation of mixing in the Kuramoto model with inertia

abstract: The Kuramoto model of coupled second order damped oscillators on convergent sequences of graphs is analyzed in this work. The oscillators in this model have random intrinsic frequencies and interact with each other via nonlinear coupling. The connectivity of the coupled system is assigned by a graph which may be random as well. In the thermodynamic limit the behavior of the system is captured by the Vlasov equation, a hyperbolic partial differential equation for the probability distribution of the oscillators in the phase space. We study stability of mixing, a steady state solution of the Vlasov equation, corresponding to the uniform distribution of phases. Specifically, we identify a critical value of the strength of coupling, at which the system undergoes a pitchfork bifurcation. It corresponds to the loss of stability of mixing and marks the onset of synchronization. As for the classical Kuramoto model, the presence of the continuous spectrum on the imaginary axis poses the main difficulty for the stability analysis. To overcome this problem, we use the methods from the generalized spectral theory developed for the original Kuramoto model. The analytical results are illustrated with numerical bifurcation diagrams computed for the Kuramoto model on Erd\H{o}s--R\'enyi and small-world graphs. Applications of the second-order Kuramoto model include power networks, coupled pendula, and various biological networks. The analysis in this paper provides a mathematical description of the onset of synchronization in these systems.


title: Multivariate Public Key Cryptosystem from Sidon Spaces

abstract: A Sidon space is a subspace of an extension field over a base field in which the product of any two elements can be factored uniquely, up to constants. This paper proposes a new public-key cryptosystem of the multivariate type which is based on Sidon spaces, and has the potential to remain secure even if quantum supremacy is attained. This system, whose security relies on the hardness of the well-known MinRank problem, is shown to be resilient to several straightforward algebraic attacks. In particular, it is proved that the two popular attacks on the MinRank problem, the kernel attack, and the minor attack, succeed only with exponentially small probability. The system is implemented in software, and its hardness is demonstrated experimentally.


title: Measuring the magnetic origins of solar flares, CMEs and Space Weather

abstract: We take a broad look at the problem of identifying the magnetic solar causes of space weather. With the lackluster performance of extrapolations based upon magnetic field measurements in the photosphere, we identify a region in the near UV part of the spectrum as optimal for studying the development of magnetic free energy over active regions. Using data from SORCE, Hubble Space Telescope, and SKYLAB, along with 1D computations of the near-UV (NUV) spectrum and numerical experiments based on the MURaM radiation-MHD and HanleRT radiative transfer codes, we address multiple challenges. These challenges are best met through a combination of near UV lines of bright \ion{Mg}{2}, and lines of \ion{Fe}{2} and \ion{Fe}{1} (mostly within the $4s-4p$ transition array) which form in the chromosphere up to $2\times10^4$ K. Both Hanle and Zeeman effects can in principle be used to derive vector magnetic fields. However, for any given spectral line the $\tau=1$ surfaces are generally geometrically corrugated owing to fine structure such as fibrils and spicules. By using multiple spectral lines spanning different optical depths, magnetic fields across nearly-horizontal surfaces can be inferred in regions of low plasma $\beta$, from which free energies, magnetic topology and other quantities can be derived. Based upon the recently-reported successful suborbital space measurements of magnetic fields with the CLASP2 instrument, we argue that a modest space-borne telescope will be able to make significant advances in the attempts to predict solar eruptions. Difficulties associated with blended lines are shown to be minor in an Appendix.


title: Tracing Back Music Emotion Predictions to Sound Sources and Intuitive Perceptual Qualities

abstract: Music emotion recognition is an important task in MIR (Music Information Retrieval) research. Owing to factors like the subjective nature of the task and the variation of emotional cues between musical genres, there are still significant challenges in developing reliable and generalizable models. One important step towards better models would be to understand what a model is actually learning from the data and how the prediction for a particular input is made. In previous work, we have shown how to derive explanations of model predictions in terms of spectrogram image segments that connect to the high-level emotion prediction via a layer of easily interpretable perceptual features. However, that scheme lacks intuitive musical comprehensibility at the spectrogram level. In the present work, we bridge this gap by merging audioLIME -- a source-separation based explainer -- with mid-level perceptual features, thus forming an intuitive connection chain between the input audio and the output emotion predictions. We demonstrate the usefulness of this method by applying it to debug a biased emotion prediction model.


title: Detecting Viruses in Contact Networks with Unreliable Detectors

abstract: This paper develops and analyzes optimization models for rapid detection of viruses in large contact networks. In the model, a virus spreads in a stochastic manner over an undirected connected graph, under various assumptions on the spread dynamics. A decision maker must place a limited number of detectors on a subset of the nodes in the graph in order to rapidly detect infection of the nodes by the virus. The objective is to determine the placement of these detectors so as to either maximize the probability of detection within a given time period or minimize the expected time to detection. Previous work in this area assumed that the detectors are perfectly reliable. In this work, it is assumed that the detectors may produce false-negative results. In computational studies, the sample average approximation method is applied to solving the problem using a mixed-integer program and a greedy heuristic. The heuristic is shown to be highly efficient and to produce high-quality solutions. In addition, it is shown that the false-negative effect can sometimes be ignored, without significant loss of solution quality, in the original optimization formulation.


title: On one photon scattering in non-relativistic qed

abstract: We consider scattering of a single photon by an atom or a molecule in the framework of non relativistic qed, and we express the scattering matrix for one photon scattering as a boundary value of the resolvent.


title: Interaction effects in graphene in a weak magnetic field

abstract: A weak perpendicular magnetic field, $B$, breaks the chiral symmetry of each valley in the electron spectrum of graphene, preserving the overall chiral symmetry in the Brillouin zone. We explore the consequences of this symmetry breaking for the interaction effects in graphene. In particular, we demonstrate that the electron-electron interaction lifetime acquires an anomalous $B$-dependence. Also, the ballistic zero-bias anomaly, $\delta \nu(\omega)$, where $\omega$ is the energy measured from the Fermi level, emerges at a weak $B$ and has the form $\delta\nu(B)\sim B^2/\omega^2$. Temperature dependence of the magnetic-field corrections to the thermodynamic characteristics of graphene is also anomalous. We discuss experimental manifestations of the effects predicted. The microscopic origin of the $B$-field sensitivity is an extra phase acquired by the electron wave-function resulting from the chirality-induced pseudospin precession.


title: DFM: A Performance Baseline for Deep Feature Matching

abstract: A novel image matching method is proposed that utilizes learned features extracted by an off-the-shelf deep neural network to obtain a promising performance. The proposed method uses pre-trained VGG architecture as a feature extractor and does not require any additional training specific to improve matching. Inspired by well-established concepts in the psychology area, such as the Mental Rotation paradigm, an initial warping is performed as a result of a preliminary geometric transformation estimate. These estimates are simply based on dense matching of nearest neighbors at the terminal layer of VGG network outputs of the images to be matched. After this initial alignment, the same approach is repeated again between reference and aligned images in a hierarchical manner to reach a good localization and matching performance. Our algorithm achieves 0.57 and 0.80 overall scores in terms of Mean Matching Accuracy (MMA) for 1 pixel and 2 pixels thresholds respectively on Hpatches dataset, which indicates a better performance than the state-of-the-art.


title: Anisotropic Kondo line defect and ODE/IM correspondence

abstract: We study the anisotropic Kondo line defects in products of chiral $SU(2)$ WZW models. We propose an ODE/IM correspondence for the anisotropic Kondo problems by considering the four-dimensional Chern Simons theory in the trigonometric case. We verify the claim both by explicit perturbative calculations in the ultraviolet and by exact WKB analysis in the infrared. In doing so, we derived the infrared dynamics of a large class of anisotropic line defects.


title: Semi-Dirac and Weyl Fermions in Transition Metal Oxides

abstract: We show that a class of compounds with $I$4/$mcm$ crystalline symmetry hosts three-dimensional semi-Dirac fermions. Unlike the known two-dimensional semi-Dirac points, the degeneracy of these three-dimensional semi-Dirac points is not lifted by spin-orbit coupling due to the protection by a nonsymmorphic symmetry -- screw rotation in the $a-b$ plane and a translation along the $c$ axis. This crystalline symmetry is found in tetragonal perovskite oxides, realizable in thin films by epitaxial strain that results in a$^0$a$^0$c$^-$-type octahedral rotation. Interestingly, with broken time-reversal symmetry, two pairs of Weyl points emerge from the semi-Dirac points within the Brillouin zone, and an additional lattice distortion leads to enhanced intrinsic anomalous Hall effect. The ability to tune the Berry phase by epitaxial strain can be useful in novel oxide-based electronic devices.


title: Assessing the Use of Prosody in Constituency Parsing of Imperfect Transcripts

abstract: This work explores constituency parsing on automatically recognized transcripts of conversational speech. The neural parser is based on a sentence encoder that leverages word vectors contextualized with prosodic features, jointly learning prosodic feature extraction with parsing. We assess the utility of the prosody in parsing on imperfect transcripts, i.e. transcripts with automatic speech recognition (ASR) errors, by applying the parser in an N-best reranking framework. In experiments on Switchboard, we obtain 13-15% of the oracle N-best gain relative to parsing the 1-best ASR output, with insignificant impact on word recognition error rate. Prosody provides a significant part of the gain, and analyses suggest that it leads to more grammatical utterances via recovering function words.


title: Interpretation of Plug-and-Play (PnP) algorithms from a different angle

abstract: It's well-known that inverse problems are ill-posed and to solve them meaningfully one has to employ regularization methods. Traditionally, the most popular regularization approaches are Variational-type approaches, i.e., penalized/constrained functional minimization. In recent years, the classical regularization approaches have been replaced by the so-called plug-and-play (PnP) algorithms, which copies the proximal gradient minimization processes, such as ADMM or FISTA, but with any general denoiser. However, unlike the traditional proximal gradient methods, the theoretical analysis and convergence results have been insufficient for these PnP-algorithms. Hence, the results from these algorithms, though empirically outstanding, are not well-defined, in the sense of, being a minimizer of a Variational problem. In this paper, we address this question of "well-definedness", but from a different angle. We explain these algorithms from the viewpoint of a semi-iterative regularization method. In addition, we expand the family of regularized solutions, corresponding to the classical semi-iterative methods, to further generalize the explainability of these algorithms, as well as, enhance the recovery process. We conclude with several numerical results which validate the developed theories and reflect the improvements over the traditional PnP-algorithms, such as ADMM-PnP and FISTA-PnP.


title: Relic Density of Axion Dark Matter in Standard and Non-Standard Cosmological Scenarios

abstract: In this master's thesis we study the production of axion dark matter through the so-called misalignment mechanism by considering that during that time, the universe was dominated by a new kind of fluid, different than radiation. We perform a very detailed analysis of the oscillation temperature and the relic density today, both analytically and numerically. Our findings show that on the one hand, the oscillation temperature is strongly influenced by the non-standard cosmology, affecting the relic density, and on the other hand, the energy density of the axion gets diluted, because the new fluid eventually decays, injecting entropy into the thermal bath. We find the predicted parameter space of axion dark matter for different non-standard cosmologies and we show its impact on the coupling of axions to two photons.


title: Embracing Uncertainty in "Small Data" Problems: Estimating Earthquakes from Historical Anecdotes

abstract: Improving understanding of current seismic risk is often dependent on developing a more complete characterization of earthquakes that have occurred in the past, and in particular before the development of modern sensing equipment in the middle of the twentieth century. However, accounts of such events are typically anecdotal in nature, limiting efforts to model them to more heuristic approaches. To address this shortfall, we develop a framework based in Bayesian inference to provide a more rigorous methodology for estimating pre-instrumental earthquakes. By directly modeling accounts of resultant tsunamis via probability distributions, the framework allows practitioners to make principled estimates of key characteristics (e.g., magnitude and location) of historical earthquakes. To illustrate this idea, we apply the methodology to the estimation of an earthquake in Eastern Indonesia in the mid 19th century, the source of which is currently the subject of considerable debate in the geological community. The approach taken here gives evidence that even "small data" that is limited in scope and extremely uncertain can still be used to yield information on past seismic events. Moreover, sensitivity bounds indicate that the results obtained here are robust despite the inherent uncertainty in the observations.


title: Poisoning Deep Reinforcement Learning Agents with In-Distribution Triggers

abstract: In this paper, we propose a new data poisoning attack and apply it to deep reinforcement learning agents. Our attack centers on what we call in-distribution triggers, which are triggers native to the data distributions the model will be trained on and deployed in. We outline a simple procedure for embedding these, and other, triggers in deep reinforcement learning agents following a multi-task learning paradigm, and demonstrate in three common reinforcement learning environments. We believe that this work has important implications for the security of deep learning models.


title: Launching into clinical space with medspaCy: a new clinical text processing toolkit in Python

abstract: Despite impressive success of machine learning algorithms in clinical natural language processing (cNLP), rule-based approaches still have a prominent role. In this paper, we introduce medspaCy, an extensible, open-source cNLP library based on spaCy framework that allows flexible integration of rule-based and machine learning-based algorithms adapted to clinical text. MedspaCy includes a variety of components that meet common cNLP needs such as context analysis and mapping to standard terminologies. By utilizing spaCy's clear and easy-to-use conventions, medspaCy enables development of custom pipelines that integrate easily with other spaCy-based modules. Our toolkit includes several core components and facilitates rapid development of pipelines for clinical text.


title: Dirac plus Nambu Monopoles in the Standard Model

abstract: We show how in the standard electroweak model three $SU(2)_L$ Nambu monopoles, each carrying electromagnetic (EM) and Z- magnetic fluxes, can merge (through Z-strings) with a single $U(1)_Y$ Dirac monopole to yield a composite monopole that only carries EM magnetic flux. Compatibility with the Dirac quantization condition requires this composite monopole to carry six quanta ($12 \pi /e$) of magnetic charge, independent of the electroweak mixing angle $\theta_w$. The Dirac monopole is not regular at the origin and the energy of the composite monopole is therefore divergent. We discuss how this problem is cured by embedding $U(1)_Y$ in a grand unified group such as $SU(5)$. A second composite configuration with only one Nambu monopole and a colored $U(1)_Y$ Dirac monopole that has minimal EM charge of $4\pi/e$ is also described. Finally, there exists a configuration with an EM charge of $8\pi/e$ as well as screened color magnetic charge.


title: Non-Autoregressive Electron Redistribution Modeling for Reaction Prediction

abstract: Reliably predicting the products of chemical reactions presents a fundamental challenge in synthetic chemistry. Existing machine learning approaches typically produce a reaction product by sequentially forming its subparts or intermediate molecules. Such autoregressive methods, however, not only require a pre-defined order for the incremental construction but preclude the use of parallel decoding for efficient computation. To address these issues, we devise a non-autoregressive learning paradigm that predicts reaction in one shot. Leveraging the fact that chemical reactions can be described as a redistribution of electrons in molecules, we formulate a reaction as an arbitrary electron flow and predict it with a novel multi-pointer decoding network. Experiments on the USPTO-MIT dataset show that our approach has established a new state-of-the-art top-1 accuracy and achieves at least 27 times inference speedup over the state-of-the-art methods. Also, our predictions are easier for chemists to interpret owing to predicting the electron flows.


title: GeoMol: Torsional Geometric Generation of Molecular 3D Conformer Ensembles

abstract: Prediction of a molecule's 3D conformer ensemble from the molecular graph holds a key role in areas of cheminformatics and drug discovery. Existing generative models have several drawbacks including lack of modeling important molecular geometry elements (e.g. torsion angles), separate optimization stages prone to error accumulation, and the need for structure fine-tuning based on approximate classical force-fields or computationally expensive methods such as metadynamics with approximate quantum mechanics calculations at each geometry. We propose GeoMol--an end-to-end, non-autoregressive and SE(3)-invariant machine learning approach to generate distributions of low-energy molecular 3D conformers. Leveraging the power of message passing neural networks (MPNNs) to capture local and global graph information, we predict local atomic 3D structures and torsion angles, avoiding unnecessary over-parameterization of the geometric degrees of freedom (e.g. one angle per non-terminal bond). Such local predictions suffice both for the training loss computation, as well as for the full deterministic conformer assembly (at test time). We devise a non-adversarial optimal transport based loss function to promote diverse conformer generation. GeoMol predominantly outperforms popular open-source, commercial, or state-of-the-art machine learning (ML) models, while achieving significant speed-ups. We expect such differentiable 3D structure generators to significantly impact molecular modeling and related applications.


title: SynthASR: Unlocking Synthetic Data for Speech Recognition

abstract: End-to-end (E2E) automatic speech recognition (ASR) models have recently demonstrated superior performance over the traditional hybrid ASR models. Training an E2E ASR model requires a large amount of data which is not only expensive but may also raise dependency on production data. At the same time, synthetic speech generated by the state-of-the-art text-to-speech (TTS) engines has advanced to near-human naturalness. In this work, we propose to utilize synthetic speech for ASR training (SynthASR) in applications where data is sparse or hard to get for ASR model training. In addition, we apply continual learning with a novel multi-stage training strategy to address catastrophic forgetting, achieved by a mix of weighted multi-style training, data augmentation, encoder freezing, and parameter regularization. In our experiments conducted on in-house datasets for a new application of recognizing medication names, training ASR RNN-T models with synthetic audio via the proposed multi-stage training improved the recognition performance on new application by more than 65% relative, without degradation on existing general applications. Our observations show that SynthASR holds great promise in training the state-of-the-art large-scale E2E ASR models for new applications while reducing the costs and dependency on production data.


title: Controlling Neural Networks with Rule Representations

abstract: We propose a novel training method that integrates rules into deep learning, in a way the strengths of the rules are controllable at inference. Deep Neural Networks with Controllable Rule Representations (DeepCTRL) incorporates a rule encoder into the model coupled with a rule-based objective, enabling a shared representation for decision making. DeepCTRL is agnostic to data type and model architecture. It can be applied to any kind of rule defined for inputs and outputs. The key aspect of DeepCTRL is that it does not require retraining to adapt the rule strength -- at inference, the user can adjust it based on the desired operation point on accuracy vs. rule verification ratio. In real-world domains where incorporating rules is critical -- such as Physics, Retail and Healthcare -- we show the effectiveness of DeepCTRL in teaching rules for deep learning. DeepCTRL improves the trust and reliability of the trained models by significantly increasing their rule verification ratio, while also providing accuracy gains at downstream tasks. Additionally, DeepCTRL enables novel use cases such as hypothesis testing of the rules on data samples, and unsupervised adaptation based on shared rules between datasets.


title: Scattering between minivalleys in a moir\'e material

abstract: A unique feature of the complex band structures of moir\'e materials is the presence of minivalleys, their hybridization, and scattering between them. Here we investigate magneto-transport oscillations caused by scattering between minivalleys - a phenomenon analogous to magneto-intersubband oscillations - in a twisted double bilayer graphene sample with a twist angle of 1.94{\deg}. We study and discuss the potential scattering mechanisms and find an electron-phonon mechanism and valley conserving scattering to be likely. Finally, we discuss the relevance of our findings for different materials and twist angles.


title: Highdicom: A Python library for standardized encoding of image annotations and machine learning model outputs in pathology and radiology

abstract: Machine learning is revolutionizing image-based diagnostics in pathology and radiology. ML models have shown promising results in research settings, but their lack of interoperability has been a major barrier for clinical integration and evaluation. The DICOM a standard specifies Information Object Definitions and Services for the representation and communication of digital images and related information, including image-derived annotations and analysis results. However, the complexity of the standard represents an obstacle for its adoption in the ML community and creates a need for software libraries and tools that simplify working with data sets in DICOM format. Here we present the highdicom library, which provides a high-level application programming interface for the Python programming language that abstracts low-level details of the standard and enables encoding and decoding of image-derived information in DICOM format in a few lines of Python code. The highdicom library ties into the extensive Python ecosystem for image processing and machine learning. Simultaneously, by simplifying creation and parsing of DICOM-compliant files, highdicom achieves interoperability with the medical imaging systems that hold the data used to train and run ML models, and ultimately communicate and store model outputs for clinical use. We demonstrate through experiments with slide microscopy and computed tomography imaging, that, by bridging these two ecosystems, highdicom enables developers to train and evaluate state-of-the-art ML models in pathology and radiology while remaining compliant with the DICOM standard and interoperable with clinical systems at all stages. To promote standardization of ML research and streamline the ML model development and deployment process, we made the library available free and open-source.


title: Dynamic Distillation Network for Cross-Domain Few-Shot Recognition with Unlabeled Data

abstract: Most existing works in few-shot learning rely on meta-learning the network on a large base dataset which is typically from the same domain as the target dataset. We tackle the problem of cross-domain few-shot learning where there is a large shift between the base and target domain. The problem of cross-domain few-shot recognition with unlabeled target data is largely unaddressed in the literature. STARTUP was the first method that tackles this problem using self-training. However, it uses a fixed teacher pretrained on a labeled base dataset to create soft labels for the unlabeled target samples. As the base dataset and unlabeled dataset are from different domains, projecting the target images in the class-domain of the base dataset with a fixed pretrained model might be sub-optimal. We propose a simple dynamic distillation-based approach to facilitate unlabeled images from the novel/base dataset. We impose consistency regularization by calculating predictions from the weakly-augmented versions of the unlabeled images from a teacher network and matching it with the strongly augmented versions of the same images from a student network. The parameters of the teacher network are updated as exponential moving average of the parameters of the student network. We show that the proposed network learns representation that can be easily adapted to the target domain even though it has not been trained with target-specific classes during the pretraining phase. Our model outperforms the current state-of-the art method by 4.4% for 1-shot and 3.6% for 5-shot classification in the BSCD-FSL benchmark, and also shows competitive performance on traditional in-domain few-shot learning task.


title: Additive complements for two given asymptotic densities

abstract: Let $0\le \alpha \le \beta\le 1$. For any finite set $B\subset\mathbb{N}$, we show that there exists a set $A\subset\mathbb{N}$ such that $\underline{d}(A+B) = \alpha$ and $\bar{d}(A+B) = \beta$, where $\underline{d}(A+ B)$ and $\bar{d}(A+B)$ are the lower and upper asymptotic densities of the set $A+B$, respectively. This partially answers a question by Faisant et al. A theorem involving the so-called highly sparse sets was proved in the previous arXiv version of this note; however, as pointed out by Sai Teja Somu, the proof of the theorem was flawed. The theorem is now an open question.


title: The aftermath of convective events near Jupiter's fastest prograde jet: implications for clouds, dynamics and vertical wind shear

abstract: The $24^{\circ}$ N jet borders the North Tropical Belt and North Tropical Zone, and is the fastest prograde jet on Jupiter, reaching speeds above $170$ m/s. In this region, observations have shown several periodic convective plumes, likely from latent heat release from water condensation, which affect the cloud and zonal wind structure of the jet. We model this region with the Explicit Planetary hybrid-Isentropic Coordinate model using its active microphysics scheme to study the phenomenology of water and ammonia clouds within the jet region. On perturbing the atmosphere, we find that an upper tropospheric wave develops that directly influences the cloud structure within the jet. This wave travels at $\sim75$ m/s in our model, and leads to periodic chevron-shaped features in the ammonia cloud deck. These features travel with the wave speed, and are subsequently much slower than the zonal wind at the cloud deck. The cloud structure, and the slower drift rate, were both observed following the convective outbreak in this region in 2016 and 2020. We find that an upper level circulation is responsible for these cloud features in the aftermath of the convective outbursts. The comparatively slower observed drift rates of these features, relative to the wind speed of the jet, provides constraints on the vertical wind shear above the cloud tops, and we suggest that wind velocities determined from cloud tracking should correspond to a different altitude compared to the $680$ hPa pressure level. We also diagnose the convective potential of the atmosphere due to water condensation, and find that it is strongly coupled to the wave.


title: Quantum criticality of the Ohmic spin-boson model in a high dense spectrum: symmetries,quantum fluctuations and correlations

abstract: Study of dissipative quantum phase transitions in the Ohmic spin-boson model is numerically challenging in a dense limit of environmental modes. In this work, large-scale numerical simulations are carried out based on the variational principle. The validity of variational calculations, spontaneous breakdown of symmetries, and quantum fluctuations and correlations in the Ohmic bath are carefully analyzed, and the critical coupling as well as exponents are accurately determined in the weak tunneling and continuum limits. In addition, quantum criticality of the Ohmic bath is uncovered both in the delocalized phase and at the transition point.


title: Equidistribution theorems for holomorphic Siegel cusp forms of general degree: the level aspect

abstract: We prove equidistribution theorems for a family of holomorphic Siegel cusp forms of general degree in the level aspect. Our main contribution is to estimate unipotent contributions for general degree in the geometric side of Arthur's invariant trace formula in terms of Shintani zeta functions. Several applications including the vertical Sato-Tate theorem and low-lying zeros for standard $L$-functions of holomorphic Siegel cusp forms are discussed. We also show that the "non-genuine forms" which come from non-trivial endoscopic contributions by Langlands functoriality classified by Arthur are negligible.


title: The $\omega$-th inner mantle

abstract: This article investigates pathological behavior at the first limit stage in the sequence of inner mantles, obtained by iterating the definition of the mantle to get smaller and smaller inner models. I show: (A) it is possible that the $\omega$-th inner mantle is not a definable class; and (B) it is possible that the $\omega$-th inner mantle is a definable class but does not satisfy $\mathsf{AC}$. This answers a pair of questions of Fuchs, Hamkins, and Reitz [FHR15].


title: To Infinity and Beyond! Accessibility is the Future for Kids' Search Engines

abstract: Research in the area of search engines for children remains in its infancy. Seminal works have studied how children use mainstream search engines, as well as how to design and evaluate custom search engines explicitly for children. These works, however, tend to take a one-size-fits-all view, treating children as a unit. Nevertheless, even at the same age, children are known to possess and exhibit different capabilities. These differences affect how children access and use search engines. To better serve children, in this vision paper, we spotlight accessibility and discuss why current research on children and search engines does not, but should, focus on this significant matter.


title: Sample Efficient Reinforcement Learning In Continuous State Spaces: A Perspective Beyond Linearity

abstract: Reinforcement learning (RL) is empirically successful in complex nonlinear Markov decision processes (MDPs) with continuous state spaces. By contrast, the majority of theoretical RL literature requires the MDP to satisfy some form of linear structure, in order to guarantee sample efficient RL. Such efforts typically assume the transition dynamics or value function of the MDP are described by linear functions of the state features. To resolve this discrepancy between theory and practice, we introduce the Effective Planning Window (EPW) condition, a structural condition on MDPs that makes no linearity assumptions. We demonstrate that the EPW condition permits sample efficient RL, by providing an algorithm which provably solves MDPs satisfying this condition. Our algorithm requires minimal assumptions on the policy class, which can include multi-layer neural networks with nonlinear activation functions. Notably, the EPW condition is directly motivated by popular gaming benchmarks, and we show that many classic Atari games satisfy this condition. We additionally show the necessity of conditions like EPW, by demonstrating that simple MDPs with slight nonlinearities cannot be solved sample efficiently.


title: Asymptotically Optimal Locally Private Heavy Hitters via Parameterized Sketches

abstract: We present two new local differentially private algorithms for frequency estimation. One solves the fundamental frequency oracle problem; the other solves the well-known heavy hitters identification problem. Consistent with prior art, these are randomized algorithms. As a function of failure probability~$\beta$, the former achieves optimal worst-case estimation error for every~$\beta$, while the latter is optimal when~$\beta$ is at least inverse polynomial in~$n$, the number of users. In both algorithms, server running time is~$\tilde{O}(n)$ while user running time is~$\tilde{O}(1)$. Our frequency-oracle algorithm achieves lower estimation error than the prior works of Bassily et al. (NeurIPS 2017). On the other hand, our heavy hitters identification method is as easily implementable as as TreeHist (Bassily et al., 2017) and has superior worst-case error, by a factor of $\Omega(\sqrt{\log n})$.


title: Tree-Values: selective inference for regression trees

abstract: We consider conducting inference on the output of the Classification and Regression Tree (CART) [Breiman et al., 1984] algorithm. A naive approach to inference that does not account for the fact that the tree was estimated from the data will not achieve standard guarantees, such as Type 1 error rate control and nominal coverage. Thus, we propose a selective inference framework for conducting inference on a fitted CART tree. In a nutshell, we condition on the fact that the tree was estimated from the data. We propose a test for the difference in the mean response between a pair of terminal nodes that controls the selective Type 1 error rate, and a confidence interval for the mean response within a single terminal node that attains the nominal selective coverage. Efficient algorithms for computing the necessary conditioning sets are provided. We apply these methods in simulation and to a dataset involving the association between portion control interventions and caloric intake.


title: Efficient Facial Expression Analysis For Dimensional Affect Recognition Using Geometric Features

abstract: Despite their continued popularity, categorical approaches to affect recognition have limitations, especially in real-life situations. Dimensional models of affect offer important advantages for the recognition of subtle expressions and more fine-grained analysis. We introduce a simple but effective facial expression analysis (FEA) system for dimensional affect, solely based on geometric features and Partial Least Squares (PLS) regression. The system jointly learns to estimate Arousal and Valence ratings from a set of facial images. The proposed approach is robust, efficient, and exhibits comparable performance to contemporary deep learning models, while requiring a fraction of the computational resources.


title: Comment on "Reentrant Localization Transition in a Quasiperiodic Chain"

abstract: In their Letter[Phys. Rev. Lett. 126, 106803 (2021)], the authors found an interesting reentrant localization phenomenon in a one-dimensional dimerized lattice with quasiperiodic disorder, i.e., the system undergoes a second localization transition at a higher disorder strength. They claimed that this reentrant feature would appear in the case of staggered disorder, but not for the uniform ones. In this Comment, we show that such reentrant feature can also appear for the uniform disorder when larger system parameters are taken into account.


title: Elastic Softening in Quantum Critical Yb-Al-Au Approximant Crystal and Quasicrystal

abstract: The elastic property of quantum critical quasicrystal (QC) Yb$_{15}$Al$_{34}$Au$_{51}$ is analyzed theoretically on the basis of the approximant crystal (AC) Yb$_{14}$Al$_{35}$Au$_{51}$. By constructing the realistic effective model in the AC, we evaluate the 4f-5d Coulomb repulsion at Yb as $U_{fd}\approx 1.46$ eV realizing the quantum critical point (QCP) of the Yb-valence transition. The RPA analysis of the QCP shows that softening in elastic constants occurs remarkably for bulk modulus and longitudinal mode at low temperatures. Possible relevance of these results to the QC as well as the pressure-tuned AC is discussed.


title: On Large-Cohort Training for Federated Learning

abstract: Federated learning methods typically learn a model by iteratively sampling updates from a population of clients. In this work, we explore how the number of clients sampled at each round (the cohort size) impacts the quality of the learned model and the training dynamics of federated learning algorithms. Our work poses three fundamental questions. First, what challenges arise when trying to scale federated learning to larger cohorts? Second, what parallels exist between cohort sizes in federated learning and batch sizes in centralized learning? Last, how can we design federated learning methods that effectively utilize larger cohort sizes? We give partial answers to these questions based on extensive empirical evaluation. Our work highlights a number of challenges stemming from the use of larger cohorts. While some of these (such as generalization issues and diminishing returns) are analogs of large-batch training challenges, others (including training failures and fairness concerns) are unique to federated learning.


title: Strong-coupling theory of condensate-mediated superconductivity in 2D materials

abstract: We develop a strong-coupling theory of Bose-Einstein condensate-mediated superconductivity in a hybrid system, which consists of a two-dimensional electron gas with either (i) parabolic spectrum or (ii) relativistic Dirac spectrum in the vicinity of a two-dimensional solid-state condensate of indirect excitons. The Eliashberg equations are derived and the expressions for the electron pairing self-energy due to the exchange interaction between electrons mediated by a single Bogoliubov excitation (a bogolon) and the bogolon pairs are found. Furthermore, we find the superconducting order parameter and estimate the critical temperature of the superconducting transition. The critical temperature reveals its linear dependence on the dimensionless coupling constant. It is shown, that the bogolon-pair-mediated interaction is the dominant mechanism of electron pairing in hybrid systems in both the weak and strong coupling regimes. We calculate the effective bogolon-electron interaction constant for both parabolic and linear electron dispersions and examine the dependence of the critical temperature of electron gas superconducting transition on exciton condensate density.


title: Canonical Face Embeddings

abstract: We present evidence that many common convolutional neural networks (CNNs) trained for face verification learn functions that are nearly equivalent under rotation. More specifically, we demonstrate that one face verification model's embeddings (i.e. last-layer activations) can be compared directly to another model's embeddings after only a rotation or linear transformation, with little performance penalty. This finding is demonstrated using IJB-C 1:1 verification across the combinations of ten modern off-the-shelf CNN-based face verification models which vary in training dataset, CNN architecture, method of angular loss calculation, or some combination of the 3. These networks achieve a mean true accept rate of 0.96 at a false accept rate of 0.01. When instead evaluating embeddings generated from two CNNs, where one CNN's embeddings are mapped with a linear transformation, the mean true accept rate drops to 0.95 using the same verification paradigm. Restricting these linear maps to only perform rotation produces a mean true accept rate of 0.91. These mappings' existence suggests that a common representation is learned by models despite variation in training or structure. We discuss the broad implications a result like this has, including an example regarding face template security.


title: Challenges and Considerations with Code-Mixed NLP for Multilingual Societies

abstract: Multilingualism refers to the high degree of proficiency in two or more languages in the written and oral communication modes. It often results in language mixing, a.k.a. code-mixing, when a multilingual speaker switches between multiple languages in a single utterance of a text or speech. This paper discusses the current state of the NLP research, limitations, and foreseeable pitfalls in addressing five real-world applications for social good crisis management, healthcare, political campaigning, fake news, and hate speech for multilingual societies. We also propose futuristic datasets, models, and tools that can significantly advance the current research in multilingual NLP applications for the societal good. As a representative example, we consider English-Hindi code-mixing but draw similar inferences for other language pairs


title: Communicating Natural Programs to Humans and Machines

abstract: The Abstraction and Reasoning Corpus (ARC) is a set of procedural tasks that tests an agent's ability to flexibly solve novel problems. While most ARC tasks are easy for humans, they are challenging for state-of-the-art AI. What makes building intelligent systems that can generalize to novel situations such as ARC difficult? We posit that the answer might be found by studying the difference of \emph{language}: While humans readily generate and interpret instructions in a general language, computer systems are shackled to a narrow domain-specific language that they can precisely execute. We present LARC, the \textit{Language-complete ARC}: a collection of natural language descriptions by a group of human participants who instruct each other on how to solve ARC tasks using language alone, which contains successful instructions for 88\% of the ARC tasks. We analyze the collected instructions as `natural programs', finding that while they resemble computer programs, they are distinct in two ways: First, they contain a wide range of primitives; Second, they frequently leverage communicative strategies beyond directly executable codes. We demonstrate that these two distinctions prevent current program synthesis techniques from leveraging LARC to its full potential, and give concrete suggestions on how to build the next-generation program synthesizers.


title: Site-Agnostic 3D Dose Distribution Prediction with Deep Learning Neural Networks

abstract: Typically, the current dose prediction models are limited to small amounts of data and require re-training for a specific site, often leading to suboptimal performance. We propose a site-agnostic, 3D dose distribution prediction model using deep learning that can leverage data from any treatment site, thus increasing the total data available to train the model. Applying our proposed model to a new target treatment site requires only a brief fine-tuning of the model to the new data and involves no modifications to the model input channels or its parameters. Thus, it can be efficiently adapted to a different treatment site, even with a small training dataset.


title: Towards quantum 3D imaging devices: the Qu3D project

abstract: We review the advancement of the research toward the design and implementation of quantum plenoptic cameras, radically novel 3D imaging devices that exploit both momentum-position entanglement and photon-number correlations to provide the typical refocusing and ultra-fast, scanning-free, 3D imaging capability of plenoptic devices, along with dramatically enhanced performances, unattainable in standard plenoptic cameras: diffraction-limited resolution, large depth of focus, and ultra-low noise. To further increase the volumetric resolution beyond the Rayleigh diffraction limit, and achieve the quantum limit, we are also developing dedicated protocols based on quantum Fisher information. However, for the quantum advantages of the proposed devices to be effective and appealing to end-users, two main challenges need to be tackled. First, due to the large number of frames required for correlation measurements to provide an acceptable SNR, quantum plenoptic imaging would require, if implemented with commercially available high-resolution cameras, acquisition times ranging from tens of seconds to a few minutes. Second, the elaboration of this large amount of data, in order to retrieve 3D images or refocusing 2D images, requires high-performance and time-consuming computation. To address these challenges, we are developing high-resolution SPAD arrays and high-performance low-level programming of ultra-fast electronics, combined with compressive sensing and quantum tomography algorithms, with the aim to reduce both the acquisition and the elaboration time by two orders of magnitude. Routes toward exploitation of the QPI devices will also be discussed.


title: Improving the compromise between accuracy, interpretability and personalization of rule-based machine learning in medical problems

abstract: One of the key challenges when developing a predictive model is the capability to describe the domain knowledge and the cause-effect relationships in a simple way. Decision rules are a useful and important methodology in this context, justifying their application in several areas, particularly in clinical practice. Several machine-learning classifiers have exploited the advantageous properties of decision rules to build intelligent prediction models, namely decision trees and ensembles of trees (ETs). However, such methodologies usually suffer from a trade-off between interpretability and predictive performance. Some procedures consider a simplification of ETs, using heuristic approaches to select an optimal reduced set of decision rules. In this paper, we introduce a novel step to those methodologies. We create a new component to predict if a given rule will be correct or not for a particular patient, which introduces personalization into the procedure. Furthermore, the validation results using three public clinical datasets suggest that it also allows to increase the predictive performance of the selected set of rules, improving the mentioned trade-off.


title: Cavity magnon-polaritons in cuprate parent compounds

abstract: Cavity control of quantum matter may offer new ways to study and manipulate many-body systems. A particularly appealing idea is to use cavities to enhance superconductivity, especially in unconventional or high-$T_c$ systems. Motivated by this, we propose a scheme for coupling Terahertz resonators to the antiferromagnetic fluctuations in a cuprate parent compound, which are believed to provide the glue for Cooper pairs in the superconducting phase. First, we derive the interaction between magnon excitations of the Ne\'el-order and polar phonons associated with the planar oxygens. This mode also couples to the cavity electric field, and in the presence of spin-orbit interactions mediates a linear coupling between the cavity and magnons, forming hybridized magnon-polaritons. This hybridization vanishes linearly with photon momentum, implying the need for near-field optical methods, which we analyze within a simple model. We then derive a higher-order coupling between the cavity and magnons which is only present in bilayer systems, but does not rely on spin-orbit coupling. This interaction is found to be large, but only couples to the bimagnon operator. As a result we find a strong, but heavily damped, bimagnon-cavity interaction which produces highly asymmetric cavity line-shapes in the strong-coupling regime. To conclude, we outline several interesting extensions of our theory, including applications to carrier-doped cuprates and other strongly-correlated systems with Terahertz-scale magnetic excitations.

categories: cond-mat.str-el cond-mat.mes-hall cond-mat.supr-con quant-ph


title: Marginally compact phase and ordered ground states in a model polymer with side spheres

abstract: We present the results of a quantitative study of the phase behavior of a model polymer chain with side spheres using two independent computer simulation techniques. We find that the mere addition of side spheres results in key modifications of standard polymer behavior. One obtains a novel marginally compact phase at low temperatures, the structures in this phase are reduced in dimensionality and are ordered, they include strands assembled into sheets and a variety of helices, and at least one of the transitions on lowering the temperature to access these ordered states is found to be first order. Our model serves to partially bridge conventional polymer phases with biomolecular phases.


title: On the Convergence and Calibration of Deep Learning with Differential Privacy

abstract: Differentially private (DP) training preserves the data privacy usually at the cost of slower convergence (and thus lower accuracy), as well as more severe mis-calibration than its non-private counterpart. To analyze the convergence of DP training, we formulate a continuous time analysis through the lens of neural tangent kernel (NTK), which characterizes the per-sample gradient clipping and the noise addition in DP training, for arbitrary network architectures and loss functions. Interestingly, we show that the noise addition only affects the privacy risk but not the convergence or calibration, whereas the per-sample gradient clipping (under both flat and layerwise clipping styles) only affects the convergence and calibration. Furthermore, we observe that while DP models trained with small clipping norm usually achieve the best accurate, but are poorly calibrated and thus unreliable. In sharp contrast, DP models trained with large clipping norm enjoy the same privacy guarantee and similar accuracy, but are significantly more \textit{calibrated}. Our code can be found at \url{https://github.com/woodyx218/opacus_global_clipping}.


title: Efficient Asynchronous Byzantine Agreement without Private Setups

abstract: Efficient asynchronous Byzantine agreement (BA) protocols were mostly studied with private setups, e.g., pre-setup threshold cryptosystem. Challenges remain to reduce the large communication in the absence of such setups. Recently, Abraham et al. (PODC'21) presented the first asynchronous validated BA (VBA) with expected $O(n^3)$ messages and $O(1)$ rounds, relying on only public key infrastructure (PKI) setup, but the design still costs $O({\lambda}n^3 \log n)$ bits. Here $n$ is the number of parties, and $\lambda$ is a cryptographic security parameter. In this paper, we reduce the communication of private-setup free asynchronous BA to expected $O(\lambda n^3)$ bits. At the core of our design, we give a systematic treatment of common randomness protocols in the asynchronous network, and proceed as: - We give an efficient reasonably fair common coin protocol in the asynchronous setting with only PKI setup. It costs only $O(\lambda n^3)$ bits and $O(1)$ rounds, and ensures that with at least 1/3 probability, all honest parties can output a common bit that is as if randomly flipped. This directly renders more efficient private-setup free asynchronous binary agreement (ABA) with expected $O(\lambda n^3)$ bits and $O(1)$ rounds. - Then, we lift our common coin to attain perfect agreement by using a single ABA. This gives us a reasonably fair random leader election protocol with expected $O(\lambda n^3)$ communication and expected constant rounds. It is pluggable in all existing VBA protocols (e.g., Cachin et al., CRYPTO'01; Abraham et al., PODC'19; Lu et al., PODC'20) to remove the needed private setup or distributed key generation (DKG). As such, the communication of private-setup free VBA is reduced to expected $O(\lambda n^3)$ bits while preserving fast termination in expected $O(1)$ rounds.


title: Learning Equivariant Energy Based Models with Equivariant Stein Variational Gradient Descent

abstract: We focus on the problem of efficient sampling and learning of probability densities by incorporating symmetries in probabilistic models. We first introduce Equivariant Stein Variational Gradient Descent algorithm -- an equivariant sampling method based on Stein's identity for sampling from densities with symmetries. Equivariant SVGD explicitly incorporates symmetry information in a density through equivariant kernels which makes the resultant sampler efficient both in terms of sample complexity and the quality of generated samples. Subsequently, we define equivariant energy based models to model invariant densities that are learned using contrastive divergence. By utilizing our equivariant SVGD for training equivariant EBMs, we propose new ways of improving and scaling up training of energy based models. We apply these equivariant energy models for modelling joint densities in regression and classification tasks for image datasets, many-body particle systems and molecular structure generation.


title: Temporal Consistency Checks to Detect LiDAR Spoofing Attacks on Autonomous Vehicle Perception

abstract: LiDAR sensors are used widely in Autonomous Vehicles for better perceiving the environment which enables safer driving decisions. Recent work has demonstrated serious LiDAR spoofing attacks with alarming consequences. In particular, model-level LiDAR spoofing attacks aim to inject fake depth measurements to elicit ghost objects that are erroneously detected by 3D Object Detectors, resulting in hazardous driving decisions. In this work, we explore the use of motion as a physical invariant of genuine objects for detecting such attacks. Based on this, we propose a general methodology, 3D Temporal Consistency Check (3D-TC2), which leverages spatio-temporal information from motion prediction to verify objects detected by 3D Object Detectors. Our preliminary design and implementation of a 3D-TC2 prototype demonstrates very promising performance, providing more than 98% attack detection rate with a recall of 91% for detecting spoofed Vehicle (Car) objects, and is able to achieve real-time detection at 41Hz


title: A Non-ergodic Effective Amplitude Ground-Motion Model for California

abstract: A new non-ergodic ground-motion model (GMM) for effective amplitude spectral ($EAS$) values for California is presented in this study. $EAS$, which is defined in Goulet et al. (2018), is a smoothed rotation-independent Fourier amplitude spectrum of the two horizontal components of an acceleration time history. The main motivation for developing a non-ergodic $EAS$ GMM, rather than a spectral acceleration GMM, is that the scaling of $EAS$ does not depend on spectral shape, and therefore, the more frequent small magnitude events can be used in the estimation of the non-ergodic terms. The model is developed using the California subset of the NGAWest2 dataset Ancheta et al. (2013). The Bayless and Abrahamson (2019b) (BA18) ergodic $EAS$ GMM was used as backbone to constrain the average source, path, and site scaling. The non-ergodic GMM is formulated as a Bayesian hierarchical model: the non-ergodic source and site terms are modeled as spatially varying coefficients following the approach of Landwehr et al. (2016), and the non-ergodic path effects are captured by the cell-specific anelastic attenuation attenuation following the approach of Dawood and Rodriguez-Marek (2013). Close to stations and past events, the mean values of the non-ergodic terms deviate from zero to capture the systematic effects and their epistemic uncertainty is small. In areas with sparse data, the epistemic uncertainty of the non-ergodic terms is large, as the systematic effects cannot be determined. The non-ergodic total aleatory standard deviation is approximately $30$ to $40\%$ smaller than the total aleatory standard deviation of BA18. This reduction in the aleatory variability has a significant impact on hazard calculations at large return periods. The epistemic uncertainty of the ground motion predictions is small in areas close to stations and past events.


title: Time-independence of gravitational R\'enyi entropies and unitarity in quantum gravity

abstract: The Hubeny-Rangamani-Takayanagi surface $\gamma_{HRT}$ computing the entropy $S(D)$ of a domain of dependence $D$ on an asymptotically AdS boundary is known to be causally inaccessible from $D$. We generalize this gravitational result to higher replica numbers $n >1$ by considering the replica-invariant surfaces (aka `splitting surfaces') $\boldsymbol{\mathbf{\gamma}}$ of real-time replica-wormhole saddle-points computing R\'enyi entropies $S_n(D)$ and showing that there is a sense in which $D$ must again be causally inaccessible from $\boldsymbol{\mathbf{\gamma}}$ when the saddle preserves both replica and conjugation symmetry. This property turns out to imply the $S_n(D)$ to be independent of any choice of any Cauchy surface $\Sigma_D$ for $D$, and also that the $S_n(D)$ are independent of the choice of boundary sources within $D$. This is a key hallmark of unitary evolution in any dual field theory. Furthermore, from the bulk point of view it adds to the evidence that time evolution of asymptotic observables in quantum gravity is implemented by a unitary operator in each baby universe superselection sector. Though we focus here on pure Einstein-Hilbert gravity and its Kaluza-Klein reductions, we expect the argument to extend to any two-derivative theory who satisfies the null convergence condition. We consider both classical saddles and the effect of back-reaction from quantum corrections.


title: Improved Regret Bounds for Online Submodular Maximization

abstract: In this paper, we consider an online optimization problem over $T$ rounds where at each step $t\in[T]$, the algorithm chooses an action $x_t$ from the fixed convex and compact domain set $\mathcal{K}$. A utility function $f_t(\cdot)$ is then revealed and the algorithm receives the payoff $f_t(x_t)$. This problem has been previously studied under the assumption that the utilities are adversarially chosen monotone DR-submodular functions and $\mathcal{O}(\sqrt{T})$ regret bounds have been derived. We first characterize the class of strongly DR-submodular functions and then, we derive regret bounds for the following new online settings: $(1)$ $\{f_t\}_{t=1}^T$ are monotone strongly DR-submodular and chosen adversarially, $(2)$ $\{f_t\}_{t=1}^T$ are monotone submodular (while the average $\frac{1}{T}\sum_{t=1}^T f_t$ is strongly DR-submodular) and chosen by an adversary but they arrive in a uniformly random order, $(3)$ $\{f_t\}_{t=1}^T$ are drawn i.i.d. from some unknown distribution $f_t\sim \mathcal{D}$ where the expected function $f(\cdot)=\mathbb{E}_{f_t\sim\mathcal{D}}[f_t(\cdot)]$ is monotone DR-submodular. For $(1)$, we obtain the first logarithmic regret bounds. In terms of the second framework, we show that it is possible to obtain similar logarithmic bounds with high probability. Finally, for the i.i.d. model, we provide algorithms with $\tilde{\mathcal{O}}(\sqrt{T})$ stochastic regret bound, both in expectation and with high probability. Experimental results demonstrate that our algorithms outperform the previous techniques in the aforementioned three settings.


title: A Survey on Mining and Analysis of Uncertain Graphs

abstract: \emph{Uncertain Graph} (also known as \emph{Probabilistic Graph}) is a generic model to represent many real\mbox{-}world networks from social to biological. In recent times analysis and mining of uncertain graphs have drawn significant attention from the researchers of the data management community. Several noble problems have been introduced and efficient methodologies have been developed to solve those problems. Hence, there is a need to summarize the existing results on this topic in a self\mbox{-}organized way. In this paper, we present a comprehensive survey on uncertain graph mining focusing on mainly three aspects: (i) different problems studied, (ii) computational challenges for solving those problems, and (iii) proposed methodologies. Finally, we list out important future research directions.


title: Force-Sensing Tensegrity for Investigating Physical Human-Robot Interaction in Compliant Robotic Systems

abstract: Advancements in the domain of physical human-robot interaction (pHRI) have tremendously improved the ability of humans and robots to communicate, collaborate, and coexist. In particular, compliant robotic systems offer many characteristics that can be leveraged towards enabling physical interactions that more efficiently and intuitively communicate intent, making compliant systems potentially useful in more physically demanding subsets of human-robot collaborative scenarios. Tensegrity robots are an example of compliant systems that are well-suited to physical interactions while still retaining useful rigid properties that make them practical for a variety of applications. In this paper, we present the design and preliminary testing of a 6-bar spherical tensegrity with force-sensing capabilities. Using this prototype, we demonstrate the ability of its force-sensor array to detect a variety of physical interaction types that might arise in a human context. We then train and test a series of classifiers using data from unique and representative interactions in order to demonstrate the feasibility of using this physical modality of sensing to reliably communicate goals and intents from a human operator in a human-robot collaborative setting.


title: Density-potential functional theory for fermions in one dimension

abstract: We showcase the advantages of orbital-free density-potential functional theory (DPFT), a more flexible variant of Hohenberg-Kohn density functional theory. DPFT resolves the usual trouble with the gradient-expanded kinetic energy functional by facilitating systematic semiclassical approximations in terms of an effective potential energy that incorporates all interactions. With the aid of two systematic approximation schemes we demonstrate that DPFT is not only scalable, universally applicable in both position and momentum space, and allows kinetic and interaction energy to be approximated consistently, but can also compete with highly accurate, yet restricted, methods. As two- and three-dimensional geometries are extensively covered elsewhere, our focus here is on one-dimensional settings, with semiclassical observables systematically derived from both the Wigner function formalism and a split-operator approach. The high quality of our results for Fermi gases in Morse potentials invites the use of DPFT for describing more exotic systems, such as trapped large-spin fermion mixtures with contact or dipole-dipole interactions.


title: The subfield codes and subfield subcodes of a family of MDS codes

abstract: Maximum distance separable (MDS) codes are very important in both theory and practice. There is a classical construction of a family of $[2^m+1, 2u-1, 2^m-2u+3]$ MDS codes for $1 \leq u \leq 2^{m-1}$, which are cyclic, reversible and BCH codes over $\mathrm{GF}(2^m)$. The objective of this paper is to study the quaternary subfield subcodes and quaternary subfield codes of a subfamily of the MDS codes for even $m$. A family of quaternary cyclic codes is obtained. These quaternary codes are distance-optimal in some cases and very good in general. Furthermore, infinite families of $3$-designs from these quaternary codes are presented.


title: Randomized Exploration for Reinforcement Learning with General Value Function Approximation

abstract: We propose a model-free reinforcement learning algorithm inspired by the popular randomized least squares value iteration (RLSVI) algorithm as well as the optimism principle. Unlike existing upper-confidence-bound (UCB) based approaches, which are often computationally intractable, our algorithm drives exploration by simply perturbing the training data with judiciously chosen i.i.d. scalar noises. To attain optimistic value function estimation without resorting to a UCB-style bonus, we introduce an optimistic reward sampling procedure. When the value functions can be represented by a function class $\mathcal{F}$, our algorithm achieves a worst-case regret bound of $\widetilde{O}(\mathrm{poly}(d_EH)\sqrt{T})$ where $T$ is the time elapsed, $H$ is the planning horizon and $d_E$ is the $\textit{eluder dimension}$ of $\mathcal{F}$. In the linear setting, our algorithm reduces to LSVI-PHE, a variant of RLSVI, that enjoys an $\widetilde{\mathcal{O}}(\sqrt{d^3H^3T})$ regret. We complement the theory with an empirical evaluation across known difficult exploration tasks.


title: Remarks on regularized Stokeslets in slender body theory

abstract: We remark on the use of regularized Stokeslets in the slender body theory (SBT) approximation of Stokes flow about a thin fiber of radius $\epsilon>0$. Denoting the regularization parameter by $\delta$, we consider regularized SBT based on the most common regularized Stokeslet plus a regularized doublet correction. Given sufficiently smooth force data along the filament, we derive $L^\infty$ bounds for the difference between regularized SBT and its classical counterpart in terms of $\delta$, $\epsilon$, and the force data. We show that the regularized and classical expressions for the velocity of the filament itself differ by a term proportional to $\log(\delta/\epsilon)$ -- in particular, $\delta=\epsilon$ is necessary to avoid an $O(1)$ discrepancy between the theories. However, the flow at the surface of the fiber differs by an expression proportional to $\log(1+\delta^2/\epsilon^2)$, and any choice of $\delta\propto\epsilon$ will result in an $O(1)$ discrepancy as $\epsilon\to 0$. Consequently, the flow around a slender fiber due to regularized SBT does not converge to the solution of the well-posed \emph{slender body PDE} which classical SBT is known to approximate. Numerics verify this $O(1)$ discrepancy but also indicate that the difference may have little impact in practice.


title: Teacher-Student MixIT for Unsupervised and Semi-supervised Speech Separation

abstract: In this paper, we introduce a novel semi-supervised learning framework for end-to-end speech separation. The proposed method first uses mixtures of unseparated sources and the mixture invariant training (MixIT) criterion to train a teacher model. The teacher model then estimates separated sources that are used to train a student model with standard permutation invariant training (PIT). The student model can be fine-tuned with supervised data, i.e., paired artificial mixtures and clean speech sources, and further improved via model distillation. Experiments with single and multi channel mixtures show that the teacher-student training resolves the over-separation problem observed in the original MixIT method. Further, the semisupervised performance is comparable to a fully-supervised separation system trained using ten times the amount of supervised data.


title: The ultimate state of turbulent permeable-channel flow

abstract: Direct numerical simulations have been performed for heat and momentum transfer in internally heated turbulent shear flow with constant bulk mean velocity and temperature, $u_{b}$ and $\theta_{b}$, between parallel, isothermal, no-slip and permeable walls. The wall-normal transpiration velocity on the walls $y=\pm h$ is assumed to be proportional to the local pressure fluctuations, i.e. $v=\pm \beta p/\rho$ (Jim\'enez et al., J. Fluid Mech., vol. 442, 2001, pp.89-117). The temperature is supposed to be a passive scalar, and the Prandtl number is set to unity. Turbulent heat and momentum transfer in permeable-channel flow for $\beta u_{b}=0.5$ has been found to exhibit distinct states depending on the Reynolds number $Re_b=2h u_b/\nu$. At $Re_{b}\lesssim 10^4$, the classical Blasius law of the friction coefficient and its similarity to the Stanton number, $St\approx c_{f}\sim Re_{b}^{-1/4}$, are observed, whereas at $Re_{b}\gtrsim 10^4$, the so-called ultimate scaling, $St\sim Re_b^0$ and $c_{f}\sim Re_b^0$, is found. The ultimate state is attributed to the appearance of large-scale intense spanwise rolls with the length scale of $O(h)$ arising from the Kelvin-Helmholtz type of shear-layer instability over the permeable walls. The large-scale rolls can induce large-amplitude velocity fluctuations of $O(u_b)$ as in free shear layers, so that the Taylor dissipation law $\epsilon\sim u_{b}^{3}/h$ (or equivalently $c_{f}\sim Re_b^0$) holds. In spite of strong turbulence promotion there is no flow separation, and thus large-amplitude temperature fluctuations of $O(\theta_b)$ can also be induced similarly. As a consequence, the ultimate heat transfer is achieved, i.e., a wall heat flux scales with $u_{b}\theta_{b}$ (or equivalently $St\sim Re_b^0$) independent of thermal diffusivity, although the heat transfer on the walls is dominated by thermal conduction.


title: Islands in Kaluza-Klein black holes

abstract: The newly proposed island formula for entanglement entropy of Hawking radiation is applied to spherically symmetric 4-dimensional eternal Kaluza-Klein (KK) black hole. The "charge" $Q$ of KK black holes quantifies its deviation from Schwarzschild black holes. The impact of $Q$ on the island is studied at late times. The late-time island, whose boundary is located outside but within a Planckian distance of the horizon, is slightly extended by $Q$. While the no-island entropy grows linearly, the late-time entanglement entropy is given by island configuration with twice the Bekenstein-Hawking entropy. Thus we reproduce the Page curve for the eternal KK black holes. Compared with Schwarzschild results, the Page time is delayed by a factor $(1+Q/r_h)$ and the scrambling time is prolonged by a factor $(1+Q/r_h)^{1/2}$. Moreover, the higher-dimensional generalization is presented. Skeptically, there are Planck length scales involved, in which a semi-classical description may break down.


title: Cluster-guided Asymmetric Contrastive Learning for Unsupervised Person Re-Identification

abstract: Unsupervised person re-identification (Re-ID) aims to match pedestrian images from different camera views in unsupervised setting. Existing methods for unsupervised person Re-ID are usually built upon the pseudo labels from clustering. However, the quality of clustering depends heavily on the quality of the learned features, which are overwhelmingly dominated by the colors in images especially in the unsupervised setting. In this paper, we propose a Cluster-guided Asymmetric Contrastive Learning (CACL) approach for unsupervised person Re-ID, in which cluster structure is leveraged to guide the feature learning in a properly designed asymmetric contrastive learning framework. To be specific, we propose a novel cluster-level contrastive loss to help the siamese network effectively mine the invariance in feature learning with respect to the cluster structure within and between different data augmentation views, respectively. Extensive experiments conducted on three benchmark datasets demonstrate superior performance of our proposal.


title: Learning Stable Classifiers by Transferring Unstable Features

abstract: While unbiased machine learning models are essential for many applications, bias is a human-defined concept that can vary across tasks. Given only input-label pairs, algorithms may lack sufficient information to distinguish stable (causal) features from unstable (spurious) features. However, related tasks often share similar biases -- an observation we may leverage to develop stable classifiers in the transfer setting. In this work, we explicitly inform the target classifier about unstable features in the source tasks. Specifically, we derive a representation that encodes the unstable features by contrasting different data environments in the source task. We achieve robustness by clustering data of the target task according to this representation and minimizing the worst-case risk across these clusters. We evaluate our method on both text and image classifications. Empirical results demonstrate that our algorithm is able to maintain robustness on the target task for both synthetically generated environments and real-world environments. Our code is available at https://github.com/YujiaBao/Tofu.


title: Cartan projections of some non-reductive subgroups and proper actions on homogeneous spaces

abstract: Kobayashi [Duke Math. J. (1992)] gave a necessary condition for the existence of compact Clifford-Klein forms in terms of Cartan projections and non-compact dimensions of reductive subgroups. We extend his method to non-reductive subgroups, and give some examples of homogeneous spaces of reductive type that do not admit compact Clifford-Klein forms by comparing Cartan projections and non-compact dimensions of reductive subgroups with those of non-reductive subgroups.


title: Simon Says: Evaluating and Mitigating Bias in Pruned Neural Networks with Knowledge Distillation

abstract: In recent years the ubiquitous deployment of AI has posed great concerns in regards to algorithmic bias, discrimination, and fairness. Compared to traditional forms of bias or discrimination caused by humans, algorithmic bias generated by AI is more abstract and unintuitive therefore more difficult to explain and mitigate. A clear gap exists in the current literature on evaluating and mitigating bias in pruned neural networks. In this work, we strive to tackle the challenging issues of evaluating, mitigating, and explaining induced bias in pruned neural networks. Our paper makes three contributions. First, we propose two simple yet effective metrics, Combined Error Variance (CEV) and Symmetric Distance Error (SDE), to quantitatively evaluate the induced bias prevention quality of pruned models. Second, we demonstrate that knowledge distillation can mitigate induced bias in pruned neural networks, even with unbalanced datasets. Third, we reveal that model similarity has strong correlations with pruning induced bias, which provides a powerful method to explain why bias occurs in pruned neural networks. Our code is available at https://github.com/codestar12/pruning-distilation-bias


title: The Inclination Correction to The Turbulence Structure Function of Thin Molecular Clouds and Its Application

abstract: The energy cascade rate of turbulence can be measured with the structure function. In practice, the 3D velocity of the gas in molecular cloud is hard to measure, which makes the measurement of structure function difficult. In the case of thin molecular clouds perpendicular to the line of sight, the structure function $S^2_{ tt}$ can be measured with core velocity dispersion (CVD), ${\rm CVD}^2=\frac{1}{2}S^2_{ tt}$. This method was extended to the case when the thin molecular cloud is not perpendicular to the line of sight, with intersection angle $\theta$, ${\rm CVD}^2=\frac{1}{2}S^2_{ tt}\left(1-\frac{1}{8}\cos^2\theta\right)R^{2/3}$, where $R$ can be expressed with elliptic integrals of the second kind $E(k,\varphi)$ as $R=\frac{2}{\pi}E(\cos\theta,\frac{\pi}{2})$.


title: Code Integrity Attestation for PLCs using Black Box Neural Network Predictions

abstract: Cyber-physical systems (CPSs) are widespread in critical domains, and significant damage can be caused if an attacker is able to modify the code of their programmable logic controllers (PLCs). Unfortunately, traditional techniques for attesting code integrity (i.e. verifying that it has not been modified) rely on firmware access or roots-of-trust, neither of which proprietary or legacy PLCs are likely to provide. In this paper, we propose a practical code integrity checking solution based on privacy-preserving black box models that instead attest the input/output behaviour of PLC programs. Using faithful offline copies of the PLC programs, we identify their most important inputs through an information flow analysis, execute them on multiple combinations to collect data, then train neural networks able to predict PLC outputs (i.e. actuator commands) from their inputs. By exploiting the black box nature of the model, our solution maintains the privacy of the original PLC code and does not assume that attackers are unaware of its presence. The trust instead comes from the fact that it is extremely hard to attack the PLC code and neural networks at the same time and with consistent outcomes. We evaluated our approach on a modern six-stage water treatment plant testbed, finding that it could predict actuator states from PLC inputs with near-100% accuracy, and thus could detect all 120 effective code mutations that we subjected the PLCs to. Finally, we found that it is not practically possible to simultaneously modify the PLC code and apply discreet adversarial noise to our attesters in a way that leads to consistent (mis-)predictions.


title: Learning to Aggregate and Personalize 3D Face from In-the-Wild Photo Collection

abstract: Non-parametric face modeling aims to reconstruct 3D face only from images without shape assumptions. While plausible facial details are predicted, the models tend to over-depend on local color appearance and suffer from ambiguous noise. To address such problem, this paper presents a novel Learning to Aggregate and Personalize (LAP) framework for unsupervised robust 3D face modeling. Instead of using controlled environment, the proposed method implicitly disentangles ID-consistent and scene-specific face from unconstrained photo set. Specifically, to learn ID-consistent face, LAP adaptively aggregates intrinsic face factors of an identity based on a novel curriculum learning approach with relaxed consistency loss. To adapt the face for a personalized scene, we propose a novel attribute-refining network to modify ID-consistent face with target attribute and details. Based on the proposed method, we make unsupervised 3D face modeling benefit from meaningful image facial structure and possibly higher resolutions. Extensive experiments on benchmarks show LAP recovers superior or competitive face shape and texture, compared with state-of-the-art (SOTA) methods with or without prior and supervision.


title: G2DA: Geometry-Guided Dual-Alignment Learning for RGB-Infrared Person Re-Identification

abstract: RGB-Infrared (IR) person re-identification aims to retrieve person-of-interest from heterogeneous cameras, easily suffering from large image modality discrepancy caused by different sensing wavelength ranges. Existing work usually minimizes such discrepancy by aligning domain distribution of global features, while neglecting the intra-modality structural relations between semantic parts. This could result in the network overly focusing on local cues, without considering long-range body part dependencies, leading to meaningless region representations. In this paper, we propose a graph-enabled distribution matching solution, dubbed Geometry-Guided Dual-Alignment (G2DA) learning, for RGB-IR ReID. It can jointly encourage the cross-modal consistency between part semantics and structural relations for fine-grained modality alignment by solving a graph matching task within a multi-scale skeleton graph that embeds human topology information. Specifically, we propose to build a semantic-aligned complete graph into which all cross-modality images can be mapped via a pose-adaptive graph construction mechanism. This graph represents extracted whole-part features by nodes and expresses the node-wise similarities with associated edges. To achieve the graph-based dual-alignment learning, an Optimal Transport (OT) based structured metric is further introduced to simultaneously measure point-wise relations and group-wise structural similarities across modalities. By minimizing the cost of an inter-modality transport plan, G2DA can learn a consistent and discriminative feature subspace for cross-modality image retrieval. Furthermore, we advance a Message Fusion Attention (MFA) mechanism to adaptively reweight the information flow of semantic propagation, effectively strengthening the discriminability of extracted semantic features.


title: Population-coding and Dynamic-neurons improved Spiking Actor Network for Reinforcement Learning

abstract: With the Deep Neural Networks (DNNs) as a powerful function approximator, Deep Reinforcement Learning (DRL) has been excellently demonstrated on robotic control tasks. Compared to DNNs with vanilla artificial neurons, the biologically plausible Spiking Neural Network (SNN) contains a diverse population of spiking neurons, making it naturally powerful on state representation with spatial and temporal information. Based on a hybrid learning framework, where a spike actor-network infers actions from states and a deep critic network evaluates the actor, we propose a Population-coding and Dynamic-neurons improved Spiking Actor Network (PDSAN) for efficient state representation from two different scales: input coding and neuronal coding. For input coding, we apply population coding with dynamically receptive fields to directly encode each input state component. For neuronal coding, we propose different types of dynamic-neurons (containing 1st-order and 2nd-order neuronal dynamics) to describe much more complex neuronal dynamics. Finally, the PDSAN is trained in conjunction with deep critic networks using the Twin Delayed Deep Deterministic policy gradient algorithm (TD3-PDSAN). Extensive experimental results show that our TD3-PDSAN model achieves better performance than state-of-the-art models on four OpenAI gym benchmark tasks. It is an important attempt to improve RL with SNN towards the effective computation satisfying biological plausibility.


title: Low-Energy and CPA-Resistant Adiabatic CMOS/MTJ Logic for IoT Devices

abstract: The tremendous growth in the number of Internet of Things (IoT) devices has increased focus on the energy efficiency and security of an IoT device. In this paper, we will present a design level, non-volatile adiabatic architecture for low-energy and Correlation Power Analysis (CPA) resistant IoT devices. IoT devices constructed with CMOS integrated circuits suffer from high dynamic energy and leakage power. To solve this, we look at both adiabatic logic and STT-MTJs (Spin Transfer Torque Magnetic Tunnel Junctions) to reduce both dynamic energy and leakage power. Furthermore, CMOS integrated circuits suffer from side-channel leakage making them insecure against power analysis attacks. We again look to adiabatic logic to design secure circuits with uniform power consumption, thus, defending against power analysis attacks. We have developed a hybrid adiabatic- MTJ architecture using two-phase adiabatic logic. We show that hybrid adiabatic-MTJ circuits are both low energy and secure when compared with CMOS circuits. As a case study, we have constructed one round of PRESENT and have shown energy savings of 64.29% at a frequency of 25 MHz. Furthermore, we have performed a correlation power analysis attack on our proposed design and determined that the key was kept hidden.


title: A Hybrid mmWave and Camera System for Long-Range Depth Imaging

abstract: mmWave radars offer excellent depth resolution even at very long ranges owing to their high bandwidth. But their angular resolution is at least an order-of-magnitude worse than camera and lidar systems. Hence, mmWave radar is not a capable 3-D imaging solution in isolation. We propose Metamoran, a system that combines the complimentary strengths of radar and camera to obtain accurate, high resolution depth images over long ranges even in high clutter environments, all from a single fixed vantage point. Metamoran enables rich long-range depth imaging with applications in security and surveillance, roadside safety infrastructure and wide-area mapping. Our approach leverages the high angular resolution from cameras using computer vision techniques, including image segmentation and monocular depth estimation, to obtain object shape. Our core contribution is a method to convert this object shape into an RF I/Q equivalent, which we use in a novel radar processing pipeline to help declutter the scene and capture extremely weak reflections from objects at long distances. We perform a detailed evaluation of Metamoran's depth imaging capabilities in 400 diverse scenes. Our evaluation shows that Metamoran estimates the depth of static objects up to 90 m and moving objects up to 305 m and with a median error of 28 cm, an improvement of 13$\times$ compared to a naive radar+camera baseline and 23$\times$ compared to monocular depth estimation.


title: Bilateral Personalized Dialogue Generation with Contrastive Learning

abstract: Generating personalized responses is one of the major challenges in natural human-robot interaction. Current researches in this field mainly focus on generating responses consistent with the robot's pre-assigned persona, while ignoring the user's persona. Such responses may be inappropriate or even offensive, which may lead to the bad user experience. Therefore, we propose a Bilateral Personalized Dialogue Generation (BPDG) method for dyadic conversation, which integrates user and robot personas into dialogue generation via designing a dynamic persona-aware fusion method. To bridge the gap between the learning objective function and evaluation metrics, the Conditional Mutual Information Maximum (CMIM) criterion is adopted with contrastive learning to select the proper response from the generated candidates. Moreover, a bilateral persona accuracy metric is designed to measure the degree of bilateral personalization. Experimental results demonstrate that, compared with several state-of-the-art methods, the final results of the proposed method are more personalized and consistent with bilateral personas in terms of both automatic and manual evaluations.


title: smFRET reveals DHX36 repetitive binding,not unfolding,of G-quadruplexes

abstract: Our data challenge Chen et al.'s interpretation of smFRET results, i.e. the repetitive unfolding of G4 with one-base translocations. We believe that the observed oscillatory curve represents the alternate binding of DHX36 to the 3' and 5'G-tetrad of G4s, rather than the repetitive unfolding between the canonical and the transformed non-canonical G4s. Noteworthily, our results reported here also call into question the previously published smFRET data of helicase-mediated G4 unfolding. Therefore,discriminating the smFRET signal of repetitive binding from that of unfolding is very important to avoid misinterpreting smFRET results.


title: Finite State Graphon Games with Applications to Epidemics

abstract: We consider a game for a continuum of non-identical players evolving on a finite state space. Their heterogeneous interactions are represented by a graphon, which can be viewed as the limit of a dense random graph. The player's transition rates between the states depend on their own control and the interaction strengths with the other players. We develop a rigorous mathematical framework for this game and analyze Nash equilibria. We provide a sufficient condition for a Nash equilibrium and prove existence of solutions to a continuum of fully coupled forward-backward ordinary differential equations characterizing equilibria. Moreover, we propose a numerical approach based on machine learning tools and show experimental results on different applications to compartmental models in epidemiology.


title: Evading Malware Classifiers via Monte Carlo Mutant Feature Discovery

abstract: The use of Machine Learning has become a significant part of malware detection efforts due to the influx of new malware, an ever changing threat landscape, and the ability of Machine Learning methods to discover meaningful distinctions between malicious and benign software. Antivirus vendors have also begun to widely utilize malware classifiers based on dynamic and static malware analysis features. Therefore, a malware author might make evasive binary modifications against Machine Learning models as part of the malware development life cycle to execute an attack successfully. This makes the studying of possible classifier evasion strategies an essential part of cyber defense against malice. To this extent, we stage a grey box setup to analyze a scenario where the malware author does not know the target classifier algorithm, and does not have access to decisions made by the classifier, but knows the features used in training. In this experiment, a malicious actor trains a surrogate model using the EMBER-2018 dataset to discover binary mutations that cause an instance to be misclassified via a Monte Carlo tree search. Then, mutated malware is sent to the victim model that takes the place of an antivirus API to test whether it can evade detection.


title: Keep CALM and Improve Visual Feature Attribution

abstract: The class activation mapping, or CAM, has been the cornerstone of feature attribution methods for multiple vision tasks. Its simplicity and effectiveness have led to wide applications in the explanation of visual predictions and weakly-supervised localization tasks. However, CAM has its own shortcomings. The computation of attribution maps relies on ad-hoc calibration steps that are not part of the training computational graph, making it difficult for us to understand the real meaning of the attribution values. In this paper, we improve CAM by explicitly incorporating a latent variable encoding the location of the cue for recognition in the formulation, thereby subsuming the attribution map into the training computational graph. The resulting model, class activation latent mapping, or CALM, is trained with the expectation-maximization algorithm. Our experiments show that CALM identifies discriminative attributes for image classifiers more accurately than CAM and other visual attribution baselines. CALM also shows performance improvements over prior arts on the weakly-supervised object localization benchmarks. Our code is available at https://github.com/naver-ai/calm.


title: Domain Adaptive SiamRPN++ for Object Tracking in the Wild

abstract: Benefit from large-scale training data, recent advances in Siamese-based object tracking have achieved compelling results on the normal sequences. Whilst Siamese-based trackers assume training and test data follow an identical distribution. Suppose there is a set of foggy or rainy test sequences, it cannot be guaranteed that the trackers trained on the normal images perform well on the data belonging to other domains. The problem of domain shift among training and test data has already been discussed in object detection and semantic segmentation areas, which, however, has not been investigated for visual tracking. To this end, based on SiamRPN++, we introduce a Domain Adaptive SiamRPN++, namely DASiamRPN++, to improve the cross-domain transferability and robustness of a tracker. Inspired by A-distance theory, we present two domain adaptive modules, Pixel Domain Adaptation (PDA) and Semantic Domain Adaptation (SDA). The PDA module aligns the feature maps of template and search region images to eliminate the pixel-level domain shift caused by weather, illumination, etc. The SDA module aligns the feature representations of the tracking target's appearance to eliminate the semantic-level domain shift. PDA and SDA modules reduce the domain disparity by learning domain classifiers in an adversarial training manner. The domain classifiers enforce the network to learn domain-invariant feature representations. Extensive experiments are performed on the standard datasets of two different domains, including synthetic foggy and TIR sequences, which demonstrate the transferability and domain adaptability of the proposed tracker.


title: Observation of a Novel Lattice Instability in Ultrafast Photoexcited SnSe

abstract: There is growing interest in using ultrafast light pulses to drive functional materials into nonequilibrium states with novel properties. The conventional wisdom is that above gap photoexcitation behaves similarly to raising the electronic temperature and lacks the desired selectivity in the final state. Here we report a novel nonthermal lattice instability induced by ultrafast above-gap excitation in SnSe, a representative of the IV-VI class of semiconductors that provides a rich platform for tuning material functionality with ultrafast pulses due to their multiple lattice instabilities. The new lattice instability is accompanied by a drastic softening of the lowest frequency A$_g$ phonon. This mode has previously been identified as the soft mode in the thermally driven phase transition to a Cmcm structure. However, by a quantitative reconstruction of the atomic displacements from time-resolved x-ray diffraction for multiple Bragg peaks and excitation densities, we show that ultrafast photoexcitation with near-infrared (1.55 eV) light, induces a distortion towards a different structure with Immm symmetry. The Immm structure of SnSe is an orthorhombic distortion of the rocksalt structure and does not occur in equilibrium. Density functional theory (DFT) calculations reveal that the photoinduced Immm lattice instability arises from electron excitation from the Se 4$p$- and Sn 5$s$-derived bands deep below the Fermi level that cannot be excited thermally. The results have implications for optical control of the thermoelectric, ferroelectric and topological properties of the monochalcogenides and related materials. More generally, the results emphasize the need for ultrafast structural probes to reveal distinct atomic-scale dynamics that are otherwise too subtle or invisible in conventional spectroscopies.