title: Variable Selection with Second-Generation P-Values

abstract: Many statistical methods have been proposed for variable selection in the past century, but few balance inference and prediction tasks well. Here we report on a novel variable selection approach called Penalized regression with Second-Generation P-Values (ProSGPV). It captures the true model at the best rate achieved by current standards, is easy to implement in practice, and often yields the smallest parameter estimation error. The idea is to use an l0 penalization scheme with second-generation p-values (SGPV), instead of traditional ones, to determine which variables remain in a model. The approach yields tangible advantages for balancing support recovery, parameter estimation, and prediction tasks. The ProSGPV algorithm can maintain its good performance even when there is strong collinearity among features or when a high dimensional feature space with p > n is considered. We present extensive simulations and a real-world application comparing the ProSGPV approach with smoothly clipped absolute deviation (SCAD), adaptive lasso (AL), and mini-max concave penalty with penalized linear unbiased selection (MC+). While the last three algorithms are among the current standards for variable selection, ProSGPV has superior inference performance and comparable prediction performance in certain scenarios. Supplementary materials are available online.


title: PyPhase -- a Python package for X-ray phase imaging

abstract: X-ray propagation-based imaging techniques are well-established at synchrotron radiation and laboratory sources. However, most reconstruction algorithms for such image modalities, also known as phase retrieval algorithms, have been developed specifically for one instrument by and for experts, making the development and spreading of the use of such techniques difficult. Here, we present PyPhase, a free and open-source package for propagation-based near-field phase reconstructions, which is distributed under the CeCILL license. PyPhase implements some of the most popular phase-retrieval algorithms in a highly-modular framework supporting the deployment on large-scale computing facilities. This makes the integration, the development of new phase-retrieval algorithms, and the deployment on different computing infrastructures straight-forward. To demonstrate its capabilities and simplicity, we present its application to data acquired at synchrotron MAX~IV (Lund, Sweden).

categories: eess.IV physics.app-ph physics.med-ph physics.optics


title: Size scaling, dynamics, and electro-thermal bifurcation of VO2 Mott oscillators

abstract: Traditional electronic devices are well-known to improve in speed and energy-efficiency as their dimensions are reduced to the nanoscale. However, this scaling behavior remains unclear for nonlinear dynamical circuit elements, such as Mott neuron-like spiking oscillators, which are of interest for bio-inspired computing. Here we show that shrinking micrometer-sized VO2 oscillators to sub-100 nm effective sizes, achieved using a nanogap cut in a metallic carbon nanotube (CNT) electrode, does not guarantee faster spiking. However, an additional heat source such as Joule heating from the CNT, in combination with small size and heat capacity (defined by the narrow volume of VO2 whose insulator-metal transition is triggered by the CNT), can increase the spiking frequency by ~1000x due to an electro-thermal bifurcation in the nonlinear dynamics. These results demonstrate that nonlinear dynamical switches operate in a complex phase space which can be controlled by careful electro-thermal design, offering new tuning parameters for designing future biomimetic electronics.


title: Holes in the Geofence: Privacy Vulnerabilities in "Smart" DNS Services

abstract: Smart DNS (SDNS) services advertise access to "geofenced" content (typically, video streaming sites such as Netflix or Hulu) that is normally inaccessible unless the client is within a prescribed geographic region. SDNS is simple to use and involves no software installation. Instead, it requires only that users modify their DNS settings to point to an SDNS resolver. The SDNS resolver "smartly" identifies geofenced domains and, in lieu of their proper DNS resolutions, returns IP addresses of proxy servers located within the geofence. These servers then transparently proxy traffic between the users and their intended destinations, allowing for the bypass of these geographic restrictions. This paper presents the first academic study of SDNS services. We identify a number of serious and pervasive privacy vulnerabilities that expose information about the users of these systems. These include architectural weaknesses that enable content providers to identify which requesting clients use SDNS. Worse, we identify flaws in the design of some SDNS services that allow {\em any} arbitrary third party to enumerate these services' users (by IP address), even if said users are currently offline. We present mitigation strategies to these attacks that have been adopted by at least one SDNS provider in response to our findings.


title: The POEMMA (Probe of Extreme Multi-Messenger Astrophysics) Observatory

abstract: The Probe Of Extreme Multi-Messenger Astrophysics (POEMMA) is designed to accurately observe ultra-high-energy cosmic rays (UHECRs) and cosmic neutrinos from space with sensitivity over the full celestial sky. POEMMA will observe the extensive air showers (EASs) from UHECRs and UHE neutrinos above 20 EeV via air fluorescence. Additionally, POEMMA will observe the Cherenkov signal from upward-moving EASs induced by Earth-interacting tau neutrinos above 20 PeV. The POEMMA spacecraft are designed to quickly re-orientate to follow up transient neutrino sources and obtain unparalleled neutrino flux sensitivity. Developed as a NASA Astrophysics Probe-class mission, POEMMA consists of two identical satellites flying in loose formation in 525 km altitude orbits. Each POEMMA instrument incorporates a wide field-of-view (45$^\circ$) Schmidt telescope with over 6 m$^2$ of collecting area. The hybrid focal surface of each telescope includes a fast (1~$\mu$s) near-ultraviolet camera for EAS fluorescence observations and an ultrafast (10~ns) optical camera for Cherenkov EAS observations. In a 5-year mission, POEMMA will provide measurements that open new multi-messenger windows onto the most energetic events in the universe, enabling the study of new astrophysics and particle physics at these otherwise inaccessible energies.


title: Limiting absorption principle and equivalence of Feynman propagators on asymptotically Minkowski spacetimes

abstract: In this paper, we shall show that the limiting absorption principle for the wave operator on the asymptotically Minkowski spacetime. This problem was previously considered by [A. Vasy, J. Spect. Theory, 10,439-461 , (2020)]. Here, we employ a more transparent tool, the Mourre theory and removes an additional condition which is imposed in his paper. Moreover, we also prove that the anti-Feynman propagator defined by G\'erard and Wrochna coincides with the outgoing resolvent.


title: Automatic Vertebra Localization and Identification in CT by Spine Rectification and Anatomically-constrained Optimization

abstract: Accurate vertebra localization and identification are required in many clinical applications of spine disorder diagnosis and surgery planning. However, significant challenges are posed in this task by highly varying pathologies (such as vertebral compression fracture, scoliosis, and vertebral fixation) and imaging conditions (such as limited field of view and metal streak artifacts). This paper proposes a robust and accurate method that effectively exploits the anatomical knowledge of the spine to facilitate vertebra localization and identification. A key point localization model is trained to produce activation maps of vertebra centers. They are then re-sampled along the spine centerline to produce spine-rectified activation maps, which are further aggregated into 1-D activation signals. Following this, an anatomically-constrained optimization module is introduced to jointly search for the optimal vertebra centers under a soft constraint that regulates the distance between vertebrae and a hard constraint on the consecutive vertebra indices. When being evaluated on a major public benchmark of 302 highly pathological CT images, the proposed method reports the state of the art identification (id.) rate of 97.4%, and outperforms the best competing method of 94.7% id. rate by reducing the relative id. error rate by half.


title: Harmonic Functions on Compactly Generated Groups

abstract: A compactly generated group is noncompact if and only if it admits a nonconstant harmonic function (for some, equivalently for every, reasonable measure). This generalizes the known fact that a finitely generated group is infinite if and only if it admits a nonconstant harmonic function (for some, equivalently every, reasonable measure).


title: SAT-MARL: Specification Aware Training in Multi-Agent Reinforcement Learning

abstract: A characteristic of reinforcement learning is the ability to develop unforeseen strategies when solving problems. While such strategies sometimes yield superior performance, they may also result in undesired or even dangerous behavior. In industrial scenarios, a system's behavior also needs to be predictable and lie within defined ranges. To enable the agents to learn (how) to align with a given specification, this paper proposes to explicitly transfer functional and non-functional requirements into shaped rewards. Experiments are carried out on the smart factory, a multi-agent environment modeling an industrial lot-size-one production facility, with up to eight agents and different multi-agent reinforcement learning algorithms. Results indicate that compliance with functional and non-functional constraints can be achieved by the proposed approach.


title: DeepLesionBrain: Towards a broader deep-learning generalization for multiple sclerosis lesion segmentation

abstract: Recently, segmentation methods based on Convolutional Neural Networks (CNNs) showed promising performance in automatic Multiple Sclerosis (MS) lesions segmentation. These techniques have even outperformed human experts in controlled evaluation conditions such as Longitudinal MS Lesion Segmentation Challenge (ISBI Challenge). However state-of-the-art approaches trained to perform well on highly-controlled datasets fail to generalize on clinical data from unseen datasets. Instead of proposing another improvement of the segmentation accuracy, we propose a novel method robust to domain shift and performing well on unseen datasets, called DeepLesionBrain (DLB). This generalization property results from three main contributions. First, DLB is based on a large group of compact 3D CNNs. This spatially distributed strategy ensures a robust prediction despite the risk of generalization failure of some individual networks. Second, DLB includes a new image quality data augmentation to reduce dependency to training data specificity (e.g., acquisition protocol). Finally, to learn a more generalizable representation of MS lesions, we propose a hierarchical specialization learning (HSL). HSL is performed by pre-training a generic network over the whole brain, before using its weights as initialization to locally specialized networks. By this end, DLB learns both generic features extracted at global image level and specific features extracted at local image level. DLB generalization was validated in cross-dataset experiments on MSSEG'16, ISBI challenge, and in-house datasets. During experiments, DLB showed higher segmentation accuracy, better segmentation consistency and greater generalization performance compared to state-of-the-art methods. Therefore, DLB offers a robust framework well-suited for clinical practice.


title: The eigensplitting of the fiber of the cyclotomic trace for the sphere spectrum

abstract: Let $p\in \mathbb Z$ be an odd prime. We show that the fiber sequence for the cyclotomic trace of the sphere spectrum $\mathbb S$ admits an "eigensplitting" that generalizes known splittings on $K$-theory and $TC$. We identify the summands in the fiber as the covers of $\mathbb Z_{p}$-Anderson duals of summands in the $K(1)$-localized algebraic $K$-theory of $\mathbb Z$. Analogous results hold for the ring $\mathbb Z$ where we prove that the $K(1)$-localized fiber sequence is self-dual for $\mathbb Z_{p}$-Anderson duality, with the duality permuting the summands by $i\mapsto p-i$ (indexed mod $p-1$). We explain an intrinsic characterization of the summand we call $Z$ in the splitting $TC(\mathbb Z)^{\wedge}_{p}\simeq j \vee \Sigma j'\vee Z$ in terms of units in the $p$-cyclotomic tower of $\mathbb Q_{p}$.


title: Synchro-betatron Resonance of Crab Crossing Scheme with Large Crossing Angle and Finite Bunch Length

abstract: Crab crossing scheme is an essential collision scheme to achieve high luminosity for the future colliders with large crossing angles. However, when bunch length of one or both colliding beams is comparable with the wavelength of the crab cavity voltage, the nonlinear dependence of the crabbing kick may present a challenge to the beam dynamics of the colliding beams and impact the beam quality as well as the luminosity lifetime. In this paper, the results of nonlinear dynamics in the crab crossing scheme are presented, using both analytical and numerical studies. The result indicates that higher-order synchro-betatron resonances may be excited in the crab crossing scheme with large crossing angle, which causes the beam quality deterioration and luminosity degradation. The studies also reveal possible countermeasures to suppress the synchro-beta resonance, hence mitigate the degradation of beam quality and luminosity.


title: Fixing Multiple Type Errors in Model Transformations with Alternative Oracles to Test Cases

abstract: This paper addresses the issue of correcting type errors in model transformations in realistic scenarios where neither predefined patches nor behavior-safe guards such as test suites are available. Instead of using predefined patches targeting isolated errors of specific categories, we propose to explore the space of possible patches by combining basic edit operations for model transformation programs. To guide the search, we define two families of objectives: one to limit the number of type errors and the other to preserve the transformation behavior. To approximate the latter, we study two objectives: minimizing the number of changes and keeping the changes local. Additionally, we define four heuristics to refine candidate patches to increase the likelihood of correcting type errors while preserving the transformation behavior. We implemented our approach for the ATL language using the evolutionary algorithm NSGA-II, and performed an evaluation based on three published case studies. The evaluation results show that our approach was able to automatically correct on average more than82% of type errors for two cases and more than 56% for the third case.


title: Classification and threshold dynamics of stochastic reaction networks

abstract: Stochastic reaction networks (SRNs) provide models of many real-world networks. Examples include networks in epidemiology, pharmacology, genetics, ecology, chemistry, and social sciences. Here, we model stochastic reaction networks by continuous time Markov chains (CTMCs) and pay special attention to one-dimensional mass-action SRNs (1-d stoichiometric subspace). We classify all states of the underlying CTMC of 1-d SRNs. In terms of (up to) four parameters, we provide sharp checkable criteria for various dynamical properties (including explosivity, recurrence, ergodicity, and the tail asymptotics of stationary or quasi-stationary distributions) of SRNs in the sense of their underlying CTMCs. As a result, we prove that all 1-d endotactic networks are non-explosive, and positive recurrent with an ergodic stationary distribution with Conley-Maxwell-Poisson (CMP)-like tail, provided the state space of the associated CTMCs consists of closed communicating classes. In particular, we prove the recently proposed positive recurrence conjecture in one dimension: Weakly reversible mass-action SRNs with 1-d stoichiometric subspaces are positive recurrent. The proofs of the main results rely on our recent work on CTMCs with polynomial transition rate functions.


title: Importance of Signal and Image Processing in Photoacoustic Imaging

abstract: Photoacoustic imaging (PAI) is a powerful imaging modality that relies on the PA effect. PAI works on the principle of electromagnetic energy absorption by the exogenous contrast agents and/or endogenous molecules present in the biological tissue, consequently generating ultrasound waves. PAI combines a high optical contrast with a high acoustic spatiotemporal resolution, allowing the non-invasive visualization of absorbers at deep structures. However, due to the optical diffusion and ultrasound attenuation in heterogeneous turbid biological tissue, the quality of the PA images is deteriorated. Therefore, signal and image processing techniques are imperative in PAI to provide high quality images with detailed structural and functional information in deep tissues. Here, we review various signal and image processing techniques that have been developed/implemented in PAI. Our goal is to highlight the importance of image computing in photoacoustic imaging.


title: Nakai-Moishezon criterions for complex Hessian equations

abstract: The $J$-equation proposed by Donaldson is a complex Hessian quotient equation on K\"ahler manifolds. The solvability of the $J$-equation is proved by Song-Weinkove to be equivalent to the existence of a subsolution. It is also conjectured by Lejmi-Szekelyhidi to be equivalent to a stability condition in terms of holomorphic intersection numbers as an analogue of the Nakai-Moishezon criterion in algebraic geometry. The conjecture is recently proved by Chen under a stronger uniform stability condition. In this paper, we establish a Nakai-Moishezon type criterion for pairs of K\"ahler classes on analytic K\"ahler varieties. As a consequence, we prove Lejmi-Szekelyhidi's original conjecture for the $J$-equation. We also apply such a criterion to obtain a family of constant scalar curvature K\"ahler metrics on smooth minimal models.


title: A Guide to Realistic Uncertainties on Fundamental Properties of Solar-Type Exoplanet Host Stars

abstract: Our understanding of the properties and demographics of exoplanets critically relies on our ability to determine fundamental properties of their host stars. The advent of Gaia and large spectroscopic surveys has now made it in principle possible to infer properties of individual stars, including most exoplanet hosts, to very high precision. However, we show that in practice, such analyses are limited both by uncertainties in the fundamental scale, and by uncertainties in our models of stellar evolution, even for stars similar to the Sun. For example, we show that current uncertainties on measured interferometric angular diameters and bolometric fluxes set a systematic uncertainty floor of $\sim$2% in temperature, $\sim$2% in luminosity, and $\sim$4% in radius. Comparisons between widely available model grids suggest uncertainties of order $\sim$5% in mass and $\sim$20% in age for main sequence and subgiant stars. While the radius uncertainties are roughly constant over this range of stars, the model dependent uncertainties are a complex function of luminosity, temperature, and metallicity. We provide open-source software for approximating these uncertainties for individual targets, and discuss strategies for reducing these uncertainties in the future.


title: Many-Body Quantum Calculations for Graphyne for Electronic Devices

abstract: Moving beyond traditional 2D materials is now desirable to have switching capabilities (e.g., transistors). Here we propose using graphyne because, as we will show in this letter, obtaining regions of the electronic bandstructure which act as valence and conduction bands, with an apparent bandgap, is found. Here for particular allotropes of graphyne, density of states (DOS) and electronic bandstructure diagrams with E(k) vs k are found for the graphyne allotropes graphyne-1 and graphyne-2 having, respectively, one and two triple C-C carbon-carbon bonds between adjoining benzene rings. The ab initio many-body quantum calculations were performed using both local density approximation (LDA) and generalized gradient approximation (GGA) for density functional theory (DFT).


title: Continuous Curve Textures

abstract: Repetitive patterns are ubiquitous in natural and human-made objects, and can be created with a variety of tools and methods. Manual authoring provides unmatched degree of freedom and control, but can require significant artistic expertise and manual labor. Computational methods can automate parts of the manual creation process, but are mainly tailored for discrete pixels or elements instead of more general continuous structures. We propose an example-based method to synthesize continuous curve patterns from exemplars. Our main idea is to extend prior sample-based discrete element synthesis methods to consider not only sample positions (geometry) but also their connections (topology). Since continuous structures can exhibit higher complexity than discrete elements, we also propose robust, hierarchical synthesis to enhance output quality. Our algorithm can generate a variety of continuous curve patterns fully automatically. For further quality improvement and customization, we also present an autocomplete user interface to facilitate interactive creation and iterative editing. We evaluate our methods and interface via different patterns, ablation studies, and comparisons with alternative methods.


title: Observations of the Lyman-$\alpha$ Universe

abstract: Hydrogen Lyman-$\alpha$ (Ly$\alpha$) emission has been one of the major observational probes for the high redshift universe, since the first discoveries of high-$z$ Ly$\alpha$ emitting galaxies in the late 1990s. Due to the strong Ly$\alpha$ emission originated by resonant scattering and recombination of the most-abundant element, Ly$\alpha$ observations witness not only HII regions of star formation and AGN but also diffuse HI gas in the circum-galactic medium (CGM) and the inter-galactic medium (IGM). Here we review Ly$\alpha$ sources, and present theoretical interpretations reached to date. We conclude that: 1) A typical Ly$\alpha$ emitter (LAE) at $z\gtrsim 2$ with a $L^*$ Ly$\alpha$ luminosity is a high-$z$ counterpart of a local dwarf galaxy, a compact metal-poor star-forming galaxy (SFG) with an approximate stellar (halo) mass and star-formation rate of $10^{8-9} M_\odot$ ($10^{10-11} M_\odot$) and $1-10 M_\odot$ yr$^{-1}$, respectively; 2) High-$z$ SFGs ubiquitously have a diffuse Ly$\alpha$ emitting halo in the CGM extending to the halo virial radius and beyond; 3) Remaining neutral hydrogen at the epoch of reionization makes a strong dimming of Ly$\alpha$ emission for galaxies at $z>6$ that suggest the late reionization history. The next generation large telescope projects will combine Ly$\alpha$ emission data with HI Ly$\alpha$ absorptions and 21cm radio data that map out the majority of hydrogen (HI+HII) gas, uncovering the exchanges of i) matter by outflow/inflow and ii) radiation, relevant to cosmic reionization, between galaxies and the CGM/IGM.


title: Exact long-range dielectric screening and interatomic force constants in quasi-2D crystals

abstract: We develop a fundamental theory of the long-range electrostatic interactions in two-dimensional crystals by performing a rigorous study of the nonanalyticities of the Coulomb kernel. We find that the dielectric functions are best represented by $2\times 2$ matrices, with nonuniform macroscopic potentials that are two-component hyperbolic functions of the out-of-plane coordinate, $z$. We demonstrate our arguments by deriving the long-range interatomic forces in the adiabatic regime, where we identify a formerly overlooked dipolar coupling involving the out-of-plane components of the dynamical charges. The resulting formula is exact up to an arbitrary multipolar order, which we illustrate in practice via the explicit inclusion of dynamical quadrupoles. By performing numerical tests on monolayer BN, SnS$_2$ and BaTiO$_3$ membranes, we show that our method allows for a drastic improvement in the description of the long-range electrostatic interactions, with comparable benefits to the quality of the interpolated phonon band structure.


title: Iterative label cleaning for transductive and semi-supervised few-shot learning

abstract: Few-shot learning amounts to learning representations and acquiring knowledge such that novel tasks may be solved with both supervision and data being limited. Improved performance is possible by transductive inference, where the entire test set is available concurrently, and semi-supervised learning, where more unlabeled data is available. Focusing on these two settings, we introduce a new algorithm that leverages the manifold structure of the labeled and unlabeled data distribution to predict pseudo-labels, while balancing over classes and using the loss value distribution of a limited-capacity classifier to select the cleanest labels, iteratively improving the quality of pseudo-labels. Our solution surpasses or matches the state of the art results on four benchmark datasets, namely miniImageNet, tieredImageNet, CUB and CIFAR-FS, while being robust over feature space pre-processing and the quantity of available data. The publicly available source code can be found in https://github.com/MichalisLazarou/iLPC.


title: Invariant Feature Learning for Sensor-based Human Activity Recognition

abstract: Wearable sensor-based human activity recognition (HAR) has been a research focus in the field of ubiquitous and mobile computing for years. In recent years, many deep models have been applied to HAR problems. However, deep learning methods typically require a large amount of data for models to generalize well. Significant variances caused by different participants or diverse sensor devices limit the direct application of a pre-trained model to a subject or device that has not been seen before. To address these problems, we present an invariant feature learning framework (IFLF) that extracts common information shared across subjects and devices. IFLF incorporates two learning paradigms: 1) meta-learning to capture robust features across seen domains and adapt to an unseen one with similarity-based data selection; 2) multi-task learning to deal with data shortage and enhance overall performance via knowledge sharing among different subjects. Experiments demonstrated that IFLF is effective in handling both subject and device diversion across popular open datasets and an in-house dataset. It outperforms a baseline model of up to 40% in test accuracy.


title: One-Loop Electron Mass and Three-Loop Dirac Neutrino Masses

abstract: In the context of a left-right extension of the standard model of quarks and leptons with the addition of a gauged $U(1)_D$ dark symmetry, it is shown how the electron may obtain a radiative mass in one loop and two Dirac neutrinos obtain masses in three loops.


title: SUPER IV. CO(J=3-2) properties of active galactic nucleus hosts at cosmic noon revealed by ALMA

abstract: Feedback from AGN is thought to be key in shaping the life cycle of their host galaxies by regulating star-formation activity. Therefore, to understand the impact of AGN on star formation, it is essential to trace the molecular gas out of which stars form. In this paper we present the first systematic study of the CO properties of AGN hosts at z~2 for a sample of 27 X-ray selected AGN spanning two orders of magnitude in AGN bolometric luminosity (Lbol= 10^44.7-10^46.9 erg/s) by using ALMA Band 3 observations of the CO(3-2) transition (~1" angular resolution). To search for evidence of AGN feedback on the CO properties of the host galaxies, we compared our AGN with a sample of inactive (i.e., non-AGN) galaxies from the PHIBSS survey with similar redshift, stellar masses, and SFRs. We used the same CO transition as a consistent proxy for the gas mass for the two samples in order to avoid systematics involved when assuming conversion factors. By adopting a Bayesian approach to take upper limits into account, we analyzed CO luminosities as a function of stellar masses and SFRs, as well as the ratio LCO(3-2)/M* (proxy for the gas fraction). The two samples show statistically consistent trends in the LCO(3-2)-Lfir and LCO(3-2)-M* planes. However, there are indications that AGN feature lower CO(3-2) luminosities (0.4-0.7 dex) than inactive galaxies at the 2-3sigma level when we focus on the subset of parameters where the results are better constrained and on the distribution of the mean LCO(3-2)/M*. Therefore, even by conservatively assuming the same excitation factor r31, we would find lower molecular gas masses in AGN, and assuming higher r31 would exacerbate this difference. We interpret our result as a hint of the potential effect of AGN activity (e.g., radiation and outflows), which may be able to heat, excite, dissociate, and/or deplete the gas reservoir of the host galaxies. (abridged)


title: Odd-One-Out Representation Learning

abstract: The effective application of representation learning to real-world problems requires both techniques for learning useful representations, and also robust ways to evaluate properties of representations. Recent work in disentangled representation learning has shown that unsupervised representation learning approaches rely on fully supervised disentanglement metrics, which assume access to labels for ground-truth factors of variation. In many real-world cases ground-truth factors are expensive to collect, or difficult to model, such as for perception. Here we empirically show that a weakly-supervised downstream task based on odd-one-out observations is suitable for model selection by observing high correlation on a difficult downstream abstract visual reasoning task. We also show that a bespoke metric-learning VAE model which performs highly on this task also out-performs other standard unsupervised and a weakly-supervised disentanglement model across several metrics.


title: Dynamics of diffractive dissociation

abstract: We describe a QCD based model which incorporates the main properties of the inclusive particle distributions expected for diffractive processes, including the diffractive dissociation at high energies. We study, in turn, the total cross section, $\sigma_{tot}$, the differential elastic, $d\sigma_{el}/dt$, cross section, the dependence of the single proton dissociation cross section, $\xi d^{SD}/d\xi $, on the momentum fraction, $\xi = 1-x_L$, lost by the leading proton, the multiplicity distributions in inelastic (non-diffractive) collisions and in the processes of dissociation. Besides this we calculate the mean transverse momenta of the `wee partons' (secondaries) produced in the case of dissociation (that is in the processes with a large rapidity gap) and compare it with that in inelastic interactions.


title: FasteNet: A Fast Railway Fastener Detector

abstract: In this work, a novel high-speed railway fastener detector is introduced. This fully convolutional network, dubbed FasteNet, foregoes the notion of bounding boxes and performs detection directly on a predicted saliency map. Fastenet uses transposed convolutions and skip connections, the effective receptive field of the network is 1.5$\times$ larger than the average size of a fastener, enabling the network to make predictions with high confidence, without sacrificing output resolution. In addition, due to the saliency map approach, the network is able to vote for the presence of a fastener up to 30 times per fastener, boosting prediction accuracy. Fastenet is capable of running at 110 FPS on an Nvidia GTX 1080, while taking in inputs of 1600$\times$512 with an average of 14 fasteners per image. Our source is open here: https://github.com/jjshoots/DL\_FasteNet.git


title: A case for new neural network smoothness constraints

abstract: How sensitive should machine learning models be to input changes? We tackle the question of model smoothness and show that it is a useful inductive bias which aids generalization, adversarial robustness, generative modeling and reinforcement learning. We explore current methods of imposing smoothness constraints and observe they lack the flexibility to adapt to new tasks, they don't account for data modalities, they interact with losses, architectures and optimization in ways not yet fully understood. We conclude that new advances in the field are hinging on finding ways to incorporate data, tasks and learning into our definitions of smoothness.


title: The proton inelastic cross section at ultrahigh energies

abstract: We study the consequences of high-energy collider data on the best fits to total, elastic, and inelastic cross sections for $pp$ and $p\bar{p}$ scattering using two very distinct unitarisation schemes: the eikonal and the $U$-matrix. Despite their analytic differences, we find that the two schemes lead to almost identical predictions up to EeV energies, with differences only becoming significant at GUT-scale and higher energies.


title: Stringy-Running-Vacuum-Model Inflation: from primordial Gravitational Waves and stiff Axion Matter to Dynamical Dark Energy

abstract: In previous works we have derived a Running Vacuum Model (RVM) for a string Universe, which provides an effective description of the evolution of 4-dimensional string-inspired cosmologies from inflation till the present epoch. In the context of this "stringy RVM" version, it is assumed that the early Universe is characterised by purely gravitational degrees of freedom, from the massless gravitational string multiplet, including the antisymmetric tensor field. The latter plays an important role, since its dual gives rise to a `stiff' gravitational-axion "matter", which in turn couples to the gravitational anomaly terms, assumed to be non-trivial at early epochs. In the presence of primordial gravitational wave (GW) perturbations, such anomalous couplings lead to an RVM-like dynamical inflation, without external inflatons. We review here this framework and discuss potential scenarios for the generation of such primordial GW, among which the formation of unstable domain walls, which eventually collapse in a non-spherical-symmetric manner, giving rise to GW. We also remark that the same type of "stiff" axionic matter could provide, upon the generation of appropriate potentials during the post-inflationary eras, (part of) the Dark Matter (DM) in the Universe, which could well be ultralight, depending on the parameters of the string-inspired model. All in all, the new (stringy) mechanism for RVM-inflation preserves the basic structure of the original (and more phenomenological) RVM, as well as its main advantages: namely, a mechanism for graceful exit and for generating a huge amount of entropy capable of explaining the horizon problem. It also predicts axionic DM and the existence of mild dynamical Dark Energy (DE) of quintessence type in the present universe, both being "living fossils" of the inflationary stages of the cosmic evolution.


title: Plurisubharmonic geodesics in spaces of non-Archimedean metrics of finite energy

abstract: Given a polarized projective variety (X,L) over any non-Archimedean field, assuming continuity of envelopes, we show that the space of finite-energy metrics on L is a geodesic metric space, where geodesics are given as maximal psh segments. Given two continuous psh metrics, we show that the maximal segment joining them is furthermore continuous.


title: Unitarity and the information problem in an explicit model of black hole evaporation

abstract: We consider the black hole information problem in an explicitly defined spacetime modelling black hole evaporation. Using this context we review basic aspects of the problem, with a particular effort to be unambiguous about subtle topics, for instance precisely what is meant by entropy in various circumstances. We then focus on questions of unitarity, and argue that commonly invoked semiclassical statements of long term, evaporation time, and Page time "unitarity" may all be violated even if physics is fundamentally unitary. This suggests that there is no horizon firewall. We discuss how the picture is modified for regular (nonsingular) evaporation models. We also compare our conclusions to recent holographic studies, and argue that they are mutually compatible.


title: A review of on-device fully neural end-to-end automatic speech recognition algorithms

abstract: In this paper, we review various end-to-end automatic speech recognition algorithms and their optimization techniques for on-device applications. Conventional speech recognition systems comprise a large number of discrete components such as an acoustic model, a language model, a pronunciation model, a text-normalizer, an inverse-text normalizer, a decoder based on a Weighted Finite State Transducer (WFST), and so on. To obtain sufficiently high speech recognition accuracy with such conventional speech recognition systems, a very large language model (up to 100 GB) is usually needed. Hence, the corresponding WFST size becomes enormous, which prohibits their on-device implementation. Recently, fully neural network end-to-end speech recognition algorithms have been proposed. Examples include speech recognition systems based on Connectionist Temporal Classification (CTC), Recurrent Neural Network Transducer (RNN-T), Attention-based Encoder-Decoder models (AED), Monotonic Chunk-wise Attention (MoChA), transformer-based speech recognition systems, and so on. These fully neural network-based systems require much smaller memory footprints compared to conventional algorithms, therefore their on-device implementation has become feasible. In this paper, we review such end-to-end speech recognition models. We extensively discuss their structures, performance, and advantages compared to conventional algorithms.


title: Learning Visual Robotic Control Efficiently with Contrastive Pre-training and Data Augmentation

abstract: Recent advances in unsupervised representation learning significantly improved the sample efficiency of training Reinforcement Learning policies in simulated environments. However, similar gains have not yet been seen for real-robot reinforcement learning. In this work, we focus on enabling data-efficient real-robot learning from pixels. We present Contrastive Pre-training and Data Augmentation for Efficient Robotic Learning (CoDER), a method that utilizes data augmentation and unsupervised learning to achieve sample-efficient training of real-robot arm policies from sparse rewards. While contrastive pre-training, data augmentation, demonstrations, and reinforcement learning are alone insufficient for efficient learning, our main contribution is showing that the combination of these disparate techniques results in a simple yet data-efficient method. We show that, given only 10 demonstrations, a single robotic arm can learn sparse-reward manipulation policies from pixels, such as reaching, picking, moving, pulling a large object, flipping a switch, and opening a drawer in just 30 minutes of mean real-world training time. We include videos and code on the project website: https://sites.google.com/view/efficient-robotic-manipulation/home


title: NeurIPS 2020 Competition: Predicting Generalization in Deep Learning

abstract: Understanding generalization in deep learning is arguably one of the most important questions in deep learning. Deep learning has been successfully adopted to a large number of problems ranging from pattern recognition to complex decision making, but many recent researchers have raised many concerns about deep learning, among which the most important is generalization. Despite numerous attempts, conventional statistical learning approaches have yet been able to provide a satisfactory explanation on why deep learning works. A recent line of works aims to address the problem by trying to predict the generalization performance through complexity measures. In this competition, we invite the community to propose complexity measures that can accurately predict generalization of models. A robust and general complexity measure would potentially lead to a better understanding of deep learning's underlying mechanism and behavior of deep models on unseen data, or shed light on better generalization bounds. All these outcomes will be important for making deep learning more robust and reliable.


title: Probabilistic Contrastive Principal Component Analysis

abstract: Dimension reduction is useful for exploratory data analysis. In many applications, it is of interest to discover variation that is enriched in a "foreground" dataset relative to a "background" dataset. Recently, contrastive principal component analysis (CPCA) was proposed for this setting. However, the lack of a formal probabilistic model makes it difficult to reason about CPCA and to tune its hyperparameter. In this work, we propose probabilistic contrastive principal component analysis (PCPCA), a model-based alternative to CPCA. We discuss how to set the hyperparameter in theory and in practice, and we show several of PCPCA's advantages over CPCA, including greater interpretability, uncertainty quantification and principled inference, robustness to noise and missing data, and the ability to generate data from the model. We demonstrate PCPCA's performance through a series of simulations and case-control experiments with datasets of gene expression, protein expression, and images.


title: Model Choices Influence Attributive Word Associations: A Semi-supervised Analysis of Static Word Embeddings

abstract: Static word embeddings encode word associations, extensively utilized in downstream NLP tasks. Although prior studies have discussed the nature of such word associations in terms of biases and lexical regularities captured, the variation in word associations based on the embedding training procedure remains in obscurity. This work aims to address this gap by assessing attributive word associations across five different static word embedding architectures, analyzing the impact of the choice of the model architecture, context learning flavor and training corpora. Our approach utilizes a semi-supervised clustering method to cluster annotated proper nouns and adjectives, based on their word embedding features, revealing underlying attributive word associations formed in the embedding space, without introducing any confirmation bias. Our results reveal that the choice of the context learning flavor during embedding training (CBOW vs skip-gram) impacts the word association distinguishability and word embeddings' sensitivity to deviations in the training corpora. Moreover, it is empirically shown that even when trained over the same corpora, there is significant inter-model disparity and intra-model similarity in the encoded word associations across different word embedding models, portraying specific patterns in the way the embedding space is created for each embedding architecture.


title: Quantum thermo-dynamical construction for driven open quantum systems

abstract: Quantum dynamics of driven open systems should be compatible with both quantum mechanic and thermodynamic principles. By formulating the thermodynamic principles in terms of a set of postulates we obtain a thermodynamically consistent master equation. Following an axiomatic approach, we base the analysis on an autonomous description, incorporating the drive as a large transient control quantum system. In the appropriate physical limit, we derive the semi-classical description, where the control is incorporated as a time-dependent term in the system Hamiltonian. The transition to the semi-classical description reflects the conservation of global coherence and highlights the crucial role of coherence in the initial control state. We demonstrate the theory by analyzing a qubit controlled by a single bosonic mode in a coherent state.


title: Infinite set of non linear Equations for the Li- Keiper Coefficients: a possible new upper and lower bound

abstract: Starting with an infinite set of non linear Equations for the Li-Keiper coefficients, we first specify a lower bound emerging from the infinite set and give a characterization of it. Then, we propose a possible new upper and lower bound for the coefficients in few of the partitions occurring in the cluster functions furnishing in a nonlinear way the coefficients. A numerical experiment up to n=15 confirms the proposed bounds and an experiment, i.e. the counting of the zeros in the binary representation of an integer for a constant related to the Glaisher-Kinkelin constant is also given up to n=32.


title: A silicon photonics feed-forward neural network for nonlinear distortion mitigation in an optical link

abstract: We design and model a single-layer, passive, all-optical silicon photonics neural network to mitigate optical link nonlinearities. The network nodes are formed by silicon microring resonators whose transfer function has been experimentally measured. Both the transmitted amplitude and phase maps of the nonlinear response of the microrings are parametrized as a function of the wavelength and of the signal power to form tunable activation functions of the single nodes in the complex valued network. Training of the network is achieved by a particle swarm optimizer which selects the complex weights and the activation functions. We demonstrate that a single feed-forward layer with a single node perceptron is effective in compensating linear and nonlinear distortions over a broad range of signal-to-noise-ratio and propagation lengths. We propose to implement this simple neuronal network as an optical link transparent layer to correct signal distortions.


title: Feature Selection for Learning to Predict Outcomes of Compute Cluster Jobs with Application to Decision Support

abstract: We present a machine learning framework and a new test bed for data mining from the Slurm Workload Manager for high-performance computing (HPC) clusters. The focus was to find a method for selecting features to support decisions: helping users decide whether to resubmit failed jobs with boosted CPU and memory allocations or migrate them to a computing cloud. This task was cast as both supervised classification and regression learning, specifically, sequential problem solving suitable for reinforcement learning. Selecting relevant features can improve training accuracy, reduce training time, and produce a more comprehensible model, with an intelligent system that can explain predictions and inferences. We present a supervised learning model trained on a Simple Linux Utility for Resource Management (Slurm) data set of HPC jobs using three different techniques for selecting features: linear regression, lasso, and ridge regression. Our data set represented both HPC jobs that failed and those that succeeded, so our model was reliable, less likely to overfit, and generalizable. Our model achieved an R^2 of 95\% with 99\% accuracy. We identified five predictors for both CPU and memory properties.


title: On Continuous Local BDD-Based Search for Hybrid SAT Solving

abstract: We explore the potential of continuous local search (CLS) in SAT solving by proposing a novel approach for finding a solution of a hybrid system of Boolean constraints. The algorithm is based on CLS combined with belief propagation on binary decision diagrams (BDDs). Our framework accepts all Boolean constraints that admit compact BDDs, including symmetric Boolean constraints and small-coefficient pseudo-Boolean constraints as interesting families. We propose a novel algorithm for efficiently computing the gradient needed by CLS. We study the capabilities and limitations of our versatile CLS solver, GradSAT, by applying it on many benchmark instances. The experimental results indicate that GradSAT can be a useful addition to the portfolio of existing SAT and MaxSAT solvers for solving Boolean satisfiability and optimization problems.


title: WISE: A Computer System Performance Index Scoring Framework

abstract: The performance levels of a computing machine running a given workload configuration are crucial for both users and providers of computing resources. Knowing how well a computing machine is running with a given workload configuration is critical to making proper computing resource allocation decisions. In this paper, we introduce a novel framework for deriving computing machine and computing resource performance indicators for a given workload configuration. We propose a workload/machine index score (WISE) framework for computing a fitness score for a workload/machine combination. The WISE score indicates how well a computing machine is running with a specific workload configuration by addressing the issue of whether resources are being stressed or sitting idle wasting precious resources. In addition to encompassing any number of computing resources, the WISE score is determined by considering how far from target levels the machine resources are operating at without maxing out. Experimental results demonstrate the efficacy of the proposed WISE framework on two distinct workload configurations.


title: Hodge-Arakelov inequalities for family of surfaces fibered by curves

abstract: The Hodge numerical invariants of a variation of Hodge structure over a smooth quas--projective variety are a measure of complexity for the global twisting of the limit mixed Hodge structure when it degenerates. These invariants appear in inequalities which they may have correction terms, called Arakelov inequalities. One may investigate the correction term to make them into equalities, also called Arakelov equalities. We investigate numerical Arakelov type (in)equilities for a family of surfaces fibered by curves. Our method uses Arakelov identities in a weight 1 and also in a weight 2 variations of Hodge structure (cf. \cite{GGK}), in a commutative triangle of fibrations. We have proposed to relate the degrees of the Hodge bundles in the two families. We also compare the Fujita decomposition of Hodge bundles in these fibrations. We examine various identities and relations between Hodge numbers and degrees of the Hodge bundles in different levels.


title: Physics-Aware Gaussian Processes in Remote Sensing

abstract: Earth observation from satellite sensory data poses challenging problems, where machine learning is currently a key player. In recent years, Gaussian Process (GP) regression has excelled in biophysical parameter estimation tasks from airborne and satellite observations. GP regression is based on solid Bayesian statistics and generally yields efficient and accurate parameter estimates. However, GPs are typically used for inverse modeling based on concurrent observations and in situ measurements only. Very often a forward model encoding the well-understood physical relations between the state vector and the radiance observations is available though and could be useful to improve predictions and understanding. In this work, we review three GP models that respect and learn the physics of the underlying processes in the context of both forward and inverse modeling. After reviewing the traditional application of GPs for parameter retrieval, we introduce a Joint GP (JGP) model that combines in situ measurements and simulated data in a single GP model. Then, we present a latent force model (LFM) for GP modeling that encodes ordinary differential equations to blend data-driven modeling and physical constraints of the system governing equations. The LFM performs multi-output regression, adapts to the signal characteristics, is able to cope with missing data in the time series, and provides explicit latent functions that allow system analysis and evaluation. Finally, we present an Automatic Gaussian Process Emulator (AGAPE) that approximates the forward physical model using concepts from Bayesian optimization and at the same time builds an optimally compact look-up-table for inversion. We give empirical evidence of the performance of these models through illustrative examples of vegetation monitoring and atmospheric modeling.


title: Interpolation and Gap Filling of Landsat Reflectance Time Series

abstract: Products derived from a single multispectral sensor are hampered by a limited spatial, spectral or temporal resolutions. Image fusion in general and downscaling/blending in particular allow to combine different multiresolution datasets. We present here an optimal interpolation approach to generate smoothed and gap-free time series of Landsat reflectance data. We fuse MODIS (moderate-resolution imaging spectroradiometer) and Landsat data globally using the Google Earth Engine (GEE) platform. The optimal interpolator exploits GEE ability to ingest large amounts of data (Landsat climatologies) and uses simple linear operations that scale easily in the cloud. The approach shows very good results in practice, as tested over five sites with different vegetation types and climatic characteristics in the contiguous US.


title: GAN Ensemble for Anomaly Detection

abstract: When formulated as an unsupervised learning problem, anomaly detection often requires a model to learn the distribution of normal data. Previous works apply Generative Adversarial Networks (GANs) to anomaly detection tasks and show good performances from these models. Motivated by the observation that GAN ensembles often outperform single GANs in generation tasks, we propose to construct GAN ensembles for anomaly detection. In the proposed method, a group of generators and a group of discriminators are trained together, so every generator gets feedback from multiple discriminators, and vice versa. Compared to a single GAN, a GAN ensemble can better model the distribution of normal data and thus better detect anomalies. Our theoretical analysis of GANs and GAN ensembles explains the role of a GAN discriminator in anomaly detection. In the empirical study, we evaluate ensembles constructed from four types of base models, and the results show that these ensembles clearly outperform single models in a series of tasks of anomaly detection.


title: The Emerging Threats of Deepfake Attacks and Countermeasures

abstract: Deepfake technology (DT) has taken a new level of sophistication. Cybercriminals now can manipulate sounds, images, and videos to defraud and misinform individuals and businesses. This represents a growing threat to international institutions and individuals which needs to be addressed. This paper provides an overview of deepfakes, their benefits to society, and how DT works. Highlights the threats that are presented by deepfakes to businesses, politics, and judicial systems worldwide. Additionally, the paper will explore potential solutions to deepfakes and conclude with future research direction.


title: Compilation Techniques for Graph Algorithms on GPUs

abstract: The performance of graph programs depends highly on the algorithm, the size and structure of the input graphs, as well as the features of the underlying hardware. No single set of optimizations or one hardware platform works well across all settings. To achieve high performance, the programmer must carefully select which set of optimizations and hardware platforms to use. The GraphIt programming language makes it easy for the programmer to write the algorithm once and optimize it for different inputs using a scheduling language. However, GraphIt currently has no support for generating high performance code for GPUs. Programmers must resort to re-implementing the entire algorithm from scratch in a low-level language with an entirely different set of abstractions and optimizations in order to achieve high performance on GPUs. We propose GG, an extension to the GraphIt compiler framework, that achieves high performance on both CPUs and GPUs using the same algorithm specification. GG significantly expands the optimization space of GPU graph processing frameworks with a novel GPU scheduling language and compiler that enables combining graph optimizations for GPUs. GG also introduces two performance optimizations, Edge-based Thread Warps CTAs load balancing (ETWC) and EdgeBlocking, to expand the optimization space for GPUs. ETWC improves load balancing by dynamically partitioning the edges of each vertex into blocks that are assigned to threads, warps, and CTAs for execution. EdgeBlocking improves the locality of the program by reordering the edges and restricting random memory accesses to fit within the L2 cache. We evaluate GG on 5 algorithms and 9 input graphs on both Pascal and Volta generation NVIDIA GPUs, and show that it achieves up to 5.11x speedup over state-of-the-art GPU graph processing frameworks, and is the fastest on 66 out of the 90 experiments.


title: Rotons in Anyon Superfluids

abstract: We consider the problem of calculating the excitation spectrum of a gas of nonrelativistic anyons. When the anyons have statistics close to fermionic and the statistical angle has the form $\theta=\pi (1-\frac{1}{k})$ where $k$ is a large integer, the problem can be solved by employing the method of bosonization, which maps the problem to that of an infinite number of bosonic excitations coupled to a $U(1)$ Chern-Simons gauge field. The spectrum consists of a Goldstone boson branch and a large number of massive branches, each having roton minima and maxima. The dispersion curves asymptote to the Landau levels at large momentum.


title: Notes on numerical analysis and solitary wave solutions of Boussinesq/Boussinesq systems for internal waves

abstract: In this paper a three-parameter family of Boussinesq systems is studied. The systems have been proposed as models of the propagation of long internal waves along the interface of a two-layer system of fluids with rigid-lid condition for the upper layer and under a Boussinesq regime for the flow in both layers. We first present some theoretical properties of well-posedness, conservation laws and Hamiltonian structure of the systems. Then the corresponding periodic initial-value problem is discretized in space by the spectral Fourier Galerkin method and for each system, error estimates for the semidiscrete approximation are proved. The rest of the paper is concerned with the study of existence and the numerical simulation of some issues of the dynamics of solitary-wave solutions. Standard theories are used to derive several results of existence of classical and generalized solitary waves, depending on the parameters of the models. A numerical procedure is used to generate numerically approximations of solitary waves. These are taken as initial conditions in a computational study of the dynamics of the solitary waves, both classical and generalized. To this end, the spectral semidiscretizations of the periodic initial-value problem for the systems are numerically integrated by a fourth-order Runge-Kutta-composition method based on the implicit midpoint rule. The fully discrete scheme is then used to approximate the evolution of perturbations of computed solitary wave profiles, and to study computationally the collisions of solitary waves as well as the resolution of initial data into trains of solitary waves.


title: Hard x-ray standing-wave photoemission study of the interfaces in a BiFeO$_3$/La$_{0.7}$Sr$_{0.3}$MnO$_3$ superlattice

abstract: Hybrid multiferroics such as BiFeO$_3$ (BFO) and La$_{0.7}$Sr$_{0.3}$MnO$_3$ (LSMO) heterostructures are highly interesting functional systems due to their complex electronic and magnetic properties. One of the key parameters influencing the emergent properties is the quality of interfaces, where varying interdiffusion lengths can give rise to different chemistry and distinctive electronic states. Here we report high-resolution depth resolved chemical and electronic investigation of BFO/LSMO superlattice using standing-wave hard X-ray photoemission spectroscopy in the first-order Bragg as well as near-total-reflection geometry. Our results show that the interfaces of BFO on top of LSMO are atomically abrupt, while the LSMO on top of BFO interfaces show an interdiffusion length of around 1.2 unit cells. The two interfaces also exhibit different chemical gradients, with the BFO/LSMO interface being Sr-terminated by a spectroscopically distinctive high binding energy component in Sr 2p core-level spectra, which is spatially contained within 1 unit cell from the interface. From the electronic point of view, unique valence band features were observed for bulk-BFO, bulk-LSMO and their interfaces. Our X-ray optical analysis revealed a unique electronic signature at the BFO/LSMO interface, which we attribute to the coupling between those respective layers. Valence band decomposition based on the Bragg-reflection standing-wave measurement also revealed the band alignment between BFO and LSMO layers. Our work demonstrates that standing-wave hard x-ray photoemission is a reliable non-destructive technique for probing depth-resolved electronic structure of buried layers and interfaces with sub-unit-cell resolution. Equivalent investigations can be successfully applied to a broad class of material such as perovskite complex oxides with emergent interfacial phenomena.


title: Binary Black-box Evasion Attacks Against Deep Learning-based Static Malware Detectors with Adversarial Byte-Level Language Model

abstract: Anti-malware engines are the first line of defense against malicious software. While widely used, feature engineering-based anti-malware engines are vulnerable to unseen (zero-day) attacks. Recently, deep learning-based static anti-malware detectors have achieved success in identifying unseen attacks without requiring feature engineering and dynamic analysis. However, these detectors are susceptible to malware variants with slight perturbations, known as adversarial examples. Generating effective adversarial examples is useful to reveal the vulnerabilities of such systems. Current methods for launching such attacks require accessing either the specifications of the targeted anti-malware model, the confidence score of the anti-malware response, or dynamic malware analysis, which are either unrealistic or expensive. We propose MalRNN, a novel deep learning-based approach to automatically generate evasive malware variants without any of these restrictions. Our approach features an adversarial example generation process, which learns a language model via a generative sequence-to-sequence recurrent neural network to augment malware binaries. MalRNN effectively evades three recent deep learning-based malware detectors and outperforms current benchmark methods. Findings from applying our MalRNN on a real dataset with eight malware categories are discussed.


title: Rational growth in torus bundle groups of odd trace

abstract: A group is said to hae a rational growth with respect to the generating set if the growth series is a rational polynomial. It was shown by Parry that a subset of torus bundle groups exhibits rational growth. We generalize this result to other torus bundle groups.


title: Effects of Spin-Orbit Resonances and Tidal Heating on the Inner Edge of the Habitable Zone

abstract: Much attention has been given to the climate dynamics and habitable boundaries of synchronously rotating planets around low mass stars. However, other rotational states are possible, particularly when higher eccentricity orbits can be maintained in a system, including spin-orbit resonant configurations. Additionally, the oscillating strain as a planet moves from periastron to apoastron results in friction and tidal heating, which can be an important energy source. Here, we simulate the climate of ocean-covered planets near the inner edge of the habitable zone around M to solar stars with ROCKE-3D, and leverage the planetary evolution software package, VPLanet, to calculate tidal heating rates for Earth-sized planets orbiting 2600 K and 3000 K stars. This study is the first to use a 3-D General Circulation Model that implements tidal heating to investigate habitability for multiple resonant states. We find that in the absence of tidal heating, the resonant state has little impact on the inner edge, because for a given stellar flux, higher-order states tend to be warmer than synchronous rotators, but for a given temperature, have drier upper atmospheres. However, when strong tidal heating is present, the rotational component implies a strong dependence of habitable conditions on the system evolution and rotational state. Since tidal and stellar heating both decrease with orbital distance, this results in a compact orbital width separating temperate and uninhabitable climates. We summarize these results and also compare ROCKE-3D to previously published simulations of the inner edge that used a modified version of the NCAR CAM4 model.


title: Theory of pressure acoustics with thermoviscous boundary layers and streaming in elastic cavities

abstract: We present an effective thermoviscous theory of acoustofluidics including pressure acoustics, thermoviscous boundary layers, and streaming for fluids embedded in elastic cavities. By including thermal fields, we thus extend the effective viscous theory by Bach and Bruus, J. Acoust. Soc. Am. 144, 766 (2018). The acoustic temperature field and the thermoviscous boundary layers are incorporated analytically as effective boundary conditions and time-averaged body forces on the thermoacoustic bulk fields. Because it avoids resolving the thin boundary layers, the effective model allows for numerical simulation of both thermoviscous acoustic and time-averaged fields in 3D models of acoustofluidic systems. We show how the acoustic streaming depends strongly on steady and oscillating thermal fields through the temperature dependency of the material parameters, in particular the viscosity and the compressibility, affecting both the boundary conditions and spawning additional body forces in the bulk. We also show how even small steady temperature gradients (1 K/mm) induce gradients in compressibility and density that may result in very high streaming velocities (1 mm/s) for moderate acoustic energy densities (100 J/m^3).


title: Relationship between two-level systems and quasi-localized normal modes in glasses

abstract: Tunnelling Two-Level Systems (TLS) dominate the physics of glasses at low temperatures. Yet TLS are extremely rare and it is extremely difficult to directly observe them $\it{in \, silico}$. It is thus crucial to develop simple structural predictors that can provide markers for determining if a TLS is present in a given glass region. It has been speculated that Quasi-Localized vibrational Modes (QLM) are closely related to TLS, and that one can extract information about TLS from QLM. In this work we address this possibility. In particular, we investigate the degree to which a linear or non-linear vibrational mode analysis can predict the location of TLS independently found by energy landscape exploration. We find that even though there is a notable spatial correlation between QLM and TLS, in general TLS are strongly non-linear and their global properties cannot be predicted by a simple normal mode analysis.


title: FaceDet3D: Facial Expressions with 3D Geometric Detail Prediction

abstract: Facial Expressions induce a variety of high-level details on the 3D face geometry. For example, a smile causes the wrinkling of cheeks or the formation of dimples, while being angry often causes wrinkling of the forehead. Morphable Models (3DMMs) of the human face fail to capture such fine details in their PCA-based representations and consequently cannot generate such details when used to edit expressions. In this work, we introduce FaceDet3D, a first-of-its-kind method that generates - from a single image - geometric facial details that are consistent with any desired target expression. The facial details are represented as a vertex displacement map and used then by a Neural Renderer to photo-realistically render novel images of any single image in any desired expression and view. The project website is: http://shahrukhathar.github.io/2020/12/14/FaceDet3D.html


title: Discovering Airline-Specific Business Intelligence from Online Passenger Reviews: An Unsupervised Text Analytics Approach

abstract: To understand the important dimensions of service quality from the passenger's perspective and tailor service offerings for competitive advantage, airlines can capitalize on the abundantly available online customer reviews (OCR). The objective of this paper is to discover company- and competitor-specific intelligence from OCR using an unsupervised text analytics approach. First, the key aspects (or topics) discussed in the OCR are extracted using three topic models - probabilistic latent semantic analysis (pLSA) and two variants of Latent Dirichlet allocation (LDA-VI and LDA-GS). Subsequently, we propose an ensemble-assisted topic model (EA-TM), which integrates the individual topic models, to classify each review sentence to the most representative aspect. Likewise, to determine the sentiment corresponding to a review sentence, an ensemble sentiment analyzer (E-SA), which combines the predictions of three opinion mining methods (AFINN, SentiStrength, and VADER), is developed. An aspect-based opinion summary (AOS), which provides a snapshot of passenger-perceived strengths and weaknesses of an airline, is established by consolidating the sentiments associated with each aspect. Furthermore, a bi-gram analysis of the labeled OCR is employed to perform root cause analysis within each identified aspect. A case study involving 99,147 airline reviews of a US-based target carrier and four of its competitors is used to validate the proposed approach. The results indicate that a cost- and time-effective performance summary of an airline and its competitors can be obtained from OCR. Finally, besides providing theoretical and managerial implications based on our results, we also provide implications for post-pandemic preparedness in the airline industry considering the unprecedented impact of coronavirus disease 2019 (COVID-19) and predictions on similar pandemics in the future.


title: Characterisations of Variant Transfinite Computational Models: Infinite Time Turing, Ordinal Time Turing, and Blum-Shub-Smale machines

abstract: We consider how changes in transfinite machine architecture can sometimes alter substantially their capabilities. We approach the subject by answering three open problems touching on: firstly differing halting time considerations for machines with multiple as opposed to single heads, secondly space requirements, and lastly limit rules. We: 1) use admissibility theory, $\Sigma_{2}$-codes and $\Pi_{3}$-reflection properties in the constructible hierarchy to classify the halting times of ITTMs with multiple independent heads; the same for Ordinal Turing Machines which have $\tmop{On}$ length tapes; 2) determine which admissible lengths of tapes for transfinite time machines with long tapes allow the machine to address each of their cells - a question raised by B. Rin; 3) characterise exactly the strength and behaviour of transfinitely acting Blum-Shub-Smale machines using a $\tmop{Liminf}$ rule on their registers - thereby establishing there is a universal such machine. This is in contradistinction to the machine using a `continuity' rule which fails to be universal.


title: Endogenous inverse demand functions

abstract: In this work we present an equilibrium formulation for price impacts. This is motivated by the Buhlmann equilibrium in which assets are sold into a system of market participants, e.g. a fire sale in systemic risk, and can be viewed as a generalization of the Esscher premium. Existence and uniqueness of clearing prices for the liquidation of a portfolio are studied. We also investigate other desired portfolio properties including monotonicity and concavity. Price per portfolio unit sold is also calculated. In special cases, we study price impacts generated by market participants who follow the exponential utility and power utility.


title: Towards a Two-Tier Hierarchical Infrastructure: An Offline Payment System for Central Bank Digital Currencies

abstract: Digital payments traditionally rely on online communications with several intermediaries such as banks, payment networks, and payment processors in order to authorize and process payment transactions. While these communication networks are designed to be highly available with continuous uptime, there may be times when an end-user experiences little or no access to network connectivity. The growing interest in digital forms of payments has led central banks around the world to explore the possibility of issuing a new type of central-bank money, known as central bank digital currency (CBDC). To facilitate the secure issuance and transfer of CBDC, we envision a CBDC design under a two-tier hierarchical trust infrastructure, which is implemented using public-key cryptography with the central bank as the root certificate authority for generating digital signatures, and other financial institutions as intermediate certificate authorities. One important design feature for CBDC that can be developed under this hierarchical trust infrastructure is an offline capability to create secure point-to-point offline payments through the use of authorized hardware. An offline capability for CBDC as digital cash can create a resilient payment system for consumers and businesses to transact in any situation. We propose an offline payment system (OPS) protocol for CBDC that allows a user to make digital payments to another user while both users are temporarily offline and unable to connect to payment intermediaries (or even the Internet). OPS can be used to instantly complete a transaction involving any form of digital currency over a point-to-point channel without communicating with any payment intermediary, achieving virtually unbounded throughput and real-time transaction latency.


title: Neutrino oscillations and flavor theories

abstract: I discuss neutrino mixing ansatze, such as the generalized Tri-bimaximal and bi-large mixing patterns, and their utility in describing the oscillation data. Unitarity tests and probes of the absolute neutrino mass scale are briefly discussed. A short overview of neutrino mass generation is given. I discuss an orbifold approach to the flavor problem and the resulting implications, e.g. the golden quark-lepton mass relation, neutrinoless double beta decay and neutrino oscillation predictions.


title: Exponential Lower Bounds for Batch Reinforcement Learning: Batch RL can be Exponentially Harder than Online RL

abstract: Several practical applications of reinforcement learning involve an agent learning from past data without the possibility of further exploration. Often these applications require us to 1) identify a near optimal policy or to 2) estimate the value of a target policy. For both tasks we derive \emph{exponential} information-theoretic lower bounds in discounted infinite horizon MDPs with a linear function representation for the action value function even if 1) \emph{realizability} holds, 2) the batch algorithm observes the exact reward and transition \emph{functions}, and 3) the batch algorithm is given the \emph{best} a priori data distribution for the problem class. Our work introduces a new `oracle + batch algorithm' framework to prove lower bounds that hold for every distribution. The work shows an exponential separation between batch and online reinforcement learning.


title: Bounds for zeros of Collatz polynomials, with necessary and sufficient strictness conditions

abstract: In a previous paper, we introduced the Collatz polynomials $P_N(z)$, whose coefficients are the terms of the Collatz sequence of the positive integer $N$. Our work in this paper expands on our previous results, using the Enestr\"om-Kakeya Theorem to tighten our old bounds of the roots of $P_N(z)$ and giving precise conditions under which these new bounds are sharp. In particular, we confirm an experimental result that zeros on the circle $\{z\in\mathbb{C}: |z| = 2\}$ are rare: the set of $N$ such that $P_N(z)$ has a root of modulus 2 is sparse in the natural numbers. We close with some questions for further study.


title: Ripplocations in Layered Materials: Sublinear Scaling and Basal Climb

abstract: The ripplocation is a crystallographic defect which is unique to layered materials, combining nanoscale delamination with the crystallographic slip of a basal dislocation. Here, we have studied basal dislocations and ripplocations, in single and multiple van der Waals layers, using analytical and computational techniques. Expressions for the energetic and structural scaling factors of surface ripplocations are derived, which are in close correspondence to the physics of a classical carpet ruck. Our simulations demonstrate that the lowest-energy structure of dislocation pile-ups in layered materials is the ripplocation, while large dislocation pile-ups in bulk graphite demonstrate multilayer delamination, curvature and voids. This can provide a concise explanation for the large volumetric expansion seen in irradiated graphite.


title: Coupled Maxwell and Time-Dependent Orbital Free Density Functional Calculations

abstract: Coupled Maxwell and time-dependent orbital-free calculations are implemented and tested to describe the interaction of electromagnetic waves and matter. The currents and induced fields predicted by the orbital-free calculations are compared to time-dependent density functional calculations and very good agreement is found for various systems including jellium sheets, jellium spheres, atomistic sheets, and icosahedron clusters.


title: Bandit-based Communication-Efficient Client Selection Strategies for Federated Learning

abstract: Due to communication constraints and intermittent client availability in federated learning, only a subset of clients can participate in each training round. While most prior works assume uniform and unbiased client selection, recent work on biased client selection has shown that selecting clients with higher local losses can improve error convergence speed. However, previously proposed biased selection strategies either require additional communication cost for evaluating the exact local loss or utilize stale local loss, which can even make the model diverge. In this paper, we present a bandit-based communication-efficient client selection strategy UCB-CS that achieves faster convergence with lower communication overhead. We also demonstrate how client selection can be used to improve fairness.


title: Expanding Belnap 2: the dual category in depth

abstract: Bilattices, which provide an algebraic tool for simultaneously modelling knowledge and truth, were introduced by N.D. Belnap in a 1977 paper entitled 'How a computer should think'. Prioritised default bilattices include not only Belnap's four values, for `true' ($t$), `false'($f$), `contradiction' ($\top$) and `no information' ($\bot$), but also indexed families of default values for simultaneously modelling degrees of knowledge and truth. Prioritised default bilattices have applications in a number of areas including artificial intelligence. In our companion paper, we introduced a new family of prioritised default bilattices, $\mathbf J_n$, for $n \in \omega$, with $\mathbf J_0$ being Belnap's seminal example. We gave a duality for the variety $\mathcal V_n$ generated by $\mathbf J_n$, with the objects of the dual category $\mathcal X_n$ being multi-sorted topological structures. Here we study the dual category in depth. We give an axiomatisation of the category $\mathcal X_n$ and show that it is isomorphic to a category $\mathcal Y_n$ of single-sorted topological structures. The objects of $\mathcal Y_n$ are Priestley spaces endowed with a continuous retraction in which the order has a natural ranking. We show how to construct the Priestley dual of the underlying bounded distributive lattice of an algebra in $\mathcal V_n$ via its dual in $\mathcal Y_n$; as an application we show that the size of the free algebra $\mathbf F_{\mathcal V_n}(1)$ is given by a polynomial in $n$ of degree $6$.


title: DeepGamble: Towards unlocking real-time player intelligence using multi-layer instance segmentation and attribute detection

abstract: Annually the gaming industry spends approximately $15 billion in marketing reinvestment. However, this amount is spent without any consideration for the skill and luck of the player. For a casino, an unskilled player could fetch ~4 times more revenue than a skilled player. This paper describes a video recognition system that is based on an extension of the Mask R-CNN model. Our system digitizes the game of blackjack by detecting cards and player bets in real-time and processes decisions they took in order to create accurate player personas. Our proposed supervised learning approach consists of a specialized three-stage pipeline that takes images from two viewpoints of the casino table and does instance segmentation to generate masks on proposed regions of interest. These predicted masks along with derivative features are used to classify image attributes that are passed onto the next stage to assimilate the gameplay understanding. Our end-to-end model yields an accuracy of ~95% for the main bet detection and ~97% for card detection in a controlled environment trained using transfer learning approach with 900 training examples. Our approach is generalizable and scalable and shows promising results in varied gaming scenarios and test data. Such granular level gathered data, helped in understanding player's deviation from optimum strategy and thereby separate the skill of the player from the luck of the game. Our system also assesses the likelihood of card counting by correlating the player's betting pattern to the deck's scaled count. Such a system lets casinos flag fraudulent activity and calculate expected personalized profitability for each player and tailor their marketing reinvestment decisions.


title: Learning to Rationalize for Nonmonotonic Reasoning with Distant Supervision

abstract: The black-box nature of neural models has motivated a line of research that aims to generate natural language rationales to explain why a model made certain predictions. Such rationale generation models, to date, have been trained on dataset-specific crowdsourced rationales, but this approach is costly and is not generalizable to new tasks and domains. In this paper, we investigate the extent to which neural models can reason about natural language rationales that explain model predictions, relying only on distant supervision with no additional annotation cost for human-written rationales. We investigate multiple ways to automatically generate rationales using pre-trained language models, neural knowledge models, and distant supervision from related tasks, and train generative models capable of composing explanatory rationales for unseen instances. We demonstrate our approach on the defeasible inference task, a nonmonotonic reasoning task in which an inference may be strengthened or weakened when new information (an update) is introduced. Our model shows promises at generating post-hoc rationales explaining why an inference is more or less likely given the additional information, however, it mostly generates trivial rationales reflecting the fundamental limitations of neural language models. Conversely, the more realistic setup of jointly predicting the update or its type and generating rationale is more challenging, suggesting an important future direction.


title: Primer AI's Systems for Acronym Identification and Disambiguation

abstract: The prevalence of ambiguous acronyms make scientific documents harder to understand for humans and machines alike, presenting a need for models that can automatically identify acronyms in text and disambiguate their meaning. We introduce new methods for acronym identification and disambiguation: our acronym identification model projects learned token embeddings onto tag predictions, and our acronym disambiguation model finds training examples with similar sentence embeddings as test examples. Both of our systems achieve significant performance gains over previously suggested methods, and perform competitively on the SDU@AAAI-21 shared task leaderboard. Our models were trained in part on new distantly-supervised datasets for these tasks which we call AuxAI and AuxAD. We also identified a duplication conflict issue in the SciAD dataset, and formed a deduplicated version of SciAD that we call SciAD-dedupe. We publicly released all three of these datasets, and hope that they help the community make further strides in scientific document understanding.


title: Acoustic topological circuitry in square and rectangular phononic crystals

abstract: We systematically engineer a series of square and rectangular phononic crystals to create experimental realisations of complex topological phononic circuits. The exotic topological transport observed is wholly reliant upon the underlying structure which must belong to either a square or rectangular lattice system and not to any hexagonal-based structure. The phononic system chosen consists of a periodic array of square steel bars which partitions acoustic waves in water over a broadband range of frequencies (~0.5 MHz). An ultrasonic transducer launches an acoustic pulse which propagates along a domain wall, before encountering a nodal point, from which the acoustic signal partitions towards three exit ports. Numerical simulations are performed to clearly illustrate the highly resolved edge states as well as corroborate our experimental findings. To achieve complete control over the flow of energy, power division and redirection devices are required. The tunability afforded by our designs, in conjunction with the topological robustness of the modes, will result in their assimilation into acoustical devices.


title: Active Learning for Deep Gaussian Process Surrogates

abstract: Deep Gaussian processes (DGPs) are increasingly popular as predictive models in machine learning (ML) for their non-stationary flexibility and ability to cope with abrupt regime changes in training data. Here we explore DGPs as surrogates for computer simulation experiments whose response surfaces exhibit similar characteristics. In particular, we transport a DGP's automatic warping of the input space and full uncertainty quantification (UQ), via a novel elliptical slice sampling (ESS) Bayesian posterior inferential scheme, through to active learning (AL) strategies that distribute runs non-uniformly in the input space -- something an ordinary (stationary) GP could not do. Building up the design sequentially in this way allows smaller training sets, limiting both expensive evaluation of the simulator code and mitigating cubic costs of DGP inference. When training data sizes are kept small through careful acquisition, and with parsimonious layout of latent layers, the framework can be both effective and computationally tractable. Our methods are illustrated on simulation data and two real computer experiments of varying input dimensionality. We provide an open source implementation in the "deepgp" package on CRAN.


title: Calibration of the underground muon detector of the Pierre Auger Observatory

abstract: To obtain direct measurements of the muon content of extensive air showers with energy above $10^{16.5}$ eV, the Pierre Auger Observatory is currently being equipped with an underground muon detector (UMD), consisting of 219 10 $\mathrm{m^2}$-modules, each segmented into 64 scintillators coupled to silicon photomultipliers (SiPMs). Direct access to the shower muon content allows for the study of both of the composition of primary cosmic rays and of high-energy hadronic interactions in the forward direction. As the muon density can vary between tens of muons per m$^2$ close to the intersection of the shower axis with the ground to much less than one per m$^2$ when far away, the necessary broad dynamic range is achieved by the simultaneous implementation of two acquisition modes in the read-out electronics: the binary mode, tuned to count single muons, and the ADC mode, suited to measure a high number of them. In this work, we present the end-to-end calibration of the muon detector modules: first, the SiPMs are calibrated by means of the binary channel, and then, the ADC channel is calibrated using atmospheric muons, detected in parallel to the shower data acquisition. The laboratory and field measurements performed to develop the implementation of the full calibration chain of both binary and ADC channels are presented and discussed. The calibration procedure is reliable to work with the high amount of channels in the UMD, which will be operated continuously, in changing environmental conditions, for several years.


title: Modeling the mixed-morphology supernova remnant IC 443. Origin of its complex morphology and X-ray emission

abstract: The morphology and the distribution of material observed in SNRs reflect the interaction of the SN blast wave with the ambient environment, the physical processes associated with the SN explosion and the internal structure of the progenitor star. IC 443 is a MM SNR located in a quite complex environment: it interacts with a molecular cloud in the NW and SE areas and with an atomic cloud in the NE. In this work we aim at investigating the origin of the complex morphology and multi-thermal X-ray emission observed in SNR IC 443, through the study of the effect of the inhomogeneous ambient medium in shaping its observed structure, and the exploration of the main parameters characterizing the remnant. We developed a 3D HD model for IC 443, which describes the interaction of the SNR with the environment, parametrized in agreement with the results of the multi-wavelength data analysis. We performed an ample exploration of the parameter space describing the initial blast wave and the environment, and the surrounding clouds. From the simulations, we synthesized the X-ray emission maps and spectra and compared them with actual X-ray data collected by XMM-Newton. Our model explains the origin of the complex X-ray morphology of SNR IC 443 in a natural way, being able to reproduce, for the first time, most of the observed features, including the centrally-peaked X-ray morphology (characteristic of MM SNRs) when considering the origin of the explosion at the position where the PWN CXOU J061705.3+222127 was at the time of the explosion. In the model which best reproduces the observations, the mass of the ejecta and the energy of the explosion are $\sim 7 M_\odot$ and $\sim10^{51}$ erg, respectively. From the exploration of the parameter space, we found that the density of the clouds is $n>300$ cm$^{-3}$ and that the age of SNR IC 443 is $\sim8000$ yr.


title: Is solid copper oxalate a spin chain or a mixture of entangled spin pairs?

abstract: Macroscopic assemblies of interacting spins give rise to a broad spectrum of behaviors determined by the spatial arrangement of the magnetic sites and the electronic interactions between them. Compounds of copper (II), in which each copper carries spin $\frac{1}{2}$, exhibit a vast variety of physical properties. For antiferromagnetically coupled spin sites, there are two limiting scenarios: spin chains in which the spins can exhibit a long-range order or a mixture of dimers in which the spins within each pair are entangled but do not communicate with the spins from other dimers. In principle, the two types can be distinguished on the basis of experimental observations and modeling using empirically parameterized effective Hamiltonians, but in practice, ambiguity may persist for decades, as is the case for copper oxalate. Here we use high-level ab initio calculations to establish the validity of the nearest-site Heisenberg model and to predict the interaction strength between the magnetic sites. The computed magnetic susceptibility provides an unambiguous interpretation of magnetic experiments performed throughout half a century, clearly supporting the infinite spin-chain behavior of solid copper oxalate.


title: Understanding graph embedding methods and their applications

abstract: Graph analytics can lead to better quantitative understanding and control of complex networks, but traditional methods suffer from high computational cost and excessive memory requirements associated with the high-dimensionality and heterogeneous characteristics of industrial size networks. Graph embedding techniques can be effective in converting high-dimensional sparse graphs into low-dimensional, dense and continuous vector spaces, preserving maximally the graph structure properties. Another type of emerging graph embedding employs Gaussian distribution-based graph embedding with important uncertainty estimation. The main goal of graph embedding methods is to pack every node's properties into a vector with a smaller dimension, hence, node similarity in the original complex irregular spaces can be easily quantified in the embedded vector spaces using standard metrics. The generated nonlinear and highly informative graph embeddings in the latent space can be conveniently used to address different downstream graph analytics tasks (e.g., node classification, link prediction, community detection, visualization, etc.). In this Review, we present some fundamental concepts in graph analytics and graph embedding methods, focusing in particular on random walk-based and neural network-based methods. We also discuss the emerging deep learning-based dynamic graph embedding methods. We highlight the distinct advantages of graph embedding methods in four diverse applications, and present implementation details and references to open-source software as well as available databases in the Appendix for the interested readers to start their exploration into graph analytics.


title: Traditional IR rivals neural models on the MS MARCO Document Ranking Leaderboard

abstract: This short document describes a traditional IR system that achieved MRR@100 equal to 0.298 on the MS MARCO Document Ranking leaderboard (on 2020-12-06). Although inferior to most BERT-based models, it outperformed several neural runs (as well as all non-neural ones), including two submissions that used a large pretrained Transformer model for re-ranking. We provide software and data to reproduce our results.


title: Dynamics of R-neutral Ramond fields in the D1-D5 SCFT

abstract: We describe the effect of the marginal deformation of the $\cal N = (4, 4)$ superconformal $(T^4)^N /S_N$ orbifold theory on a doublet of R-neutral twisted Ramond fields, in the large-$N$ approximation. Our analysis of their dynamics explores the explicit analytic form of the genus-zero four-point function involving two R-neutral Ramond fields and two deformation operators. We compute this correlation function with two different approaches: the Lunin-Mathur path-integral technique and the stress-tensor method. From its short distance limits, we extract the OPE structure constants and the scaling dimensions of non-BPS fields appearing in the fusion. In the deformed CFT, at second order in the deformation parameter, the two-point function of the $n$-twisted Ramond fields is UV-divergent. We perform an appropriate regularization, together with a renormalization of the undeformed fields, obtaining finite, well-defined corrections to their two-point functions and their bare conformal weights, for $n < N$. The fields with maximal twist $n=N$ remain protected from renormalization, with vanishing anomalous dimensions.


title: Identification of inferential parameters in the covariate-normalized linear conditional logit model

abstract: The conditional logit model is a standard workhorse approach to estimating customers' product feature preferences using choice data. Using these models at scale, however, can result in numerical imprecision and optimization failure due to a combination of large-valued covariates and the softmax probability function. Standard machine learning approaches alleviate these concerns by applying a normalization scheme to the matrix of covariates, scaling all values to sit within some interval (such as the unit simplex). While this type of normalization is innocuous when using models for prediction, it has the side effect of perturbing the estimated coefficients, which are necessary for researchers interested in inference. This paper shows that, for two common classes of normalizers, designated scaling and centered scaling, the data-generating non-scaled model parameters can be analytically recovered along with their asymptotic distributions. The paper also shows the numerical performance of the analytical results using an example of a scaling normalizer.


title: Friedrichs Learning: Weak Solutions of Partial Differential Equations via Deep Learning

abstract: This paper proposes Friedrichs learning as a novel deep learning methodology that can learn the weak solutions of PDEs via a minmax formulation, which transforms the PDE problem into a minimax optimization problem to identify weak solutions. The name "Friedrichs learning" is for highlighting the close relationship between our learning strategy and Friedrichs theory on symmetric systems of PDEs. The weak solution and the test function in the weak formulation are parameterized as deep neural networks in a mesh-free manner, which are alternately updated to approach the optimal solution networks approximating the weak solution and the optimal test function, respectively. Extensive numerical results indicate that our mesh-free method can provide reasonably good solutions to a wide range of PDEs defined on regular and irregular domains in various dimensions, where classical numerical methods such as finite difference methods and finite element methods may be tedious or difficult to be applied.


title: Agglomeration-Based Geometric Multigrid Solvers for Compact Discontinuous Galerkin Discretizations on Unstructured Meshes

abstract: We present a geometric multigrid solver for the Compact Discontinuous Galerkin method through building a hierarchy of coarser meshes using a simple agglomeration method which handles arbitrary element shapes and dimensions. The method is easily extendable to other discontinuous Galerkin discretizations, including the Local DG method and the Interior Penalty method. We demonstrate excellent solver performance for Poisson's equation, provided a flux formulation is used for the operator coarsening and a suitable switch function chosen for the numerical fluxes.