title: Revisiting profile instability of J1022+1001

abstract: Millisecond pulsars in timing arrays can act as probes for gravitational wave detection and improving the solar system ephemerides among several other applications. However, the stability of the integrated pulse profiles can limit the precision of the ephemeris parameters and in turn the applications derived from it. It is thus crucial for the pulsars in the array to have stable integrated pulse profiles. Here we present evidence for long-term profile instability in PSR J1022+1001 which is currently included in the European and Parkes pulsar timing arrays. We apply a new evaluation method to an expanded data set ranging from the Effelsberg Pulsar Observing System back-end used in the 1990s to that of data from the current PSRIX backend at the Effelsberg Radio Telescope. We show that this intrinsic variability in the pulse shape persists over time scales of years. We investigate if systematic instrumental effects like polarisation calibration or signal propagation effects in the interstellar medium causes the observed profile instability. We find that the total variation cannot be fully accounted for by instrumental and propagation effects. This suggests additional intrinsic effects as the origin for the variation. We finally discuss several factors that could lead to the observed behaviour and comment on the consequent implications.


title: Franck-Condon tuning of optical cycling centers by organic functionalization

abstract: Laser induced electronic excitations that spontaneously emit photons and decay directly to the initial ground state ("optical cycling transitions") are used in quantum information and precision measurement for state initialization and readout. To extend this primarily atomic technique to organic compounds, we theoretically investigate optical cycling of alkaline earth phenoxides and their functionalized derivatives. We find that optical cycle leakage due to wavefunction mismatch is low in these species, and can be further suppressed by using chemical substitution to boost the electron withdrawing strength of the aromatic molecular ligand through resonance and induction effects. This provides a straightforward way to use chemical functional groups to construct optical cycling moieties for laser cooling, state preparation, and quantum measurement.


title: The McCoy property in Ohm-Rush algebras

abstract: An Ohm-Rush algebra $R \rightarrow S$ is called *McCoy* if for any zero-divisor $f$ in $S$, its content $c(f)$ has nonzero annihilator in $R$, because McCoy proved this when $S=R[x]$. We answer a question of Nasehpour by giving an example of a faithfully flat Ohm-Rush algebra with the McCoy property that is not a weak content algebra. However, we show that a faithfully flat Ohm-Rush algebra is a weak content algebra iff $R/I \rightarrow S/I S$ is McCoy for all radical (resp. prime) ideals $I$ of $R$. When $R$ is Noetherian (or has the more general \emph{fidel (A)} property), we show that it is equivalent that $R/I \rightarrow S/IS$ is McCoy for all ideals.


title: Towards the Detection of Building Occupancy with Synthetic Environmental Data

abstract: Information about room-level occupancy is crucial to many building-related tasks, such as building automation or energy performance simulation. Current occupancy detection literature focuses on data-driven methods, but is mostly based on small case studies with few rooms. The necessity to collect room-specific data for each room of interest impedes applicability of machine learning, especially data-intensive deep learning approaches, in practice. To derive accurate predictions from less data, we suggest knowledge transfer from synthetic data. In this paper, we conduct an experiment with data from a CO$_2$ sensor in an office room, and additional synthetic data obtained from a simulation. Our contribution includes (a) a simulation method for CO$_2$ dynamics under randomized occupant behavior, (b) a proof of concept for knowledge transfer from simulated CO$_2$ data, and (c) an outline of future research implications. From our results, we can conclude that the transfer approach can effectively reduce the required amount of data for model training.


title: Stochastic and quasi-adiabatic electron heating in quasi-parallel shocks

abstract: Using Magnetospheric Multiscale (MMS) observations at the Earth's quasi-parallel bow shock we demonstrate that electrons are heated by two different mechanisms: a quasi-adiabatic heating process during magnetic field compression, characterized by the isotropic temperature relation $T/B=(T_0/B_0)(B_0/B)^{\alpha}$ with $\alpha=2/3$ when the electron heating function $|\chi_e|<1$, and a stochastic heating process when $|\chi_e|>1$. Both processes are controlled by the value of the stochastic heating function $\chi_j = m_j q_j^{-1} B^{-2}\mathrm{div}(\mathbf{E}_\perp)$ for particles with mass $m_j$ and charge $q_j$ in the electric and magnetic fields $\mathbf{E}$ and $\mathbf{B}$. Test particle simulations are used to show that the stochastic electron heating and acceleration in the studied shock is accomplished by waves at frequencies (0.4 - 5) $f_{ce}$ (electron gyrofrequency) for bulk heating, and waves $f>5\,f_{ce}$ for acceleration of the tail of the distribution function. Stochastic heating can give rise to flat-top electron distribution functions, frequently observed near shocks. It is also shown that obliquely polarized electric fields of electron cyclotron drift (ECD) and ion acoustic instabilities scatter the electrons into the parallel direction and keep the isotropy of the electron distribution. The results reported in this paper may be relevant to electron heating and acceleration at interplanetary shocks and other astrophysical shocks.

categories: physics.space-ph astro-ph.EP astro-ph.HE astro-ph.SR physics.plasm-ph


title: Provable Fictitious Play for General Mean-Field Games

abstract: We propose a reinforcement learning algorithm for stationary mean-field games, where the goal is to learn a pair of mean-field state and stationary policy that constitutes the Nash equilibrium. When viewing the mean-field state and the policy as two players, we propose a fictitious play algorithm which alternatively updates the mean-field state and the policy via gradient-descent and proximal policy optimization, respectively. Our algorithm is in stark contrast with previous literature which solves each single-agent reinforcement learning problem induced by the iterates mean-field states to the optimum. Furthermore, we prove that our fictitious play algorithm converges to the Nash equilibrium at a sublinear rate. To the best of our knowledge, this seems the first provably convergent single-loop reinforcement learning algorithm for mean-field games based on iterative updates of both mean-field state and policy.


title: Machine Learning Enabled Scalable Performance Prediction of Scientific Codes

abstract: We present the Analytical Memory Model with Pipelines (AMMP) of the Performance Prediction Toolkit (PPT). PPT-AMMP takes high-level source code and hardware architecture parameters as input, predicts runtime of that code on the target hardware platform, which is defined in the input parameters. PPT-AMMP transforms the code to an (architecture-independent) intermediate representation, then (i) analyzes the basic block structure of the code, (ii) processes architecture-independent virtual memory access patterns that it uses to build memory reuse distance distribution models for each basic block, (iii) runs detailed basic-block level simulations to determine hardware pipeline usage. PPT-AMMP uses machine learning and regression techniques to build the prediction models based on small instances of the input code, then integrates into a higher-order discrete-event simulation model of PPT running on Simian PDES engine. We validate PPT-AMMP on four standard computational physics benchmarks, finally present a use case of hardware parameter sensitivity analysis to identify bottleneck hardware resources on different code inputs. We further extend PPT-AMMP to predict the performance of scientific application (radiation transport), SNAP. We analyze the application of multi-variate regression models that accurately predict the reuse profiles and the basic block counts. The predicted runtimes of SNAP when compared to that of actual times are accurate.


title: Classical Thermodynamics Revisited: A Systems and Control Perspective

abstract: The purpose of this paper is two-fold. First, to make clear (and de-mystify) the basic concepts of classical thermodynamics, and thus to enable the integration of thermodynamics within systems modeling and control. Second, to demonstrate that systems and control theory provides a natural context for the formulation and understanding of classical thermodynamics. This is not so surprising since classical thermodynamics, firmly rooted in engineering with questions such as the maximal efficiency of steam engines, deals from the very start with systems in interaction with their surrounding (by heat flow, mechanical work, flow of matter, etc.). In particular, it will be shown that dissipativity theory is key in the formulation and interpretation of the First and Second Law of thermodynamics. Also a geometric view on the state properties and the dynamics of thermodynamic systems will be emphasized, thereby unifying and simplifying different representations of thermodynamic systems. On the other hand, I will also argue that thermodynamics motivates paradigm shifts within systems and control; in particular, the use of non-minimal state space formulations, and a geometric view on them. Furthermore, while systems and control theory has been primarily based on linear systems with quadratic cost criteria, in line with basic system models in electrical and mechanical engineering (RLC-circuits, mass-spring-damper systems, etc.), thermodynamics necessitates to go beyond this linear-quadratic paradigm.


title: Metal-Poor Stars Observed with the Southern African Large Telescope

abstract: We present the first release of a large-scale study of relatively bright (V < 13.5) metal-poor stars observed with the Southern African Large Telescope (SALT), based on high-resolution spectra of 50 stars with a resolving power of R ~ 40,000 and S/N ~ 20 per pixel at 4300 Angstrom. The elemental abundances of C, Sr, Ba, and Eu are reported, as well as several alpha-elements (Mg, Ca, Sc, Ti, V) and iron-peak elements (Mn, Co, Ni, Zn). We find a diverse array of abundance patterns, including several consistent with the signatures of carbon-enhanced metal-poor CEMP-i and CEMP-r stars. We find that 15 of 50 (30%) are carbon enhanced (with [C/Fe] >+ 0.70), and that a large fraction (26 of 50, 52%) are enhanced in r-process elements, among the r-process-enhanced stars, five are strongly enhanced r-II ([Eu/Fe] >+ 1.0) stars (two of which are newly discovered) and 21 are newly discovered moderately enhanced r-I (+0.3 <= [Eu/Fe] <=+ 1..0) stars. There are eight stars in our sample that, on the basis of their abundances and kinematics, are possible members of the metal-weak thick-disk population. We also compare our measured abundances to progenitor-enrichment models, and find that the abundance patterns for the majority of our stars can be attributed to a single (rather than multiple) enrichment event.


title: Gravitational form factors and mechanical properties of proton in a light-front quark-diquark model

abstract: We obtain the gravitational form factors (GFFs) and investigate their applications for the description of the mechanical properties, i.e., the distributions of pressures, shear forces inside proton, and the mechanical radius, in a light-front quark-diquark model constructed by the soft-wall AdS/QCD. The GFFs, $A(Q^2)$ and $B(Q^2)$ are found to be consistent with the lattice QCD, while the qualitative behavior of the $D$-term form factor is in agreement with the extracted data from the deeply virtual Compton scattering (DVCS) experiments at JLab, the lattice QCD, and the predictions of different phenomenological models. The pressure and shear force distributions are also consistent with the results of different models.


title: Affine-Invariant Robust Training

abstract: The field of adversarial robustness has attracted significant attention in machine learning. Contrary to the common approach of training models that are accurate in average case, it aims at training models that are accurate for worst case inputs, hence it yields more robust and reliable models. Put differently, it tries to prevent an adversary from fooling a model. The study of adversarial robustness is largely focused on $\ell_p-$bounded adversarial perturbations, i.e. modifications of the inputs, bounded in some $\ell_p$ norm. Nevertheless, it has been shown that state-of-the-art models are also vulnerable to other more natural perturbations such as affine transformations, which were already considered in machine learning within data augmentation. This project reviews previous work in spatial robustness methods and proposes evolution strategies as zeroth order optimization algorithms to find the worst affine transforms for each input. The proposed method effectively yields robust models and allows introducing non-parametric adversarial perturbations.


title: The effects of rotation on the lithium depletion of G- and K-dwarfs in Messier 35

abstract: New fibre spectroscopy and radial velocities from the WIYN telescope are used to measure photospheric lithium in 242 high-probability, zero-age-main-sequence (ZAMS) F- to K-type members of the rich cluster M35. Combining these with published rotation periods, the connection between lithium depletion and rotation is studied in unprecedented detail. At $T_{\rm eff}<5500$ K there is a strong relationship between faster rotation and less Li depletion, although with a dispersion larger than measurement uncertainties. Components of photometrically identified binary systems follow the same relationship. A correlation is also established between faster rotation rate (or smaller Rossby number), decreased Li depletion and larger stellar radius at a given $T_{\rm eff}$. These results support models where starspots and interior magnetic fields lead to inflated radii and reduced Li depletion during the pre main sequence (PMS) phase for the fastest rotators. However, the data are also consistent with the idea that all stars suffered lower levels of Li depletion than predicted by standard PMS models, perhaps because of deficiencies in those models or because saturated levels of magnetic activity suppress Li depletion equally in PMS stars of similar $T_{\rm eff}$ regardless of rotation rate, and that slower rotators subsequently experience more mixing and post-PMS Li depletion.


title: Adaptive spectral density estimation by model selection under local differential privacy

abstract: We study spectral density estimation under local differential privacy. Anonymization is achieved through truncation followed by Laplace perturbation. We select our estimator from a set of candidate estimators by a penalized contrast criterion. This estimator is shown to attain nearly the same rate of convergence as the best estimator from the candidate set. A key ingredient of the proof are recent results on concentration of quadratic forms in terms of sub-exponential random variables obtained in arXiv:1903.05964. We illustrate our findings in a small simulation study.


title: Covariance Kernel of Linear Spectral Statistics for Half-Heavy tailed Wigner Matrices

abstract: In this paper we analyze the covariance kernel of the Gaussian process that arises as the limit of fluctuations of linear spectral statistics for Wigner matrices with a few moments. More precisely, the process we study here corresponds to Hermitian matrices with independent entries that have $\alpha$ moments for $2<\alpha < 4$. We obtain a closed form $\alpha$-dependent expression for the covariance of the limiting process resulting from fluctuations of the Stieltjes transform by explicitly integrating the known double Laplace transform integral formula obtained in the literature. We then express the covariance as an integral kernel acting on bounded continuous test functions. The resulting formulation allows us to offer a heuristic interpretation of the impact the typical large eigenvalues of this matrix ensemble have on the covariance structure.


title: Hybrid Beamforming in 5G mmWave Networks: a Full-stack Perspective

abstract: This paper studies the cross-layer challenges and performance of Hybrid Beamforming (HBF) and Multi-User Multiple-Input Multiple-Output (MU-MIMO) in 5G millimeter wave (mmWave) cellular networks with full-stack TCP/IP traffic and MAC scheduling. While previous research on HBF and MU-MIMO has focused on link-level analysis of full-buffer transmissions, this work reveals the interplay between HBF techniques and the higher layers of the protocol stack. To this aim, prior work on full stack simulation of mmWave cellular network has been extended by including the modeling of MU-MIMO and HBF. Our results reveal novel relations between the networking layers and the HBF MU-MIMO performance in the physical layer. Particularly, throughput can be increased in 5G networks by means of Spatial Division Multiple Access (SDMA). However, in order to achieve such benefits it is necessary to take into account certain trade-offs and the implementation complexity of a full-stack HBF solution.


title: MOBSTER -- V: Discovery of a magnetic companion star to the magnetic $\beta$ Cep pulsator HD 156424

abstract: HD 156424 (B2 V) is a little-studied magnetic hot star in the Sco OB4 association, previously noted to display both high-frequency radial velocity (RV) variability and magnetospheric H$\alpha$ emission. We have analysed the TESS light curve, and find that it is a $\beta$ Cep pulsator with 11 detectable frequencies, 4 of which are independent $p$-modes. The strongest frequency is also detectable in RVs from ground-based high-resolution spectroscopy. RVs also show a long-term variation, suggestive of orbital motion with a period of $\sim$years; significant differences in the frequencies determined from TESS and RV datasets are consistent with a light-time effect from orbital motion. Close examination of the star's spectrum reveals the presence of a spectroscopic companion, however as its RV is not variable it cannot be responsible for the orbital motion and we therefore infer that the system is a hierarchical triple with a so-far undetected third star. Reanalysis of LSD profiles from ESPaDOnS and HARPSpol spectropolarimetry reveals the surprising presence of a strong magnetic field in the companion star, with $\langle B_z \rangle$ about $+1.5$ kG as compared to $\langle B_z \rangle \sim -0.8$ kG for the primary. HD 156424 is thus the second hot binary with two magnetic stars. We are unable to identify a rotational period for HD 156424A. The magnetospheric H$\alpha$ emission appears to originate around HD 156424B. Using H$\alpha$, as well as other variable spectral lines, we determine a period of about 0.52 d, making HD 156424B one of the most rapidly rotating magnetic hot stars.


title: AFLOW-XtalFinder: a reliable choice to identify crystalline prototypes

abstract: The accelerated growth rate of repository entries in crystallographic databases makes it arduous to identify and classify their prototype structures. The open-source AFLOW-XtalFinder package was developed to solve this problem. It symbolically maps structures into standard designations following the AFLOW Prototype Encyclopedia and calculates the internal degrees of freedom consistent with the International Tables for Crystallography. To ensure uniqueness, structures are analyzed and compared via symmetry, local atomic geometries, and crystal mapping techniques, simultaneously grouping them by similarity. The software i. distinguishes distinct crystal prototypes and atom decorations, ii. determines equivalent spin configurations, iii. reveals compounds with similar properties, and iv. guides the discovery of unexplored materials. The operations are accessible through a Python module ready for workflows, and through command line syntax. All the 4+ million compounds in the AFLOW.org repositories are mapped to their ideal prototype, allowing users to search database entries via symbolic structure-type. Furthermore, 15,000 unique structures - sorted by prevalence - are extracted from the AFLOW-ICSD catalog to serve as future prototypes in the Encyclopedia.


title: Fictitious play in zero-sum stochastic games

abstract: We present a novel variant of fictitious play dynamics combining classical fictitious play with Q-learning for stochastic games and analyze its convergence properties in two-player zero-sum stochastic games. Our dynamics involves players forming beliefs on the opponent strategy and their own continuation payoff (Q-function), and playing a greedy best response by using the estimated continuation payoffs. Players update their beliefs from observations of opponent actions. A key property of the learning dynamics is that update of the beliefs on Q-functions occurs at a slower timescale than update of the beliefs on strategies. We show both in the model-based and model-free cases (without knowledge of player payoff functions and state transition probabilities), the beliefs on strategies converge to a stationary mixed Nash equilibrium of the zero-sum stochastic game.


title: Gender domain adaptation for automatic speech recognition task

abstract: This paper is focused on the finetuning of acoustic models for speaker adaptation goals on a given gender. We pretrained the Transformer baseline model on Librispeech-960 and conduct experiments with finetuning on the gender-specific test subsets and. In general, we do not obtain essential WER reduction by finetuning techniques by this approach. We achieved up to ~5% lower word error rate on the male subset and 3% on the female subset if the layers in the encoder and decoder are not frozen, but the tuning is started from the last checkpoints. Moreover, we adapted our base model on the full L2 Arctic dataset of accented speech and fine-tuned it for particular speakers and male and female genders separately. The models trained on the gender subsets obtained 1-2% higher accuracy when compared to the model tuned on the whole L2 Arctic dataset. Finally, we tested the concatenation of the pretrained x-vector voice embeddings and embeddings from a conventional encoder, but its gain in accuracy is not significant.


title: Ensemble Hyperspectral Band Selection for Detecting Nitrogen Status in Grape Leaves

abstract: The large data size and dimensionality of hyperspectral data demands complex processing and data analysis. Multispectral data do not suffer the same limitations, but are normally restricted to blue, green, red, red edge, and near infrared bands. This study aimed to identify the optimal set of spectral bands for nitrogen detection in grape leaves using ensemble feature selection on hyperspectral data from over 3,000 leaves from 150 Flame Seedless table grapevines. Six machine learning base rankers were included in the ensemble: random forest, LASSO, SelectKBest, ReliefF, SVM-RFE, and chaotic crow search algorithm (CCSA). The pipeline identified less than 0.45% of the bands as most informative about grape nitrogen status. The selected violet, yellow-orange, and shortwave infrared bands lie outside of the typical blue, green, red, red edge, and near infrared bands of commercial multispectral cameras, so the potential improvement in remote sensing of nitrogen in grapevines brought forth by a customized multispectral sensor centered at the selected bands is promising and worth further investigation. The proposed pipeline may also be used for application-specific multispectral sensor design in domains other than agriculture.


title: Regular black holes with stable cores

abstract: Non-singular black hole geometries typically come with two spacetime horizons: an (outer) event horizon and an (inner) Cauchy horizon. This nurtures the speculation that they may be subject to a mass-inflation effect which renders the Cauchy horizon unstable. We analyze the dynamics associated with spherically symmetric, regular black holes taking the full backreaction between the infalling matter and geometry into account. On this basis, we identify the crucial features taming the growth of the mass function and diminishing the curvature singularity at the Cauchy horizon. It is demonstrated explicitly that the regular black hole solutions proposed by Hayward and obtained from Asymptotic Safety satisfy these properties.


title: A low discrepancy sequence on graphs

abstract: Many applications such as election forecasting, environmental monitoring, health policy, and graph based machine learning require taking expectation of functions defined on the vertices of a graph. We describe a construction of a sampling scheme analogous to the so called Leja points in complex potential theory that can be proved to give low discrepancy estimates for the approximation of the expected value by the impirical expected value based on these points. In contrast to classical potential theory where the kernel is fixed and the equilibrium distribution depends upon the kernel, we fix a probability distribution and construct a kernel (which represents the graph structure) for which the equilibrium distribution is the given probability distribution. Our estimates do not depend upon the size of the graph.


title: All for One and One for All: Improving Music Separation by Bridging Networks

abstract: This paper proposes several improvements for music separation with deep neural networks (DNNs), namely a multi-domain loss (MDL) and two combination schemes. First, by using MDL we take advantage of the frequency and time domain representation of audio signals. Next, we utilize the relationship among instruments by jointly considering them. We do this on the one hand by modifying the network architecture and introducing a CrossNet structure. On the other hand, we consider combinations of instrument estimates by using a new combination loss (CL). MDL and CL can easily be applied to many existing DNN-based separation methods as they are merely loss functions which are only used during training and which do not affect the inference step. Experimental results show that the performance of Open-Unmix (UMX), a well-known and state-of-the-art open source library for music separation, can be improved by utilizing our above schemes. Our modifications of UMX are open-sourced together with this paper.


title: Gamma-Ray Burst Triangulation with a Near-Earth Network

abstract: We study the characteristics of Near-Earth-Networks (NENs) of gamma-ray burst (GRB) detectors, with the objective of defining a network with all-sky, full-time localization capability for multi-messenger astrophysics. We show that a minimum network consisting of 9 identical spacecraft in two orbits with different inclinations provides a good combination of sky coverage with several-degree localization accuracy with detector areas of 100 cm$^2$. In order to achieve this, careful attention must be paid to systematics. This includes accurate photon timing ($\sim$ 0.1 ms), good energy resolution ($\sim$ 10\%), and reduction of Earth albedo, which are all within current capabilities. Such a network can be scaled in both the number and size of detectors to produce increased accuracy. We introduce a new method of localization which does not rely on on-board trigger systems or on the cross-correlation of time histories, but rather, in ground processing, tests positions over the entire sky and assigns probabilities to them to detect and localize events. We demonstrate its capabilities with simulations. If the NEN spacecraft can downlink at least several hundred time- and energy-tagged events per second, and the data can be ground-processed as they are received, it can in principle derive GRB positions in near-real time over the entire sky.


title: No MCMC for me: Amortized sampling for fast and stable training of energy-based models

abstract: Energy-Based Models (EBMs) present a flexible and appealing way to represent uncertainty. Despite recent advances, training EBMs on high-dimensional data remains a challenging problem as the state-of-the-art approaches are costly, unstable, and require considerable tuning and domain expertise to apply successfully. In this work, we present a simple method for training EBMs at scale which uses an entropy-regularized generator to amortize the MCMC sampling typically used in EBM training. We improve upon prior MCMC-based entropy regularization methods with a fast variational approximation. We demonstrate the effectiveness of our approach by using it to train tractable likelihood models. Next, we apply our estimator to the recently proposed Joint Energy Model (JEM), where we match the original performance with faster and stable training. This allows us to extend JEM models to semi-supervised classification on tabular data from a variety of continuous domains.


title: Entropy production in exactly solvable systems

abstract: The rate of entropy production by a stochastic process quantifies how far it is from thermodynamic equilibrium. Equivalently, entropy production captures the degree to which detailed balance and time-reversal symmetry are broken. Despite abundant references to entropy production in the literature and its many applications in the study of non-equilibrium stochastic particle systems, a comprehensive list of typical examples illustrating the fundamentals of entropy production is lacking. Here, we present a brief, self-contained review of entropy production and calculate it from first principles in a catalogue of exactly solvable setups, encompassing both discrete- and continuous-state Markov processes, as well as single- and multiple-particle systems. The examples covered in this work provide a stepping stone for further studies on entropy production of more complex systems, such as many-particle active matter, as well as a benchmark for the development of alternative mathematical formalisms.


title: A gauge invariant order parameter for monopole condensation in $QCD$ vacuum

abstract: In this paper we improve the existing order parameter for monopole condensation in gauge theory vacuum, making it gauge-invariant from scratch and free of the spurious infrared problems which plagued the old one. Computing the new parameter on the lattice will unambiguously detect weather dual superconductivity is the mechanism for color confinement. As a byproduct we relate confinement to the existence of a finite correlation length in the gauge-invariant correlator of chromo-electric field strengths.


title: Domain walls and M2-branes partition functions: M-theory and ABJM Theory

abstract: We study the BPS counting functions (free energies) of the M-string configurations. We consider separated M5-branes along with M2-branes stretched between them, with M5-branes acting as domain walls interpolating different configurations of M2-branes. We find recursive structure in the free energies of these configurations. The M-string degrees of freedom on the domain walls are interpreted in terms of a pair of interacting supersymmetric WZW models. We also compute the elliptic genus of the M-string in a toy model of the ABJM theory and compare it with the M-theory computation.


title: S0-2 star, G1- and G2-objects and flaring activity of the Milky Way's Galactic Center black hole in 2019

abstract: In 2019, the Galactic center black hole Sgr A* produced an unusually high number of bright near-infrared flares, including the brightest-ever detected flare (Do et al 2019, Gravity Collaboration 2020). We propose that this activity was triggered by the near simultaneous infall of material shed by G1 and G2 objects due to their interaction with the background accretion flow. We discuss mechanisms by which S-stars and G-objects shed material, and estimate both the quantity of material and the infall time to reach the black hole.


title: Duff: A Dataset-Distance-Based Utility Function Family for the Exponential Mechanism

abstract: We propose and analyze a general-purpose dataset-distance-based utility function family, Duff, for differential privacy's exponential mechanism. Given a particular dataset and a statistic (e.g., median, mode), this function family assigns utility to a possible output o based on the number of individuals whose data would have to be added to or removed from the dataset in order for the statistic to take on value o. We show that the exponential mechanism based on Duff often offers provably higher fidelity to the statistic's true value compared to existing differential privacy mechanisms based on smooth sensitivity. In particular, Duff is an affirmative answer to the open question of whether it is possible to have a noise distribution whose variance is proportional to smooth sensitivity and whose tails decay at a faster-than-polynomial rate. We conclude our paper with an empirical evaluation of the practical advantages of Duff for the task of computing medians.


title: Results of the further analysis of Tien-Shan array data on the energy spectrum of primary cosmic rays at 2x10$^{13}$ - 3x10$^{17}$ eV

abstract: The energy spectrum of primary cosmic rays at energies between at 2x10$^{13}$ - 3x10$^{17}$ eV is presented according to data from the Tien Shan array on the basis of the detection of the number of electrons in extensive air showers. In the energy range 5x10$^{15}$ - 3x10$^{17}$ eV, the spectrum was obtained by means of the HADRON array and was extended to the region of lower energies from 2x10$^{13}$ eV on the basis of the results of an individual experiment. The changes in the slope of the spectrum in the energy range of 10$^{16}$ - 3x10$^{17}$ eV and a feature of this spectrum at about 1017 eV are analyzed in detail and are described. The spectrum in question is compared with the results obtained at some other arrays.


title: Randomized Overdrive Neural Networks

abstract: By processing audio signals in the time-domain with randomly weighted temporal convolutional networks (TCNs), we uncover a wide range of novel, yet controllable overdrive effects. We discover that architectural aspects, such as the depth of the network, the kernel size, the number of channels, the activation function, as well as the weight initialization, all have a clear impact on the sonic character of the resultant effect, without the need for training. In practice, these effects range from conventional overdrive and distortion, to more extreme effects, as the receptive field grows, similar to a fusion of distortion, equalization, delay, and reverb. To enable use by musicians and producers, we provide a real-time plugin implementation. This allows users to dynamically design networks, listening to the results in real-time. We provide a demonstration and code at https://csteinmetz1.github.io/ronn.


title: On ribbon graphs and virtual links

abstract: We introduce a new equivalence relation on decorated ribbon graphs, and show that its equivalence classes directly correspond to virtual links. We demonstrate how this correspondence can be used to convert any invariant of virtual links into an invariant of ribbon graphs, and vice versa.


title: Deterministic Identification Over Channels With Power Constraints

abstract: The identification capacity is developed without randomization at neither the encoder nor the decoder. In particular, full characterization is established for the deterministic identification (DI) capacity for the Gaussian channel and for the general discrete memoryless channel (DMC) with and without constraints. Originally, Ahlswede and Dueck established the identification capacity with local randomness given at the encoder, resulting in a double exponential number of messages in the block length. In the deterministic setup, the number of messages scales exponentially, as in Shannon's transmission paradigm, but the achievable identification rates can be significantly higher than those of the transmission rates. Ahlswede and Dueck further stated a capacity result for the deterministic setting of a DMC, but did not provide an explicit proof. In this paper, a detailed proof is given for both the Gaussian channel and the general DMC. The DI capacity of a Gaussian channel is infinite regardless of the noise.


title: Two faces of Hawking radiation and thin-shell emission: pair-creation vs. tunneling

abstract: We first revisit Hartle and Hawking's path integral derivation of Hawking radiation. In the first point of view, we interpret that a particle-antiparticle pair is created and the negative energy antiparticle falls into the black hole. On the other point of view, a particle inside the horizon, or beyond the Einstein-Rosen bridge, tunnels to outside the horizon, where this computation requires the analytic continuation of the time. These two faces of the Hawking radiation process can be extended to not only particles but also fields. As a concrete example, we study the thin-shell tunneling process; by introducing the antishell as a negative tension shell, we can give the consistent interpretation for two pictures, where one is a tunneling from inside to outside the horizon using instantons, while the other is a shell-antishell pair-creation. This shows that the Euclidean path integral indeed carries vast physical implications not only for perturbative, but also for non-perturbative processes.


title: Raising type twisted Pieri formulas for Jack polynomials and their applications to interpolation Jack polynomials

abstract: We propose new Pieri type formulas for Jack polynomials, which is another kind of Pieri type formulas than the ones in the previous paper (G. Shibukawa, arXiv:2004.12875). From these new Pieri type formulas, we give yet another proof of difference and Pieri formulas for interpolation Jack polynomials. Further, we also generalize a falling type twisted Pieri formula to the binomial type polynomials including Jack and multivariate Bernoulli polynomials.


title: Ultra-bright Quantum Photon Sources on Chip

abstract: Quantum photon sources of high rate, brightness, and purity are increasingly desirable as quantum information systems are quickly scaled up and applied to many fields. Using a periodically poled lithium niobate microresonator on chip, we demonstrate photon-pair generation at high rates of 8.5 MHz and 36.3 MHz using only 3.4-$\mu$W and 13.4-$\mu$W pump power, respectively, marking orders of magnitude improvement over the state-of-the-art. The measured coincidence to accidental ratio is well above 100 at those high rates and reaches $14,682\pm 4427$ at a lower pump power. The same chip enables heralded single-photon generation at tens of megahertz rates, each with low auto-correlation $g^{(2)}_{H}(0)=0.008$ and $0.097$ for the microwatt pumps. Such distinct performance, facilitated by the chip device's noiseless and giant optical nonlinearity, will contribute to the forthcoming pervasive adoption of quantum optical information technologies.


title: Betelgeuse scope: Single-mode-fibers-assisted optical interferometer design for dedicated stellar activity monitoring

abstract: Betelgeuse has gone through a sudden shift in its brightness and dimmed mysteriously. This is likely caused by a hot blob of plasma ejected from Betelgeuse and then cooled to obscuring dust. If true, it is a remarkable opportunity to directly witness the formation of dust around a red supergiant star. Today's optical telescope facilities are not optimized for time-evolution monitoring of the Betelgeuse surface, so in this work, we propose a low-cost optical interferometer. The facility will consist of $12 \times 4$ inch optical telescopes mounted on the surface of a large radio dish for interferometric imaging; polarization-maintaining single-mode fibers will carry the coherent beams from the individual optical telescopes to an all-in-one beam combiner. A fast steering mirror assisted fiber injection system guides the flux into fibers. A metrology system senses vibration-induced piston errors in optical fibers, and these errors are corrected using fast-steering delay lines. We will present the design.


title: Nonstationary Reinforcement Learning with Linear Function Approximation

abstract: We consider reinforcement learning (RL) in episodic Markov decision processes (MDPs) with linear function approximation under drifting environment. Specifically, both the reward and state transition functions can evolve over time but their total variations do not exceed a $\textit{variation budget}$. We first develop $\texttt{LSVI-UCB-Restart}$ algorithm, an optimistic modification of least-squares value iteration with periodic restart, and bound its dynamic regret when variation budgets are known. Then we propose a parameter-free algorithm $\texttt{Ada-LSVI-UCB-Restart}$ that extends to unknown variation budgets. We also derive the first minimax dynamic regret lower bound for nonstationary linear MDPs and as a byproduct establish a minimax regret lower bound for linear MDPs unsolved by Jin et al. (2020). Finally, we provide numerical experiments to demonstrate the effectiveness of our proposed algorithms.


title: Query-Key Normalization for Transformers

abstract: Low-resource language translation is a challenging but socially valuable NLP task. Building on recent work adapting the Transformer's normalization to this setting, we propose QKNorm, a normalization technique that modifies the attention mechanism to make the softmax function less prone to arbitrary saturation without sacrificing expressivity. Specifically, we apply $\ell_2$ normalization along the head dimension of each query and key matrix prior to multiplying them and then scale up by a learnable parameter instead of dividing by the square root of the embedding dimension. We show improvements averaging 0.928 BLEU over state-of-the-art bilingual benchmarks for 5 low-resource translation pairs from the TED Talks corpus and IWSLT'15.


title: Dual Inference for Improving Language Understanding and Generation

abstract: Natural language understanding (NLU) and Natural language generation (NLG) tasks hold a strong dual relationship, where NLU aims at predicting semantic labels based on natural language utterances and NLG does the opposite. The prior work mainly focused on exploiting the duality in model training in order to obtain the models with better performance. However, regarding the fast-growing scale of models in the current NLP area, sometimes we may have difficulty retraining whole NLU and NLG models. To better address the issue, this paper proposes to leverage the duality in the inference stage without the need of retraining. The experiments on three benchmark datasets demonstrate the effectiveness of the proposed method in both NLU and NLG, providing the great potential of practical usage.


title: Entropic Causal Inference for Neurological Applications

abstract: The ultimate goal of cognitive neuroscience is to understand the mechanistic neural processes underlying the functional organization of the brain. Key to this study is understanding structure of both the structural and functional connectivity between anatomical regions. In this paper we follow previous work in developing a simple dynamical model of the brain by simulating its various regions as Kuramoto oscillators whose coupling structure is described by a complex network. However in our simulations rather than generating synthetic networks, we simulate our synthetic model but coupled by a real network of the anatomical brain regions which has been reconstructed from diffusion tensor imaging (DTI) data. By using an information theoretic approach that defines direct information flow in terms of causation entropy (CSE), we show that we can more accurately recover the true structural network than either of the popular correlation or LASSO regression techniques. We demonstrate the effectiveness of our method when applied to data simulated on the realistic DTI network, as well as on randomly generated small-world and Erd\"os-R\'enyi (ER) networks.


title: Stochastically forced ensemble dynamic mode decomposition for forecasting and analysis of near-periodic systems

abstract: Time series forecasting remains a central challenge problem in almost all scientific disciplines. We introduce a novel load forecasting method in which observed dynamics are modeled as a forced linear system using Dynamic Mode Decomposition (DMD) in time delay coordinates. Central to this approach is the insight that grid load, like many observables on complex real-world systems, has an "almost-periodic" character, i.e., a continuous Fourier spectrum punctuated by dominant peaks, which capture regular (e.g., daily or weekly) recurrences in the dynamics. The forecasting method presented takes advantage of this property by (i) regressing to a deterministic linear model whose eigenspectrum maps onto those peaks, and (ii) simultaneously learning a stochastic Gaussian process regression (GPR) process to actuate this system. Our forecasting algorithm is compared against state-of-the-art forecasting techniques not using additional explanatory variables and is shown to produce superior performance. Moreover, its use of linear intrinsic dynamics offers a number of desirable properties in terms of interpretability and parsimony. Results are presented for a test case using load data from an electrical grid. Load forecasting is an essential challenge in power systems engineering, with major implications for real-time control, pricing, maintenance, and security decisions.


title: Evaluating the Effectiveness of Efficient Neural Architecture Search for Sentence-Pair Tasks

abstract: Neural Architecture Search (NAS) methods, which automatically learn entire neural model or individual neural cell architectures, have recently achieved competitive or state-of-the-art (SOTA) performance on variety of natural language processing and computer vision tasks, including language modeling, natural language inference, and image classification. In this work, we explore the applicability of a SOTA NAS algorithm, Efficient Neural Architecture Search (ENAS) (Pham et al., 2018) to two sentence pair tasks, paraphrase detection and semantic textual similarity. We use ENAS to perform a micro-level search and learn a task-optimized RNN cell architecture as a drop-in replacement for an LSTM. We explore the effectiveness of ENAS through experiments on three datasets (MRPC, SICK, STS-B), with two different models (ESIM, BiLSTM-Max), and two sets of embeddings (Glove, BERT). In contrast to prior work applying ENAS to NLP tasks, our results are mixed -- we find that ENAS architectures sometimes, but not always, outperform LSTMs and perform similarly to random architecture search.


title: Imaging evidence for solar wind outflows originating from a CME footpoint

abstract: We report on the Atmospheric Imaging Assembly (AIA) observations of plasma outflows originating in a coronal dimming during the 2015 April 28th filament eruption. After the filament started to erupt, two flare ribbons formed, one of which had a well-visible hook enclosing a core (twin) dimming region. Along multiple funnels located in this dimming, a motion of plasma directed outwards started to be visible in the 171 and 193 filter channels of the instrument. In time-distance diagrams, this motion generated a strip-like pattern, which lasted for more than five hours and which characteristics did not change along the funnel. We therefore suggest the motion to be a signature of outflows corresponding to velocities ranging between $\approx70$ and 140 km s$^{-1}$. Interestingly, the pattern of the outflows as well as their velocities were found to be similar to those we observed in a neighboring ordinary coronal hole. Therefore, the outflows were most likely a signature of a CME-induced slow solar wind flowing along the open-field structures rooted in the dimming region. Further, the evolution of the hook encircling the dimming region was examined in the context of the latest predictions imposed for the three-dimensional magnetic reconnection. The observations indicate that the filament's footpoints were, during their transformation to the dimming region, reconnecting with surrounding canopies. To our knowledge, our observations present the first imaging evidence for outflows of plasma from a dimming region.


title: Blow-up of radial solutions for the intercritical inhomogeneous NLS equation

abstract: We consider the inhomogeneous nonlinear Schr\"odinger (INLS) equation in $\mathbb{R}^N$ $$i \partial_t u +\Delta u +|x|^{-b} |u|^{2\sigma}u = 0,$$ where $N\geq 3$, $0<b<\min\left\{\frac{N}{2},2\right\}$ and $\frac{2-b}{N}<\sigma<\frac{2-b}{N-2}$. The scaling invariant Sobolev space is $\dot{H}^{s_c}$ with $s_c=\frac{N}{2}-\frac{2-b}{2\sigma}$. The restriction on $\sigma$ implies $0<s_c<1$ and the equation is called intercritical (i.e. mass-supercritical and energy-subcritical). Let $u_0\in \dot H^{s_c}\cap \dot H^1$ be a radial initial data and $u(t)$ the corresponding solution to the INLS equation. We first show that if $E[u_0]\leq 0$, then the maximal time of existence of the solution $u(t)$ is finite. Also, for all radially symmetric solution of the INLS equation with finite maximal time of existence $T^{\ast}>0$, then $\limsup_{t\rightarrow T^{\ast}}\|u(t)\|_{\dot H^{s_c}}=+\infty$. Moreover, under an additional assumption and recalling that $\dot{H}^{s_c} \subset L^{\sigma_c}$ with $\sigma_c=\frac{2N\sigma}{2-b}$, we can in fact deduce, for some $\gamma=\gamma(N,\sigma,b)>0$, the following lower bound for the blow-up rate $$c\|u(t)\|_{\dot H^{s_c}}\geq \|u(t)\|_{L^{\sigma_c}}\geq |\log (T-t)|^{\gamma},\,\,\,\mbox{ as }\,\,\,t\rightarrow T^{\ast}.$$ The proof is based on the ideas introduced for the $L^2$ super critical nonlinear Schr\"odinger equation in the work of Merle and Rapha\"el [13] and here we extend their results to the INLS setting.


title: The H$\alpha$ Dots Survey. II. A Second List of Faint Emission-Line Objects

abstract: We present the second catalog of serendipitously discovered compact extragalactic emission-line sources -- H$\alpha$ Dots. These objects have been discovered in searches of moderately deep narrow-band images acquired for the ALFALFA H$\alpha$ project (Van Sistine et al. 2016). In addition to cataloging 119 new H$\alpha$ Dots, we also present follow-up spectral data for the full sample. These spectra allow us to confirm the nature of these objects as true extragalactic emission-line objects, to classify them in terms of activity type (star forming or AGN), and to identify the emission line via which they were discovered. We tabulate photometric and spectroscopic data for the all objects, and present an overview of the properties of the full H$\alpha$ Dot sample. The H$\alpha$ Dots represent a broad range of star-forming and active galaxies detected via several different emission lines over a wide range of redshifts. The sample includes H$\alpha$-detected blue compact dwarf galaxies at low redshift, [\ion{O}{3}]-detected Seyfert 2 and Green Pea-like galaxies at intermediate redshifts, and QSOs detected via one of several UV emission lines, including Ly$\alpha$. Despite the heterogeneous appearance of the resulting catalog of objects, we show that our selection method leads to well-defined samples of specific classes of emission-line objects with properties that allow for statistical studies of each class.


title: A Mechanistic Model of Annual Sulfate Concentrations in the United States

abstract: We develop a mechanistic model to analyze the impact of sulfur dioxide emissions from coal-fired power plants on average sulfate concentrations in the central United States. A multivariate Ornstein-Uhlenbeck (OU) process is used to approximate the dynamics of the underlying space-time chemical transport process, and its distributional properties are leveraged to specify novel probability models for spatial data (i.e., spatially-referenced data with no temporal replication) that are viewed as either a snapshot or a time-averaged observation of the OU process. Air pollution transport dynamics determine the mean and covariance structure of our atmospheric sulfate model, allowing us to infer which process dynamics are driving observed air pollution concentrations. We use these inferred dynamics to assess the regulatory impact of flue-gas desulfurization (FGD) technologies on human exposure to sulfate aerosols.


title: Exploring Sensitivity of ICF Outputs to Design Parameters in Experiments Using Machine Learning

abstract: Building a sustainable burn platform in inertial confinement fusion (ICF) requires an understanding of the complex coupling of physical processes and the effects that key experimental design changes have on implosion performance. While simulation codes are used to model ICF implosions, incomplete physics and the need for approximations deteriorate their predictive capability. Identification of relationships between controllable design inputs and measurable outcomes can help guide the future design of experiments and development of simulation codes, which can potentially improve the accuracy of the computational models used to simulate ICF implosions. In this paper, we leverage developments in machine learning (ML) and methods for ML feature importance/sensitivity analysis to identify complex relationships in ways that are difficult to process using expert judgment alone. We present work using random forest (RF) regression for prediction of yield, velocity, and other experimental outcomes given a suite of design parameters, along with an assessment of important relationships and uncertainties in the prediction model. We show that RF models are capable of learning and predicting on ICF experimental data with high accuracy, and we extract feature importance metrics that provide insight into the physical significance of different controllable design inputs for various ICF design configurations. These results can be used to augment expert intuition and simulation results for optimal design of future ICF experiments.


title: Spectroscopic analysis of the bulge Globular Cluster ESO~456-SC38

abstract: It has been suggested that the oldest stellar populations in the Milky Way Galaxy are tightly bound and confined to the central regions of the Galaxy. This is one of the reasons why a handful of globular clusters located in the bulge region are thought to be remnants of the primeval formation stages of the Milky Way. The globular cluster, ESO 456-SC38 (Djorgovski~2) is one such cluster; it has a blue horizontal branch, is projected very close to the center of the Galaxy, and has an orbit confining it to the bulge/bar region. The first alpha abundances of seven stars in this heavily reddened cluster are presented using APOGEE DR16. A significant spread in the abundances of N, C, Na, and Al indicates the presence of multiple stellar populations in this cluster. Using Gaia DR2 proper motions and radial velocities from BRAVA-RR, we confirm RR Lyrae stars belong to this globular cluster.


title: Unraveling excitation energy transfer assisted by collective behaviors of vibrations

abstract: We investigate how collective behaviors of vibrations such as cooperativity and interference can enhance energy transfer in a nontrivial way, focusing on an example of a donor-bridge-acceptor trimeric chromophore system coupled to two vibrational degrees of freedom. Employing parameters selected to provide an overall uphill energy transfer from donor to acceptor, we use numerical calculations of dynamics in a coupled exciton-vibration basis, together with perturbation-based analytics and calculation of vibronic spectra, we identify clear spectral features of single- and multi-phonon vibrationally-assisted energy transfer (VAET) dynamics, where the latter include up to six-phonon contributions. We identify signatures of vibrational cooperation and interference that provide enhancement of energy transfer relative to that obtained from VAET with a single vibrational mode. We observe a phononic analogue of two-photon absorption, as well as a novel heteroexcitation mechanism in which a single phonon gives rise to simultaneous excitation of both the trimeric system and the vibrational degrees of freedom. The impact of vibrations and of the one- and two-phonon VAET processes on the energy transfer are seen to be quite different in the weak and strong site-vibration coupling regimes. In the weak coupling regime, two-phonon processes dominate, whereas in the strong coupling regime up to six-phonon VAET processes can be induced. The VAET features are seen to be enhanced with increasing temperature and site-vibration coupling strength, and are reduced in the presence of dissipation. We analyze the dependence of these phenomena on the explicit form of the chromophore-vibration couplings, with comparison of VAET spectra for local and non-local couplings.


title: Fast Fourier Transformation for Optimizing Convolutional Neural Networks in Object Recognition

abstract: This paper proposes to use Fast Fourier Transformation-based U-Net (a refined fully convolutional networks) and perform image convolution in neural networks. Leveraging the Fast Fourier Transformation, it reduces the image convolution costs involved in the Convolutional Neural Networks (CNNs) and thus reduces the overall computational costs. The proposed model identifies the object information from the images. We apply the Fast Fourier transform algorithm on an image data set to obtain more accessible information about the image data, before segmenting them through the U-Net architecture. More specifically, we implement the FFT-based convolutional neural network to improve the training time of the network. The proposed approach was applied to publicly available Broad Bioimage Benchmark Collection (BBBC) dataset. Our model demonstrated improvement in training time during convolution from $600-700$ ms/step to $400-500$ ms/step. We evaluated the accuracy of our model using Intersection over Union (IoU) metric showing significant improvements.


title: Test4Enforcers: Test Case Generation for Software Enforcers

abstract: Software enforcers can be used to modify the runtime behavior of software applications to guarantee that relevant correctness policies are satisfied. Indeed, the implementation of software enforcers can be tricky, due to the heterogeneity of the situations that they must be able to handle. Assessing their ability to steer the behavior of the target system without introducing any side effect is an important challenge to fully trust the resulting system. To address this challenge, this paper presents Test4Enforcers, the first approach to derive thorough test suites that can validate the impact of enforcers on a target system. The paper also shows how to implement the Test4Enforcers approach in the DroidBot test generator to validate enforcers for Android apps.


title: Unsupervised Joint $k$-node Graph Representations with Compositional Energy-Based Models

abstract: Existing Graph Neural Network (GNN) methods that learn inductive unsupervised graph representations focus on learning node and edge representations by predicting observed edges in the graph. Although such approaches have shown advances in downstream node classification tasks, they are ineffective in jointly representing larger $k$-node sets, $k{>}2$. We propose MHM-GNN, an inductive unsupervised graph representation approach that combines joint $k$-node representations with energy-based models (hypergraph Markov networks) and GNNs. To address the intractability of the loss that arises from this combination, we endow our optimization with a loss upper bound using a finite-sample unbiased Markov Chain Monte Carlo estimator. Our experiments show that the unsupervised MHM-GNN representations of MHM-GNN produce better unsupervised representations than existing approaches from the literature.


title: Fake Reviews Detection through Analysis of Linguistic Features

abstract: Online reviews play an integral part for success or failure of businesses. Prior to purchasing services or goods, customers first review the online comments submitted by previous customers. However, it is possible to superficially boost or hinder some businesses through posting counterfeit and fake reviews. This paper explores a natural language processing approach to identify fake reviews. We present a detailed analysis of linguistic features for distinguishing fake and trustworthy online reviews. We study 15 linguistic features and measure their significance and importance towards the classification schemes employed in this study. Our results indicate that fake reviews tend to include more redundant terms and pauses, and generally contain longer sentences. The application of several machine learning classification algorithms revealed that we were able to discriminate fake from real reviews with high accuracy using these linguistic features.


title: Dissecting Hessian: Understanding Common Structure of Hessian in Neural Networks

abstract: Hessian captures important properties of the deep neural network loss landscape. Previous works have observed low rank structure in the Hessians of neural networks. In this paper, we propose a decoupling conjecture that decomposes the layer-wise Hessians of a network as the Kronecker product of two smaller matrices. We can analyze the properties of these smaller matrices and prove the structure of top eigenspace random 2-layer networks. The decoupling conjecture has several other interesting implications - top eigenspaces for different models have surprisingly high overlap, and top eigenvectors form low rank matrices when they are reshaped into the same shape as the corresponding weight matrix. All of these can be verified empirically for deeper networks. Finally, we use the structure of layer-wise Hessian to get better explicit generalization bounds for neural networks.


title: Economic Dispatch With Distributed Energy Resources: Co-Optimization of Transmission and Distribution Systems

abstract: The increasing penetration of distributed energy resources (DERs) in the distribution networks has turned the conventionally passive load buses into active buses that can provide grid services for the transmission system. To take advantage of the DERs in the distribution networks, this letter formulates a transmission-and-distribution (T&D) systems co-optimization problem that achieves economic dispatch at the transmission level and optimal voltage regulation at the distribution level by leveraging large generators and DERs. A primal-dual gradient algorithm is proposed to solve this optimization problem jointly for T&D systems, and a distributed market-based equivalent of the gradient algorithm is used for practical implementation. The results are corroborated by numerical examples with the IEEE 39-Bus system connected with 7 different distribution networks.


title: On the spectrum of the periodic focusing Zakharov-Shabat operator

abstract: The spectrum of the focusing Zakharov-Shabat operator on the circle is studied, and its explicit dependence on the presence of a semiclassical parameter is also considered. Several new results are obtained. In particular: (i) it is proved that the resolvent set is comprised of two connected components, (ii) new bounds on the location of the Floquet and Dirichlet spectra are obtained, some of which depend explicitly on the value of the semiclassical parameter, (iii) it is proved that the spectrum localizes to a "cross" in the spectral plane in the semiclassical limit. The results are illustrated by discussing several examples in which the spectrum is computed analytically or numerically.


title: On the Generation of Compressible Mirror-mode Fluctuations in the Inner Heliosheath

abstract: Measurements made with the Voyager 1 spacecraft indicate that significant levels of compressive fluctuations exist in the inner heliosheath. Some studies have already been performed with respect to the mirror-mode instability in the downstream region close to the solar wind termination shock, and here we extend the investigation to the whole inner heliosheath. We employ quasilinear theory and results from a global magnetohydrodynamic model of the heliosphere to compute the time evolution of both the temperature anisotropy and the energy density of the corresponding magnetic fluctuations, and we demonstrate their likely presence in the inner heliosheath. Furthermore, we compute the associated, locally generated density fluctuations. The results can serve as inputs for future models of the transport of compressible turbulence in the inner heliosheath.


title: Debreu's open gap lemma for semiorders

abstract: The problem of finding a (continuous) utility function for a semiorder has been studied since in 1956 R.D. Luce introduced in \emph{Econometrica} the notion. There was almost no results on the continuity of the representation. A similar result to Debreu's Lemma, but for semiorders, was never achieved. Recently, some necessary conditions for the existence of a continuous representation as well as some conjectures were presented by A. Estevan. In the present paper we prove these conjectures, achieving the desired version of Debreu's Open Gap Lemma for bounded semiorders. This result allows to remove the open-closed and closed-open gaps of a subset $S\subseteq \mathbb{R}$, but now keeping the constant threshold, so that $x+1<y$ if and only if $g(x)+1<g(y) \, (x,y\in S)$. Therefore, the continuous representation (in the sense of Scott-Suppes) of bounded semiorders is characterized. These results are achieved thanks to the key notion of $\epsilon$-continuity, which generalizes the idea of continuity for semiorders.


title: Explaining Atomki anomaly and muon $g-2$ in $U(1)_X$ extended flavour violating two Higgs doublet model

abstract: We investigate a two Higgs doublet model with extra flavour depending $U(1)_X$ gauge symmetry where $Z'$ boson interactions can explain the Atomki anomaly by choosing appropriate charge assignment for the SM fermions. For parameter region explaining the Atomki anomaly we obtain light scalar boson with $\mathcal{O}(10)$ GeV mass, and we explore scalar sector to search for allowed parameter space. We then discuss anomalous magnetic dipole moment of muon and lepton flavour violating processes induced by Yukawa couplings of our model.


title: The divergence and curl in arbitrary basis

abstract: In this work, the divergence and curl operators are obtained using the coordinate free non rigid basis formulation of differential geometry. Although the authors have attempted to keep the presentation self-contained as much as possible, some previous exposure to the language of differential geometry may be helpful. In this sense the work is aimed to late undergraduate or beginners graduate students interested in mathematical physics. To illustrate the development, we graphically present the eleven coordinate systems in which the Laplace operator is separable. We detail the development of the basis and the connection for the cylindrical and paraboloidal coordinate systems. We also present in [1] codes both in Maxima and Maple for the spherical orthonormal basis, which serves as a working model for calculations in other situations of interest. Also in [1] the codes to obtain the coordinate surfaces are given.


title: ClasSOMfier: A neural network for cluster analysis and detection of lattice defects

abstract: ClasSOMfier is a software package to classify atoms into a given number of disconnected groups (or clusters) and detect lattice defects, such as vacancies, interstitials, dislocations, voids and grain boundaries. Each cluster is formed by atoms whose atomic environment can be described by a common pattern. Unlike many methods available in the literature, where these patterns are given in advance and are associated with known lattice structures (i.e. fcc, bcc or hcp), this code implements a Kohonen network, which is based on unsupervised learning and where no information about the atomic environment has to be given in advance. ClasSOMfier accelerates the application of machine learning for cluster analysis by providing an efficient and fast code in Fortran with a user-friendly interface in Python.


title: Music to My Ears: Neural modularity and flexibility differ in response to real-world music stimuli

abstract: Music listening involves many simultaneous neural operations, including auditory processing, working memory, temporal sequencing, pitch tracking, anticipation, reward, and emotion, and thus, a full investigation of music cognition would benefit from whole-brain analyses. Here, we quantify whole-brain activity while participants listen to a variety of music and speech auditory pieces using two network measures that are grounded in complex systems theory: modularity, which measures the degree to which brain regions are interacting in communities, and flexibility, which measures the rate that brain regions switch the communities to which they belong. In a music and brain connectivity study that is part of a larger clinical investigation into music listening and stroke recovery, fMRI was performed on healthy participants while they listened to self-selected music to which they felt a positive emotional attachment, as well as culturally familiar music (J.S. Bach), culturally unfamiliar music (Gagaku court music of medieval Japan), and several excerpts of speech. There was a marked contrast among the whole-brain networks during the different types of auditory pieces, in particular for the unfamiliar music. During the self-selected and Bach tracks, participants' whole-brain networks exhibited modular organization that was significantly coordinated with the network flexibility. Meanwhile, when the Gagaku music was played, this relationship between brain network modularity and flexibility largely disappeared. In addition, while the auditory cortex's flexibility during the self-selected piece was equivalent to that during Bach, it was more flexible during Gagaku. The results suggest that the modularity and flexibility measures of whole-brain activity have the potential to lead to new insights into the complex neural function that occurs during music perception of real-world songs.


title: Constructive Ackermann's interpretation

abstract: The main goal of this paper is to formulate a constructive analogue of Ackermann's observation about finite set theory and arithmetic. We will see that Heyting arithmetic is bi-interpretable with $\mathsf{CZF^{fin}}$, the finitary version of $\mathsf{CZF}$. We also examine bi-interpretability between subtheories of finitary $\mathsf{CZF}$ and Heyting arithmetic based on the modification of Fleischmann's hierarchy of formulas, and the set of hereditarily finite sets over $\mathsf{CZF}$, which turns out to be a model of $\mathsf{CZF^{fin}}$ but not a model of finitary $\mathsf{IZF}$.


title: Prescribed virtual homological torsion of 3-manifolds

abstract: We prove that given any finite abelian group $A$ and any irreducible $3$-manifold $M$ with empty or toroidal boundary which is not a graph manifold there exists a finite cover $M' \to M$ so that $A$ is a direct factor in $H_1(M',\mathbb{Z})$. This generalizes results of Sun and of Friedl-Herrmann.


title: Structural evolution of binary oxide nanolaminates with annealing and its impact on room-temperature internal friction

abstract: Internal friction in oxide thin films imposes a critical limitation to the sensitivity and stability of ultra-high finesse optical cavities for gravitational wave detectors. Strategies like doping or creating nanolaminates are sought to introduce structural modifications that reduce internal friction. This work describes an investigation of the morphological changes SiO2/Ta2O5 and TiO2/Ta2O5 nanolaminates undergo with annealing and their impact on room temperature internal friction. It is demonstrated that thermal treatment results in a reduction of internal friction in both nanolaminates, but through different pathways. In the SiO2/Ta2O5 nanolaminate, which layers remain intact after annealing, the total reduction in internal friction follows the reduction in the composing SiO2 and Ta2O5 layers. Instead, interdiffusion initiated by annealing at the interface of the TiO2/Ta2O5 nanolaminate and the formation of a mixed phase dictate a more significant reduction in internal friction to ~ 2.6 * 10-4, a value lower than any other Ta2O5 mixture coating with similar cation concentration.


title: Mating quadratic maps with the modular group III: The modular Mandelbrot set

abstract: We prove that there exists a homeomorphism $\chi$ between the connectedness locus $\mathcal{M}_{\Gamma}$ for the family $\mathcal{F}_a$ of $(2:2)$ holomorphic correspondences introduced by Bullett and Penrose, and the parabolic Mandelbrot set $\mathcal{M}_1$. The homeomorphism $\chi$ is dynamical ($\mathcal{F}_a$ is a mating between $PSL(2,\mathbb{Z})$ and $P_{\chi(a)}$), it is conformal on the interior of $\mathcal{M}_{\Gamma}$, and it extends to a homeomorphism between suitably defined neighbourhoods in the respective one parameter moduli spaces. Following the recent proof by Petersen and Roesch that $\mathcal{M}_1$ is homeomorphic to the classical Mandelbrot set $\mathcal{M}$, we deduce that $\mathcal{M}_{\Gamma}$ is homeomorphic to $\mathcal{M}$.


title: Energy Data Visualizations on Smartphones for Triggering Behavioral Change: Novel Vs. Conventional

abstract: This paper conveys the importance of using suitable data visualizations for electrical energy consumption and the effect it carries on reducing said consumption. Data visualization tools construct an important pillar in energy micro-moments, i.e., the concept of providing the right information at the right time in the right way for a specific power consumer. Such behavioral change can be triggered with the help of good recommendations and suitable visualizations to convey the right message. A questionnaire is built as a mobile application to evaluate different groups of conventional and novel visualizations. Conventional charts are restricted to bar, line and stacked area charts, while novel visualizations contain heatmap, spiral and appliance-level stacked bar charts. Significant findings gathered from participants' responses indicate that they are slightly inclined towards conventional charts. However, their understanding of the novel charts is better by 8% when the analysis questions are investigated. Finally, a question is answered on whether a group of visualizations should be discarded completely, or some modifications can be applied.


title: Synthetic MRI-aided Head-and-Neck Organs-at-Risk Auto-Delineation for CBCT-guided Adaptive Radiotherapy

abstract: Purpose: Organ-at-risk (OAR) delineation is a key step for cone-beam CT (CBCT) based adaptive radiotherapy planning that can be a time-consuming, labor-intensive, and subject-to-variability process. We aim to develop a fully automated approach aided by synthetic MRI for rapid and accurate CBCT multi-organ contouring in head-and-neck (HN) cancer patients. MRI has superb soft-tissue contrasts, while CBCT offers bony-structure contrasts. Using the complementary information provided by MRI and CBCT is expected to enable accurate multi-organ segmentation in HN cancer patients. In our proposed method, MR images are firstly synthesized using a pre-trained cycle-consistent generative adversarial network given CBCT. The features of CBCT and synthetic MRI are then extracted using dual pyramid networks for final delineation of organs. CBCT images and their corresponding manual contours were used as pairs to train and test the proposed model. Quantitative metrics including Dice similarity coefficient (DSC) were used to evaluate the proposed method. The proposed method was evaluated on a cohort of 65 HN cancer patients. CBCT images were collected from those patients who received proton therapy. Overall, DSC values of 0.87, 0.79/0.79, 0.89/0.89, 0.90, 0.75/0.77, 0.86, 0.66, 0.78/0.77, 0.96, 0.89/0.89, 0.832, and 0.84 for commonly used OARs for treatment planning including brain stem, left/right cochlea, left/right eye, larynx, left/right lens, mandible, optic chiasm, left/right optic nerve, oral cavity, left/right parotid, pharynx, and spinal cord, respectively, were achieved. In this study, we developed a synthetic MRI-aided HN CBCT auto-segmentation method based on deep learning. It provides a rapid and accurate OAR auto-delineation approach, which can be used for adaptive radiation therapy.


title: interface : Electronic Chamber Ensemble

abstract: This paper presents the interface developments and music of the duo "interface," formed by Curtis Bahn and Dan Trueman. We describe gestural instrument design, interactive performance interfaces for improvisational music, spherical speakers (multi-channel, outward-radiating geodesic speaker arrays) and Sensor-Speaker-Arrays (SenSAs: combinations of various sensor devices with spherical speaker arrays). We discuss the concept, design and construction of these systems, and, give examples from several newly published CDs of work by Bahn and Trueman.


title: Direct Numerical Simulation of a Turbulent Boundary Layer on a Flat Plate Using Synthetic Turbulence Generation

abstract: The turbulent boundary layer over a flat plate is computed by direct numerical simulation (DNS) of the incompressible Navier-Stokes equations as a test bed for a synthetic turbulence generator (STG) inflow boundary condition. The inlet momentum thickness Reynolds number is approximately 1,000. The study provides validation of the ability of the STG to develop accurate turbulence in 5 to 7 boundary layer thicknesses downstream of the boundary condition. Also tested was the effect of changes in the stabilization scheme on the development of the boundary layer. Moreover, the grid resolution required for both the development region and the downstream flow is investigated when using a stabilized finite element method.


title: Refinement of Predicted Missing Parts Enhance Point Cloud Completion

abstract: Point cloud completion is the task of predicting complete geometry from partial observations using a point set representation for a 3D shape. Previous approaches propose neural networks to directly estimate the whole point cloud through encoder-decoder models fed by the incomplete point set. By predicting the complete model, the current methods compute redundant information because the output also contains the known incomplete input geometry. This paper proposes an end-to-end neural network architecture that focuses on computing the missing geometry and merging the known input and the predicted point cloud. Our method is composed of two neural networks: the missing part prediction network and the merging-refinement network. The first module focuses on extracting information from the incomplete input to infer the missing geometry. The second module merges both point clouds and improves the distribution of the points. Our experiments on ShapeNet dataset show that our method outperforms the state-of-the-art methods in point cloud completion. The code of our methods and experiments is available in \url{https://github.com/ivansipiran/Refinement-Point-Cloud-Completion}.


title: Trajectory Inspection: A Method for Iterative Clinician-Driven Design of Reinforcement Learning Studies

abstract: Reinforcement learning (RL) has the potential to significantly improve clinical decision making. However, treatment policies learned via RL from observational data are sensitive to subtle choices in study design. We highlight a simple approach, trajectory inspection, to bring clinicians into an iterative design process for model-based RL studies. We identify where the model recommends unexpectedly aggressive treatments or expects surprisingly positive outcomes from its recommendations. Then, we examine clinical trajectories simulated with the learned model and policy alongside the actual hospital course. Applying this approach to recent work on RL for sepsis management, we uncover a model bias towards discharge, a preference for high vasopressor doses that may be linked to small sample sizes, and clinically implausible expectations of discharge without weaning off vasopressors. We hope that iterations of detecting and addressing the issues unearthed by our method will result in RL policies that inspire more confidence in deployment.


title: Comments on the "Generalized" KLJN Key Exchanger with Arbitrary Resistors: Power, Impedance, Security

abstract: In (Nature) Science Report 5 (2015) 13653, Vadai, Mingesz and Gingl (VMG) introduce a new Kirchhoff-law-Johnson-noise (KLJN) secure key exchanger that operates with 4 arbitrary resistors (instead of 2 arbitrary resistance values forming 2 identical resistor pairs in the original system). They state that in this new, VMG-KLJN, non-equilibrium system with nonzero power flow, the security during the exchange of the two (HL and LH) bit values is as strong as in the original KLJN scheme. Moreover, they claim that, at practical conditions, their VMG-KLJN protocol "supports more robust protection against attacks". First, we investigate the power flow and thermal equilibrium issues of the VMG-KLJN system with 4 arbitrary resistors. Then we introduce a new KLJN protocol that allows the arbitrary choice of 3 resistors from the 4, while it still operates with zero power flow during the exchange of single bits by utilizing a specific value of the 4th resistor and a binary temperature set for the exchanged (HL and LH) bit values. Then we show that, in general, the KLJN schemes with more than 2 arbitrary resistors (including our new protocol mentioned above) are prone to 4 new passive attacks utilizing the parasitic capacitance and inductance in the cable, while the original KLJN scheme is naturally immune against these new attacks. The core of the security vulnerability exploited by these attacks is the different line resistances in the HL and LH cases. Therefore, on the contrary of the statement and claim cited above, the practical VMG-KLJN system is less secure than the original KLJN scheme. We introduce another 2, modified, non-equilibrium KLJN systems to eliminate the vulnerability against some - but not all - of these attacks. However the price for that is the loss of arbitrariness of the selection of the 4th resistor and the information leak still remains greater than zero.


title: Sensitivity Analysis of Submodular Function Maximization

abstract: We study the recently introduced idea of worst-case sensitivity for monotone submodular maximization with cardinality constraint $k$, which captures the degree to which the output argument changes on deletion of an element in the input. We find that for large classes of algorithms that non-trivial sensitivity of $o(k)$ is not possible, even with bounded curvature, and that these results also hold in the distributed framework. However, we also show that in the regime $k = \Omega(n)$ that we can obtain $O(1)$ sensitivity for sufficiently low curvature.


title: RBF-HS: Recursive Best-First Hitting Set Search

abstract: Various model-based diagnosis scenarios require the computation of most preferred fault explanations. Existing algorithms that are sound (i.e., output only actual fault explanations) and complete (i.e., can return all explanations), however, require exponential space to achieve this task. As a remedy, we propose two novel diagnostic search algorithms, called RBF-HS (Recursive Best-First Hitting Set Search) and HBF-HS (Hybrid Best-First Hitting Set Search), which build upon tried and tested techniques from the heuristic search domain. RBF-HS can enumerate an arbitrary predefined finite number of fault explanations in best-first order within linear space bounds, without sacrificing the desirable soundness or completeness properties. The idea of HBF-HS is to find a trade-off between runtime optimization and a restricted space consumption that does not exceed the available memory. In extensive experiments on real-world diagnosis cases we compared our approaches to Reiter's HS-Tree, a state-of-the-art method that gives the same theoretical guarantees and is as general(ly applicable) as the suggested algorithms. For the computation of minimum-cardinality fault explanations, we find that (1) RBF-HS reduces memory requirements substantially in most cases by up to several orders of magnitude, (2) in more than a third of the cases, both memory savings and runtime savings are achieved, and (3) given the runtime overhead is significant, using HBF-HS instead of RBF-HS reduces the runtime to values comparable with HS-Tree while keeping the used memory reasonably bounded. When computing most probable fault explanations, we observe that RBF-HS tends to trade memory savings more or less one-to-one for runtime overheads. Again, HBF-HS proves to be a reasonable remedy to cut down the runtime while complying with practicable memory bounds.


title: Large Scale Indexing of Generic Medical Image Data using Unbiased Shallow Keypoints and Deep CNN Features

abstract: We propose a unified appearance model accounting for traditional shallow (i.e. 3D SIFT keypoints) and deep (i.e. CNN output layers) image feature representations, encoding respectively specific, localized neuroanatomical patterns and rich global information into a single indexing and classification framework. A novel Bayesian model combines shallow and deep features based on an assumption of conditional independence and validated by experiments indexing specific family members and general group categories in 3D MRI neuroimage data of 1010 subjects from the Human Connectome Project, including twins and non-twin siblings. A novel domain adaptation strategy is presented, transforming deep CNN vectors elements into binary class-informative descriptors. A GPU-based implementation of all processing is provided. State-of-the-art performance is achieved in large-scale neuroimage indexing, both in terms of computational complexity, accuracy in identifying family members and sex classification.


title: Leveraging Unpaired Text Data for Training End-to-End Speech-to-Intent Systems

abstract: Training an end-to-end (E2E) neural network speech-to-intent (S2I) system that directly extracts intents from speech requires large amounts of intent-labeled speech data, which is time consuming and expensive to collect. Initializing the S2I model with an ASR model trained on copious speech data can alleviate data sparsity. In this paper, we attempt to leverage NLU text resources. We implemented a CTC-based S2I system that matches the performance of a state-of-the-art, traditional cascaded SLU system. We performed controlled experiments with varying amounts of speech and text training data. When only a tenth of the original data is available, intent classification accuracy degrades by 7.6% absolute. Assuming we have additional text-to-intent data (without speech) available, we investigated two techniques to improve the S2I system: (1) transfer learning, in which acoustic embeddings for intent classification are tied to fine-tuned BERT text embeddings; and (2) data augmentation, in which the text-to-intent data is converted into speech-to-intent data using a multi-speaker text-to-speech system. The proposed approaches recover 80% of performance lost due to using limited intent-labeled speech.


title: Photoinduced Dirac semimetal in ZrTe5

abstract: Novel phases of matter with unique properties that emerge from quantum and topological protection present an important thrust of modern research. Of particular interest is to engineer these phases on demand using ultrafast external stimuli, such as photoexcitation, which offers prospects of their integration into future devices compatible with optical communication and information technology. Here, we use MeV Ultrafast Electron Diffraction (UED) to show how a transient three-dimensional (3D) Dirac semimetal state can be induced by a femtosecond laser pulse in a topological insulator ZrTe$_5$. We observe marked changes in Bragg diffraction, which are characteristic of bond distortions in the photoinduced state. Using the atomic positions refined from the UED, we perform density functional theory (DFT) analysis of the electronic band structure. Our results reveal that the equilibrium state of ZrTe$_5$ is a topological insulator with a small band gap of $\sim$25 meV, consistent with angle-resolved photoemission (ARPES) experiments. However, the gap is closed in the presence of strong spin-orbit coupling (SOC) in the photoinduced transient state, where massless Dirac fermions emerge in the chiral band structure. The time scale of the relaxation dynamics to the transient Dirac semimetal state is remarkably long, $\tau \sim$160 ps, which is two orders of magnitude longer than the conventional phonon-driven structural relaxation. The long relaxation is consistent with the vanishing density of states in Dirac spectrum and slow spin-repolarization of the SOC-controlled band structure accompanying the emergence of Dirac fermions.


title: Solitons and instantons in vacuum stability: physical phenomena

abstract: In a previous paper [JCAP06, 033 (2018)] we have proved that it is possible to have a stable false vacuum in a potential that is unbounded from below. In this paper we discuss the Physics related to our theoretical and numerical results. We show that the results of recent CERN experiments lead to the fact that our vacuum is safe. We present a new mechanism, where the space-time dimension plays an important role, that explains why our Universe is stable. We provide new evidence that supports a process for the origin of matter-antimatter asymmetry recently introduced by other scientists. We examine confinement in the context of escape problems. We discuss multiverse, string theory landscape, and extra-dimensions using our framework. Finally, we use our solutions to introduce some hypotheses about Dark Matter and Dark Energy.


title: Jump Models with delay -- option pricing and logarithmic Euler-Maruyama scheme

abstract: In this paper, we obtain the existence, uniqueness and positivity of the solution to delayed stochastic differential equations with jumps. This equation is then applied to model the price movement of the risky asset in a financial market and the Black-Scholes formula for the price of European options is obtained together with the hedging portfolios. The option price is evaluated analytically at the last delayed period by using the Fourier transformation technique. But in general, there is no analytical expression for the option price. To evaluate the price numerically we then use the Monte-Carlo method. To this end, we need to simulate the delayed stochastic differential equations with jumps. We propose a logarithmic Euler-Maruyama scheme to approximate the equation and prove that all the approximations remain positive and the rate of convergence of the scheme is proved to be $0.5$.


title: On the Role of Style in Parsing Speech with Neural Models

abstract: The differences in written text and conversational speech are substantial; previous parsers trained on treebanked text have given very poor results on spontaneous speech. For spoken language, the mismatch in style also extends to prosodic cues, though it is less well understood. This paper re-examines the use of written text in parsing speech in the context of recent advances in neural language processing. We show that neural approaches facilitate using written text to improve parsing of spontaneous speech, and that prosody further improves over this state-of-the-art result. Further, we find an asymmetric degradation from read vs. spontaneous mismatch, with spontaneous speech more generally useful for training parsers.


title: NGC7538 IRS1 -- an O star driving an ionized jet and giant N-S outflow

abstract: NGC 7538 IRS 1 is a very young embedded O star driving an ionized jet and accreting mass with an accretion rate > 10^-4 Msun/year, which is quenching the hypercompact HII region. We use SOFIA GREAT data, Herschel PACS and SPIRE archive data, SOFIA FORCAST archive data, Onsala 20m and CARMA data, and JCMT archive data to determine the properties of the O star and its outflow. IRS 1 appears to be a single O-star with a bolometric luminosity > 1 10^5 Lsun, i.e. spectral type O7 or earlier. We find that IRS 1 drives a large molecular outflow with the blue-shifted northern outflow lobe extending to ~ 280" or 3.6 pc from IRS 1. Near IRS 1 the outflow is well aligned with the ionized jet. The dynamical time scale of the outflow is ~ 1.3 10^5 yr. The total outflow mass is ~ 130 Msun. We determine a mass outflow rate of 1.0 10^-3 Msun/yr, roughly consistent with the observed mass accretion rate. We observe strong high velocity [CII] emission in the outflow, confirming that strong UV radiation from IRS 1 escapes into the outflow lobes and is ionizing the gas. Many O stars may form like low mass stars, but with a higher accretion rate and in a denser environment. As long as the accretion stays high enough to quench the HII region, the star will continue to grow. When the accretion rate drops, the HII region will rapidly start to expand.


title: Deep Learning Meets Projective Clustering

abstract: A common approach for compressing NLP networks is to encode the embedding layer as a matrix $A\in\mathbb{R}^{n\times d}$, compute its rank-$j$ approximation $A_j$ via SVD, and then factor $A_j$ into a pair of matrices that correspond to smaller fully-connected layers to replace the original embedding layer. Geometrically, the rows of $A$ represent points in $\mathbb{R}^d$, and the rows of $A_j$ represent their projections onto the $j$-dimensional subspace that minimizes the sum of squared distances ("errors") to the points. In practice, these rows of $A$ may be spread around $k>1$ subspaces, so factoring $A$ based on a single subspace may lead to large errors that turn into large drops in accuracy. Inspired by \emph{projective clustering} from computational geometry, we suggest replacing this subspace by a set of $k$ subspaces, each of dimension $j$, that minimizes the sum of squared distances over every point (row in $A$) to its \emph{closest} subspace. Based on this approach, we provide a novel architecture that replaces the original embedding layer by a set of $k$ small layers that operate in parallel and are then recombined with a single fully-connected layer. Extensive experimental results on the GLUE benchmark yield networks that are both more accurate and smaller compared to the standard matrix factorization (SVD). For example, we further compress DistilBERT by reducing the size of the embedding layer by $40\%$ while incurring only a $0.5\%$ average drop in accuracy over all nine GLUE tasks, compared to a $2.8\%$ drop using the existing SVD approach. On RoBERTa we achieve $43\%$ compression of the embedding layer with less than a $0.8\%$ average drop in accuracy as compared to a $3\%$ drop previously. Open code for reproducing and extending our results is provided.


title: A Brief on Optimal Transport

abstract: The presentation covers prerequisite results from Topology and Measure Theory. This is then followed by an introduction into couplings and basic definitions for optimal transport. The Kantrorovich problem is then introduced and an existence theorem is presented. Following the setup of optimal transport is a brief overview of the Wasserstein distance and a short proof of how it metrizes the space of probability measures on a COMPACT domain. This presentation is a detailed examination of Villani's "Optimal Transport: Old and New" chapters 1-4 and part of 6.


title: comp-syn: Perceptually Grounded Word Embeddings with Color

abstract: Popular approaches to natural language processing create word embeddings based on textual co-occurrence patterns, but often ignore embodied, sensory aspects of language. Here, we introduce the Python package comp-syn, which provides grounded word embeddings based on the perceptually uniform color distributions of Google Image search results. We demonstrate that comp-syn significantly enriches models of distributional semantics. In particular, we show that (1) comp-syn predicts human judgments of word concreteness with greater accuracy and in a more interpretable fashion than word2vec using low-dimensional word-color embeddings, and (2) comp-syn performs comparably to word2vec on a metaphorical vs. literal word-pair classification task. comp-syn is open-source on PyPi and is compatible with mainstream machine-learning Python packages. Our package release includes word-color embeddings for over 40,000 English words, each associated with crowd-sourced word concreteness judgments.


title: Analysis of Disfluency in Children's Speech

abstract: Disfluencies are prevalent in spontaneous speech, as shown in many studies of adult speech. Less is understood about children's speech, especially in pre-school children who are still developing their language skills. We present a novel dataset with annotated disfluencies of spontaneous explanations from 26 children (ages 5--8), interviewed twice over a year-long period. Our preliminary analysis reveals significant differences between children's speech in our corpus and adult spontaneous speech from two corpora (Switchboard and CallHome). Children have higher disfluency and filler rates, tend to use nasal filled pauses more frequently, and on average exhibit longer reparandums than repairs, in contrast to adult speakers. Despite the differences, an automatic disfluency detection system trained on adult (Switchboard) speech transcripts performs reasonably well on children's speech, achieving an F1 score that is 10\% higher than the score on an adult out-of-domain dataset (CallHome).


title: Performance Analysis of a Two-Tile Reconfigurable Intelligent Surface Assisted $2\times 2$ MIMO System

abstract: We consider a two--tile reconfigurable intelligent surface (RIS) assisted wireless network with a two-antenna transmitter and receiver over Rayleigh fading. We show that the average received signal-to-noise-ratio (SNR) optimal transmission and combining vectors are given by the left and right singular spaces of the RIS-receiver and transmit-RIS channel matrices, respectively. Moreover, the optimal phases at the two tiles of the RIS are determined by the phases of the elements of the latter spaces. To further study the effect of phase compensation, we statistically characterize the average SNR of all possible combinations of transmission and combining directions pertaining to the latter singular spaces by deriving novel expressions for the outage probability and throughput of each of those modes. Furthermore, for comparison, we derive the corresponding expressions in the absence of RIS. Our results show an approximate SNR improvement of $2$\,dB due to the phase compensation at the RIS.