title: The Limitations of Large Width in Neural Networks: A Deep Gaussian Process Perspective

abstract: Large width limits have been a recent focus of deep learning research: modulo computational practicalities, do wider networks outperform narrower ones? Answering this question has been challenging, as conventional networks gain representational power with width, potentially masking any negative effects. Our analysis in this paper decouples capacity and width via the generalization of neural networks to Deep Gaussian Processes (Deep GP), a class of nonparametric hierarchical models that subsume neural nets. In doing so, we aim to understand how width affects (standard) neural networks once they have sufficient capacity for a given modeling task. Our theoretical and empirical results on Deep GP suggest that large width can be detrimental to hierarchical models. Surprisingly, we prove that even nonparametric Deep GP converge to Gaussian processes, effectively becoming shallower without any increase in representational power. The posterior, which corresponds to a mixture of data-adaptable basis functions, becomes less data-dependent with width. Our tail analysis demonstrates that width and depth have opposite effects: depth accentuates a model's non-Gaussianity, while width makes models increasingly Gaussian. We find there is a "sweet spot" that maximizes test performance before the limiting GP behavior prevents adaptability, occurring at width = 1 or width = 2 for nonparametric Deep GP. These results make strong predictions about the same phenomenon in conventional neural networks trained with L2 regularization (analogous to a Gaussian prior on parameters): we show that such neural networks may need up to 500 - 1000 hidden units for sufficient capacity - depending on the dataset - but further width degrades performance.


title: Label Noise SGD Provably Prefers Flat Global Minimizers

abstract: In overparametrized models, the noise in stochastic gradient descent (SGD) implicitly regularizes the optimization trajectory and determines which local minimum SGD converges to. Motivated by empirical studies that demonstrate that training with noisy labels improves generalization, we study the implicit regularization effect of SGD with label noise. We show that SGD with label noise converges to a stationary point of a regularized loss $L(\theta) +\lambda R(\theta)$, where $L(\theta)$ is the training loss, $\lambda$ is an effective regularization parameter depending on the step size, strength of the label noise, and the batch size, and $R(\theta)$ is an explicit regularizer that penalizes sharp minimizers. Our analysis uncovers an additional regularization effect of large learning rates beyond the linear scaling rule that penalizes large eigenvalues of the Hessian more than small ones. We also prove extensions to classification with general loss functions, SGD with momentum, and SGD with general noise covariance, significantly strengthening the prior work of Blanc et al. to global convergence and large learning rates and of HaoChen et al. to general models.


title: The infrared echo of SN2010jl and its implications for shock breakout characteristics

abstract: SN 2010jl is a Type IIn core collapse supernova whose radiative output is powered by the interaction of the SN shock wave with its surrounding dense circumstellar medium (CSM). After day ~60, its light curve developed a NIR excess emission from dust. This excess could be a thermal IR echo from pre-existing CSM dust, or emission from newly-formed dust either in the cooling postshock region of the CSM, or in the cooling SN ejecta. Recent analysis has shown that dust formation in the CSM can commence only after day ~380, and has also ruled out newly-formed ejecta dust as the source of the NIR emission. The early (< 380 d) NIR emission can therefore only be attributed to an IR echo. The H-K color temperature of the echo is about 1250 K. The best fitting model requires the presence of about 1.6e-4 Msun of amorphous carbon dust at a distance of 2.2e16 cm from the explosion. The CSM-powered luminosity is preceded by an intense burst of hard radiation generated by the breakout of the SN shock through the stellar surface. The peak burst luminosity seen by the CSM dust is significantly reduced by Thomson scattering in the CSM, but still has the potential of evaporating the dust needed to produce the echo. We show that the survival of the echo-producing dust provides important constraints on the intensity, effective temperature, and duration of the burst.


title: Singular Behavior of the Macroscopic Quantity Near the Boundary for a Lorentz-Gas Model with the Infinite-Range Potential

abstract: Possibility of the diverging gradient of the macroscopic quantity near the boundary is investigated by a mono-speed Lorentz-gas model, with a special attention to the regularizing effect of the grazing collision for the infinite-range potential on the velocity distribution function (VDF) and its influence on the macroscopic quantity. By careful numerical analyses of the steady one-dimensional boundary-value problem, it is confirmed that the grazing collision suppresses the occurrence of a jump discontinuity of the VDF on the boundary. However, as the price for that regularization, the collision integral becomes no longer finite in the direction of the molecular velocity parallel to the boundary. Consequently, the gradient of the macroscopic quantity diverges, even stronger than the case of the finite-range potential. A conjecture about the diverging rate in approaching the boundary is made as well for a wide range of the infinite-range potentials, accompanied by the numerical evidence.

categories: cond-mat.stat-mech math-ph math.MP physics.flu-dyn


title: View Generalization for Single Image Textured 3D Models

abstract: Humans can easily infer the underlying 3D geometry and texture of an object only from a single 2D image. Current computer vision methods can do this, too, but suffer from view generalization problems - the models inferred tend to make poor predictions of appearance in novel views. As for generalization problems in machine learning, the difficulty is balancing single-view accuracy (cf. training error; bias) with novel view accuracy (cf. test error; variance). We describe a class of models whose geometric rigidity is easily controlled to manage this tradeoff. We describe a cycle consistency loss that improves view generalization (roughly, a model from a generated view should predict the original view well). View generalization of textures requires that models share texture information, so a car seen from the back still has headlights because other cars have headlights. We describe a cycle consistency loss that encourages model textures to be aligned, so as to encourage sharing. We compare our method against the state-of-the-art method and show both qualitative and quantitative improvements.


title: Reliability Disasters -- a follow up to Doganaksoy Meeker and Hahn

abstract: We discuss the use of the FMEA to address some of the root causes of the reliability disasters discussed in the article Reliability Disasters by Doganaksoy Meeker and Hahn, which appeared in Quality Progress in August 2020


title: On a Theorem of Dedekind

abstract: Let $(K,\nu)$ be an arbitrary valued field with valuation ring $R_{\nu}$ and $L=K(\alpha)$, where $\alpha$ is a root of a monic irreducible polynomial $f\in R_{\nu}[x]$. In this paper, we characterize the integral closedness of $R_\nu[\alpha]$ in such a way that extend Dedekind's criterion. Without the assumption of separability of the extension $L/K$, we show that Dedekind's theorem and its converse hold.


title: Unsupervised Neural Hidden Markov Models with a Continuous latent state space

abstract: We introduce a new procedure to neuralize unsupervised Hidden Markov Models in the continuous case. This provides higher flexibility to solve problems with underlying latent variables. This approach is evaluated on both synthetic and real data. On top of generating likely model parameters with comparable performances to off-the-shelf neural architecture (LSTMs, GRUs,..), the obtained results are easily interpretable.


title: The Auditory Tuning of a Keyboard

abstract: An optimal auditory tunable well (circular) temperament is determined. A temperament that is applicable in practice is derived from this optimum. No other historical temperament fits as well, with this optimum. A brief comparison of temperaments is worked out.


title: Product-type classes for vertex algebra cohomology of foliations on complex curves

abstract: We define a product of pairs of double complex spaces $C^n_m(V, \mathcal{W}, \mathcal{F})$ for gradig-restricted vertex algebra cohomology of codimension one foliation on a complex curve. We introduce a vertex algebra counterpart of the classical %product-type cohomological class using the orthogonality conditions on elements of double complex spaces with respect to the product we introduced.


title: Foliation of a space associated to vertex operator algebra

abstract: We construct the foliation of aspace associated to correlation functions of vertex operator algebras on considered on Riemann surfaces. We prove that the computation of general genus $g$ correlation functions determines a foliation on the space associated to these correlation functions a sewn Riemann surface. Certain further applications of the definition are proposed.


title: Galactic Clustering Under Power-law Modified Newtonian Potential

abstract: We estimate galaxy clustering under a modified gravitational potential. In particular, the modifications in gravitational potential energy occur due to a power-law and cosmological constant terms. We derive a canonical partition function for the system of galaxies interacting under such a modified gravitational potential. Moreover, we compute various thermodynamical equation of states for the system. We do comparative analysis in order to emphasize the effect of corrections on thermodynamics of the system. Interestingly, the modifications in thermodynamical quantities are embedded in clustering parameter only.


title: Reduction cohomology of Riemann surfaces

abstract: We study the algebraic conditions leading to the chain property of complexes for vertex operator algebra $n$-point functions with differential being defined through reduction formulas. The notion of the reduction cohomology of Riemann surfaces is introduced. Algebraic, geometrical, and cohomological meanings of reduction formulas is clarified. A counterpart of the Bott-Segal theorem for Riemann surfaces in terms of the reductions cohomology is proven. It is shown that the reduction cohomology is given by the cohomology of $n$-point connections over the vertex operator algebra bundle defined on a genus $g$ Riemann surface $\Sigma^{(g)}$. The reduction cohomology for a vertex operator algebra with formal parameters identified with local coordinates around marked points on $\Sigma^{(g)}$ is found in terms of the space of analytical continuations of solutions to Knizhnik-Zamolodchikov equations. For the reduction cohomology, the Euler-Poincare formula is derived. Examples for various genera and vertex operator cluster algebras are provided.


title: Canonical torsor bundles of prescribed rational functions on complex curves

abstract: Prescribed rational functions constitute a subset of rational functions satisfying certain symmetry and analyticity conditions. We define and construct explicitly prescribed rational functions-valued bundle $\mathcal{W}_M$ over a smooth complex curve $M$. An intrinsic coordinate-independent formulation for such bundle is is given. The construction presented in this paper is useful for studies of the canonical cosimplicial cohomology of infinite-dimensional Lie algebras on smooth manifolds, as well as for purposed of conformal field theory, deformation theory, and the theory of foliations.


title: A hidden, heavier resonance of the Higgs field

abstract: In Veltman's original view, the Standard Model with a large Higgs particle mass of about 1 TeV was the natural completion of non-renormalizable Glashow model. This mass was thus a second threshold for weak interactions, as the W mass was for the non-renormalizable 4-fermion V-A theory. Today, after the observation of the narrow scalar resonance at 125 GeV, Veltman's large-mass idea seems to be ruled out. Yet, this is not necessarily true. Depending on the description of SSB in $\Phi^4$ theory, and by combining analytic calculations and lattice simulations, besides the known particle at 125 GeV, a new resonance of the Higgs field may also show up around 700 GeV. The peculiarity, though, is that this heavier state would couple to longitudinal vector bosons with the same typical strength of the low-mass state and thus represent a relatively narrow resonance. In this way, such hypothetical new resonance would naturally fit with some excess of 4-lepton events observed by ATLAS around 680 GeV. Analogous data from CMS are needed to confirm or disprove this interpretation. Implications of a two-mass structure for radiative corrections are also discussed.


title: The Physical Properties of Luminous $z\gtrsim8$ Galaxies and Implications for the Cosmic Star Formation Rate Density From $\sim$0.35 deg$^{2}$ of (Pure-)Parallel HST Observations

abstract: We present the largest systematic, HST-based search to date for luminous $z\gtrsim8$ galaxy candidates using $\sim$1267 arcmin$^{2}$ of (pure-)parallel observations from a compilation of 288 random sightlines with ACS and WFC3 observations, derived from the SuperBoRG data set and together representing a factor $\sim1.12\times$ larger than existing space-based data sets. Using NIR color cuts and careful photo-$z$ analyses, we find 31 $z\gtrsim8$ galaxy candidates over 29 unique sightlines, and derive global galaxy properties such as UV magnitudes and continuum slopes, sizes, and rest-frame optical properties (e.g., SFRs, stellar masses, $A_{\rm v}$). Taking advantage of the (pure-)parallel nature of our data set - making it one of the most representative thus far - and derived SFRs, we evaluate the cosmic star formation rate density for the bright end of the UV luminosity function at $z\sim8-10$ and test the validity of luminosity function-derived results using a conversion factor. We find our method yields comparable results to those derived with luminosity functions. Furthermore, we present follow up observations of 5 (Super)BoRG targets with Keck/MOSFIRE, finding no evidence of Ly$\alpha$ in $>3$ hrs of $Y-$band observations in either, consistent with a largely neutral medium at $z\sim8$. Our results offer a definitive HST legacy on the bright end of the luminosity function and provide a valuable benchmark as well as targets for follow up with JWST.


title: Evidence for lensing of gravitational waves from LIGO-Virgo

abstract: Recently, the LIGO-Virgo Collaboration (LVC) concluded that there is no evidence for lensed gravitational waves (GW) in the first half of the O3 run, claiming "We find the observation of lensed events to be unlikely, with the fractional rate at $\mu>2$ being $3.3\times 10^{-4}$". While we agree that the chance of an individual GW event being lensed at $\mu>2$ is smaller than $10^{-3}$, the number of observed events depends on the product of this small probability times the rate of mergers at high redshift. Observational constraints from the stochastic GW background indicate that the rate of conventional mass BBH mergers (8 < M (M$_{\odot}$) < 15) in the redshift range 1<z< 2 could be as high as O($10^7$) events per year, more than sufficient to compensate for the intrinsically low probability of lensing. To reach the LVC trigger threshold these events require high magnification, but would still produce up to 10 to 30 LVC observable events per year. Thus, all the LVC observed ordinary stellar mass BBH mergers from this epoch must be strongly lensed. By adopting low-rates at high redshift, LVC assumes that lensed events can not be taking place, thus incorrectly assigning them a closer distance and higher masses by a factor of a few (typically 2 to 5). The LVC adopted priors on time delay are in tension with the distribution of observed time delays in lensed quasars. Pairs of events like GW190421-GW190910 and GW190424-GW190910, which are directly assigned a probability of zero by LVC, should be instead considered as prime candidates to be strongly lensed GW pairs, since their separation in time is consistent with observations of time delays in lensed quasars. Correcting for the LVC wrong Bayesian priors, maximum merger rate of conventional mass BBH in 1<z<2, and gravitational lensing time-delay model, reverses the LVC conclusions and supports the strong gravitational lensing hypothesis.


title: Local alignments of parsec-scale AGN radiojets

abstract: Context.Coherence in the characteristics of neighboring sources in 2D and 3D space may suggest the existence of large-scale cosmic structures, which are useful for cosmological studies. Numerous works have been conducted to detect such features in global scalesas well as in confined areas of the sky. However, results are often contradictory and their interpretation remains controversial. Aims.We investigate the potential alignment of parsec-scale radio jets in localized regions of the coordinates-redshift space. Methods.We use data from the Astrogeo VLBI FITS image database to deduce jet directions of radio sources. We perform the search for statistical alignments between nearby sources and explore the impact of instrumental biases. Results.We unveil four regions for which the alignment between jet directions deviates from randomness at a significance level of more than 5 sigma and is unlikely due to instrumental systematics. Intriguingly, their locations coincide with other known large-scale cosmic structures and/or regions of alignments. Conclusions.If the alignments found are the result of physical processes, the discovered regions may designate some of the largest structures known to date.


title: On the wall velocity dependence of electroweak baryogenesis

abstract: We re-evaluate the status of supersonic electroweak baryogenesis using a generalized fluid Ansatz for the non-equilibrium distribution functions. Instead of truncating the expansion to first order in momentum, we allow for higher order terms as well, including up to 21 fluctuations. The collision terms are computed analytically at leading-log accuracy. We also point out inconsistencies in the standard treatments of transport in electroweak baryogenesis, arguing that one cannot do without specifying an Ansatz for the distribution function. We present the first analysis of baryogenesis using the fluid approximation to higher orders. Our results support the recent findings that baryogenesis may indeed be possible even in the presence of supersonic wall velocities.


title: The MicroBooNE Experiment, the NuMI Absorber, and Heavy Neutral Leptons

abstract: Motivated by the recent search for a Higgs-Portal Scalar decaying inside the MicroBooNE detector, we demonstrate that the same search can be used to constrain Heavy Neutral Leptons. These are gauge-singlet fermions that interact with the Standard Model by mixing with neutrinos only and could be related to the origin of neutrino masses. By recasting the results of the MicroBooNE Collaboration's analysis, we show that, for a Heavy Neutral Lepton that mixes predominantly with muon-flavored neutrinos, previously unexplored parameter space can be excluded for masses between 30 and 150 MeV. Additionally, we make our Monte Carlo tools publicly available.


title: Programming the full stack of an open-access quantum computer

abstract: We present a new quantum programming language called "Quala" that enables true full-stack programming of quantum hardware. Quala allows seamless integration of abstraction layers such as the digital circuit layer and the analog control pulse waveform layer. Additionally, the language supports user-issued low-level hardware instructions like FPGA actions. Mid-circuit measurements and branching decision logic support real-time, adaptive programs. This flexibility allows users to write code for everything from quantum error correction to analog quantum simulation. The combination of a user-facing calibration database and a powerful symbolic algebra framework provides users with an unprecedented level of expressiveness and transparency. We display the salient characteristics of the language structure and describe how the accompanying compiler can translate programs written in any abstraction layer into precisely timed hardware commands. We intend for this language to bridge the gap between circuit-level programming and physical operations on real hardware while maintaining full transparency in each level of the stack. This eliminates the need for "behind-the-scenes" compilation and provides users with insights into the day-to-day calibration routines.


title: Planetary Systems Around White Dwarfs

abstract: White dwarf planetary science is a rapidly growing field of research featuring a diverse set of observations and theoretical explorations. Giant planets, minor planets, and debris discs have all been detected orbiting white dwarfs. The innards of broken-up minor planets are measured on an element-by-element basis, providing a unique probe of exoplanetary chemistry. Numerical simulations and analytical investigations trace the violent physical and dynamical history of these systems from au-scale distances to the immediate vicinity of the white dwarf, where minor planets are broken down into dust and gas and are accreted onto the white dwarf photosphere. Current and upcoming ground-based and space-based instruments are likely to further accelerate the pace of discoveries.


title: Geodesic structure and quasinormal modes of a tidally perturbed spacetime

abstract: Tidal perturbations play an important role in the study of the dynamics in the classical two-body system. Understanding tidal effects in strong-field regions may allow one to use gravitational-wave or electromagnetic observations to locate or constraint the location of possible companions. Here, we investigate how timelike and null geodesics of a Schwarzschild black hole are affected in the presence of a companion. There is a panoply of new effects. In some limiting cases, we find analytical solutions for closed null or timelike geodesics. Our results show that light ring period as measured by a far-away observer can be eiter shorter or longer, depending on the location of the companion. We also show that there are closed lightlike trajectories which are elliptic (for equatorial companions), and that timelike particles are affected in a similar manner. Finally, we attempt at estimating the ringdown from tidally perturbed geometries. Our results indicate that there are two stages in the relaxation of such geometries, one associated with a prompt decay of waves around the deformed photonsphere, and a later relaxation of the global geometry. These results are consistent with previous, full numerical studies.


title: Quantum communication complexity beyond Bell nonlocality

abstract: Efficient distributed computing offers a scalable strategy for solving resource-demanding tasks such as parallel computation and circuit optimisation. Crucially, the communication overhead introduced by the allotment process should be minimised -- a key motivation behind the communication complexity problem (CCP). Quantum resources are well-suited to this task, offering clear strategies that can outperform classical counterparts. Furthermore, the connection between quantum CCPs and nonlocality provides an information-theoretic insights into fundamental quantum mechanics. Here we connect quantum CCPs with a generalised nonlocality framework -- beyond the paradigmatic Bell's theorem -- by incorporating the underlying causal structure, which governs the distributed task, into a so-called nonlocal hidden variable model. We prove that a new class of communication complexity tasks can be associated to Bell-like inequalities, whose violation is both necessary and sufficient for a quantum gain. We experimentally implement a multipartite CCP akin to the guess-your-neighbour-input scenario, and demonstrate a quantum advantage when multipartite Greenberger-Horne-Zeilinger (GHZ) states are shared among three users.


title: NRPyCritCol & SFcollapse1D: an open-source, user-friendly toolkit to study critical phenomena

abstract: We present a new open-source, user-friendly toolkit of two codes$-$SFcollapse1D and NRPyCritCol$-$to study critical phenomena in the context of gravitational collapse. SFcollapse1D is a C/C++ tool designed to solve the problem of gravitational collapse of massless, spherically symmetric scalar fields with the ADM formalism in spherical-like coordinates. NRPyCritColis a collection of Python modules that leverage the NRPy+ infrastructure to generate a highly optimized C-code for evolving massless scalar fields within a covariant BSSN formalism. The toolkit was developed with user-friendliness and code efficiency in mind, enabling the exploration of critical phenomena with consumer-grade computers. We present a study of critical phenomena from the collapse of massless scalar fields in spherical symmetry, using only these two codes and a laptop computer.


title: The origin of chirality induced spin selectivity in photo-induced electron transfer

abstract: Here we propose a mechanism by which spin polarization can be generated dynamically in chiral molecular systems undergoing photo-induced electron transfer. The proposed mechanism explains how spin polarization emerges in systems where charge transport is dominated by incoherent hopping, mediated by spin orbit and electronic exchange couplings through an intermediate charge transfer state. We derive a simple expression for the spin polarization that predicts a non-monotonic temperature dependence consistent with recent experiments. We validate this theory using approximate quantum master equations and the numerically exact hierarchical equations of motion. The proposed mechanism of chirality induced spin selectivity should apply to many chiral systems, and the ideas presented here have implications for the study of spin transport at temperatures relevant to biology, and provide simple principles for the molecular control of spins in fluctuating environments.


title: Robust Knowledge Graph Completion with Stacked Convolutions and a Student Re-Ranking Network

abstract: Knowledge Graph (KG) completion research usually focuses on densely connected benchmark datasets that are not representative of real KGs. We curate two KG datasets that include biomedical and encyclopedic knowledge and use an existing commonsense KG dataset to explore KG completion in the more realistic setting where dense connectivity is not guaranteed. We develop a deep convolutional network that utilizes textual entity representations and demonstrate that our model outperforms recent KG completion methods in this challenging setting. We find that our model's performance improvements stem primarily from its robustness to sparsity. We then distill the knowledge from the convolutional network into a student network that re-ranks promising candidate entities. This re-ranking stage leads to further improvements in performance and demonstrates the effectiveness of entity re-ranking for KG completion.


title: The Stylic Monoid

abstract: The free monoid $A^*$ on a finite totally ordered alphabet $A$ acts at the left on columns, by Schensted left insertion. This defines a finite monoid, denoted $Styl(A)$ and called the stylic monoid. It is canonically a quotient of the plactic monoid. Main results are: the cardinality of $Styl(A)$ is equal to the number of partitions of a set on $|A|+1$ elements. We give a bijection with so-called $N$-tableaux, similar to Schensted's algorithm, explaining this fact. Presentation of $Styl(A)$: it is generated by $A$ subject to the plactic (Knuth) relations and the idempotent relations $a^2=a$, $a\in A$. The canonical involutive anti-automorphism on $A^*$, which reverses the order on $A$, induces an involution of $Styl(A)$, which similarly to the corresponding involution of the plactic monoid, may be computed by an evacuation-like operation (Sch\"utzenberger involution on tableaux) on so-called standard immaculate tableaux (which are in bijection with partitions). The monoid $Styl(A)$ is $J$-trivial, and the $J$-order of $Styl(A)$ is graded: the co-rank is given by the number of elements in the $N$-tableau. The monoid $Styl(A)$ is the syntactic monoid for the the function which associates to each word $w\in A^*$ the length of its longest strictly decreasing subword.


title: Stacking fault energy induced softening in the nucleation limited plasticity regime: a molecular dynamics study on Cu-Al alloys

abstract: In general, with the addition of solutes, the yield strength of alloys is expected to increase and this phenomenon is known as solid solution strengthening. However, reports on the ``anomalous'' softening with alloying additions are not uncommon; for example, it is known that the heterogeneous nucleation of dislocations at the sites of solute atoms can lead to softening. In this study, using Molecular Dynamics (MD) simulations, we show anomalous softening in Cu-Al alloys deformed at 300 K; specifically, not only the yield stress but also the magnitude of stress drop at yield decrease with increasing Al content. We calculate the stress needed for the homogeneous nucleation of partial dislocation loops using a continuum model. One of the key inputs to the continuum model is the stacking fault energy (SFE). We carry out the thermodynamic integration to evaluate the free energies in crystals with and without the stacking faults and hence calculate the SFE as a function of Al content at 300 K. Using the SFE values thus obtained we show that softening is a consequence of the reduction of SFE values with the addition of Al in a system where yielding is controlled by the nucleation of dislocation loops. Specifically, the results of continuum model are in good agreement with MD simulation results of pure copper. However, in the Cu-Al alloys, the drop in yield strength can only be explained using a combination of the continuum model (which assumes homogeneous nucleation), and the reduction in heterogeneous nucleation barrier (which is a function of the ratio of the unstable and stable stacking fault energies). We show that the decrease in stress drop can be rationalised in terms of the stored energy available at yielding -- the stored energy at yielding decreases with increasing Al, and, as a result, the maximum dislocation density decreases with increasing Al content.


title: Chandra/LETGS Studies of the Collisional Plasma in 4U 1626-67

abstract: We present an analysis of \chandra/LETGS observations of the ultracompact X-ray binary (UCXB) 4U 1626$-$67, continuing our project to analyze the existing Chandra gratings data of this interesting source. The extremely low mass, hydrogen-depleted donor star provides a unique opportunity to study the properties and structure of the metal-rich accreted plasma. There are strong, double-peaked emission features of OVII-VIII and Ne IX-X, but no other identified emission lines are detected. Our spectral fit simultaneously models the emission line profiles and the plasma parameters, using a two-temperature collisionally-ionized plasma. Based on our line profile fitting, we constrain the inclination of the system to 25--60$^{\circ}$ and the inner disk radius to $\sim$1500 gravitational radii, in turn constraining the donor mass to $\lesssim$0.026 M_sun, while our plasma modeling confirms previous reports of high neon abundance in the source, establishing a Ne/O ratio in the system of $0.47 \pm 0.04$, while simultaneously estimating a very low Fe/O ratio of $0.0042 \pm 0.0008$ and limiting the Mg/O ratio to less than 1% by number. We discuss these results in light of previous work.


title: New Projections for Dark Matter Searches with Paleo-Detectors

abstract: Paleo-detectors are a proposed experimental technique to search for dark matter (DM). In lieu of the conventional approach of operating a tonne-scale real-time detector to search for DM-induced nuclear recoils, paleo-detectors take advantage of small samples of naturally occurring rocks on Earth that have been deep underground ($\gtrsim 5$ km), accumulating nuclear damage tracks from recoiling nuclei for $\mathcal{O}(1)$ Gyr. Modern microscopy techniques promise the capability to read out nuclear damage tracks with nanometer resolution in macroscopic samples. Thanks to their $\mathcal{O}(1)$ Gyr integration times, paleo-detectors could constitute nuclear recoil detectors with keV recoil energy thresholds and 100 kilotonne-yr exposures. This combination would allow paleo-detectors to probe DM-nucleon cross sections orders of magnitude below existing upper limits from conventional direct detection experiments. In this article, we use improved background modeling and a new spectral analysis technique to update the sensitivity forecast for paleo-detectors. We demonstrate the robustness of the sensitivity forecast to the (lack of) ancillary measurements of the age of the samples and the parameters controlling the backgrounds, systematic mismodeling of the spectral shape of the backgrounds, and the radiopurity of the mineral samples. Specifically, we demonstrate that even if the uranium concentration in paleo-detector samples is $10^{-8}$ (per weight), many orders of magnitude larger than what we expect in the most radiopure samples obtained from ultra basic rock or marine evaporite deposits, paleo-detectors could still probe DM-nucleon cross sections below current limits. For DM masses $\lesssim 10$ GeV/$c^2$, the sensitivity of paleo-detectors could still reach down all the way to the conventional neutrino floor in a Xe-based direct detection experiment.

categories: astro-ph.CO astro-ph.IM hep-ex hep-ph physics.ins-det


title: HR-NAS: Searching Efficient High-Resolution Neural Architectures with Lightweight Transformers

abstract: High-resolution representations (HR) are essential for dense prediction tasks such as segmentation, detection, and pose estimation. Learning HR representations is typically ignored in previous Neural Architecture Search (NAS) methods that focus on image classification. This work proposes a novel NAS method, called HR-NAS, which is able to find efficient and accurate networks for different tasks, by effectively encoding multiscale contextual information while maintaining high-resolution representations. In HR-NAS, we renovate the NAS search space as well as its searching strategy. To better encode multiscale image contexts in the search space of HR-NAS, we first carefully design a lightweight transformer, whose computational complexity can be dynamically changed with respect to different objective functions and computation budgets. To maintain high-resolution representations of the learned networks, HR-NAS adopts a multi-branch architecture that provides convolutional encoding of multiple feature resolutions, inspired by HRNet. Last, we proposed an efficient fine-grained search strategy to train HR-NAS, which effectively explores the search space, and finds optimal architectures given various tasks and computation resources. HR-NAS is capable of achieving state-of-the-art trade-offs between performance and FLOPs for three dense prediction tasks and an image classification task, given only small computational budgets. For example, HR-NAS surpasses SqueezeNAS that is specially designed for semantic segmentation while improving efficiency by 45.9%. Code is available at https://github.com/dingmyu/HR-NAS


title: GANs N' Roses: Stable, Controllable, Diverse Image to Image Translation (works for videos too!)

abstract: We show how to learn a map that takes a content code, derived from a face image, and a randomly chosen style code to an anime image. We derive an adversarial loss from our simple and effective definitions of style and content. This adversarial loss guarantees the map is diverse -- a very wide range of anime can be produced from a single content code. Under plausible assumptions, the map is not just diverse, but also correctly represents the probability of an anime, conditioned on an input face. In contrast, current multimodal generation procedures cannot capture the complex styles that appear in anime. Extensive quantitative experiments support the idea the map is correct. Extensive qualitative results show that the method can generate a much more diverse range of styles than SOTA comparisons. Finally, we show that our formalization of content and style allows us to perform video to video translation without ever training on videos.


title: Mostar index and edge Mostar index of polymers

abstract: Let $G=(V,E)$ be a graph and $e=uv\in E$. Define $n_u(e,G)$ be the number of vertices of $G$ closer to $u$ than to $v$. The number $n_v(e,G)$ can be defined in an analogous way. The Mostar index of $G$ is a new graph invariant defined as $Mo(G)=\sum_{uv\in E(G)}|n_u(uv,G)-n_v(uv,G)|$. The edge version of Mostar index is defined as $Mo_e(G)=\sum_{e=uv\in E(G)} |m_u(e|G)-m_v(G|e)|$, where $m_u(e|G)$ and $m_v(e|G)$ are the number of edges of $G$ lying closer to vertex $u$ than to vertex $v$ and the number of edges of $G$ lying closer to vertex $v$ than to vertex $u$, respectively. Let $G$ be a connected graph constructed from pairwise disjoint connected graphs $G_1,\ldots ,G_k$ by selecting a vertex of $G_1$, a vertex of $G_2$, and identifying these two vertices. Then continue in this manner inductively. We say that $G$ is a polymer graph, obtained by point-attaching from monomer units $G_1,...,G_k$. In this paper, we consider some particular cases of these graphs that are of importance in chemistry and study their Mostar and edge Mostar indices.


title: A note on the interpretation of the statistical analysis of the $M_{\bullet}-M_{G}\sigma^2$ scaling relation

abstract: In the context of scaling relations between Supermassive Black Holes and host-galaxy properties, we aim to enhance the comparison between $M_{\bullet} - M_{G}\sigma^2$ and $M_{\bullet} - \sigma$ relations from a statistical point of view. First, it is suggested to take into account the predictive accuracy of the scaling relation, in addition to the classical measures of goodness of fit. Here, prediction accuracy is fairly evaluated according to a leave-one-out cross-validation strategy. Then, we spread more light on the analysis of residuals from the fitted scaling relation, in order to provide more useful information on the role played by the different variables in their correlation with the black hole mass. The findings from six samples are discussed.


title: Electronic Structure of Chromium Trihalides beyond Density Functional Theory

abstract: We explore the electronic band structure of free standing monolayers of chromium trihalides, CrX\textsubscript{3}{, X= Cl, Br, I}, within an advanced \emph{ab-initio} theoretical approach based in the use of Green's function functionals. We compare the local density approximation with the quasi-particle self-consistent \emph{GW} approximation (QS\emph{GW}) and its self-consistent extension (QS$G\widehat{W}$) by solving the particle-hole ladder Bethe-Salpeter equations to improve the effective interaction \emph{W}. We show that at all levels of theory, the valence band consistently changes shape in the sequence Cl{\textrightarrow}Br{\textrightarrow}I, and the valence band maximum shifts from the M point to the $\Gamma$ point. However, the details of the transition, the one-particle bandgap, and the eigenfunctions change considerably going up the ladder to higher levels of theory. The eigenfunctions become more directional, and at the M point there is a strong anisotropy in the effective mass. Also the dynamic and momentum dependent self energy shows that QS$G\widehat{W}$ adds to the localization of the systems in comparison to the QS\emph{GW} thereby leading to a narrower band and reduced amount of halogens in the valence band manifold.


title: Neural Codes and Neural ring endomorphisms

abstract: We investigate combinatorial, topological and algebraic properties of certain classes of neural codes. We look into a conjecture that states if the minimal \textit{open convex} embedding dimension of a neural code is two then its minimal \textit{convex} embedding dimension is also two. We prove the conjecture for two interesting classes of examples and provide a counterexample for the converse of the conjecture. We introduce a new class of neural codes, \textit{Doublet maximal}. We show that a Doublet maximal code is open convex if and only if it is max-intersection complete. We prove that surjective neural ring homomorphisms preserve max-intersection complete property. We introduce another class of neural codes, \textit{Circulant codes}. We give the count of neural ring endomorphisms for several sub-classes of this class.


title: Sample-efficient Linguistic Generalizations through Program Synthesis: Experiments with Phonology Problems

abstract: Neural models excel at extracting statistical patterns from large amounts of data, but struggle to learn patterns or reason about language from only a few examples. In this paper, we ask: Can we learn explicit rules that generalize well from only a few examples? We explore this question using program synthesis. We develop a synthesis model to learn phonology rules as programs in a domain-specific language. We test the ability of our models to generalize from few training examples using our new dataset of problems from the Linguistics Olympiad, a challenging set of tasks that require strong linguistic reasoning ability. In addition to being highly sample-efficient, our approach generates human-readable programs, and allows control over the generalizability of the learnt programs.


title: The X-Rays wind connection in PG 2112+059

abstract: We study the connection between the X-ray and UV properties of the broad absorption line (BAL) wind in the highly X-ray variable quasar PG 2112+059 by comparing Chandra-ACIS data with contemporaneous UV HST/STIS spectra in three different epochs. We observe a correlation whereby an increase in the equivalent-widths (EWs) of the BALs is accompanied by a redder UV spectrum. The growth in the BALs EWs is also accompanied by a significant dimming in soft X-ray emission (<2 keV), consistent with increased absorption. Variations in the hard X-ray emission (>2 keV) are only accompanied by minor spectral variations of the UV-BALs and do not show significant changes in the EW of BALs. These trends suggest a wind-shield scenario where the outflow inclination with respect to the line of sight is decreasing and/or the wind mass is increasing. These changes elevate the covering fraction and/or column densities of the BALs and are likely accompanied by a nearly contemporaneous increase in the column density of the shield.


title: Bootstrapping Clustered Data in R using lmeresampler

abstract: Linear mixed-effects models are commonly used to analyze clustered data structures. There are numerous packages to fit these models in R and conduct likelihood-based inference. The implementation of resampling-based procedures for inference are more limited. In this paper, we introduce the lmeresampler package for bootstrapping nested linear mixed-effects models fit via lme4 or nlme. Bootstrap estimation allows for bias correction, adjusted standard errors and confidence intervals for small samples sizes and when distributional assumptions break down. We will also illustrate how bootstrap resampling can be used to diagnose this model class. In addition, lmeresampler makes it easy to construct interval estimates of functions of model parameters.


title: Characterization of a turbulent flow with independent variation of Mach and Reynolds numbers

abstract: The Variable Density and Speed of Sound Vessel (VDSSV) produces subsonic turbulent flows that are both compressible and observable at all scales with existing instrumentation including hot wires and particle tracking. We realize this objective by looking at the flow of a heavy gas (sulfur hexafluoride $SF_6$), with a speed of sound almost three times lower than for air. By switching between air and $SF_6$, we isolate the influence of the turbulent Mach number (up to $M_t$ = 0.17) on turbulence statistics from the influences of changes in the Reynolds number (up to $R_{\lambda}$ = 1600), and boundary conditions, which we hold constant. A free shear flow is produced by a ducted fan, and we show that it behaves like a turbulent jet in that the mean velocity profiles approach self-similarity with increasing distance from the orifice (up to $x/D_f$ = 9). The jet responds like a compressible shear layer in that it spreads more slowly at higher Mach numbers (up to $M_j$ = 0.7) than at low Mach numbers. In contrast, the integral length scales and Kolmogorov constant of the turbulence are approximately invariant with respect to changes in either the Reynolds or Mach numbers. We briefly report on instrumentation under development that will extend the accessible Taylor-scale Reynolds and turbulent Mach numbers to 4000 and 0.3, respectively.


title: Irreducibility and singularities of some nested Hilbert schemes

abstract: Let $S$ be a smooth projective surface over $\mathbb{C}$. We study the local and global geometry of the nested Hilbert scheme of points $S^{[n,n+1,n+2]}$. In particular, we show that $S^{[n,n+1,n+2]}$ is an irreducible local complete intersection with klt singularities. In addition, we compute the Picard group of $S^{[n,n+1,n+2]}$ when $h^1(S,\mathcal{O}_S) = 0$. From the irreducibility of $S^{[n,n+1,n+2]}$, we deduce irreducibility for four other infinite families of nested Hilbert schemes. We give the first explicit example of a reducible nested Hilbert scheme, which allows us to show that $S^{[n_1,\dots,n_k]}$ is reducible for $k > 22$.


title: Optimal control of port-Hamiltonian descriptor systems with minimal energy supply

abstract: We consider the singular optimal control problem of minimizing the energy supply of linear dissipative port-Hamiltonian descriptor systems subject to control and terminal state constraints. To this end, after reducing the problem to an ODE with feed-through term, we derive an input-state turnpike towards a subspace for optimal control of generalized port-Hamiltonian ordinary differential equations. We study the reachability properties of the system and prove that optimal states exhibit a turnpike behavior with respect to the conservative subspace. By means of the port-Hamiltonian structure, we show that, despite control constraints, this turnpike property is global in the initial state. Further, we characterize the class of dissipative Hamiltonian matrices and pencils.


title: Hausdorff dimension of Gauss--Cantor sets and two applications to classical Lagrange and Markov spectra

abstract: This paper is dedicated to the study of two famous subsets of the real line, namely Lagrange spectrum $L$ and Markov spectrum $M$. Our first result, Theorem 2.1, provides a rigorous estimate on the smallest value $t_1$ such that the portion of the Markov spectrum $(-\infty,t_1)\cap M$ has Hausdorff dimension $1$. Our second result, Theorem 3.1, gives a new upper bound on the Hausdorff dimension of the set difference $M\setminus L$. Our method combines new facts about the structure of the classical spectra together with finer estimates on the Hausdorff dimension of Gauss--Cantor sets of continued fraction expansions whose entries satisfy appropriate restrictions.


title: Understanding Deflation Process in Over-parametrized Tensor Decomposition

abstract: In this paper we study the training dynamics for gradient flow on over-parametrized tensor decomposition problems. Empirically, such training process often first fits larger components and then discovers smaller components, which is similar to a tensor deflation process that is commonly used in tensor decomposition algorithms. We prove that for orthogonally decomposable tensor, a slightly modified version of gradient flow would follow a tensor deflation process and recover all the tensor components. Our proof suggests that for orthogonal tensors, gradient flow dynamics works similarly as greedy low-rank learning in the matrix setting, which is a first step towards understanding the implicit regularization effect of over-parametrized models for low-rank tensors.


title: Landscape Correspondence of Empirical and Population Risks in the Eigendecomposition Problem

abstract: Spectral methods include a family of algorithms related to the eigenvectors of certain data-generated matrices. In this work, we are interested in studying the geometric landscape of the eigendecomposition problem in various spectral methods. In particular, we first extend known results regarding the landscape at critical points to larger regions near the critical points in a special case of finding the leading eigenvector of a symmetric matrix. For a more general eigendecomposition problem, inspired by recent findings on the connection between the landscapes of empirical risk and population risk, we then build a novel connection between the landscape of an eigendecomposition problem that uses random measurements and the one that uses the true data matrix. We also apply our theory to a variety of low-rank matrix optimization problems and conduct a series of simulations to illustrate our theoretical findings.


title: Auto-NBA: Efficient and Effective Search Over the Joint Space of Networks, Bitwidths, and Accelerators

abstract: While maximizing deep neural networks' (DNNs') acceleration efficiency requires a joint search/design of three different yet highly coupled aspects, including the networks, bitwidths, and accelerators, the challenges associated with such a joint search have not yet been fully understood and addressed. The key challenges include (1) the dilemma of whether to explode the memory consumption due to the huge joint space or achieve sub-optimal designs, (2) the discrete nature of the accelerator design space that is coupled yet different from that of the networks and bitwidths, and (3) the chicken and egg problem associated with network-accelerator co-search, i.e., co-search requires operation-wise hardware cost, which is lacking during search as the optimal accelerator depending on the whole network is still unknown during search. To tackle these daunting challenges towards optimal and fast development of DNN accelerators, we propose a framework dubbed Auto-NBA to enable jointly searching for the Networks, Bitwidths, and Accelerators, by efficiently localizing the optimal design within the huge joint design space for each target dataset and acceleration specification. Our Auto-NBA integrates a heterogeneous sampling strategy to achieve unbiased search with constant memory consumption, and a novel joint-search pipeline equipped with a generic differentiable accelerator search engine. Extensive experiments and ablation studies validate that both Auto-NBA generated networks and accelerators consistently outperform state-of-the-art designs (including co-search/exploration techniques, hardware-aware NAS methods, and DNN accelerators), in terms of search time, task accuracy, and accelerator efficiency. Our codes are available at: https://github.com/RICE-EIC/Auto-NBA.


title: Gas accretion onto the disc of a simulated Milky Way-mass galaxy

abstract: In the standard paradigm of galaxy formation and evolution, the baryonic component of galaxies forms from the collapse and condensation of gas within dark matter haloes, and later grows from continuous accretion of gaseous mass, both in diffuse form and in mergers with other systems. After a first period of rapid and violent halo growth, the gas settles into a rotationally-supported structure, eventually giving rise to the formation of a stellar disc. Stars evolve and return chemically-processed gas and energy to the interstellar medium, mainly through Type II supernova explosions. In the disc region, the cosmological accretion of gas combines with the outflows resulting from supernovae, affecting the hydrodynamical and structural properties of the disc and producing gas flows in the vertical and radial directions. In this work, we use a simulation of the Auriga Project, a suite of magneto-hydrodynamical, zoom-in cosmological simulations of Milky Way-like galaxies, to study the temporal and radial dependencies of gas accretion onto the disc. We also investigate the disc evolution, focusing on the inside-out disc formation scenario, which is one of the fundamental hypotheses of chemical evolution models of the Galaxy.


title: A3C-S: Automated Agent Accelerator Co-Search towards Efficient Deep Reinforcement Learning

abstract: Driven by the explosive interest in applying deep reinforcement learning (DRL) agents to numerous real-time control and decision-making applications, there has been a growing demand to deploy DRL agents to empower daily-life intelligent devices, while the prohibitive complexity of DRL stands at odds with limited on-device resources. In this work, we propose an Automated Agent Accelerator Co-Search (A3C-S) framework, which to our best knowledge is the first to automatically co-search the optimally matched DRL agents and accelerators that maximize both test scores and hardware efficiency. Extensive experiments consistently validate the superiority of our A3C-S over state-of-the-art techniques.


title: On nonlinear Rudin-Carleson type theorem

abstract: In this paper we study nonlinear interpolation problems for interpolation and peak-interpolation sets of function algebras. The subject goes back to the classical Rudin-Carleson interpolation theorem. In particular, we prove the following nonlinear version of this theorem: Let $\bar{\mathbb D}\subset \mathbb C$ be the closed unit disk, $\mathbb T\subset\bar{\mathbb D}$ the unit circle, $S\subset\mathbb T$ a closed subset of Lebesgue measure zero and $M$ a connected complex manifold. Then for every continuous $M$-valued map $f$ on $S$ there exists a continuous $M$-valued map $g$ on $\bar{\mathbb D}$ holomorphic on its interior such that $g|_S=f$. We also consider similar interpolation problems for continuous maps $f: S\rightarrow\bar M$, where $\bar M$ is a complex manifold with boundary $\partial M$ and interior $M$. Assuming that $f(S)\cap\partial M\ne\emptyset$ we are looking for holomorphic extensions $g$ of $f$ such that $g(\bar{\mathbb D}\setminus S)\subset M$.


title: Federated Learning with Spiking Neural Networks

abstract: As neural networks get widespread adoption in resource-constrained embedded devices, there is a growing need for low-power neural systems. Spiking Neural Networks (SNNs)are emerging to be an energy-efficient alternative to the traditional Artificial Neural Networks (ANNs) which are known to be computationally intensive. From an application perspective, as federated learning involves multiple energy-constrained devices, there is a huge scope to leverage energy efficiency provided by SNNs. Despite its importance, there has been little attention on training SNNs on a large-scale distributed system like federated learning. In this paper, we bring SNNs to a more realistic federated learning scenario. Specifically, we propose a federated learning framework for decentralized and privacy-preserving training of SNNs. To validate the proposed federated learning framework, we experimentally evaluate the advantages of SNNs on various aspects of federated learning with CIFAR10 and CIFAR100 benchmarks. We observe that SNNs outperform ANNs in terms of overall accuracy by over 15% when the data is distributed across a large number of clients in the federation while providing up to5.3x energy efficiency. In addition to efficiency, we also analyze the sensitivity of the proposed federated SNN framework to data distribution among the clients, stragglers, and gradient noise and perform a comprehensive comparison with ANNs.


title: Revealing the canalizing structure of Boolean functions: Algorithms and applications

abstract: Boolean functions can be represented in many ways including logical forms, truth tables, and polynomials. Additionally, Boolean functions have different canonical representations such as minimal disjunctive normal forms. Other canonical representation is based on the polynomial representation of Boolean functions where they can be written as a nested product of canalizing layers and a polynomial that contains the noncanalizing variables. In this paper we study the problem of identifying the canalizing layers format of Boolean functions. First, we show that the problem of finding the canalizing layers is NP-hard. Second, we present several algorithms for finding the canalizing layers of a Boolean function, discuss their complexities, and compare their performances. Third, we show applications where the computation of canalizing layers can be used for finding a disjunctive normal form of a nested canalizing function. Another application deals with the reverse engineering of Boolean networks with a prescribed layering format. Finally, implementations of our algorithms in Python and in the computer algebra system Macaulay2 are available at https://github.com/ckadelka/BooleanCanalization.


title: On the stabilisation of locked tearing modes in ITER and other large tokamaks

abstract: Tearing modes in tokamaks typically rotate while small and then lock at a fixed location when larger. Research on present-day devices has focused almost exclusively on stabilisation of rotating modes, as it has been considered imperative to avoid locked modes. However, in larger devices, stabilisation during the rotating phase is made difficult by fast locking at small island widths, and large broadening of the stabilising wave-driven current profile. In contrast, the smaller island width at locking not only mitigates the deleterious consequences of locked modes, but also permits their efficient stabilisation. On large devices, it thus becomes surprisingly advantageous to allow the mode to grow and lock naturally before stabilising it, challenging the mainstream strategy of neoclassical tearing mode stabilisation during the rotating phase. Calculations indicate that a locked island stabilisation strategy should be adopted in the ITER tokamak, with a large potential impact on the fusion gain and disruptivity.


title: Mechanism Design meets Priority Design: Redesigning the US Army's Branching Process

abstract: Army cadets obtain occupations through a centralized process. Three objectives -- increasing retention, aligning talent, and enhancing trust -- have guided reforms to this process since 2006. West Point's mechanism for the Class of 2020 exacerbated challenges implementing Army policy aims. We formulate these desiderata as axioms and study their implications theoretically and with administrative data. We show that the Army's objectives not only determine an allocation mechanism, but also a specific priority policy, a uniqueness result that integrates mechanism and priority design. These results led to a re-design of the mechanism, now adopted at both West Point and ROTC.


title: Deception Detection and Remote Physiological Monitoring: A Dataset and Baseline Experimental Results

abstract: We present the Deception Detection and Physiological Monitoring (DDPM) dataset and initial baseline results on this dataset. Our application context is an interview scenario in which the interviewee attempts to deceive the interviewer on selected responses. The interviewee is recorded in RGB, near-infrared, and long-wave infrared, along with cardiac pulse, blood oxygenation, and audio. After collection, data were annotated for interviewer/interviewee, curated, ground-truthed, and organized into train / test parts for a set of canonical deception detection experiments. Baseline experiments found random accuracy for micro-expressions as an indicator of deception, but that saccades can give a statistically significant response. We also estimated subject heart rates from face videos (remotely) with a mean absolute error as low as 3.16 bpm. The database contains almost 13 hours of recordings of 70 subjects, and over 8 million visible-light, near-infrared, and thermal video frames, along with appropriate meta, audio and pulse oximeter data. To our knowledge, this is the only collection offering recordings of five modalities in an interview scenario that can be used in both deception detection and remote photoplethysmography research.


title: Expanding Nuclear Physics Horizons with the Gamma Factory

abstract: The Gamma Factory (GF) is an ambitious proposal, currently explored within the CERN Physics Beyond Colliders program, for a source of photons with energies up to $\approx 400\,$MeV and photon fluxes (up to $\approx 10^{17}$ photons per second) exceeding those of the currently available gamma sources by orders of magnitude. The high-energy (secondary) photons are produced via resonant scattering of the primary laser photons by highly relativistic partially-stripped ions circulating in the accelerator. The secondary photons are emitted in a narrow cone and the energy of the beam can be monochromatized, eventually down to the $\approx1$ ppm level, via collimation, at the expense of the photon flux. This paper surveys the new opportunities that may be afforded by the GF in nuclear physics and related fields.

categories: nucl-ex hep-ex nucl-th physics.acc-ph physics.atom-ph


title: On the numerical accuracy in finite-volume methods to accurately capture turbulence in compressible flows

abstract: The goal of the present paper is to understand the impact of numerical schemes for the reconstruction of data at cell faces in finite-volume methods, and to assess their interaction with the quadrature rule used to compute the average over the cell volume. Here, third-, fifth- and seventh-order WENO-Z schemes are investigated. On a problem with a smooth solution, the theoretical order of convergence rate for each method is retrieved, and changing the order of the reconstruction at cell faces does not impact the results, whereas for a shock-driven problem all the methods collapse to first-order. Study of the decay of compressible homogeneous isotropic turbulence reveals that using a high-order quadrature rule to compute the average over a finite volume cell does not improve the spectral accuracy and that all methods present a second-order convergence rate. However the choice of the numerical method to reconstruct data at cell faces is found to be critical to correctly capture turbulent spectra. In the context of simulations with finite-volume methods of practical flows encountered in engineering applications, it becomes apparent that an efficient strategy is to perform the average integration with a low-order quadrature rule on a fine mesh resolution, whereas high-order schemes should be used to reconstruct data at cell faces.


title: Breaking the Limit of Graph Neural Networks by Improving the Assortativity of Graphs with Local Mixing Patterns

abstract: Graph neural networks (GNNs) have achieved tremendous success on multiple graph-based learning tasks by fusing network structure and node features. Modern GNN models are built upon iterative aggregation of neighbor's/proximity features by message passing. Its prediction performance has been shown to be strongly bounded by assortative mixing in the graph, a key property wherein nodes with similar attributes mix/connect with each other. We observe that real world networks exhibit heterogeneous or diverse mixing patterns and the conventional global measurement of assortativity, such as global assortativity coefficient, may not be a representative statistic in quantifying this mixing. We adopt a generalized concept, node-level assortativity, one that is based at the node level to better represent the diverse patterns and accurately quantify the learnability of GNNs. We find that the prediction performance of a wide range of GNN models is highly correlated with the node level assortativity. To break this limit, in this work, we focus on transforming the input graph into a computation graph which contains both proximity and structural information as distinct type of edges. The resulted multi-relational graph has an enhanced level of assortativity and, more importantly, preserves rich information from the original graph. We then propose to run GNNs on this computation graph and show that adaptively choosing between structure and proximity leads to improved performance under diverse mixing. Empirically, we show the benefits of adopting our transformation framework for semi-supervised node classification task on a variety of real world graph learning benchmarks.


title: Classification algorithms applied to structure formation simulations

abstract: Throughout cosmological simulations, the properties of the matter density field in the initial conditions have a decisive impact on the features of the structures formed today. In this paper we use a random-forest classification algorithm to infer whether or not dark matter particles, traced back to the initial conditions, would end up in dark matter halos whose masses are above some threshold. This problem might be posed as a binary classification task, where the initial conditions of the matter density field are mapped into classification labels provided by a halo finder program. Our results show that random forests are effective tools to predict the output of cosmological simulations without running the full process. These techniques might be used in the future to decrease the computational time and to explore more efficiently the effect of different dark matter/dark energy candidates on the formation of cosmological structures.


title: Visualization Techniques to Enhance Automated Event Extraction

abstract: Robust visualization of complex data is critical for the effective use of NLP for event classification, as the volume of data is large and the high-dimensional structure of text makes data challenging to summarize succinctly. In event extraction tasks in particular, visualization can aid in understanding and illustrating the textual relationships from which machine learning tools produce insights. Through our case study which seeks to identify potential triggers of state-led mass killings from news articles using NLP, we demonstrate how visualizations can aid in each stage, from exploratory analysis of raw data, to machine learning training analysis, and finally post-inference validation.


title: Cosmology with Love: Measuring the Hubble constant using neutron star universal relations

abstract: Gravitational-wave cosmology began in 2017 with the observation of the gravitational waves emitted in the merger of two neutron stars, and the coincident observation of the electromagnetic emission that followed. Although only a $30\%$ measurement of the Hubble constant was achieved, future observations may yield more precise measurements either through other coincident events or through cross correlation of gravitational-wave events with galaxy catalogs. Here, we implement a new way to measure the Hubble constant without an electromagnetic counterpart and through the use of the binary Love relations. These relations govern the tidal deformabilities of neutron stars in an equation-of-state insensitive way. Importantly, the Love relations depend on the component masses of the binary in the source frame. Since the gravitational-wave phase and amplitude depend on the chirp mass in the observer (and hence redshifted) frame, one can in principle combine the binary Love relations with the gravitational-wave data to directly measure the redshift, and thereby infer the value of the Hubble constant. We implement this approach in both real and synthetic data through a Bayesian parameter estimation study in a range of observing scenarios. We find that for the LIGO/Virgo/KAGRA design sensitivity era, this method results in a similar measurement accuracy of the Hubble constant to those of current-day, dark-siren measurements. For third generation detectors, this accuracy improves to $\lesssim 10\%$ when combining measurements from binary neutron star events in the LIGO Voyager era, and to $\lesssim 2\%$ in the Cosmic Explorer era.


title: Analog Seizure Detection for Implanted Responsive Neurostimulation

abstract: Epilepsy can be treated with medication, however, $30\%$ of epileptic patients are still drug resistive. Devices like responsive neurostimluation systems are implanted in select patients who may not be amenable to surgical resection. However, state-of-the-art devices suffer from low accuracy and high sensitivity. We propose a novel patient-specific seizure detection system based on na\"ive Bayesian inference using M\"uller C-elements. The system improves upon the current leading neurostimulation device, NeuroPace's RNS by implementing analog signal processing for feature extraction, minimizing the power consumption compared to the digital counterpart. Preliminary simulations were performed in MATLAB, demonstrating that through integrating multiple channels and features, up to $98\%$ detection accuracy for individual patients can be achieved. Similarly, power calculations were performed, demonstrating that the system uses $6.5 \mu W$ per channel, which when compared to the state-of-the-art NeuroPace system would increase battery life by up to $50 \%$.


title: Sand and fire: applying the sandpile model of self-organized criticality to wildfire mitigation

abstract: Prescribed burns have been increasingly utilized in forest management in the past few decades. However, their effectiveness in reducing the risk of destructive wildfires has been debated. The sandpile model of self-organized criticality, first proposed to model natural hazards, has been recently applied to wildfire research for describing a negative linear relationship between the logarithm of fire size, in area burned, and the logarithm of the fire incidence number of that size. In this study, we leverage this powerful sandpile model to perform a series of simulations demonstrating that prescribed fires indeed suppress the incidence of destructive wildfires. The same conclusion was obtained when this method was utilized to analyze historical data of forest fires from three American states: Florida, California and Georgia. Our study justifies the application of the sandpile model to wildfire research and establishes a novel method based on the analysis of slope estimated from the sandpile model, related to the leverage described in the literature, for facilitating the investigation of potential risk factors of wildfires. The new method may be utilized for the development of optimal strategies for prescribed burning. An R-script for sandpile model simulation is available for further wildfire investigation.


title: Dise\~no y desarrollo de aplicaci\'on m\'ovil para la clasificaci\'on de flora nativa chilena utilizando redes neuronales convolucionales

abstract: Introduction: Mobile apps, through artificial vision, are capable of recognizing vegetable species in real time. However, the existing species recognition apps do not take in consideration the wide variety of endemic and native (Chilean) species, which leads to wrong species predictions. This study introduces the development of a chilean species dataset and an optimized classification model implemented to a mobile app. Method: the data set was built by putting together pictures of several species captured on the field and by selecting some pictures available from other datasets available online. Convolutional neural networks were used in order to develop the images prediction models. The networks were trained by performing a sensitivity analysis, validating with k-fold cross validation and performing tests with different hyper-parameters, optimizers, convolutional layers, and learning rates in order to identify and choose the best models and then put them together in one classification model. Results: The final data set was compounded by 46 species, including native species, endemic and exotic from Chile, with 6120 training pictures and 655 testing pictures. The best models were implemented on a mobile app, obtaining a 95% correct prediction rate with respect to the set of tests. Conclusion: The app developed in this study is capable of classifying species with a high level of accuracy, depending on the state of the art of the artificial vision and it can also show relevant information related to the classified species.


title: Toward Accurate and Realistic Outfits Visualization with Attention to Details

abstract: Virtual try-on methods aim to generate images of fashion models wearing arbitrary combinations of garments. This is a challenging task because the generated image must appear realistic and accurately display the interaction between garments. Prior works produce images that are filled with artifacts and fail to capture important visual details necessary for commercial applications. We propose Outfit Visualization Net (OVNet) to capture these important details (e.g. buttons, shading, textures, realistic hemlines, and interactions between garments) and produce high quality multiple-garment virtual try-on images. OVNet consists of 1) a semantic layout generator and 2) an image generation pipeline using multiple coordinated warps. We train the warper to output multiple warps using a cascade loss, which refines each successive warp to focus on poorly generated regions of a previous warp and yields consistent improvements in detail. In addition, we introduce a method for matching outfits with the most suitable model and produce significant improvements for both our and other previous try-on methods. Through quantitative and qualitative analysis, we demonstrate our method generates substantially higher-quality studio images compared to prior works for multi-garment outfits. An interactive interface powered by this method has been deployed on fashion e-commerce websites and received overwhelmingly positive feedback.


title: Strategies for Maximizing Detection Rate in Radio SETI

abstract: The Search for Extraterrestrial intelligence (SETI) is a scientific and cultural effort seeking evidence of intelligent life beyond earth. Radio SETI observes the radio spectrum for ''technosignatures" that could be produced by an advanced ET society. This work models radio SETI as an end-to-end system, and focuses on narrow-band intentional transmissions. We look at strategies to maximize the expected number of detections per year (DPY) of search. Assuming that ET civilizations will be associated with star systems, we want to maximize the number of stars that may be observed at one time. Assuming a representative star density, this requires maximizing the search volume in a cone defined by the detection range and field of view (FOV). The parameter trades are modified from the case where one simply maximizes signal-to-noise ratio. Instead, a joint optimization between FOV and sensitivity is needed. Some implications: 1) Instead of focusing on the terrestrial microwave window of 1-10 GHz, frequencies below 1 GHz may be optimal for detection rate due to the larger field of view; 2) Arrays of smaller dishes should be favored compared to a single dish of equivalent area; 3) Aperture arrays are desirable due to their large potential FOV. Many radio telescopes under development will provide both high sensitivity and large FOV, and should offer much improved SETI detection rates. Still higher DPY is needed, however, to achieve results in reasonable time horizons, which should be possible by greatly expanding computation capability to the next-generation wide-FOV antenna arrays.


title: Bucket-brigade inspired power line network protocol for sensed quantity profile acquisition with smart sensors deployed as a queue in harsh environment

abstract: Pressure and temperature profile are key data for safe production in oil and gas wells. In this paper, a bucket-brigade inspired sensor network protocol is proposed which can be used to extract sensed data profile from the nanoscale up to kilometer long structures. The PHY/MAC layers are discussed. This protocol is best suited for low data rate exchanges in small fixed-size packets, named buckets, transmitted as time-domain bursts among high-precision smart sensors deployed as a queue. There is only one coordinator, which is not directly accessible by most of the sensor nodes. The coordinator is responsible for collecting the measurement profile and send it to a supervisory node. There is no need for complex routing mechanism, as the network topology is determined during deployment. There are many applications which require sensors to be deployed as a long queue and sensed data could be transmitted at low data rates. Examples of such monitoring applications are: neural connected artificial skin, oil/gas/water pipeline integrity, power transmission line tower integrity, (rail)road/highway lighting and integrity, individualized monitoring in vineyard or re-foresting or plantation, underwater telecommunications cable integrity, oil/gas riser integrity, oil/gas well temperature and pressure profile, among others. For robustness and reduced electromagnetic interference, wired network is preferred. Besides in some harsh environment wireless is not feasible. To reduce wiring, communications can be carried out in the same cable used to supply electrical power.


title: Disentangling the Roles of Curation, Data-Augmentation and the Prior in the Cold Posterior Effect

abstract: The "cold posterior effect" (CPE) in Bayesian deep learning describes the uncomforting observation that the predictive performance of Bayesian neural networks can be significantly improved if the Bayes posterior is artificially sharpened using a temperature parameter T<1. The CPE is problematic in theory and practice and since the effect was identified many researchers have proposed hypotheses to explain the phenomenon. However, despite this intensive research effort the effect remains poorly understood. In this work we provide novel and nuanced evidence relevant to existing explanations for the cold posterior effect, disentangling three hypotheses: 1. The dataset curation hypothesis of Aitchison (2020): we show empirically that the CPE does not arise in a real curated data set but can be produced in a controlled experiment with varying curation strength. 2. The data augmentation hypothesis of Izmailov et al. (2021) and Fortuin et al. (2021): we show empirically that data augmentation is sufficient but not necessary for the CPE to be present. 3. The bad prior hypothesis of Wenzel et al. (2020): we use a simple experiment evaluating the relative importance of the prior and the likelihood, strongly linking the CPE to the prior. Our results demonstrate how the CPE can arise in isolation from synthetic curation, data augmentation, and bad priors. Cold posteriors observed "in the wild" are therefore unlikely to arise from a single simple cause; as a result, we do not expect a simple "fix" for cold posteriors.


title: On an Asymptotic Distribution for the MLE

abstract: The paper presents a novel asymptotic distribution for a mle when the log--likelihood is strictly concave in the parameter for all data points; for example, the exponential family. The new asymptotic distribution can be seen as a refinement of the usual normal asymptotic distribution and is comparable to an Edgeworth expansion. However, it is obtained with weaker conditions than even those for asymptotic normality. The same technique is then used to find the exact distribution of the weighted likelihood bootstrap sampler.


title: Leveraging Pre-trained Language Model for Speech Sentiment Analysis

abstract: In this paper, we explore the use of pre-trained language models to learn sentiment information of written texts for speech sentiment analysis. First, we investigate how useful a pre-trained language model would be in a 2-step pipeline approach employing Automatic Speech Recognition (ASR) and transcripts-based sentiment analysis separately. Second, we propose a pseudo label-based semi-supervised training strategy using a language model on an end-to-end speech sentiment approach to take advantage of a large, but unlabeled speech dataset for training. Although spoken and written texts have different linguistic characteristics, they can complement each other in understanding sentiment. Therefore, the proposed system can not only model acoustic characteristics to bear sentiment-specific information in speech signals, but learn latent information to carry sentiments in the text representation. In these experiments, we demonstrate the proposed approaches improve F1 scores consistently compared to systems without a language model. Moreover, we also show that the proposed framework can reduce 65% of human supervision by leveraging a large amount of data without human sentiment annotation and boost performance in a low-resource condition where the human sentiment annotation is not available enough.


title: The value of travel speed

abstract: Travel speed is an intrinsic feature of transport, and enlarging the speed is considered as beneficial. The benefit of a speed increase is generally assessed as the value of the saved travel time. However, this approach conflicts with the observation that time spent on travelling is rather constant and might not be affected by speed changes. The paper aims to define the benefits of a speed increase and addresses two research questions. First, how will a speed increase in person transport work out, which factors are affected? Second, is the value of time a good proxy for the value of speed? Based on studies on time spending and research on the association between speed and land use, we argue that human wealth could be the main affected factor by speed changes, rather than time or access. Then the value of time is not a good proxy for the value of speed: the benefits of a wealth increase are negatively correlated with prosperity following the law of diminishing marginal utility, while the calculated benefits of saved travel time prove to be positively correlated. The inadequacy of the value of time is explained by some shortcomings with respect to the willingness to pay that is generally used for assessing the value of time: people do not predict correctly the personal benefits that will be gained from a decision, and they neglect the social impacts.


title: Break-It-Fix-It: Unsupervised Learning for Program Repair

abstract: We consider repair tasks: given a critic (e.g., compiler) that assesses the quality of an input, the goal is to train a fixer that converts a bad example (e.g., code with syntax errors) into a good one (e.g., code with no syntax errors). Existing works create training data consisting of (bad, good) pairs by corrupting good examples using heuristics (e.g., dropping tokens). However, fixers trained on this synthetically-generated data do not extrapolate well to the real distribution of bad inputs. To bridge this gap, we propose a new training approach, Break-It-Fix-It (BIFI), which has two key ideas: (i) we use the critic to check a fixer's output on real bad inputs and add good (fixed) outputs to the training data, and (ii) we train a breaker to generate realistic bad code from good code. Based on these ideas, we iteratively update the breaker and the fixer while using them in conjunction to generate more paired data. We evaluate BIFI on two code repair datasets: GitHub-Python, a new dataset we introduce where the goal is to repair Python code with AST parse errors; and DeepFix, where the goal is to repair C code with compiler errors. BIFI outperforms existing methods, obtaining 90.5% repair accuracy on GitHub-Python (+28.5%) and 71.7% on DeepFix (+5.6%). Notably, BIFI does not require any labeled data; we hope it will be a strong starting point for unsupervised learning of various repair tasks.


title: COSTA: Communication-Optimal Shuffle and Transpose Algorithm with Process Relabeling

abstract: Communication-avoiding algorithms for Linear Algebra have become increasingly popular, in particular for distributed memory architectures. In practice, these algorithms assume that the data is already distributed in a specific way, thus making data reshuffling a key to use them. For performance reasons, a straightforward all-to-all exchange must be avoided. Here, we show that process relabeling (i.e. permuting processes in the final layout) can be used to obtain communication optimality for data reshuffling, and that it can be efficiently found by solving a Linear Assignment Problem (Maximum Weight Bipartite Perfect Matching). Based on this, we have developed a Communication-Optimal Shuffle and Transpose Algorithm (COSTA): this highly-optimised algorithm implements $A=\alpha\cdot \operatorname{op}(B) + \beta \cdot A,\ \operatorname{op} \in \{\operatorname{transpose}, \operatorname{conjugate-transpose}, \operatorname{identity}\}$ on distributed systems, where $A, B$ are matrices with potentially different (distributed) layouts and $\alpha, \beta$ are scalars. COSTA can take advantage of the communication-optimal process relabeling even for heterogeneous network topologies, where latency and bandwidth differ among nodes. The implementation not only outperforms the best available ScaLAPACK redistribute and transpose routines multiple times, but is also able to deal with more general matrix layouts, in particular it is not limited to block-cyclic layouts. Finally, we use COSTA to integrate a communication-optimal matrix multiplication algorithm into the CP2K quantum chemistry simulation package. This way, we show that COSTA can be used to unlock the full potential of recent Linear Algebra algorithms in applications by facilitating interoperability between algorithms with a wide range of data layouts, in addition to bringing significant redistribution speedups.


title: Inference for treatment-specific survival curves using machine learning

abstract: In the absence of data from a randomized trial, researchers often aim to use observational data to draw causal inference about the effect of a treatment on a time-to-event outcome. In this context, interest often focuses on the treatment-specific survival curves; that is, the survival curves were the entire population under study to be assigned to receive the treatment or not. Under certain causal conditions, including that all confounders of the treatment-outcome relationship are observed, the treatment-specific survival can be identified with a covariate-adjusted survival function. Several estimators of this function have been proposed, including estimators based on outcome regression, inverse probability weighting, and doubly robust estimators. In this article, we propose a new cross-fitted doubly-robust estimator that incorporates data-adaptive (e.g. machine learning) estimators of the conditional survival functions. We establish conditions on the nuisance estimators under which our estimator is consistent and asymptotically linear, both pointwise and uniformly in time. We also propose a novel ensemble learner for combining multiple candidate estimators of the conditional survival estimators. Notably, our methods and results accommodate events occurring in discrete or continuous time (or both). We investigate the practical performance of our methods using numerical studies and an application to the effect of a surgical treatment to prevent metastases of parotid carcinoma on mortality.


title: A Shuffling Framework for Local Differential Privacy

abstract: ldp deployments are vulnerable to inference attacks as an adversary can link the noisy responses to their identity and subsequently, auxiliary information using the order of the data. An alternative model, shuffle DP, prevents this by shuffling the noisy responses uniformly at random. However, this limits the data learnability -- only symmetric functions (input order agnostic) can be learned. In this paper, we strike a balance and show that systematic shuffling of the noisy responses can thwart specific inference attacks while retaining some meaningful data learnability. To this end, we propose a novel privacy guarantee, d-sigma-privacy, that captures the privacy of the order of a data sequence. d-sigma-privacy allows tuning the granularity at which the ordinal information is maintained, which formalizes the degree the resistance to inference attacks trading it off with data learnability. Additionally, we propose a novel shuffling mechanism that can achieve \name-privacy and demonstrate the practicality of our mechanism via evaluation on real-world datasets.


title: Verified Synthesis of Optimal Safety Controllers for Human-Robot Collaboration

abstract: We present a tool-supported approach for the synthesis, verification and validation of the control software responsible for the safety of the human-robot interaction in manufacturing processes that use collaborative robots. In human-robot collaboration, software-based safety controllers are used to improve operational safety, e.g., by triggering shutdown mechanisms or emergency stops to avoid accidents. Complex robotic tasks and increasingly close human-robot interaction pose new challenges to controller developers and certification authorities. Key among these challenges is the need to assure the correctness of safety controllers under explicit (and preferably weak) assumptions. Our controller synthesis, verification and validation approach is informed by the process, risk analysis, and relevant safety regulations for the target application. Controllers are selected from a design space of feasible controllers according to a set of optimality criteria, are formally verified against correctness criteria, and are translated into executable code and validated in a digital twin. The resulting controller can detect the occurrence of hazards, move the process into a safe state, and, in certain circumstances, return the process to an operational state from which it can resume its original task. We show the effectiveness of our software engineering approach through a case study involving the development of a safety controller for a manufacturing work cell equipped with a collaborative robot.


title: Modeling Language Usage and Listener Engagement in Podcasts

abstract: While there is an abundance of popular writing targeted to podcast creators on how to speak in ways that engage their listeners, there has been little data-driven analysis of podcasts that relates linguistic style with listener engagement. In this paper, we investigate how various factors -- vocabulary diversity, distinctiveness, emotion, and syntax, among others -- correlate with engagement, based on analysis of the creators' written descriptions and transcripts of the audio. We build models with different textual representations, and show that the identified features are highly predictive of engagement. Our analysis tests popular wisdom about stylistic elements in high-engagement podcasts, corroborating some aspects, and adding new perspectives on others.


title: A Concept for Polarized $^3$He Targets for High Luminosity Scattering Experiments in High Magnetic Field Environments

abstract: We present the conceptual design of a polarized $^3$He target to be used for high luminosity scattering experiments within high magnetic field environments. This two-cell target will take advantage of advancements in optical pumping techniques at high magnetic field to create 60% longitudinally polarized $^3$He gas in a pumping cell within a uniform magnetic field above 1 T. By transferring the polarized gas to cryogenic target cell, the gas density is increased to create a target thickness suitable for high luminosity applications. We discuss the general design of this scheme, and plans for its application in Jefferson Lab's CLAS12 detector.


title: Invariance Principle Meets Information Bottleneck for Out-of-Distribution Generalization

abstract: The invariance principle from causality is at the heart of notable approaches such as invariant risk minimization (IRM) that seek to address out-of-distribution (OOD) generalization failures. Despite the promising theory, invariance principle-based approaches fail in common classification tasks, where invariant (causal) features capture all the information about the label. Are these failures due to the methods failing to capture the invariance? Or is the invariance principle itself insufficient? To answer these questions, we revisit the fundamental assumptions in linear regression tasks, where invariance-based approaches were shown to provably generalize OOD. In contrast to the linear regression tasks, we show that for linear classification tasks we need much stronger restrictions on the distribution shifts, or otherwise OOD generalization is impossible. Furthermore, even with appropriate restrictions on distribution shifts in place, we show that the invariance principle alone is insufficient. We prove that a form of the information bottleneck constraint along with invariance helps address key failures when invariant features capture all the information about the label and also retains the existing success when they do not. We propose an approach that incorporates both of these principles and demonstrate its effectiveness in several experiments.


title: Statistical Analysis from the Fourier Integral Theorem

abstract: Taking the Fourier integral theorem as our starting point, in this paper we focus on natural Monte Carlo and fully nonparametric estimators of multivariate distributions and conditional distribution functions. We do this without the need for any estimated covariance matrix or dependence structure between variables. These aspects arise immediately from the integral theorem. Being able to model multivariate data sets using conditional distribution functions we can study a number of problems, such as prediction for Markov processes, estimation of mixing distribution functions which depend on covariates, and general multivariate data. Estimators are explicit Monte Carlo based and require no recursive or iterative algorithms.


title: Statistical Features of High-Dimensional Hamiltonian Systems

abstract: In this short review we propose a critical assessment of the role of chaos for the thermalization of Hamiltonian systems with high dimensionality. We discuss this problem for both classical and quantum systems. A comparison is made between the two situations: some examples from recent and past literature are presented which support the point of view that chaos is not necessary for thermalization. Finally, we suggest that a close analogy holds between the role played by Kinchin's theorem for high-dimensional classical systems and the role played by Von Neumann's theorem for many-body quantum systems.


title: Scalars are universal: Equivariant machine learning, structured like classical physics

abstract: There has been enormous progress in the last few years in designing neural networks that respect the fundamental symmetries and coordinate freedoms of physical law. Some of these frameworks make use of irreducible representations, some make use of high-order tensor objects, and some apply symmetry-enforcing constraints. Different physical laws obey different combinations of fundamental symmetries, but a large fraction (possibly all) of classical physics is equivariant to translation, rotation, reflection (parity), boost (relativity), and permutations. Here we show that it is simple to parameterize universally approximating polynomial functions that are equivariant under these symmetries, or under the Euclidean, Lorentz, and Poincar\'e groups, at any dimensionality $d$. The key observation is that nonlinear O($d$)-equivariant (and related-group-equivariant) functions can be universally expressed in terms of a lightweight collection of scalars -- scalar products and scalar contractions of the scalar, vector, and tensor inputs. We complement our theory with numerical examples that show that the scalar-based method is simple, efficient, and scalable.


title: One-way dependent clusters and stability of cluster synchronization in directed networks

abstract: Cluster synchronization in networks of coupled oscillators is the subject of broad interest from the scientific community, with applications ranging from neural to social and animal networks and technological systems. Most of these networks are directed, with flows of information or energy that propagate unidirectionally from given nodes to other nodes. Nevertheless, most of the work on cluster synchronization has focused on undirected networks. Here we characterize cluster synchronization in general directed networks. Our first observation is that, in directed networks, a cluster A of nodes might be one-way dependent on another cluster B: in this case, A may remain synchronized provided that B is stable, but the opposite does not hold. The main contribution of this paper is a method to transform the cluster stability problem in an irreducible form. In this way, we decompose the original problem into subproblems of the lowest dimension, which allows us to immediately detect inter-dependencies among clusters. We apply our analysis to two examples of interest, a human network of violin players executing a musical piece for which directed interactions may be either activated or deactivated by the musicians, and a multilayer neural network with directed layer-to-layer connections.


title: On restricted diagonalization

abstract: Let $\mathcal{H}$ be a separable infinite-dimensional complex Hilbert space, $\mathcal{B}(\mathcal{H})$ the algebra of bounded linear operators acting on $\mathcal{H}$ and $\mathcal{J}$ a proper two-sided ideal of $\mathcal{B}(\mathcal{H})$. Denote by $\mathcal{U}_\mathcal{J}(\mathcal{H})$ the group of all unitary operators of the form $I+\mathcal{J}$. Recall that an operator $A \in \mathcal{B}(\mathcal{H})$ is diagonalizable if there exists a unitary operator $U$ such that $UAU^*$ is diagonal with respect to some orthonormal basis. A more restrictive notion of diagonalization can be formulated with respect to a fixed orthonormal basis $\mathrm{e}=\{ e_n\}_{n\geq 1}$ and a proper operator ideal $\mathcal{J}$ as follows: $A \in \mathcal{B}(\mathcal{H})$ is called restricted diagonalizable if there exists $U\in \mathcal{U}_\mathcal{J}(\mathcal{H})$ such that $UAU^*$ is diagonal with respect to $\mathrm{e}$. In this work we give necessary and sufficient conditions for a diagonalizable operator to be restricted diagonalizable. Our conditions become a characterization of those diagonalizable operators which are restricted diagonalizable when the ideal is arithmetic mean closed. Then we obtain results on the structure of the set of all restricted diagonalizable operators. In this way we answer several open problems recently raised by Belti\c{t}$\breve{\text{a}}$, Patnaik and Weiss.