title: Stellar dynamics and dark matter in Local Group dwarf galaxies

abstract: When interpreted within the standard framework of Newtonian gravity and dynamics, the kinematics of stars and gas in dwarf galaxies reveals that most of these systems are completely dominated by their dark matter halos. These dwarf galaxies are thus among the best astrophysical laboratories to study the structure of dark halos and the nature of dark matter. We review the properties of the dwarf galaxies of the Local Group from the point of view of stellar dynamics. After describing the observed kinematics of their stellar components and providing an overview of the dynamical modelling techniques, we look into the dark matter content and distribution of these galaxies, as inferred from the combination of observed data and dynamical models. We also briefly touch upon the prospects of using nearby dwarf galaxies as targets for indirect detection of dark matter via annihilation or decay emission.


title: Description of $GL_3$-orbits on the quadruple projective varieties

abstract: This article gives a description of the diagonal $GL_3$-orbits on the quadruple projective variety $(\mathbb P^2)^4$. We give explicit representatives of orbits, and describe the closure relations of orbits. A distinguished feature of our setting is that it is the simplest case where $\mathrm{diag}(GL_n)$ has infinitely many orbits but has an open orbit in the multiple projective space $(\mathbb P^{n-1})^m$.


title: Remarks on the penguin decay $B_s \to \phi \phi$ with prospects for FCCee

abstract: We underline the theoretical interest of the vector-vector penguin decay $B_s \to \phi \phi$, very clean from the experimental point of view. The CP-violation asymmetry $A_{CP}^{mix}$ comes from the interference of mixing and decay $\lambda_{\phi \phi} = {q \over p} {\bar{A} \over A}$. In the Standard Model (SM) and in the Naive Factorization limit, the CP phase from the mixing ${q \over p}$ exactly cancels the CP phase from the decay ratio ${\bar{A} \over A}$. Therefore, this mode is suitable to look for possible New Physics (NP) because $A_{CP}^{mix}$ would directly indicate the departure from the SM in mixing. We estimate the deviation from this cancellation by analyzing possible small effects in the SM, using in particular the QCD Factorization scheme. We compare the theoretical expectation for $A_{CP}^{mix}$ to the measurement of LHCb, and the implications for NP. We pay also special attention to the transverse amplitude $h = -$, the longitudinal and transverse polarization fractions, and the interesting helicity-dependent observables $\lambda_{\phi \phi}^{h=0}$ and $\lambda_{\phi \phi}^{h=-}$. On the other hand, we make an estimation of the expected sensitivity at the future FCCee experiment for the CP phase and modulus of $\lambda_{\phi \phi}$. We find $\delta(\mid \lambda_{\phi \phi}\mid) = 0.004$ and $\delta(\phi_{\phi \phi}) = 0.009$ rad and, comparing to the LHCb data, we point out the expectations at FCCee in the search of NP.


title: Exasim: Generating Discontinuous Galerkin Codes for Numerical Solutions of Partial Differential Equations on Graphics Processors

abstract: This paper presents an overview of the functionalities and applications of Exasim, an open-source code for generating high-order discontinuous Galerkin codes to numerically solve parametrized partial differential equations (PDEs). The software combines high-level and low-level languages to construct parametrized PDE models via Julia, Python or Matlab scripts and produce high-performance C++ codes for solving the PDE models on CPU and Nvidia GPU processors with distributed memory. Exasim provides matrix-free discontinuous Galerkin discretization schemes together with scalable reduced basis preconditioners and Newton-GMRES solvers, making it suitable for accurate and efficient approximation of wide-ranging classes of PDEs.

categories: cs.MS cs.CE cs.NA math.NA physics.comp-ph physics.flu-dyn


title: Comments on QCD$_3$ and anomalies with fundamental and adjoint matter

abstract: 't Hooft anomaly matching is powerful for constraining the low energy phases of gauge theories. In 3d one common anomaly is the parity anomaly in a $T$-symmetric theory where one cannot gauge the global symmetry group without breaking the time-reversal symmetry. We find that a $T$-symmetric $\text{SU}(N)$ gauge theory with either fermionic or bosonic matter in the fundamental representation of the gauge group has a parity anomaly between the flavor group and $T$-symmetry provided that there is also a massless Majorana fermion in the adjoint representation of the gauge group. We then analyze the parity anomaly in this theory, together with the more recent mod 16 time-reversal anomaly, and give some free fermion proposals as candidates for the low energy phases consistent with the anomalies. We make brief comments about the large $N$ limit and the $\T$-broken regimes in the conclusion as well as related anomalies in 4d. }


title: GraphHD: Efficient graph classification using hyperdimensional computing

abstract: Hyperdimensional Computing (HDC) developed by Kanerva is a computational model for machine learning inspired by neuroscience. HDC exploits characteristics of biological neural systems such as high-dimensionality, randomness and a holographic representation of information to achieve a good balance between accuracy, efficiency and robustness. HDC models have already been proven to be useful in different learning applications, especially in resource-limited settings such as the increasingly popular Internet of Things (IoT). One class of learning tasks that is missing from the current body of work on HDC is graph classification. Graphs are among the most important forms of information representation, yet, to this day, HDC algorithms have not been applied to the graph learning problem in a general sense. Moreover, graph learning in IoT and sensor networks, with limited compute capabilities, introduce challenges to the overall design methodology. In this paper, we present GraphHD$-$a baseline approach for graph classification with HDC. We evaluate GraphHD on real-world graph classification problems. Our results show that when compared to the state-of-the-art Graph Neural Networks (GNNs) the proposed model achieves comparable accuracy, while training and inference times are on average 14.6$\times$ and 2.0$\times$ faster, respectively.


title: Compact gradient Einstein-type manifolds with boundary

abstract: We deal with rigidity results for compact gradient Einstein-type manifolds with nonempty boundaries. As a result, we obtain new characterizations for hemispheres and geodesic balls in simply connected space forms. In dimensions three and five, we obtain topological characterizations for the boundary and upper bounds for its area.


title: Digital Blind Box: Random Symmetric Private Information Retrieval

abstract: We introduce the problem of random symmetric private information retrieval (RSPIR). In canonical PIR, a user downloads a message out of $K$ messages from $N$ non-colluding and replicated databases in such a way that no database can know which message the user has downloaded (user privacy). In SPIR, the privacy is symmetric, in that, not only that the databases cannot know which message the user has downloaded, the user itself cannot learn anything further than the particular message it has downloaded (database privacy). In RSPIR, different from SPIR, the user does not have an input to the databases, i.e., the user does not pick a specific message to download, instead is content with any one of the messages. In RSPIR, the databases need to send symbols to the user in such a way that the user is guaranteed to download a message correctly (random reliability), the databases do not know which message the user has received (user privacy), and the user does not learn anything further than the one message it has received (database privacy). This is the digital version of a blind box, also known as gachapon, which implements the above specified setting with physical objects for entertainment. This is also the blind version of $1$-out-of-$K$ oblivious transfer (OT), an important cryptographic primitive. We study the information-theoretic capacity of RSPIR for the case of $N=2$ databases. We determine its exact capacity for the cases of $K = 2, 3, 4$ messages. While we provide a general achievable scheme that is applicable to any number of messages, the capacity for $K\geq 5$ remains open.


title: Federated Anomaly Detection over Distributed Data Streams

abstract: Sharing of telecommunication network data, for example, even at high aggregation levels, is nowadays highly restricted due to privacy legislation and regulations and other important ethical concerns. It leads to scattering data across institutions, regions, and states, inhibiting the usage of AI methods that could otherwise take advantage of data at scale. It creates the need to build a platform to control such data, build models or perform calculations. In this work, we propose an approach to building the bridge among anomaly detection, federated learning, and data streams. The overarching goal of the work is to detect anomalies in a federated environment over distributed data streams. This work complements the state-of-the-art by adapting the data stream algorithms in a federated learning setting for anomaly detection and by delivering a robust framework and demonstrating the practical feasibility in a real-world distributed deployment scenario.


title: FactPEGASUS: Factuality-Aware Pre-training and Fine-tuning for Abstractive Summarization

abstract: We present FactPEGASUS, an abstractive summarization model that addresses the problem of factuality during pre-training and fine-tuning: (1) We augment the sentence selection strategy of PEGASUS's (Zhang et al., 2020) pre-training objective to create pseudo-summaries that are both important and factual; (2) We introduce three complementary components for fine-tuning. The corrector removes hallucinations present in the reference summary, the contrastor uses contrastive learning to better differentiate nonfactual summaries from factual ones, and the connector bridges the gap between the pre-training and fine-tuning for better transfer of knowledge. Experiments on three downstream tasks demonstrate that FactPEGASUS substantially improves factuality evaluated by multiple automatic metrics and humans. Our thorough analysis suggests that FactPEGASUS is more factual than using the original pre-training objective in zero-shot and few-shot settings, retains factual behavior more robustly than strong baselines, and does not rely entirely on becoming more extractive to improve factuality. Our code and data are publicly available at: https://github.com/meetdavidwan/factpegasus


title: Expected Frequency Matrices of Elections: Computation, Geometry, and Preference Learning

abstract: We use the ``map of elections'' approach of Szufa et al. (AAMAS-2020) to analyze several well-known vote distributions. For each of them, we give an explicit formula or an efficient algorithm for computing its frequency matrix, which captures the probability that a given candidate appears in a given position in a sampled vote. We use these matrices to draw the ``skeleton map'' of distributions, evaluate its robustness, and analyze its properties. Finally, we develop a general and unified framework for learning the distribution of real-world preferences using the frequency matrices of established vote distributions.


title: The Visual Survey Group: A Decade of Hunting Exoplanets and Unusual Stellar Events with Space-Based Telescopes

abstract: This article presents the history of the Visual Survey Group (VSG) - a Professional-Amateur (Pro-Am) collaboration within the field of astronomy working on data from several space missions (Kepler, K2 and TESS). This paper covers the formation of the VSG, its survey-methods including the most common tools used and its discoveries made over the past decade. So far, the group has visually surveyed nearly 10 million light curves and authored 69 peer-reviewed papers which mainly focus on exoplanets and discoveries involving multistellar systems found using the transit method. The preferred manual search-method carried out by the VSG has revealed its strength by detecting numerous sub-stellar objects which were overlooked or discarded by automated search programs, uncovering some of the most rare stars in our galaxy, and leading to several serendipitous discoveries of unprecedented astrophysical phenomena. The main purpose of the VSG is to assist in the exploration of our local Universe, and we therefore advocate continued crowd-sourced examination of time-domain data sets, and invite other research teams to reach out in order to establish collaborating projects.


title: Decision Making for Hierarchical Multi-label Classification with Multidimensional Local Precision Rate

abstract: Hierarchical multi-label classification (HMC) has drawn increasing attention in the past few decades. It is applicable when hierarchical relationships among classes are available and need to be incorporated along with the multi-label classification whereby each object is assigned to one or more classes. There are two key challenges in HMC: i) optimizing the classification accuracy, and meanwhile ii) ensuring the given class hierarchy. To address these challenges, in this article, we introduce a new statistic called the multidimensional local precision rate (mLPR) for each object in each class. We show that classification decisions made by simply sorting objects across classes in descending order of their true mLPRs can, in theory, ensure the class hierarchy and lead to the maximization of CATCH, an objective function we introduce that is related to the area under a hit curve. This approach is the first of its kind that handles both challenges in one objective function without additional constraints, thanks to the desirable statistical properties of CATCH and mLPR. In practice, however, true mLPRs are not available. In response, we introduce HierRank, a new algorithm that maximizes an empirical version of CATCH using estimated mLPRs while respecting the hierarchy. The performance of this approach was evaluated on a synthetic data set and two real data sets; ours was found to be superior to several comparison methods on evaluation criteria based on metrics such as precision, recall, and $F_1$ score.


title: Patchy nightside clouds on ultra-hot Jupiters: General Circulation Model simulations with radiatively active cloud tracers

abstract: The atmospheres of ultra-hot Jupiters have been characterized in detail through recent phase curve and low- and high-resolution emission and transmission spectroscopic observations. Previous numerical studies have analyzed the effect of the localized recombination of hydrogen on the atmospheric dynamics and heat transport of ultra-hot Jupiters, finding that hydrogen dissociation and recombination lead to a reduction in the day-to-night contrasts of ultra-hot Jupiters relative to previous expectations. In this work, we add to previous efforts by also considering the localized condensation of clouds in the atmospheres of ultra-hot Jupiters, their resulting transport by the atmospheric circulation, and the radiative feedback of clouds on the atmospheric dynamics. To do so, we include radiatively active cloud tracers into the existing MITgcm framework for simulating the atmospheric dynamics of ultra-hot Jupiters. We take cloud condensate properties appropriate for the high-temperature condensate corundum from CARMA cloud microphysics models. We conduct a suite of GCM simulations with varying cloud microphysical and radiative properties, and we find that partial cloud coverage is a ubiquitous outcome of our simulations. This patchy cloud distribution is inherently set by atmospheric dynamics in addition to equilibrium cloud condensation, and causes a cloud greenhouse effect that warms the atmosphere below the cloud deck. Nightside clouds are further sequestered at depth due to a dynamically induced high-altitude thermal inversion. We post-process our GCMs with the Monte Carlo radiative transfer code gCMCRT and find that the patchy clouds on ultra-hot Jupiters do not significantly impact transmission spectra but can affect their phase-dependent emission spectra.


title: Whole-Body Human Kinematics Estimation using Dynamical Inverse Kinematics and Contact-Aided Lie Group Kalman Filter

abstract: Full-body motion estimation of a human through wearable sensing technologies is challenging in the absence of position sensors. This paper contributes to the development of a model-based whole-body kinematics estimation algorithm using wearable distributed inertial and force-torque sensing. This is done by extending the existing dynamical optimization-based Inverse Kinematics (IK) approach for joint state estimation, in cascade, to include a center of pressure-based contact detector and a contact-aided Kalman filter on Lie groups for floating base pose estimation. The proposed method is tested in an experimental scenario where a human equipped with a sensorized suit and shoes performs walking motions. The proposed method is demonstrated to obtain a reliable reconstruction of the whole-body human motion.


title: 2SLS with Multiple Treatments

abstract: We study what two-stage least squares (2SLS) identifies in models with multiple treatments under treatment effect heterogeneity. Two conditions are shown to be necessary and sufficient for the 2SLS to identify positively weighted sums of agent-specific effects of each treatment: average conditional monotonicity and no cross effects. Our identification analysis allows for any number of treatments, any number of continuous or discrete instruments, and the inclusion of covariates. We provide testable implications and present characterizations of choice behavior implied by our identification conditions.


title: Noisy propagation of Gaussian states in optical media with finite bandwidth

abstract: We address propagation and entanglement of Gaussian states in optical media characterised by non-trivial spectral densities. In particular, we consider environments with a finite bandwidth and show that in the low temperature regime: i) secular terms in the master equation may be neglected; ii) attenuation (damping) is strongly suppressed; iii) the overall diffusion process may be described as a Gaussian noise channel with variance depending only on the bandwidth. We find several regimes where propagation is not much detrimental and entanglement may be protected form decoherence.


title: Physics-informed machine learning techniques for edge plasma turbulence modelling in computational theory and experiment

abstract: Edge plasma turbulence is critical to the performance of magnetic confinement fusion devices. Towards better understanding edge turbulence in both theory and experiment, a custom-built physics-informed deep learning framework constrained by partial differential equations is developed to accurately learn turbulent fields consistent with the two-fluid theory from partial observations of electron pressure. This calculation is not otherwise possible using conventional equilibrium models. With this technique, the first direct quantitative comparisons of turbulent fields between electrostatic two-fluid theory and electromagnetic gyrokinetic modelling are demonstrated with good overall agreement found in magnetized helical plasmas at low normalized pressure. To translate these computational techniques to experimental fusion plasmas, a novel method to translate brightness measurements of HeI line radiation into local plasma fluctuations is demonstrated via a newly created deep learning framework that integrates neutral transport physics and collisional radiative theory for the $3^3 D - 2^3 P$ transition in atomic helium. Using fast camera data on the Alcator C-Mod tokamak, this thesis presents the first 2-dimensional time-dependent experimental measurements of the turbulent electron density, electron temperature, and neutral density in a fusion plasma using a single spectral line. With this experimentally inferred data, initial estimates of the 2-dimensional turbulent electric field consistent with drift-reduced Braginskii theory under the framework of an axisymmetric fusion plasma with purely toroidal field are calculated. The inclusion of atomic helium effects on particle and energy sources are found to strengthen correlations between the electric field and electron pressure while broadening turbulent field amplitudes which impact ${\bf E \times B}$ flows and shearing rates.

categories: physics.plasm-ph cs.LG cs.NA math.NA stat.ML


title: Deep Spectral Methods: A Surprisingly Strong Baseline for Unsupervised Semantic Segmentation and Localization

abstract: Unsupervised localization and segmentation are long-standing computer vision challenges that involve decomposing an image into semantically-meaningful segments without any labeled data. These tasks are particularly interesting in an unsupervised setting due to the difficulty and cost of obtaining dense image annotations, but existing unsupervised approaches struggle with complex scenes containing multiple objects. Differently from existing methods, which are purely based on deep learning, we take inspiration from traditional spectral segmentation methods by reframing image decomposition as a graph partitioning problem. Specifically, we examine the eigenvectors of the Laplacian of a feature affinity matrix from self-supervised networks. We find that these eigenvectors already decompose an image into meaningful segments, and can be readily used to localize objects in a scene. Furthermore, by clustering the features associated with these segments across a dataset, we can obtain well-delineated, nameable regions, i.e. semantic segmentations. Experiments on complex datasets (Pascal VOC, MS-COCO) demonstrate that our simple spectral method outperforms the state-of-the-art in unsupervised localization and segmentation by a significant margin. Furthermore, our method can be readily used for a variety of complex image editing tasks, such as background removal and compositing.


title: Obstructions to asymptotic stabilization

abstract: Necessary conditions for asymptotic stability and stabilizability of subsets for dynamical and control systems are obtained. The main necessary condition is homotopical and is in turn used to obtain a homological one. A certain extension is ruled out. Questions are posed.


title: On the arithmetic case of Vojta's conjecture with truncated counting functions

abstract: We prove a Diophantine approximation inequality for rational points in varieties of any dimension, in the direction of Vojta's conjecture with truncated counting functions. Our results also provide a bound towards the $abc$ conjecture which in several cases is subexponential. The main theorem gives a lower bound for the truncated counting function relative to a divisor with sufficiently many components, in terms of the proximity to an algebraic point. Furthermore, we show that the Lang-Waldschmidt conjecture implies a special case of Vojta's conjecture with truncation in arbitrary dimension. Our methods are based on the theory of linear forms in logarithms and a geometric construction.


title: A globalisation of Jones and Alexander polynomials constructed from a graded intersection of two Lagrangians in a configuration space

abstract: We consider two Laurent polynomials in two variables associated to a braid, given by {\em graded intersections} between {\em fixed Lagrangians in configuration spaces}. In order to get link invariants, we notice that we have to quotient by a quadratic relation. Then we prove by topological tools that this relation is sufficient and the first graded intersection gives an invariant which is the Jones polynomial. This shows a {\em topological model for the Jones polynomial} and a direct {\em topological proof}\hspace{0.4mm} that it is a well-defined invariant. The other intersection model in the quotient turns out to be an invariant globalising the Jones and Alexander polynomials. This globalisation in the quotient ring is given by a {\em specific interpolation between the Alexander and Jones polynomials}.


title: Loss Landscape Engineering via Data Regulation on PINNs

abstract: Physics-Informed Neural Networks have shown unique utility in parameterising the solution of a well-defined partial differential equation using automatic differentiation and residual losses. Though they provide theoretical guarantees of convergence, in practice the required training regimes tend to be exacting and demanding. Through the course of this paper, we take a deep dive into understanding the loss landscapes associated with a PINN and how that offers some insight as to why PINNs are fundamentally hard to optimise for. We demonstrate how PINNs can be forced to converge better towards the solution, by way of feeding in sparse or coarse data as a regulator. The data regulates and morphs the topology of the loss landscape associated with the PINN to make it easily traversable for the minimiser. Data regulation of PINNs helps ease the optimisation required for convergence by invoking a hybrid unsupervised-supervised training approach, where the labelled data pushes the network towards the vicinity of the solution, and the unlabelled regime fine-tunes it to the solution.


title: Guess What Moves: Unsupervised Video and Image Segmentation by Anticipating Motion

abstract: Motion, measured via optical flow, provides a powerful cue to discover and learn objects in images and videos. However, compared to using appearance, it has some blind spots, such as the fact that objects become invisible if they do not move. In this work, we propose an approach that combines the strengths of motion-based and appearance-based segmentation. We propose to supervise an image segmentation network with the pretext task of predicting regions that are likely to contain simple motion patterns, and thus likely to correspond to objects. As the model only uses a single image as input, we can apply it in two settings: unsupervised video segmentation, and unsupervised image segmentation. We achieve state-of-the-art results for videos, and demonstrate the viability of our approach on still images containing novel objects. Additionally we experiment with different motion models and optical flow backbones and find the method to be robust to these change. Project page and code available at https://www.robots.ox.ac.uk/~vgg/research/gwm.


title: Non-Universal Stellar Initial Mass Functions: Large Uncertainties in Star Formation Rates at $z\approx 2-4$ and Other Astrophysical Probes

abstract: We explore the assumption, widely used in many astrophysical calculations, that the stellar initial mass function (IMF) is universal across all galaxies. By considering both a canonical Salpeter-like IMF and a non-universal IMF, we are able to compare the effect of different IMFs on multiple observables and derived quantities in astrophysics. Specifically, we consider a non-universal IMF which varies as a function of the local star formation rate, and explore the effects on the star formation rate density (SFRD), the extragalactic background light, the supernova (both core-collapse and thermonuclear) rates, and the diffuse supernova neutrino background. Our most interesting result is that our adopted varying IMF leads to much greater uncertainty on the SFRD at $z \approx 2-4$ than is usually assumed. Indeed, we find a SFRD (inferred using observed galaxy luminosity distributions) that is a factor of $\gtrsim 3$ lower than canonical results obtained using a universal Salpeter-like IMF. Secondly, the non-universal IMF we explore implies a reduction in the supernova core-collapse rate of a factor of $\sim2$, compared against a universal IMF. The other potential tracers are only slightly affected by changes to the properties of the IMF. We find that currently available data do not provide a clear preference for universal or non-universal IMF. However, improvements to measurements of the star formation rate and core-collapse supernova rate at redshifts $z \gtrsim 2$ may offer the best prospects for discernment.

categories: astro-ph.GA astro-ph.CO astro-ph.IM astro-ph.SR


title: Exclusive production of a pair of high transverse momentum photons in pion-nucleon collisions for extracting generalized parton distributions

abstract: We show that exclusive production of a pair of high transverse momentum photons in pion-nucleon collisions can be systematically studied in QCD factorization approach if the photon's transverse momentum $q_T$ with respect to the colliding pion is much greater than $\Lambda_{\rm QCD}$. We demonstrate that the leading power non-perturbative contributions to the scattering amplitudes of this exclusive process are process-independent and can be systematically factorized into universal pion's distribution amplitudes (DAs) and nucleon's generalized parton distributions (GPDs), which are convoluted with corresponding infrared safe and perturbatively calculable short-distance hard parts. The correction to this factorized expression is suppressed by powers of $1/q_T$. We demonstrate quantitatively that this new type of exclusive processes is not only complementary to existing processes for extracting GPDs, but also capable of providing an enhanced sensitivity to the dependence of both DAs and GPDs on the active parton's momentum fraction $x$. We also introduce additional, but the same type of exclusive observables to enhance our capability to explore GPDs, in particular, their $x$-dependence.


title: Benefits and Drawbacks of a Graduate Course: An Experience Teaching Systematic Literature Review

abstract: Graduate courses can provide specialized knowledge for Ph.D. and Master's students and contribute to develop their hard and soft skills. At the same time, Systematic Literature Review (SLR) has been increasingly adopted in the computing area as a valuable technique to synthesize the state of the art of a given research topic. However, there is still a poor understanding of the real benefits and drawbacks of offering the SLR course for graduate students. This paper reports an experience that examines such benefits and drawbacks, the difficulties for professors (i.e., educators), and the essential SLR topics to be taught as well as a way to better teach them. We also surveyed computer science graduate students who attended the SLR course, which we have offered for almost ten years for Ph.D. and Master's students in our institution. We found the attendance to the SLR course is a valuable opportunity for graduate students to conduct the required deep literature review of their research topic, improve their research skills, and increase their formation. Hence, we recommend that Ph.D. and Masters' programs offer the SLR course to contribute to their academic achievement.


title: Power and limitations of single-qubit native quantum neural networks

abstract: Quantum neural networks (QNNs) have emerged as a leading strategy to establish applications in machine learning, chemistry, and optimization. While the applications of QNN have been widely investigated, its theoretical foundation remains less understood. In this paper, we formulate a theoretical framework for the expressive ability of data re-uploading quantum neural networks that consist of interleaved encoding circuit blocks and trainable circuit blocks. First, we prove that single-qubit quantum neural networks can approximate any univariate function by mapping the model to a partial Fourier series. We in particular establish the exact correlations between the parameters of the trainable gates and the Fourier coefficients, resolving an open problem on the universal approximation property of QNN. Second, we discuss the limitations of single-qubit native QNNs on approximating multivariate functions by analyzing the frequency spectrum and the flexibility of Fourier coefficients. We further demonstrate the expressivity and limitations of single-qubit native QNNs via numerical experiments. We believe these results would improve our understanding of QNNs and provide a helpful guideline for designing powerful QNNs for machine learning tasks.

categories: quant-ph cond-mat.dis-nn cs.AI cs.LG math-ph math.MP


title: Cosmological Bound on the QCD Axion Mass, Redux

abstract: We revisit the joint constraints in the mixed hot dark matter scenario in which both thermally produced QCD axions and relic neutrinos are present. Upon recomputing the cosmological axion abundance via recent advances in the literature, we improve the state-of-the-art analyses and provide updated bounds on axion and neutrino masses. By avoiding approximate methods, such as the instantaneous decoupling approximation, and limitations due to the limited validity of the perturbative approach in QCD that forced to artificially divide the constraints from the axion-pion and the axion-gluon production channels, we find robust and self-consistent limits. We investigate the two most popular axion frameworks: KSVZ and DFSZ. From Big Bang Nucleosynthesis (BBN) light element abundances data we find for the KSVZ axion $\Delta N_{\rm eff}<0.31$ and an axion mass bound $m_a < 0.53 $ eV (i.e., a bound on the axion decay constant $f_a > 1.07 \times 10^7$ GeV) both at $95\%$ CL. These BBN bounds are improved to $\Delta N_{\rm eff}<0.14$ and $m_a< 0.16$ eV ($f_a > 3.56 \times 10^7$ GeV) if a prior on the baryon energy density from Cosmic Microwave Background (CMB) data is assumed. When instead considering cosmological observations from the CMB temperature, polarization and lensing from the Planck satellite combined with large scale structure data we find $\Delta N_{\rm eff}<0.23$, $m_a< 0.28$ eV ($f_a > 2.02 \times 10^7$ GeV) and $\sum m_\nu < 0.16$ eV at $95\%$ CL. This corresponds approximately to a factor of $5$ improvement in the axion mass bound with respect to the existing limits. Very similar results are obtained for the DFSZ axion. We also forecast upcoming observations from future CMB and galaxy surveys, showing that they could reach percent level errors for $m_a\sim 1$ eV.


title: Hyperdimensional Hashing: A Robust and Efficient Dynamic Hash Table

abstract: Most cloud services and distributed applications rely on hashing algorithms that allow dynamic scaling of a robust and efficient hash table. Examples include AWS, Google Cloud and BitTorrent. Consistent and rendezvous hashing are algorithms that minimize key remapping as the hash table resizes. While memory errors in large-scale cloud deployments are common, neither algorithm offers both efficiency and robustness. Hyperdimensional Computing is an emerging computational model that has inherent efficiency, robustness and is well suited for vector or hardware acceleration. We propose Hyperdimensional (HD) hashing and show that it has the efficiency to be deployed in large systems. Moreover, a realistic level of memory errors causes more than 20% mismatches for consistent hashing while HD hashing remains unaffected.


title: ST-ExpertNet: A Deep Expert Framework for Traffic Prediction

abstract: Recently, forecasting the crowd flows has become an important research topic, and plentiful technologies have achieved good performances. As we all know, the flow at a citywide level is in a mixed state with several basic patterns (e.g., commuting, working, and commercial) caused by the city area functional distributions (e.g., developed commercial areas, educational areas and parks). However, existing technologies have been criticized for their lack of considering the differences in the flow patterns among regions since they want to build only one comprehensive model to learn the mixed flow tensors. Recognizing this limitation, we present a new perspective on flow prediction and propose an explainable framework named ST-ExpertNet, which can adopt every spatial-temporal model and train a set of functional experts devoted to specific flow patterns. Technically, we train a bunch of experts based on the Mixture of Experts (MoE), which guides each expert to specialize in different kinds of flow patterns in sample spaces by using the gating network. We define several criteria, including comprehensiveness, sparsity, and preciseness, to construct the experts for better interpretability and performances. We conduct experiments on a wide range of real-world taxi and bike datasets in Beijing and NYC. The visualizations of the expert's intermediate results demonstrate that our ST-ExpertNet successfully disentangles the city's mixed flow tensors along with the city layout, e.g., the urban ring road structure. Different network architectures, such as ST-ResNet, ConvLSTM, and CNN, have been adopted into our ST-ExpertNet framework for experiments and the results demonstrates the superiority of our framework in both interpretability and performances.


title: REMuS-GNN: A Rotation-Equivariant Model for Simulating Continuum Dynamics

abstract: Numerical simulation is an essential tool in many areas of science and engineering, but its performance often limits application in practice or when used to explore large parameter spaces. On the other hand, surrogate deep learning models, while accelerating simulations, often exhibit poor accuracy and ability to generalise. In order to improve these two factors, we introduce REMuS-GNN, a rotation-equivariant multi-scale model for simulating continuum dynamical systems encompassing a range of length scales. REMuS-GNN is designed to predict an output vector field from an input vector field on a physical domain discretised into an unstructured set of nodes. Equivariance to rotations of the domain is a desirable inductive bias that allows the network to learn the underlying physics more efficiently, leading to improved accuracy and generalisation compared with similar architectures that lack such symmetry. We demonstrate and evaluate this method on the incompressible flow around elliptical cylinders.


title: Heterogeneous Domain Adaptation with Adversarial Neural Representation Learning: Experiments on E-Commerce and Cybersecurity

abstract: Learning predictive models in new domains with scarce training data is a growing challenge in modern supervised learning scenarios. This incentivizes developing domain adaptation methods that leverage the knowledge in known domains (source) and adapt to new domains (target) with a different probability distribution. This becomes more challenging when the source and target domains are in heterogeneous feature spaces, known as heterogeneous domain adaptation (HDA). While most HDA methods utilize mathematical optimization to map source and target data to a common space, they suffer from low transferability. Neural representations have proven to be more transferable; however, they are mainly designed for homogeneous environments. Drawing on the theory of domain adaptation, we propose a novel framework, Heterogeneous Adversarial Neural Domain Adaptation (HANDA), to effectively maximize the transferability in heterogeneous environments. HANDA conducts feature and distribution alignment in a unified neural network architecture and achieves domain invariance through adversarial kernel learning. Three experiments were conducted to evaluate the performance against the state-of-the-art HDA methods on major image and text e-commerce benchmarks. HANDA shows statistically significant improvement in predictive performance. The practical utility of HANDA was shown in real-world dark web online markets. HANDA is an important step towards successful domain adaptation in e-commerce applications.


title: Functional2Structural: Cross-Modality Brain Networks Representation Learning

abstract: MRI-based modeling of brain networks has been widely used to understand functional and structural interactions and connections among brain regions, and factors that affect them, such as brain development and disease. Graph mining on brain networks may facilitate the discovery of novel biomarkers for clinical phenotypes and neurodegenerative diseases. Since brain networks derived from functional and structural MRI describe the brain topology from different perspectives, exploring a representation that combines these cross-modality brain networks is non-trivial. Most current studies aim to extract a fused representation of the two types of brain network by projecting the structural network to the functional counterpart. Since the functional network is dynamic and the structural network is static, mapping a static object to a dynamic object is suboptimal. However, mapping in the opposite direction is not feasible due to the non-negativity requirement of current graph learning techniques. Here, we propose a novel graph learning framework, known as Deep Signed Brain Networks (DSBN), with a signed graph encoder that, from an opposite perspective, learns the cross-modality representations by projecting the functional network to the structural counterpart. We validate our framework on clinical phenotype and neurodegenerative disease prediction tasks using two independent, publicly available datasets (HCP and OASIS). The experimental results clearly demonstrate the advantages of our model compared to several state-of-the-art methods.


title: Decentral and Incentivized Federated Learning Frameworks: A Systematic Literature Review

abstract: The advent of Federated Learning (FL) has ignited a new paradigm for parallel and confidential decentralized Machine Learning (ML) with the potential of utilizing the computational power of a vast number of IoT, mobile and edge devices without data leaving the respective device, ensuring privacy by design. Yet, in order to scale this new paradigm beyond small groups of already entrusted entities towards mass adoption, the Federated Learning Framework (FLF) has to become (i) truly decentralized and (ii) participants have to be incentivized. This is the first systematic literature review analyzing holistic FLFs in the domain of both, decentralized and incentivized federated learning. 422 publications were retrieved, by querying 12 major scientific databases. Finally, 40 articles remained after a systematic review and filtering process for in-depth examination. Although having massive potential to direct the future of a more distributed and secure AI, none of the analyzed FLF is production-ready. The approaches vary heavily in terms of use-cases, system design, solved issues and thoroughness. We are the first to provide a systematic approach to classify and quantify differences between FLF, exposing limitations of current works and derive future directions for research in this novel domain.


title: Impact of Learning Rate on Noise Resistant Property of Deep Learning Models

abstract: The interest in analog computation has grown tremendously in recent years due to its fast computation speed and excellent energy efficiency, which is very important for edge and IoT devices in the sub-watt power envelope for deep learning inferencing. However, significant performance degradation suffered by deep learning models due to the inherent noise present in the analog computation can limit their use in mission-critical applications. Hence, there is a need to understand the impact of critical model hyperparameters choice on the resulting model noise-resistant property. This need is critical as the insight obtained can be used to design deep learning models that are robust to analog noise. In this paper, the impact of the learning rate, a critical design choice, on the noise-resistant property is investigated. The study is achieved by first training deep learning models using different learning rates. Thereafter, the models are injected with analog noise and the noise-resistant property of the resulting models is examined by measuring the performance degradation due to the analog noise. The results showed there exists a sweet spot of learning rate values that achieves a good balance between model prediction performance and model noise-resistant property. Furthermore, the theoretical justification of the observed phenomenon is provided.


title: Neural Program Synthesis with Query

abstract: Aiming to find a program satisfying the user intent given input-output examples, program synthesis has attracted increasing interest in the area of machine learning. Despite the promising performance of existing methods, most of their success comes from the privileged information of well-designed input-output examples. However, providing such input-output examples is unrealistic because it requires the users to have the ability to describe the underlying program with a few input-output examples under the training distribution. In this work, we propose a query-based framework that trains a query neural network to generate informative input-output examples automatically and interactively from a large query space. The quality of the query depends on the amount of the mutual information between the query and the corresponding program, which can guide the optimization of the query framework. To estimate the mutual information more accurately, we introduce the functional space (F-space) which models the relevance between the input-output examples and the programs in a differentiable way. We evaluate the effectiveness and generalization of the proposed query-based framework on the Karel task and the list processing task. Experimental results show that the query-based framework can generate informative input-output examples which achieve and even outperform well-designed input-output examples.


title: Predicting tacrolimus exposure in kidney transplanted patients using machine learning

abstract: Tacrolimus is one of the cornerstone immunosuppressive drugs in most transplantation centers worldwide following solid organ transplantation. Therapeutic drug monitoring of tacrolimus is necessary in order to avoid rejection of the transplanted organ or severe side effects. However, finding the right dose for a given patient is challenging, even for experienced clinicians. Consequently, a tool that can accurately estimate the drug exposure for individual dose adaptions would be of high clinical value. In this work, we propose a new technique using machine learning to estimate the tacrolimus exposure in kidney transplant recipients. Our models achieve predictive errors that are at the same level as an established population pharmacokinetic model, but are faster to develop and require less knowledge about the pharmacokinetic properties of the drug.


title: Btech thesis report on adversarial attack detection and purification of adverserially attacked images

abstract: This is Btech thesis report on detection and purification of adverserially attacked images. A deep learning model is trained on certain training examples for various tasks such as classification, regression etc. By training, weights are adjusted such that the model performs the task well not only on training examples judged by a certain metric but has an excellent ability to generalize on other unseen examples as well which are typically called the test data. Despite the huge success of machine learning models on a wide range of tasks, security has received a lot less attention along the years. Robustness along various potential cyber attacks also should be a metric for the accuracy of the machine learning models. These cyber attacks can potentially lead to a variety of negative impacts in the real world sensitive applications for which machine learning is used such as medical and transportation systems. Hence, it is a necessity to secure the system from such attacks. Int this report, I focus on a class of these cyber attacks called the adversarial attacks in which the original input sample is modified by small perturbations such that they still look visually the same to human beings but the machine learning models are fooled by such inputs. In this report I discuss 2 novel ways to counter the adversarial attack using AutoEncoders, 1) by detecting the presence of adversaries and 2) purifying these adversaries to make target classification models robust against such attacks.


title: AdaCap: Adaptive Capacity control for Feed-Forward Neural Networks

abstract: The capacity of a ML model refers to the range of functions this model can approximate. It impacts both the complexity of the patterns a model can learn but also memorization, the ability of a model to fit arbitrary labels. We propose Adaptive Capacity (AdaCap), a training scheme for Feed-Forward Neural Networks (FFNN). AdaCap optimizes the capacity of FFNN so it can capture the high-level abstract representations underlying the problem at hand without memorizing the training dataset. AdaCap is the combination of two novel ingredients, the Muddling labels for Regularization (MLR) loss and the Tikhonov operator training scheme. The MLR loss leverages randomly generated labels to quantify the propensity of a model to memorize. We prove that the MLR loss is an accurate in-sample estimator for out-of-sample generalization performance and that it can be used to perform Hyper-Parameter Optimization provided a Signal-to-Noise Ratio condition is met. The Tikhonov operator training scheme modulates the capacity of a FFNN in an adaptive, differentiable and data-dependent manner. We assess the effectiveness of AdaCap in a setting where DNN are typically prone to memorization, small tabular datasets, and benchmark its performance against popular machine learning methods.


title: Depression Diagnosis and Forecast based on Mobile Phone Sensor Data

abstract: Previous studies have shown the correlation between sensor data collected from mobile phones and human depression states. Compared to the traditional self-assessment questionnaires, the passive data collected from mobile phones is easier to access and less time-consuming. In particular, passive mobile phone data can be collected on a flexible time interval, thus detecting moment-by-moment psychological changes and helping achieve earlier interventions. Moreover, while previous studies mainly focused on depression diagnosis using mobile phone data, depression forecasting has not received sufficient attention. In this work, we extract four types of passive features from mobile phone data, including phone call, phone usage, user activity, and GPS features. We implement a long short-term memory (LSTM) network in a subject-independent 10-fold cross-validation setup to model both a diagnostic and a forecasting tasks. Experimental results show that the forecasting task achieves comparable results with the diagnostic task, which indicates the possibility of forecasting depression from mobile phone sensor data. Our model achieves an accuracy of 77.0 % for major depression forecasting (binary), an accuracy of 53.7 % for depression severity forecasting (5 classes), and a best RMSE score of 4.094 (PHQ-9, range from 0 to 27).


title: A Safety Assurable Human-Inspired Perception Architecture

abstract: Although artificial intelligence-based perception (AIP) using deep neural networks (DNN) has achieved near human level performance, its well-known limitations are obstacles to the safety assurance needed in autonomous applications. These include vulnerability to adversarial inputs, inability to handle novel inputs and non-interpretability. While research in addressing these limitations is active, in this paper, we argue that a fundamentally different approach is needed to address them. Inspired by dual process models of human cognition, where Type 1 thinking is fast and non-conscious while Type 2 thinking is slow and based on conscious reasoning, we propose a dual process architecture for safe AIP. We review research on how humans address the simplest non-trivial perception problem, image classification, and sketch a corresponding AIP architecture for this task. We argue that this architecture can provide a systematic way of addressing the limitations of AIP using DNNs and an approach to assurance of human-level performance and beyond. We conclude by discussing what components of the architecture may already be addressed by existing work and what remains future work.


title: Quality versus speed in energy demand prediction for district heating systems

abstract: In this paper, we consider energy demand prediction in district heating systems. Effective energy demand prediction is essential in combined heat power systems when offering electrical energy in competitive electricity markets. To address this problem, we propose two sets of algorithms: (1) a novel extension to the algorithm proposed by E. Dotzauer and (2) an autoregressive predictor based on hour-of-week adjusted linear regression on moving averages of energy consumption. These two methods are compared against state-of-the-art artificial neural networks. Energy demand predictor algorithms have various computational costs and prediction quality. While prediction quality is a widely used measure of predictor superiority, computational costs are less frequently analyzed and their impact is not so extensively studied. When predictor algorithms are constantly updated using new data, some computationally expensive forecasting methods may become inapplicable. The computational costs can be split into training and execution parts. The execution part is the cost paid when the already trained algorithm is applied to predict something. In this paper, we evaluate the above methods with respect to the quality and computational costs, both in the training and in the execution. The comparison is conducted on a real-world dataset from a district heating system in the northwest part of Poland.


title: Privacy Enhancement for Cloud-Based Few-Shot Learning

abstract: Requiring less data for accurate models, few-shot learning has shown robustness and generality in many application domains. However, deploying few-shot models in untrusted environments may inflict privacy concerns, e.g., attacks or adversaries that may breach the privacy of user-supplied data. This paper studies the privacy enhancement for the few-shot learning in an untrusted environment, e.g., the cloud, by establishing a novel privacy-preserved embedding space that preserves the privacy of data and maintains the accuracy of the model. We examine the impact of various image privacy methods such as blurring, pixelization, Gaussian noise, and differentially private pixelization (DP-Pix) on few-shot image classification and propose a method that learns privacy-preserved representation through the joint loss. The empirical results show how privacy-performance trade-off can be negotiated for privacy-enhanced few-shot learning.


title: Simple Contrastive Graph Clustering

abstract: Contrastive learning has recently attracted plenty of attention in deep graph clustering for its promising performance. However, complicated data augmentations and time-consuming graph convolutional operation undermine the efficiency of these methods. To solve this problem, we propose a Simple Contrastive Graph Clustering (SCGC) algorithm to improve the existing methods from the perspectives of network architecture, data augmentation, and objective function. As to the architecture, our network includes two main parts, i.e., pre-processing and network backbone. A simple low-pass denoising operation conducts neighbor information aggregation as an independent pre-processing, and only two multilayer perceptrons (MLPs) are included as the backbone. For data augmentation, instead of introducing complex operations over graphs, we construct two augmented views of the same vertex by designing parameter un-shared siamese encoders and corrupting the node embeddings directly. Finally, as to the objective function, to further improve the clustering performance, a novel cross-view structural consistency objective function is designed to enhance the discriminative capability of the learned network. Extensive experimental results on seven benchmark datasets validate our proposed algorithm's effectiveness and superiority. Significantly, our algorithm outperforms the recent contrastive deep clustering competitors with at least seven times speedup on average.


title: Primal-Dual UNet for Sparse View Cone Beam Computed Tomography Volume Reconstruction

abstract: In this paper, the Primal-Dual UNet for sparse view CT reconstruction is modified to be applicable to cone beam projections and perform reconstructions of entire volumes instead of slices. Experiments show that the PSNR of the proposed method is increased by 10dB compared to the direct FDK reconstruction and almost 3dB compared to the modified original Primal-Dual Network when using only 23 projections. The presented network is not optimized wrt. memory consumption or hyperparameters but merely serves as a proof of concept and is limited to low resolution projections and volumes.


title: Feature and Instance Joint Selection: A Reinforcement Learning Perspective

abstract: Feature selection and instance selection are two important techniques of data processing. However, such selections have mostly been studied separately, while existing work towards the joint selection conducts feature/instance selection coarsely; thus neglecting the latent fine-grained interaction between feature space and instance space. To address this challenge, we propose a reinforcement learning solution to accomplish the joint selection task and simultaneously capture the interaction between the selection of each feature and each instance. In particular, a sequential-scanning mechanism is designed as action strategy of agents, and a collaborative-changing environment is used to enhance agent collaboration. In addition, an interactive paradigm introduces prior selection knowledge to help agents for more efficient exploration. Finally, extensive experiments on real-world datasets have demonstrated improved performances.


title: Minimal Neural Network Models for Permutation Invariant Agents

abstract: Organisms in nature have evolved to exhibit flexibility in face of changes to the environment and/or to themselves. Artificial neural networks (ANNs) have proven useful for controlling of artificial agents acting in environments. However, most ANN models used for reinforcement learning-type tasks have a rigid structure that does not allow for varying input sizes. Further, they fail catastrophically if inputs are presented in an ordering unseen during optimization. We find that these two ANN inflexibilities can be mitigated and their solutions are simple and highly related. For permutation invariance, no optimized parameters can be tied to a specific index of the input elements. For size invariance, inputs must be projected onto a common space that does not grow with the number of projections. Based on these restrictions, we construct a conceptually simple model that exhibit flexibility most ANNs lack. We demonstrate the model's properties on multiple control problems, and show that it can cope with even very rapid permutations of input indices, as well as changes in input size. Ablation studies show that is possible to achieve these properties with simple feedforward structures, but that it is much easier to optimize recurrent structures.


title: Near out-of-distribution detection for low-resolution radar micro-Doppler signatures

abstract: Near out-of-distribution detection (OODD) aims at discriminating semantically similar data points without the supervision required for classification. This paper puts forward an OODD use case for radar targets detection extensible to other kinds of sensors and detection scenarios. We emphasize the relevance of OODD and its specific supervision requirements for the detection of a multimodal, diverse targets class among other similar radar targets and clutter in real-life critical systems. We propose a comparison of deep and non-deep OODD methods on simulated low-resolution pulse radar micro-Doppler signatures, considering both a spectral and a covariance matrix input representation. The covariance representation aims at estimating whether dedicated second-order processing is appropriate to discriminate signatures. The potential contributions of labeled anomalies in training, self-supervised learning, contrastive learning insights and innovative training losses are discussed, and the impact of training set contamination caused by mislabelling is investigated.


title: Unsupervised Driving Behavior Analysis using Representation Learning and Exploiting Group-based Training

abstract: Driving behavior monitoring plays a crucial role in managing road safety and decreasing the risk of traffic accidents. Driving behavior is affected by multiple factors like vehicle characteristics, types of roads, traffic, but, most importantly, the pattern of driving of individuals. Current work performs a robust driving pattern analysis by capturing variations in driving patterns. It forms consistent groups by learning compressed representation of time series (Auto Encoded Compact Sequence) using a multi-layer seq-2-seq autoencoder and exploiting hierarchical clustering along with recommending the choice of best distance measure. Consistent groups aid in identifying variations in driving patterns of individuals captured in the dataset. These groups are generated for both train and hidden test data. The consistent groups formed using train data, are exploited for training multiple instances of the classifier. Obtained choice of best distance measure is used to select the best train-test pair of consistent groups. We have experimented on the publicly available UAH-DriveSet dataset considering the signals captured from IMU sensors (accelerometer and gyroscope) for classifying driving behavior. We observe proposed method, significantly outperforms the benchmark performance.


title: Mondrian Forest for Data Stream Classification Under Memory Constraints

abstract: Supervised learning algorithms generally assume the availability of enough memory to store their data model during the training and test phases. However, in the Internet of Things, this assumption is unrealistic when data comes in the form of infinite data streams, or when learning algorithms are deployed on devices with reduced amounts of memory. In this paper, we adapt the online Mondrian forest classification algorithm to work with memory constraints on data streams. In particular, we design five out-of-memory strategies to update Mondrian trees with new data points when the memory limit is reached. Moreover, we design trimming mechanisms to make Mondrian trees more robust to concept drifts under memory constraints. We evaluate our algorithms on a variety of real and simulated datasets, and we conclude with recommendations on their use in different situations: the Extend Node strategy appears as the best out-of-memory strategy in all configurations, whereas different trimming mechanisms should be adopted depending on whether a concept drift is expected. All our methods are implemented in the OrpailleCC open-source library and are ready to be used on embedded systems and connected objects.


title: ScAN: Suicide Attempt and Ideation Events Dataset

abstract: Suicide is an important public health concern and one of the leading causes of death worldwide. Suicidal behaviors, including suicide attempts (SA) and suicide ideations (SI), are leading risk factors for death by suicide. Information related to patients' previous and current SA and SI are frequently documented in the electronic health record (EHR) notes. Accurate detection of such documentation may help improve surveillance and predictions of patients' suicidal behaviors and alert medical professionals for suicide prevention efforts. In this study, we first built Suicide Attempt and Ideation Events (ScAN) dataset, a subset of the publicly available MIMIC III dataset spanning over 12k+ EHR notes with 19k+ annotated SA and SI events information. The annotations also contain attributes such as method of suicide attempt. We also provide a strong baseline model ScANER (Suicide Attempt and Ideation Events Retriever), a multi-task RoBERTa-based model with a retrieval module to extract all the relevant suicidal behavioral evidences from EHR notes of an hospital-stay and, and a prediction module to identify the type of suicidal behavior (SA and SI) concluded during the patient's stay at the hospital. ScANER achieved a macro-weighted F1-score of 0.83 for identifying suicidal behavioral evidences and a macro F1-score of 0.78 and 0.60 for classification of SA and SI for the patient's hospital-stay, respectively. ScAN and ScANER are publicly available.


title: HDR Lighting Dilation for Dynamic Range Reduction on Virtual Production Stages

abstract: We present a technique to reduce the dynamic range of an HDRI lighting environment map in an efficient, energy-preserving manner by spreading out the light of concentrated light sources. This allows us to display a reasonable approximation of the illumination of an HDRI map in a lighting reproduction system with limited dynamic range such as virtual production LED Stage. The technique identifies regions of the HDRI map above a given pixel threshold, dilates these regions until the average pixel value within each is below the threshold, and finally replaces each dilated region's pixels with the region's average pixel value. The new HDRI map contains the same energy as the original, spreads the light as little as possible, and avoids chromatic fringing.


title: How to Fine-tune Models with Few Samples: Update, Data Augmentation, and Test-time Augmentation

abstract: Most of the recent few-shot learning (FSL) algorithms are based on transfer learning, where a model is pre-trained using a large amount of source data, and the pre-trained model is fine-tuned using a small amount of target data. In transfer learning-based FSL, sophisticated pre-training methods have been widely studied for universal representation. Therefore, it has become more important to utilize the universal representation for downstream tasks, but there are few studies on fine-tuning in FSL. In this paper, we focus on how to transfer pre-trained models to few-shot downstream tasks from the three perspectives: update, data augmentation, and test-time augmentation. First, we compare the two popular update methods, full fine-tuning (i.e., updating the entire network, FT) and linear probing (i.e., updating only a linear classifier, LP). We find that LP is better than FT with extremely few samples, whereas FT outperforms LP as training samples increase. Next, we show that data augmentation cannot guarantee few-shot performance improvement and investigate the effectiveness of data augmentation based on the intensity of augmentation. Finally, we adopt augmentation to both a support set for update (i.e., data augmentation) as well as a query set for prediction (i.e., test-time augmentation), considering support-query distribution shifts, and improve few-shot performance. The code is available at https://github.com/kimyuji/updating_FSL.


title: The Hard Truth about Soft Skills in Game Development

abstract: This article explores the value and measurable effects of hard and soft skills in academia when teaching and developing abilities for the game industry. As we discuss, each individuals engagement with the subject directly impacts their performance; which is influenced by their 'soft' skill level. Students that succeed in mastering soft skills earlier on typically have a greater understanding and satisfaction of the subject (able to see the underlying heterogeneous nature of the material). As soft and hard skill don't just help individuals achieve their goals (qualifications), they also change their mindset. While it is important to master both hard and soft skills, often when we talk about the quality of education (for game development); the measure is more towards quantitative measures and assessments (which don't always sit well with soft skills). As it is easy to forget, in this digital age, that 'people' are at the heart of video game development. Not just about 'code' and 'technologies'. There exists a complex relationship between hard and soft skills and their dual importance is crucial if graduates are to succeed in the game industry.


title: Almost everywhere and norm convergence of Approximate Identity and Fej\'er means of trigonometric and Vilenkin systems

abstract: In this paper, we investigate very general approximation kernels with special properties, called an approximate identity, and prove almost everywhere and norm convergence of these general methods, which consists of a class of summability methods and provide norm and a.e. convergence of these summability methods with respect to the trigonometric system. Investigations of these summations can be used to obtain norm convergence of Fej\'er means with respect to the Vilenkin system also, but these methods are not useful to study a.e. convergence in this case, because of some special properties of the kernels of Fej\'er means. Despite these different properties we give alternative methods to prove almost everywhere convergence of Fej\'er means with respect to the Vilenkin systems.


title: A Comprehensive Survey on Model Quantization for Deep Neural Networks in Image Classification

abstract: Recent advancements in machine learning achieved by Deep Neural Networks (DNNs) have been significant. While demonstrating high accuracy, DNNs are associated with a huge number of parameters and computations, which leads to high memory usage and energy consumption. As a result, deploying DNNs on devices with constrained hardware resources poses significant challenges. To overcome this, various compression techniques have been widely employed to optimize DNN accelerators. A promising approach is quantization, in which the full-precision values are stored in low bit-width precision. Quantization not only reduces memory requirements but also replaces high-cost operations with low-cost ones. DNN quantization offers flexibility and efficiency in hardware design, making it a widely adopted technique in various methods. Since quantization has been extensively utilized in previous works, there is a need for an integrated report that provides an understanding, analysis, and comparison of different quantization approaches. Consequently, we present a comprehensive survey of quantization concepts and methods, with a focus on image classification. We describe clustering-based quantization methods and explore the use of a scale factor parameter for approximating full-precision values. Moreover, we thoroughly review the training of a quantized DNN, including the use of a straight-through estimator and quantization regularization. We explain the replacement of floating-point operations with low-cost bitwise operations in a quantized DNN and the sensitivity of different layers in quantization. Furthermore, we highlight the evaluation metrics for quantization methods and important benchmarks in the image classification task. We also present the accuracy of the state-of-the-art methods on CIFAR-10 and ImageNet.


title: Neurofeminism: feminist critiques of research on sex/gender differences in the neurosciences

abstract: Over the last three decades, the human brain, and its role in determining behavior have been receiving a growing amount of attention in academia as well as in society more generally. Neuroscientific explanations of human behavior or other phenomena are often especially appealing to lay people. Therefore, neuroscientific explanations that can affect individuals, groups, or social relations in general should be formulated in a careful and responsible way. One field in which especially feminist scholars request more caution is the neuroscientific examination of sex or gender differences. Feminist scholars have described various ways in which sexist bias might be present in neuroscientific research on sex or gender differences. In this context, they coined the term "neurosexism" to describe the entanglement between neuroscientific work and sexist ideology, and "neurofeminism" as a response to that. Here, we aim to give an overview over the contemporary neurofeminist literature. In the first part, common levels of analysis in the neurofeminist literature are presented and the research level is explored in more detail. In the second part, some common developments in more recent neurofeminist scholarship are discussed. For this, we review recent publications with the aim to provide neuroscientists with a solid understanding of neurofeminist criticism so that they may evaluate neuroscientific claims about on sex or gender differences from this critical perspective.


title: How accurate can combined measurements be -- experiment, simulation, and theory

abstract: In this paper we investigate the question of how much combined measurements can increase the accuracy of additive quantities. Therefore, we consider a set of measurements from a selection of all possible combinations of the $n$ labeled masses and then estimate the individual weights of the $n$ masses by a linear regression approach. We present experimental results which motivate comprehensive simulation campaigns. These simulations provide valid statistical statements and reliable forecasts of the experimental results. A profound analytical treatment in turn supports these simulation outcomes with excellent consistency. One important achievement therein is a general analytical expression for the estimate's error, not only limited to the two particular weighing schemes presented. It turns out that combined measurements allow to estimate the weight of mass elements with an accuracy that under-runs by orders of magnitude the resolution of the scale used. As the error depends on the amount of measurements, one gains higher accuracy with increasing effort. In a broader sense, our work wants to promote the method and give inspirations to applications in various metrological fields beyond high-precision mass determination. Moreover, the novel simulations and analytic formulas enable the design of optimal experiments.


title: A Note on the Chernoff Bound for Random Variables in the Unit Interval

abstract: The Chernoff bound is a well-known tool for obtaining a high probability bound on the expectation of a Bernoulli random variable in terms of its sample average. This bound is commonly used in statistical learning theory to upper bound the generalisation risk of a hypothesis in terms of its empirical risk on held-out data, for the case of a binary-valued loss function. However, the extension of this bound to the case of random variables taking values in the unit interval is less well known in the community. In this note we provide a proof of this extension for convenience and future reference.


title: Developing patient-driven artificial intelligence based on personal rankings of care decision making steps

abstract: We propose and experimentally motivate a new methodology to support decision-making processes in healthcare with artificial intelligence based on personal rankings of care decision making steps that can be identified with our methodology, questionnaire data and its statistical patterns. Our longitudinal quantitative cross-sectional three-stage study gathered self-ratings for 437 expression statements concerning healthcare situations on Likert scales in respect to "the need for help", "the advancement of health", "the hopefulness", "the indication of compassion" and "the health condition", and 45 answers about the person's demographics, health and wellbeing, also the duration of giving answers. Online respondents between 1 June 2020 and 29 June 2021 were recruited from Finnish patient and disabled people's organizations, other health-related organizations and professionals, and educational institutions (n=1075). With Kruskal-Wallis test, Wilcoxon rank-sum test (i.e., Mann-Whitney U test), Wilcoxon rank-sum pairwise test, Welch's t test and one-way analysis of variance (ANOVA) between groups test we identified statistically significant differences of ratings and their durations for each expression statement in respect to respondent groupings based on the answer values of each background question. Frequencies of the later reordering of rating rankings showed dependencies with ratings given earlier in respect to various interpretation task entities, interpretation dimensions and respondent groupings. Our methodology, questionnaire data and its statistical patterns enable analyzing with self-rated expression statements the representations of decision making steps in healthcare situations and their chaining, agglomeration and branching in knowledge entities of personalized care paths. Our results support building artificial intelligence solutions to address the patient's needs concerning care.


title: Aligning Robot Representations with Humans

abstract: As robots are increasingly deployed in real-world scenarios, a key question is how to best transfer knowledge learned in one environment to another, where shifting constraints and human preferences render adaptation challenging. A central challenge remains that often, it is difficult (perhaps even impossible) to capture the full complexity of the deployment environment, and therefore the desired tasks, at training time. Consequently, the representation, or abstraction, of the tasks the human hopes for the robot to perform in one environment may be misaligned with the representation of the tasks that the robot has learned in another. We postulate that because humans will be the ultimate evaluator of system success in the world, they are best suited to communicating the aspects of the tasks that matter to the robot. Our key insight is that effective learning from human input requires first explicitly learning good intermediate representations and then using those representations for solving downstream tasks. We highlight three areas where we can use this approach to build interactive systems and offer future directions of work to better create advanced collaborative robots.


title: Learning Car Speed Using Inertial Sensors for Dead Reckoning Navigation

abstract: A deep neural network (DNN) is trained to estimate the speed of a car driving in an urban area using as input a stream of measurements from a low-cost six-axis inertial measurement unit (IMU). Three hours of data was collected by driving through the city of Ashdod, Israel in a car equipped with a global navigation satellite system (GNSS) real time kinematic (RTK) positioning device and a synchronized IMU. Ground truth labels for the car speed were calculated using the position measurements obtained at the high rate of 50 Hz. A DNN architecture with long short-term memory layers is proposed to enable high-frequency speed estimation that accounts for previous inputs history and the nonlinear relation between speed, acceleration and angular velocity. A simplified aided dead reckoning localization scheme is formulated to assess the trained model which provides the speed pseudo-measurement. The trained model is shown to substantially improve the position accuracy during a 4 minutes drive without the use of GNSS position updates.


title: On the misinterpretation of conditionally-solvable quantum-mechanical problems

abstract: We apply the Frobenius (power-series) method to some simple exactly-solvable and conditionally-solvable quantum-mechanical models with supposed physical interest. We show that the supposedly exact solutions to radial eigenvalue equations derived in recent papers are not correct because they do not satisfy some well-known theorems. We also discuss the origin of the mistake by means of the approach indicated above.


title: Enforcing KL Regularization in General Tsallis Entropy Reinforcement Learning via Advantage Learning

abstract: Maximum Tsallis entropy (MTE) framework in reinforcement learning has gained popularity recently by virtue of its flexible modeling choices including the widely used Shannon entropy and sparse entropy. However, non-Shannon entropies suffer from approximation error and subsequent underperformance either due to its sensitivity or the lack of closed-form policy expression. To improve the tradeoff between flexibility and empirical performance, we propose to strengthen their error-robustness by enforcing implicit Kullback-Leibler (KL) regularization in MTE motivated by Munchausen DQN (MDQN). We do so by drawing connection between MDQN and advantage learning, by which MDQN is shown to fail on generalizing to the MTE framework. The proposed method Tsallis Advantage Learning (TAL) is verified on extensive experiments to not only significantly improve upon Tsallis-DQN for various non-closed-form Tsallis entropies, but also exhibits comparable performance to state-of-the-art maximum Shannon entropy algorithms.


title: An Empirical Investigation of Representation Learning for Imitation

abstract: Imitation learning often needs a large demonstration set in order to handle the full range of situations that an agent might find itself in during deployment. However, collecting expert demonstrations can be expensive. Recent work in vision, reinforcement learning, and NLP has shown that auxiliary representation learning objectives can reduce the need for large amounts of expensive, task-specific data. Our Empirical Investigation of Representation Learning for Imitation (EIRLI) investigates whether similar benefits apply to imitation learning. We propose a modular framework for constructing representation learning algorithms, then use our framework to evaluate the utility of representation learning for imitation across several environment suites. In the settings we evaluate, we find that existing algorithms for image-based representation learning provide limited value relative to a well-tuned baseline with image augmentations. To explain this result, we investigate differences between imitation learning and other settings where representation learning has provided significant benefit, such as image classification. Finally, we release a well-documented codebase which both replicates our findings and provides a modular framework for creating new representation learning algorithms out of reusable components.


title: Fast multi-source nanophotonic simulations using augmented partial factorization

abstract: Full-wave simulations are indispensable for nanophotonics and electromagnetics but are severely constrained on large systems, especially multi-channel ones such as disordered media, aperiodic metasurfaces, and densely packed photonic circuits where each input requires a large-scale simulation. Here we bypass the computationally demanding solution of Maxwell's equations and directly evaluate the full-wave multi-input response, with no approximation. We augment the Maxwell operator with all input source profiles and output projection profiles, followed by a single partial factorization that directly yields the entire multi-input scattering matrix via the Schur complement. This method is simple to implement and applies to any linear partial differential equation. Its advantage grows with size, being 1,000 to 30,000,000 times faster than existing methods for systems with about ten million variables. We use it to realize the first full-wave simulations of entangled-photon backscattering from disorder and all-angle characterizations of high-numerical-aperture metalenses that are thousands of wavelengths wide. This work reveals the significant efficiency gain when we rethink what to compute and enables the exploration of diverse multi-channel systems.


title: Data-Driven Interpolation for Super-Scarce X-Ray Computed Tomography

abstract: We address the problem of reconstructing X-Ray tomographic images from scarce measurements by interpolating missing acquisitions using a self-supervised approach. To do so, we train shallow neural networks to combine two neighbouring acquisitions into an estimated measurement at an intermediate angle. This procedure yields an enhanced sequence of measurements that can be reconstructed using standard methods, or further enhanced using regularisation approaches. Unlike methods that improve the sequence of acquisitions using an initial deterministic interpolation followed by machine-learning enhancement, we focus on inferring one measurement at once. This allows the method to scale to 3D, the computation to be faster and crucially, the interpolation to be significantly better than the current methods, when they exist. We also establish that a sequence of measurements must be processed as such, rather than as an image or a volume. We do so by comparing interpolation and up-sampling methods, and find that the latter significantly under-perform. We compare the performance of the proposed method against deterministic interpolation and up-sampling procedures and find that it outperforms them, even when used jointly with a state-of-the-art projection-data enhancement approach using machine-learning. These results are obtained for 2D and 3D imaging, on large biomedical datasets, in both projection space and image space.


title: Laser-assisted charged Higgs boson decay in Two Higgs Doublet Model -- type II

abstract: In this paper, we investigate the charged Higgs boson decay in the context of the type-II two-Higgs-doublet model in the presence of a circularly polarized electromagnetic field of laser radiation. The calculations are performed by adopting the Furry picture approach of non-perturbative interactions with the external electromagnetic field. Using the method of exact solutions for charged particles states in the presence of a circularly polarized electromagnetic wave field and evaluating the $S$-matrix elements, an exact analytic expression is derived for the decay width of leptonic, hadronic and bosonic decay modes. The branching ratios of different decay modes with multiple photon emission and absorption from the laser beam are analyzed and found to be dramatically modified in the region of superstrong fields. The dependencies of the decay width on the laser field strength and frequency are also examined. The results obtained may be interesting for future experimental and theoretical investigations.


title: On the Difficulty of Defending Self-Supervised Learning against Model Extraction

abstract: Self-Supervised Learning (SSL) is an increasingly popular ML paradigm that trains models to transform complex inputs into representations without relying on explicit labels. These representations encode similarity structures that enable efficient learning of multiple downstream tasks. Recently, ML-as-a-Service providers have commenced offering trained SSL models over inference APIs, which transform user inputs into useful representations for a fee. However, the high cost involved to train these models and their exposure over APIs both make black-box extraction a realistic security threat. We thus explore model stealing attacks against SSL. Unlike traditional model extraction on classifiers that output labels, the victim models here output representations; these representations are of significantly higher dimensionality compared to the low-dimensional prediction scores output by classifiers. We construct several novel attacks and find that approaches that train directly on a victim's stolen representations are query efficient and enable high accuracy for downstream models. We then show that existing defenses against model extraction are inadequate and not easily retrofitted to the specificities of SSL.


title: Harvesting mutual information from BTZ black hole spacetime

abstract: We investigate the correlation harvesting protocol for mutual information between two Unruh-DeWitt detectors in a static BTZ black hole spacetime. Here, the effects coming from communication and change in proper separation of the detectors are set to be negligible so that only a black hole affects the extracted mutual information. We find that, unlike the entanglement harvesting scenario, harvested mutual information is zero only when a detector reaches an event horizon, and that although the Hawking effect and gravitational redshift both affect the extraction of mutual information, it is extreme Hawking radiation that inhibits the detectors from harvesting.


title: Impact of Point Spread Function Higher Moments Error on Weak Gravitational Lensing II: A Comprehensive Study

abstract: Weak gravitational lensing, or weak lensing, is one of the most powerful probes for dark matter and dark energy science, although it faces increasing challenges in controlling systematic uncertainties as \edit{the statistical errors become smaller}. The Point Spread Function (PSF) needs to be precisely modeled to avoid systematic error on the weak lensing measurements. The weak lensing biases induced by errors in the PSF model second moments, i.e., its size and shape, are well-studied. However, Zhang et al. (2021) showed that errors in the higher moments of the PSF may also be a significant source of systematics for upcoming weak lensing surveys. Therefore, the goal of this work is to comprehensively investigate the modeling quality of PSF moments from the $3^{\text{rd}}$ to $6^{\text{th}}$ order, and estimate their impact on cosmological parameter inference. We propagate the \textsc{PSFEx} higher moments modeling error in the HSC survey dataset to the weak lensing \edit{shear-shear correlation functions} and their cosmological analyses. We find that the overall multiplicative shear bias associated with errors in PSF higher moments can cause a $\sim 0.1 \sigma$ shift on the cosmological parameters for LSST Y10. PSF higher moment errors also cause additive biases in the weak lensing shear, which, if not accounted for in the cosmological parameter analysis, can induce cosmological parameter biases comparable to their $1\sigma$ uncertainties for LSST Y10. We compare the \textsc{PSFEx} model with PSF in Full FOV (\textsc{Piff}), and find similar performance in modeling the PSF higher moments. We conclude that PSF higher moment errors of the future PSF models should be reduced from those in current methods to avoid a need to explicitly model these effects in the weak lensing analysis.


title: A Fisher matrix for gravitational-wave population inference

abstract: We derive a Fisher matrix for the parameters characterising a population of gravitational-wave events. This provides a guide to the precision with which population parameters can be estimated with multiple observations, which becomes increasingly accurate as the number of events and the signal-to-noise ratio of the sampled events increases. The formalism takes into account individual event measurement uncertainties and selection effects, and can be applied to arbitrary population models. We illustrate the framework with two examples: an analytical calculation of the Fisher matrix for the mean and variance of a Gaussian model describing a population affected by selection effects, and an estimation of the precision with which the slope of a power law distribution of supermassive black-hole masses can be measured using extreme-mass-ratio inspiral observations. We compare the Fisher predictions to results from Monte Carlo analyses, finding very good agreement.


title: The Diverse Properties of Type Icn Supernovae Point to Multiple Progenitor Channels

abstract: We present a sample of Type Icn supernovae (SNe Icn), a newly-discovered class of transients characterized by their interaction with H- and He-poor circumstellar material (CSM). This sample is the largest collection of SNe Icn to date and includes observations of two published objects (SN 2019hgp and SN 2021csp) as well as two objects (SN 2019jc and SN 2021ckj) not yet published in the literature. The SNe Icn display a range of peak luminosities, rise times, and decline rates, as well as diverse late-time spectral features. To investigate their explosion and progenitor properties we fit their bolometric light curves to a semi-analytical model consisting of luminosity inputs from circumstellar interaction and radioactive decay of $^{56}$Ni. We infer low ejecta masses ($\lesssim$ 2 M$_\odot$) and $^{56}$Ni masses ($\lesssim$ 0.04 M$_\odot$) from the light curves, suggesting that normal stripped-envelope supernova (SESN) explosions within a dense CSM cannot be the underlying mechanism powering SNe Icn. Additionally, we find that an upper limit on the star formation rate density at the location of SN 2019jc lies at the lower end of a distribution of SESNe, in conflict with a massive star progenitor of this object. Based on the estimated ejecta masses, $^{56}$Ni masses, and explosion site properties, we favor a low-mass, ultra-stripped star as the progenitor of some SNe Icn. For others, we suggest that a Wolf-Rayet star progenitor may better explain their observed properties. This study demonstrates that multiple progenitor channels may produce SNe Icn and other interaction-powered transients.


title: The Great Planetary Heist: Theft and capture in star-forming regions

abstract: Gravitational interactions in star-forming regions are capable of disrupting and destroying planetary systems, as well as creating new ones. In particular, a planet can be stolen, where it is directly exchanged between passing stars during an interaction; or captured, where a planet is first ejected from its birth system and is free-floating for a period of time, before being captured by a passing star. We perform sets of direct N-body simulations of young, substructured star-forming regions, and follow their evolution for 10 Myr in order to determine how many planets are stolen and captured, and their respective orbital properties. We show that in high density star-forming regions, stolen and captured planets have distinct properties. The semimajor axis distribution of captured planets is significantly skewed to wider orbits compared to the semimajor axis distribution of stolen planets and planets that are still orbiting their parent star (preserved planets). However, the eccentricity and inclination distributions of captured and stolen planets are similar, but in turn very different to the inclination and eccentricity distributions of preserved planets. In low-density star-forming regions these differences are not as distinct but could still, in principle, be used to determine whether observed exoplanets have likely formed in situ or have been stolen or captured. We find that the initial degree of spatial and kinematic substructure in a star-forming region is as important a factor as the stellar density in determining whether a planetary system will be altered, disrupted, captured or stolen.


title: Strong supernovae bounds on ALPs from quantum loops

abstract: We show that in theories of axionlike particles (ALPs) coupled to electrons at tree-level, the one-loop effective coupling to photons is process dependent: the effective coupling relevant for decay processes, $g_{a\gamma}^{\text{(D)}}$, differs significantly from the coupling appearing in the phenomenologically important Primakoff process, $g_{a\gamma}^{\text{(P)}}$. We show that this has important implications for the physics of massive ALPs in hot and dense environments, such as supernovae. We derive, as a consequence, new limits on the ALP-electron coupling, $\hat{g}_{ae}$, from SN 1987A by accounting for all relevant production processes, including one-loop processes, and considering bounds from excess cooling as well as the absence of an associated gamma-ray burst from ALP decays. Our limits are among the strongest to date for ALP masses in the range $0.03 \, \text{MeV} \, < m_a< 240 \, \text{MeV}$. Moreover, we also show how cosmological bounds on the ALP-photon coupling translate into new, strong limits on $\hat{g}_{ae}$ at one loop. Our analysis emphasises that large hierarchies between ALP effective couplings are difficult to realise once quantum loops are taken into account.


title: Slightly broken higher-spin current in bosonic and fermionic QED in the large-$N$ limit

abstract: We study the slightly broken higher-spin currents in various CFTs with $\mathrm{U}(1)$ gauge field, including the tricritical QED, scalar QED, fermionic QED and QED-Gross-Neveu-Yukawa theory. We calculate their anomalous dimension by making use of the classical non-conservation equation and the equations of motion. We find a logarithmic asymptotic behaviour ($\gamma_s\sim 16/(N\pi^2) \log s $) of the anomalous dimension at large spin $s$, which is different from other interacting CFTs without gauge fields and may indicate certain unique features of gauge theories. We also study slightly broken higher-spin currents of the $\mathrm{SU}(N)_1$ WZW model at $d=2+\epsilon$ dimensions by formulating them as the QED theory, and we again find its anomalous dimension has a logarithmic asymptotic behaviour with respect to spin. This result resolves the mystery regarding the mechanism of breaking higher spin currents of Virasoro symmetry at $d=2+\epsilon$ dimensions, and may be applicable to other interesting problems such as the $2+\epsilon$ expansion of Ising CFT.


title: Fast and realistic large-scale structure from machine-learning-augmented random field simulations

abstract: Producing thousands of simulations of the dark matter distribution in the Universe with increasing precision is a challenging but critical task to facilitate the exploitation of current and forthcoming cosmological surveys. Many inexpensive substitutes to full $N$-body simulations have been proposed, even though they often fail to reproduce the statistics of the smaller, non-linear scales. Among these alternatives, a common approximation is represented by the lognormal distribution, which comes with its own limitations as well, while being extremely fast to compute even for high-resolution density fields. In this work, we train a generative deep learning model, mainly made of convolutional layers, to transform projected lognormal dark matter density fields to more realistic dark matter maps, as obtained from full $N$-body simulations. We detail the procedure that we follow to generate highly correlated pairs of lognormal and simulated maps, which we use as our training data, exploiting the information of the Fourier phases. We demonstrate the performance of our model comparing various statistical tests with different field resolutions, redshifts and cosmological parameters, proving its robustness and explaining its current limitations. When evaluated on 100 test maps, the augmented lognormal random fields reproduce the power spectrum up to wavenumbers of $1 \ h \ \rm{Mpc}^{-1}$, and the bispectrum within 10%, and always within the error bars, of the fiducial target simulations. Finally, we describe how we plan to integrate our proposed model with existing tools to yield more accurate spherical random fields for weak lensing analysis.