title: Reference Optical Turbulence and Wind Profiles for Single Conjugate and Extreme Adaptive Optics

abstract: We present a simple method of extracting a small number of reference optical turbulence and wind profiles from a large dataset for single conjugate and extreme adaptive optics simulations. These reference profiles can be used in slow end-to-end adaptive optics simulations to represent the variability of the atmosphere. The method is based on the assumption that performance for these systems is correlated with integrated atmospheric parameters $r_0$, $\theta_0$ and $\tau_0$. Profiles are selected from a large dataset that conform concurrently to the distributions of these parameters, and hence represent the variability of the atmosphere as seen by the AO system. We also extend the equivalent layers method of profile compression to include wind profiles. The method is applied to stereo-SCIDAR data from ESO Paranal to extract five turbulence and wind profiles that cover a broad range in atmospheric variability, and we show using analytical AO simulation that this correlates to the equivalent range of AO-corrected Strehl ratios.


title: Contrastive Unsupervised Learning of World Model with Invariant Causal Features

abstract: In this paper we present a world model, which learns causal features using the invariance principle. In particular, we use contrastive unsupervised learning to learn the invariant causal features, which enforces invariance across augmentations of irrelevant parts or styles of the observation. The world-model-based reinforcement learning methods independently optimize representation learning and the policy. Thus naive contrastive loss implementation collapses due to a lack of supervisory signals to the representation learning module. We propose an intervention invariant auxiliary task to mitigate this issue. Specifically, we utilize depth prediction to explicitly enforce the invariance and use data augmentation as style intervention on the RGB observation space. Our design leverages unsupervised representation learning to learn the world model with invariant causal features. Our proposed method significantly outperforms current state-of-the-art model-based and model-free reinforcement learning methods on out-of-distribution point navigation tasks on the iGibson dataset. Moreover, our proposed model excels at the sim-to-real transfer of our perception learning module. Finally, we evaluate our approach on the DeepMind control suite and enforce invariance only implicitly since depth is not available. Nevertheless, our proposed model performs on par with the state-of-the-art counterpart.


title: Training Normalizing Flows from Dependent Data

abstract: Normalizing flows are powerful non-parametric statistical models that function as a hybrid between density estimators and generative models. Current learning algorithms for normalizing flows assume that data points are sampled independently, an assumption that is frequently violated in practice, which may lead to erroneous density estimation and data generation. We propose a likelihood objective of normalizing flows incorporating dependencies between the data points, for which we derive a flexible and efficient learning algorithm suitable for different dependency structures. We show that respecting dependencies between observations can improve empirical results on both synthetic and real-world data, and leads to higher statistical power in a downstream application to genome-wide association studies.


title: Towards a sharp, structure preserving two-velocity model for two-phase flow: transport of mass and momentum

abstract: The numerical modelling of convection dominated high density ratio two-phase flow poses several challenges, amongst which is resolving the relatively thin shear layer at the interface. To this end we propose a sharp discretisation of the two-velocity model of the two-phase Navier-Stokes (NS) equations. This results in the ability to model the shear layer, rather than resolving it, by allowing for a velocity discontinuity in the direction(s) tangential to the interface. In this paper we focus our attention on the transport of mass and momentum in the presence of such a velocity discontinuity. We propose a generalisation of the dimensionally unsplit geometric volume of fluid (VOF) method for the advection of the interface in the two-velocity formulation. Sufficient conditions on the construction of donating regions are derived that ensure boundedness of the volume fraction for dimensionally unsplit advection methods. We propose to interpolate the mass fluxes resulting from the dimensionally unsplit geometric VOF method for the advection of the staggered momentum field, resulting in semi-discrete energy conservation. Division of the momentum by the respective mass, to obtain the velocity, is not always well-defined for nearly empty control volumes and therefore care is taken in the construction of the momentum flux interpolant: our proposed flux interpolant guarantees that this division is always well-defined without being unnecessarily dissipative. Besides the newly proposed two-velocity model we also detail our exactly conservative (mass per phase and total linear momentum) implementation of the one-velocity formulation of the two-phase NS equations, which will be used for comparison. The discretisation methods are validated using classical time-reversible flow fields, where in this paper the advection is uncoupled from the NS solver, which will be developed in a later paper.


title: Does Zero-Shot Reinforcement Learning Exist?

abstract: A zero-shot RL agent is an agent that can solve any RL task in a given environment, instantly with no additional planning or learning, after an initial reward-free learning phase. This marks a shift from the reward-centric RL paradigm towards "controllable" agents that can follow arbitrary instructions in an environment. Current RL agents can solve families of related tasks at best, or require planning anew for each task. Strategies for approximate zero-shot RL ave been suggested using successor features (SFs) [BBQ+ 18] or forward-backward (FB) representations [TO21], but testing has been limited. After clarifying the relationships between these schemes, we introduce improved losses and new SF models, and test the viability of zero-shot RL schemes systematically on tasks from the Unsupervised RL benchmark [LYL+21]. To disentangle universal representation learning from exploration, we work in an offline setting and repeat the tests on several existing replay buffers. SFs appear to suffer from the choice of the elementary state features. SFs with Laplacian eigenfunctions do well, while SFs based on auto-encoders, inverse curiosity, transition models, low-rank transition matrix, contrastive learning, or diversity (APS), perform unconsistently. In contrast, FB representations jointly learn the elementary and successor features from a single, principled criterion. They perform best and consistently across the board, reaching 85% of supervised RL performance with a good replay buffer, in a zero-shot manner.


title: Quantum chaos, scrambling and operator growth in $T\bar{T}$ deformed SYK models

abstract: In this work, we investigate the quantum chaos in various $T\bar{T}$-deformed SYK models with finite $N$, including the SYK$_4$, the supersymmetric SYK$_4$, and the SYK$_2$ models. We numerically study the evolution of the spectral form factor (SFF), the out-of-time ordered correlator (OTOC), and the Krylov complexity. We find that the characteristic evolution of the SFF, OTOC and K-complexity of both the SYK$_4$ and SSYK$_4$ models remains unchanged under the deformation, which implies that the properties of quantum chaos is preserved. We also identify a many-body localization behavior in the deformed SYK$_2$ model.


title: NAG-GS: Semi-Implicit, Accelerated and Robust Stochastic Optimizer

abstract: Classical machine learning models such as deep neural networks are usually trained by using Stochastic Gradient Descent-based (SGD) algorithms. The classical SGD can be interpreted as a discretization of the stochastic gradient flow. In this paper we propose a novel, robust and accelerated stochastic optimizer that relies on two key elements: (1) an accelerated Nesterov-like Stochastic Differential Equation (SDE) and (2) its semi-implicit Gauss-Seidel type discretization. The convergence and stability of the obtained method, referred to as NAG-GS, are first studied extensively in the case of the minimization of a quadratic function. This analysis allows us to come up with an optimal learning rate in terms of the convergence rate while ensuring the stability of NAG-GS. This is achieved by the careful analysis of the spectral radius of the iteration matrix and the covariance matrix at stationarity with respect to all hyperparameters of our method. Further, we show that NAG- GS is competitive with state-of-the-art methods such as momentum SGD with weight decay and AdamW for the training of machine learning models such as the logistic regression model, the residual networks models on standard computer vision datasets, Transformers in the frame of the GLUE benchmark and the recent Vision Transformers.


title: Max-linear graphical models with heavy-tailed factors on trees of transitive tournaments

abstract: Graphical models with heavy-tailed factors can be used to model extremal dependence or causality between extreme events. In a Bayesian network, variables are recursively defined in terms of their parents according to a directed acyclic graph (DAG). We focus on max-linear graphical models with respect to a special type of graphs, which we call a tree of transitive tournaments. The latter are block graphs combining in a tree-like structure a finite number of transitive tournaments, each of which is a DAG in which every two nodes are connected. We study the limit of the joint tails of the max-linear model conditionally on the event that a given variable exceeds a high threshold. Under a suitable condition, the limiting distribution involves the factorization into independent increments along the shortest trail between two variables, thereby imitating the behavior of a Markov random field. We are also interested in the identifiability of the model parameters in case some variables are latent and only a subvector is observed. It turns out that the parameters are identifiable under a criterion on the nodes carrying the latent variables which is easy and quick to check.


title: A large integer is a sum of two prime avoiding numbers

abstract: Let $f(n)=\min_{p} |n-p|$, where $p$ is a prime. We show that there is a positive constant $\delta$ such that for any large integer $N$ there exist two positive integers $n_1$ and $n_2$ such that $N=n_1 + n_2$ and $f(n_i)\gg \ln N (\ln\ln N)^{\delta}$, $i=1, 2$.


title: Reinforcement Learning Algorithms: An Overview and Classification

abstract: The desire to make applications and machines more intelligent and the aspiration to enable their operation without human interaction have been driving innovations in neural networks, deep learning, and other machine learning techniques. Although reinforcement learning has been primarily used in video games, recent advancements and the development of diverse and powerful reinforcement algorithms have enabled the reinforcement learning community to move from playing video games to solving complex real-life problems in autonomous systems such as self-driving cars, delivery drones, and automated robotics. Understanding the environment of an application and the algorithms' limitations plays a vital role in selecting the appropriate reinforcement learning algorithm that successfully solves the problem on hand in an efficient manner. Consequently, in this study, we identify three main environment types and classify reinforcement learning algorithms according to those environment types. Moreover, within each category, we identify relationships between algorithms. The overview of each algorithm provides insight into the algorithms' foundations and reviews similarities and differences among algorithms. This study provides a perspective on the field and helps practitioners and researchers to select the appropriate algorithm for their use case.


title: EDA: Explicit Text-Decoupling and Dense Alignment for 3D Visual Grounding

abstract: 3D visual grounding aims to find the object within point clouds mentioned by free-form natural language descriptions with rich semantic cues. However, existing methods either extract the sentence-level features coupling all words or focus more on object names, which would lose the word-level information or neglect other attributes. To alleviate these issues, we present EDA that Explicitly Decouples the textual attributes in a sentence and conducts Dense Alignment between such fine-grained language and point cloud objects. Specifically, we first propose a text decoupling module to produce textual features for every semantic component. Then, we design two losses to supervise the dense matching between two modalities: position alignment loss and semantic alignment loss. On top of that, we further introduce a new visual grounding task, locating objects without object names, which can thoroughly evaluate the model's dense alignment capacity. Through experiments, we achieve state-of-the-art performance on two widely-adopted 3D visual grounding datasets, ScanRefer and SR3D/NR3D, and obtain absolute leadership on our newly-proposed task. The source code is available at https://github.com/yanmin-wu/EDA.


title: 3-Plethysms of homogeneous and elementary symmetric functions

abstract: We introduce the new combinatorial approach of plethystic type of tableaux, as a method to understand coefficients of Schur functions appearing in plethysms $s_\nu[h_\lambda]$ and $s_{\nu}[e_{\lambda}]$, for any partitions $\lambda$ and $\nu$. We first give general results about this approach, then use results on tableaux, ribbon tableaux and integer points in polytopes to understand the case where $\nu$ is a partition of $3$ and $\lambda$ has one part. We then use a \textit{Kronecker map} to extend these results to any partition $\lambda$.


title: Role of Filamentary Structures in the Formation of Two Dense Cores, L1544 and L694-2

abstract: We present mapping results of two prestellar cores, L1544 and L694-2, embedded in filamentary clouds in C$^{18}$O (3-2), $^{13}$CO (3-2), $^{12}$CO (3-2), HCO$^+$ (4-3), and H$^{13}$CO$^+$ (4-3) with the JCMT telescope to examine the role of the filamentary structures in the formation of dense cores in the clouds, with new distance estimates for L1544 ($175_{-3}^{+4}$ pc) and L694-2 ($203_{-7}^{+6}$ pc). From these observations, we found that the non-thermal velocity dispersion of two prestellar cores and their surrounding clouds are smaller than or comparable to the sound speed. This may indicate that the turbulence has already been dissipated for both filaments and cores during their formation time. We also found a $\lambda/4$ shift between the periodic oscillations in the velocity and the column density distributions implying the possible presence of gravitational core-forming flow motion along the axis of the filament. The mass accretion rates due to these flow motions are estimated to be 2-3 M$_\odot$ Myr$^{-1}$, being comparable to that for Serpens cloud but much smaller than those for the Hub filaments, cluster, or high mass forming filaments by 1 or 2 order of magnitudes. From this study, we suggest that the filaments in our targets might be formed from the shock-compression of colliding clouds, and then the cores are formed by gravitational fragmentation of the filaments to evolve to the prestellar stage. We conclude that the filamentary structures in the clouds play an important role in the entire process of formation of dense cores and their evolution.


title: Single-Shot Electron Radiography Using a Laser-Plasma Accelerator

abstract: Contact and projection electron radiography of static targets was demonstrated using a laser plasma accelerator driven by a kilojoule, picosecond class laser as a source of relativistic electrons with an average energy of 20 MeV. Objects with areal densities as high as 7.7 g/cm^2 were probed in materials ranging from plastic to tungsten, and radiographs with resolution as good as 90 micrometers were produced. The effects of electric fields produced by the laser ablation of the radiography objects were observed and are well described by an analytic expression relating imaging magnification change to electric field strength.


title: Asynchronous Correspondences Between Hybrid Trajectory Semantics

abstract: We formalize the semantics of hybrid systems as sets of hybrid trajectories, including those generated by an hybrid transition system. We study the abstraction of hybrid trajectory semantics for verification, static analysis, and refinement. We mainly consider abstractions of hybrid semantics which establish a correspondence between trajectories derived from a correspondence between states such as homomorphisms, simulations, bisimulations, and preservations with progress. We also consider abstractions that cannot be defined stepwise like discretization. All these abstractions are Galois connections between concrete and abstract hybrid trajectory or discrete trace semantics. In contrast to semantic based abstractions, we investigate the problematic trace-based composition of abstractions.


title: EiHi Net: Out-of-Distribution Generalization Paradigm

abstract: This paper develops a new EiHi net to solve the out-of-distribution (OoD) generalization problem in deep learning. EiHi net is a model learning paradigm that can be blessed on any visual backbone. This paradigm can change the previous learning method of the deep model, namely find out correlations between inductive sample features and corresponding categories, which suffers from pseudo correlations between indecisive features and labels. We fuse SimCLR and VIC-Reg via explicitly and dynamically establishing the original - positive - negative sample pair as a minimal learning element, the deep model iteratively establishes a relationship close to the causal one between features and labels, while suppressing pseudo correlations. To further validate the proposed model, and strengthen the established causal relationships, we develop a human-in-the-loop strategy, with few guidance samples, to prune the representation space directly. Finally, it is shown that the developed EiHi net makes significant improvements in the most difficult and typical OoD dataset Nico, compared with the current SOTA results, without any domain ($e.g.$ background, irrelevant features) information.


title: Controlling and scripting laboratory hardware with open-source, intuitive interfaces: OpenFlexure Voice Control and OpenFlexure Blockly

abstract: Making user interaction with laboratory equipment more convenient and intuitive should promote experimental work and help researchers to complete their tasks efficiently. The most common form of interaction in current instrumentation is either direct tactile, with buttons and knobs, or interfaced through a computer, using a mouse and keyboard. Scripting is another function typical of smart and automated laboratory equipment, yet users are currently required to learn bespoke programming languages and libraries for individual pieces of equipment. In this paper, we present two open-source, novel and intuitive ways of interacting with and scripting laboratory equipment. We choose the OpenFlexure family of microscopes as our exemplar, due to their open-source nature and smart control system. Firstly, we demonstrate 'OpenFlexure Voice Control' to enable users to control the microscope hands-free. Secondly, we present 'OpenFlexure Blockly' which uses the Blockly Visual Programming Language to enable users to easily create scripts for the microscope, using a drag and drop web interface. We explain the design choices when developing these tools, and discuss more typical use cases and more general applications.


title: Remarks on the $S$-wave masses of singly heavy mesons

abstract: Based on the study of the string model methods of singly heavy mesons and singly heavy baryons, we calculate the mass spectrum of $1S$-and $2S$-wave for both charm and bottom mesons$(D/D_{s}, B/B_{s})$. Experimentally, there are most masses spectra of $1S$-wave have been found, while the masses part of the $2S$-state is not determined. In this paper, we will use singly light quark or diquark model images and Regge trajectory models, combined with perturbation processing methods, to analyze and study the observed singly heavy mesons, further predict the unobserved mesons masses and their corresponding spin-parity quantum numbers.


title: Recurrence relation for instanton partition function in SU(N) gauge theory

abstract: We study the equivariant instanton partition function in $\mathcal{N}=2$ supersymmetric theory on $\mathbb{C}^2$ with $SU(N)$ gauge group and find the generalisation of the Zamolodchikov recurrence relation. We consider the pure theory as well as theories with matter hypermultiplets in the adjoint and fundamental representations.


title: Cosmic Reionization On Computers: Baryonic Effects on Halo Concentrations During the Epoch of Reionization

abstract: Baryons both increase halo concentration through adiabatic contraction and expel mass through feedback processes. However, it is not well understood how the radiation fields prevalent during the epoch of reionization affect the evolution of concentration in dark matter halos. We investigate how baryonic physics during the epoch of reionization modify the structure of dark matter halos in the Cosmic Reionization On Computers (CROC) simulations. We use two different measures of halo concentration to quantify the effects. We compare concentrations of halos matched between full physics simulations and dark-matter-only simulations with identical initial conditions between $5 \leq z \leq 9$. Baryons in full physics simulations do pull matter towards the center, increasing the maximum circular velocity compared to dark-matter-only simulations. However, their overall effects are much less than if all the baryons were simply centrally concentrated indicating that heating processes efficiently counteract cooling effects. Finally, we show that the baryonic effects on halo concentrations at $z\approx5$ are relatively insensitive to environmental variations of reionization history. These results are pertinent to models of galaxy-halo connection during the epoch of reionization.


title: Distributed decentralized receding horizon control for very large-scale networks with application to satellite mega-constellations

abstract: The implementation feasibility of control algorithms over very large-scale networks calls for hard constraints regarding communication, computational, and memory requirements. In this paper, the decentralized receding horizon control problem for very large-scale networks of dynamically decoupled systems with a common, possibly time-varying, control objective is addressed. Each system is assumed to be modeled by linear time-varying dynamics, which can be leveraged to approximate nonlinear systems about successive points of operation. A distributed and decentralized receding horizon control solution is put forward, which: i) takes communication delays into account; ii) allows local communication exclusively; and iii) whose computational and memory requirements in each computational unit do not scale with the dimension of the network. The scalability of the proposed solution enables emerging very large-scale applications of swarm robotics and networked control. This approach is applied to the orbit control problem of low Earth orbit mega-constellations, featuring high-fidelity numerical simulations for the Starlink mega-constellation.


title: CacheQL: Quantifying and Localizing Cache Side-Channel Vulnerabilities in Production Software

abstract: Cache side-channel attacks extract secrets by examining how victim software accesses cache. To date, practical attacks on cryptosystems and media libraries are demonstrated under different scenarios, inferring secret keys and reconstructing private media data such as images. This work first presents eight criteria for designing a full-fledged detector for cache side-channel vulnerabilities. Then, we propose CacheQL, a novel detector that meets all of these criteria. CacheQL precisely quantifies information leaks of binary code, by characterizing the distinguishability of logged side channel traces. Moreover, CacheQL models leakage as a cooperative game, allowing information leakage to be precisely distributed to program points vulnerable to cache side channels. CacheQL is meticulously optimized to analyze whole side channel traces logged from production software (where each trace can have millions of records), and it alleviates randomness introduced by cryptographic blinding, ORAM, or real-world noises. Our evaluation quantifies side-channel leaks of production cryptographic and media software. We further localize vulnerabilities reported by previous detectors and also identify a few hundred new leakage sites in recent OpenSSL (ver. 3.0.0), MbedTLS (ver. 3.0.0), Libgcrypt (ver. 1.9.4). Many of our localized program points are within the pre-processing modules of cryptosystems, which are not analyzed by existing works due to scalability. We also localize vulnerabilities in Libjpeg (ver. 2.1.2) that leak privacy about input images.


title: Complete two-loop electroweak corrections to $e^+e^-\rightarrow HZ$

abstract: We compute the complete two-loop electroweak corrections to the Higgsstralung process $e^+e^-\rightarrow HZ$ at the future Higgs factory. The Feynman integrals involved in the computation are decomposed into linear combinations of a minimal set of master integrals taking advantage of the recent developments of integral reduction techniques. The master integrals are then evaluated by differential equations with boundary conditions provided by the auxiliary mass flow method. Our final result for given $\sqrt{s}$ is expressed as a piecewise function defined by several deeply expanded power series, which has high precision and can be further manipulated efficiently. Our calculation presents the first complete two-loop electroweak corrections for processes with four external particles.


title: Generalized matrix nearness problems

abstract: We show that the global minimum solution of $\lVert A - BXC \rVert$ can be found in closed-form with singular value decompositions and generalized singular value decompositions for a variety of constraints on $X$ involving rank, norm, symmetry, two-sided product, and prescribed eigenvalue. This extends the solution of Friedland--Torokhti for the generalized rank-constrained approximation problem to other constraints as well as provides an alternative solution for rank constraint in terms of singular value decompositions. For more complicated constraints on $X$ involving structures such as Toeplitz, Hankel, circulant, nonnegativity, stochasticity, positive semidefiniteness, prescribed eigenvector, etc, we prove that a simple iterative method is linearly and globally convergent to the global minimum solution.


title: Charge transport in the spatially correlated exponential random energy landscape: effect of the non-positive correlation function

abstract: Charge transport in amorphous semiconductors having spatially correlated exponential density of states (DOS) has been considered for the arbitrary behavior of the correlation function of random energies. Average carrier velocity is exactly calculated for the quasi-equilibrium (nondispersive) transport regime. For the symmetric exponential DOS with exponential tails for low and high energies and non-positive correlation function the temperature for the transition to the dispersive transport regime depends on correlation properties and becomes greater than the traditional estimation based on the DOS decay energy $kT=U_0$. Another new feature of the transport in the landscape having non-positive correlation function is the decay of the mobility with field in low field region.


title: Reply to "Comment on: 'Case for a U(1)$_\pi$ Quantum Spin Liquid Ground State in the Dipole-Octupole Pyrochlore $\mathrm{Ce}_2\mathrm{Zr}_2\mathrm{O}_7$' "

abstract: In his comment [arXiv:2209.03235], S. W. Lovesey argues that our analysis of neutron scattering experiments performed on Ce$_2$Zr$_2$O$_7$ is invalid. Lovesey argues that we have not properly accounted for the higher-order multipolar contributions to the magnetic scattering and that our use of pseudospin-$1/2$ operators to describe the scattering is inappropriate. In this reply, we show that the multipolar corrections discussed by Lovesey only become significant at scattering wavevectors exceeding those accessed in our experiments. This in no way contradicts or undermines our work, which never claimed a direct observation of scattering from higher-order multipoles. We further show that Lovesey's objections to our use of pseudospins are unfounded, and that the pseudospin operators are able to describe all magnetic scattering processes at the energy scale of our experiments, far below the crystal field gap. Finally, we comment on certain assumptions in Lovesey's calculations of the scattering amplitude which are inconsistent with experiment.


title: Universality for cokernels of random matrix products

abstract: For random integer matrices $M_1,\ldots,M_k \in \operatorname{Mat}_n(\mathbb{Z})$ with independent entries, we study the distribution of the cokernel $\operatorname{cok}(M_1 \cdots M_k)$ of their product. We show that this distribution converges to a universal one as $n \to \infty$ for a general class of matrix entry distributions, and more generally show universal limits for the joint distribution of $\operatorname{cok}(M_1),\operatorname{cok}(M_1M_2),\ldots,\operatorname{cok}(M_1 \cdots M_k)$. Furthermore, we characterize the universal distributions arising as marginals of a natural generalization of the Cohen-Lenstra measure to sequences of abelian groups with maps between them, which weights sequences inversely proportionally to their number of automorphisms. The proofs develop an extension of the moment method of Wood to joint moments of multiple groups, and rely also on the connection to Hall-Littlewood polynomials and symmetric function identities. As a corollary we obtain an explicit universal distribution for coranks of random matrix products over $\mathbb{F}_p$ as the matrix size tends to infinity.


title: Co-Writing Screenplays and Theatre Scripts with Language Models: An Evaluation by Industry Professionals

abstract: Language models are increasingly attracting interest from writers. However, such models lack long-range semantic coherence, limiting their usefulness for longform creative writing. We address this limitation by applying language models hierarchically, in a system we call Dramatron. By building structural context via prompt chaining, Dramatron can generate coherent scripts and screenplays complete with title, characters, story beats, location descriptions, and dialogue. We illustrate Dramatron's usefulness as an interactive co-creative system with a user study of 15 theatre and film industry professionals. Participants co-wrote theatre scripts and screenplays with Dramatron and engaged in open-ended interviews. We report critical reflections both from our interviewees and from independent reviewers who watched stagings of the works to illustrate how both Dramatron and hierarchical text generation could be useful for human-machine co-creativity. Finally, we discuss the suitability of Dramatron for co-creativity, ethical considerations -- including plagiarism and bias -- and participatory models for the design and deployment of such tools.


title: Integrable gravity with boundaries

abstract: Symmetric teleparallel gravity is shown to be integrable in the presence of boundaries, given the consistent implementation of constraints in the covariant phase space formalism.


title: Detector Challenges of the strong-field QED experiment LUXE at the European XFEL

abstract: The LUXE experiment aims at studying high-field QED in electron-laser and photon-laser interactions, with the 16.5 GeV electron beam of the European XFEL and a laser beam with power of up to 350 TW. The experiment will measure the spectra of electrons, positrons and photons in expected ranges of 10$^{-3}$ to 10$^9$ per 1 Hz bunch crossing, depending on the laser power and focus. These measurements have to be performed in the presence of low-energy high radiation-background. To meet these challenges, for high-rate electron and photon fluxes, the experiment will use Cherenkov radiation detectors, scintillator screens, sapphire sensors as well as lead-glass monitors for backscattering off the beam-dump. A fourlayer silicon-pixel tracker and a compact electromagnetic tungsten calorimeter with GaAs sensors will be used to measure the positron spectra. The layout of the experiment and the expected performance under the harsh radiation conditions will be presented. Beam tests for the Cherenkov detector and the electromagnetic calorimeter were performed at DESY recently and results will be presented. The experiment received a stage 0 critical approvement (CD0) from the DESY management and is in the process of preparing its technical design report (TDR). It is expected to start running in 2025/6.


title: Motion of Spinning and Spinning Deviation Density Tensors in Riemannian Geometry

abstract: Equations of motion of spinning density for extended objects, and corresponding deviation equations are derived. The problem of motion for a variable mass to a spinning extended object is obtained. Spinning fluids may be considered as a special case to express the motion of spinning density for extended objects. Meanwhile, spinning density tensor can be expressed in terms of tetrad formalism of General Relativity to be regarded as a gauge theory of gravity. Equations of spinning and spinning deviation density tensors have been derived using a specific type of Bazanski Lagrangian is performed.


title: Site-specific atomic substitution in a giant magnetocaloric Fe$_2$P-type system

abstract: Giant magnetocaloric (GMC) materials constitute a requirement for near room temperature magnetic refrigeration. (Fe,Mn)$_2$(P,Si) is a GMC compound with strong magnetoelastic coupling. The main hindrance towards application of this material is a comparably large temperature hysteresis, which can be reduced by metal site substitution with a nonmagnetic element. However, the (Fe,Mn)$_2$(P,Si) compound has two equally populated metal sites, the tetrahedrally coordinated $3f$ and the pyramidally coordinated $3g$ sites. The magnetic and magnetocaloric properties of such compounds are highly sensitive to the site specific occupancy of the magnetic atoms. Here we have attempted to study separately the effect of $3f$ and $3g$ site substitution with equal amounts of vanadium. Using formation energy calculations, the site preference of vanadium and its influence on the magnetic phase formation are described. A large difference in the isothermal entropy change (as high as 44\%) with substitution in the $3f$ and $3g$ sites is observed. The role of the lattice parameter change with temperature and the strength of the magnetoelastic coupling on the magnetic properties are highlighted.


title: Approximate Solutions To Constrained Risk-Sensitive Markov Decision Processes

abstract: This paper considers the problem of finding near-optimal Markovian randomized (MR) policies for finite-state-action, infinite-horizon, constrained risk-sensitive Markov decision processes (CRSMDPs). Constraints are in the form of standard expected discounted cost functions as well as expected risk-sensitive discounted cost functions over finite and infinite horizons. The main contribution is to show that the problem possesses a solution if it is feasible, and to provide two methods for finding an approximate solution in the form of an ultimately stationary (US) MR policy. The latter is achieved through two approximating finite-horizon CRSMDPs which are constructed from the original CRSMDP by time-truncating the original objective and constraint cost functions, and suitably perturbing the constraint upper bounds. The first approximation gives a US policy which is $\epsilon$-optimal and feasible for the original problem, while the second approximation gives a near-optimal US policy whose violation of the original constraints is bounded above by a specified $\epsilon$. A key step in the proofs is an appropriate choice of a metric that makes the set of infinite-horizon MR policies and the feasible regions of the three CRSMDPs compact, and the objective and constraint functions continuous. A linear-programming-based formulation for solving the approximating finite-horizon CRSMDPs is also given.


title: Towards better discrimination and improved modelling of dark-sector showers

abstract: As no evidence for classic WIMP-based signatures of dark matter have been found at the LHC, several phenomenological studies have raised the possibility of accessing a strongly-interacting dark sector through new collider-event topologies. If dark mesons exist, their evolution and hadronization procedure are currently little constrained. They could decay promptly and result in QCD-like jet structures, even though the original decaying particles are dark sector ones; they could behave as semi-visible jets; or they could behave as completely detector-stable hadrons, in which case the final state is just the missing transverse momentum. In this contribution we will introduce a study performed to explore use of jet substructure methods to distinguish dark-sector from QCD jets in the first two scenarios, using observables in a IRC-safe linear basis, and discuss ways forward for this approach to dark-matter at the LHC.


title: DirectTracker: 3D Multi-Object Tracking Using Direct Image Alignment and Photometric Bundle Adjustment

abstract: Direct methods have shown excellent performance in the applications of visual odometry and SLAM. In this work we propose to leverage their effectiveness for the task of 3D multi-object tracking. To this end, we propose DirectTracker, a framework that effectively combines direct image alignment for the short-term tracking and sliding-window photometric bundle adjustment for 3D object detection. Object proposals are estimated based on the sparse sliding-window pointcloud and further refined using an optimization-based cost function that carefully combines 3D and 2D cues to ensure consistency in image and world space. We propose to evaluate 3D tracking using the recently introduced higher-order tracking accuracy (HOTA) metric and the generalized intersection over union similarity measure to mitigate the limitations of the conventional use of intersection over union for the evaluation of vision-based trackers. We perform evaluation on the KITTI Tracking benchmark for the Car class and show competitive performance in tracking objects both in 2D and 3D.


title: A number theoretic classification of toroidal solenoids

abstract: We classify toroidal solenoids defined by non-singular $n\times n$-matrices $A$ with integer coefficients by studying associated first \^Cech cohomology groups. In a previous work, we classified the groups in the case $n=2$ using generalized ideal classes in the splitting field of the characteristic polynomial of $A$. In this paper we explore the classification problem for an arbitrary $n$.


title: Statistical Learning and Inverse Problems: A Stochastic Gradient Approach

abstract: Inverse problems are paramount in Science and Engineering. In this paper, we consider the setup of Statistical Inverse Problem (SIP) and demonstrate how Stochastic Gradient Descent (SGD) algorithms can be used in the linear SIP setting. We provide consistency and finite sample bounds for the excess risk. We also propose a modification for the SGD algorithm where we leverage machine learning methods to smooth the stochastic gradients and improve empirical performance. We exemplify the algorithm in a setting of great interest nowadays: the Functional Linear Regression model. In this case we consider a synthetic data example and examples with a real data classification problem.


title: Search for Cosmic-ray Boosted Sub-GeV Dark Matter using Recoil Protons at Super-Kamiokande

abstract: We report a search for cosmic-ray boosted dark matter with protons using the 0.37 megaton$\times$years data collected at Super-Kamiokande experiment during the 1996-2018 period (SKI-IV phase). We searched for an excess of proton recoils above the atmospheric neutrino background from the vicinity of the Galactic Center. No such excess is observed, and limits are calculated for two reference models of dark matter with either a constant interaction cross-section or through a scalar mediator. This is the first experimental search for boosted dark matter with hadrons using directional information. The results present the most stringent limits on cosmic-ray boosted dark matter and exclude the dark matter-nucleon elastic scattering cross-section between $10^{-33}\text{ cm}^{2}$ and $10^{-27}\text{ cm}^{2}$ for dark matter mass from 10 MeV/$c^2$ to 1 GeV/$c^2$.


title: Transfer Learning with Pretrained Remote Sensing Transformers

abstract: Although the remote sensing (RS) community has begun to pretrain transformers (intended to be fine-tuned on RS tasks), it is unclear how these models perform under distribution shifts. Here, we pretrain a new RS transformer--called SatViT-V2--on 1.3 million satellite-derived RS images, then fine-tune it (along with five other models) to investigate how it performs on distributions not seen during training. We split an expertly labeled land cover dataset into 14 datasets based on source biome. We train each model on each biome separately and test them on all other biomes. In all, this amounts to 1638 biome transfer experiments. After fine-tuning, we find that SatViT-V2 outperforms SatViT-V1 by 3.1% on in-distribution (matching biomes) and 2.8% on out-of-distribution (mismatching biomes) data. Additionally, we find that initializing fine-tuning from the linear probed solution (i.e., leveraging LPFT [1]) improves SatViT-V2's performance by another 1.2% on in-distribution and 2.4% on out-of-distribution data. Next, we find that pretrained RS transformers are better calibrated under distribution shifts than non-pretrained models and leveraging LPFT results in further improvements in model calibration. Lastly, we find that five measures of distribution shift are moderately correlated with biome transfer performance. We share code and pretrained model weights. (https://github.com/antofuller/SatViT)


title: 3D Rendering Framework for Data Augmentation in Optical Character Recognition

abstract: In this paper, we propose a data augmentation framework for Optical Character Recognition (OCR). The proposed framework is able to synthesize new viewing angles and illumination scenarios, effectively enriching any available OCR dataset. Its modular structure allows to be modified to match individual user requirements. The framework enables to comfortably scale the enlargement factor of the available dataset. Furthermore, the proposed method is not restricted to single frame OCR but can also be applied to video OCR. We demonstrate the performance of our framework by augmenting a 15% subset of the common Brno Mobile OCR dataset. Our proposed framework is capable of leveraging the performance of OCR applications especially for small datasets. Applying the proposed method, improvements of up to 2.79 percentage points in terms of Character Error Rate (CER), and up to 7.88 percentage points in terms of Word Error Rate (WER) are achieved on the subset. Especially the recognition of challenging text lines can be improved. The CER may be decreased by up to 14.92 percentage points and the WER by up to 18.19 percentage points for this class. Moreover, we are able to achieve smaller error rates when training on the 15% subset augmented with the proposed method than on the original non-augmented full dataset.


title: Hyperspectral Remote Sensing Benchmark Database for Oil Spill Detection with an Isolation Forest-Guided Unsupervised Detector

abstract: Oil spill detection has attracted increasing attention in recent years since marine oil spill accidents severely affect environments, natural resources, and the lives of coastal inhabitants. Hyperspectral remote sensing images provide rich spectral information which is beneficial for the monitoring of oil spills in complex ocean scenarios. However, most of the existing approaches are based on supervised and semi-supervised frameworks to detect oil spills from hyperspectral images (HSIs), which require a huge amount of effort to annotate a certain number of high-quality training sets. In this study, we make the first attempt to develop an unsupervised oil spill detection method based on isolation forest for HSIs. First, considering that the noise level varies among different bands, a noise variance estimation method is exploited to evaluate the noise level of different bands, and the bands corrupted by severe noise are removed. Second, kernel principal component analysis (KPCA) is employed to reduce the high dimensionality of the HSIs. Then, the probability of each pixel belonging to one of the classes of seawater and oil spills is estimated with the isolation forest, and a set of pseudo-labeled training samples is automatically produced using the clustering algorithm on the detected probability. Finally, an initial detection map can be obtained by performing the support vector machine (SVM) on the dimension-reduced data, and then, the initial detection result is further optimized with the extended random walker (ERW) model so as to improve the detection accuracy of oil spills. Experiments on airborne hyperspectral oil spill data (HOSD) created by ourselves demonstrate that the proposed method obtains superior detection performance with respect to other state-of-the-art detection approaches.


title: Ultrastrong light-matter interaction in a multimode photonic crystal

abstract: Harnessing the interaction between light and matter at the quantum level has been a central theme in atomic physics and quantum optics, with applications from quantum computation to quantum metrology. Combining complex interactions with photonic synthetic materials provides an opportunity to investigate novel quantum phases and phenomena, establishing interesting connections to condensed matter physics. Here we explore many-body phenomena with a single artificial atom coupled to the many discrete modes of a photonic crystal. This experiment reaches the ultrastrong light-matter coupling regime using the circuit quantum electrodynamics paradigm, by galvanically coupling a highly nonlinear fluxonium qubit to a tight-binding lattice of microwave resonators. In this regime, the transport of a single photon becomes a many-body problem, owing to the strong participation of multi-photon bound states arising from interactions that break particle number conservation. Exploiting the effective photon-photon interactions mediated by the qubit, the transport of multiple photons leads to complex multimode dynamics that can be employed for generating a continuous reservoir of strongly-correlated photons, an important resource for quantum networks. This work opens exciting prospects for exploring nonlinear quantum optics at the single-photon level and stabilizing entangled many-body phases of light.


title: Deep Unfolding for Iterative Stripe Noise Removal

abstract: The non-uniform photoelectric response of infrared imaging systems results in fixed-pattern stripe noise being superimposed on infrared images, which severely reduces image quality. As the applications of degraded infrared images are limited, it is crucial to effectively preserve original details. Existing image destriping methods struggle to concurrently remove all stripe noise artifacts, preserve image details and structures, and balance real-time performance. In this paper we propose a novel algorithm for destriping degraded images, which takes advantage of neighbouring column signal correlation to remove independent column stripe noise. This is achieved through an iterative deep unfolding algorithm where the estimated noise of one network iteration is used as input to the next iteration. This progression substantially reduces the search space of possible function approximations, allowing for efficient training on larger datasets. The proposed method allows for a more precise estimation of stripe noise to preserve scene details more accurately. Extensive experimental results demonstrate that the proposed model outperforms existing destriping methods on artificially corrupted images on both quantitative and qualitative assessments.


title: Greybox XAI: a Neural-Symbolic learning framework to produce interpretable predictions for image classification

abstract: Although Deep Neural Networks (DNNs) have great generalization and prediction capabilities, their functioning does not allow a detailed explanation of their behavior. Opaque deep learning models are increasingly used to make important predictions in critical environments, and the danger is that they make and use predictions that cannot be justified or legitimized. Several eXplainable Artificial Intelligence (XAI) methods that separate explanations from machine learning models have emerged, but have shortcomings in faithfulness to the model actual functioning and robustness. As a result, there is a widespread agreement on the importance of endowing Deep Learning models with explanatory capabilities so that they can themselves provide an answer to why a particular prediction was made. First, we address the problem of the lack of universal criteria for XAI by formalizing what an explanation is. We also introduced a set of axioms and definitions to clarify XAI from a mathematical perspective. Finally, we present the Greybox XAI, a framework that composes a DNN and a transparent model thanks to the use of a symbolic Knowledge Base (KB). We extract a KB from the dataset and use it to train a transparent model (i.e., a logistic regression). An encoder-decoder architecture is trained on RGB images to produce an output similar to the KB used by the transparent model. Once the two models are trained independently, they are used compositionally to form an explainable predictive model. We show how this new architecture is accurate and explainable in several datasets.


title: Causal Inference via Nonlinear Variable Decorrelation for Healthcare Applications

abstract: Causal inference and model interpretability research are gaining increasing attention, especially in the domains of healthcare and bioinformatics. Despite recent successes in this field, decorrelating features under nonlinear environments with human interpretable representations has not been adequately investigated. To address this issue, we introduce a novel method with a variable decorrelation regularizer to handle both linear and nonlinear confounding. Moreover, we employ association rules as new representations using association rule mining based on the original features to further proximate human decision patterns to increase model interpretability. Extensive experiments are conducted on four healthcare datasets (one synthetically generated and three real-world collections on different diseases). Quantitative results in comparison to baseline approaches on parameter estimation and causality computation indicate the model's superior performance. Furthermore, expert evaluation given by healthcare professionals validates the effectiveness and interpretability of the proposed model.


title: Parameter-Conditioned Reachable Sets for Updating Safety Assurances Online

abstract: Hamilton-Jacobi (HJ) reachability analysis is a powerful tool for analyzing the safety of autonomous systems. However, the provided safety assurances are often predicated on the assumption that once deployed, the system or its environment does not evolve. Online, however, an autonomous system might experience changes in system dynamics, control authority, external disturbances, and/or the surrounding environment, requiring updated safety assurances. Rather than restarting the safety analysis from scratch, which can be time-consuming and often intractable to perform online, we propose to compute \textit{parameter-conditioned} reachable sets. Assuming expected system and environment changes can be parameterized, we treat these parameters as virtual states in the system and leverage recent advances in high-dimensional reachability analysis to solve the corresponding reachability problem offline. This results in a family of reachable sets that is parameterized by the environment and system factors. Online, as these factors change, the system can simply query the corresponding safety function from this family to ensure system safety, enabling a real-time update of the safety assurances. Through various simulation studies, we demonstrate the capability of our approach in maintaining system safety despite the system and environment evolution.


title: Transformer Meets Boundary Value Inverse Problems

abstract: A Transformer-based deep direct sampling method is proposed for electrical impedance tomography, a well-known severely ill-posed nonlinear boundary value inverse problem. A real-time reconstruction is achieved by evaluating the learned inverse operator between carefully designed data and the reconstructed images. An effort is made to give a specific example to a fundamental question: whether and how one can benefit from the theoretical structure of a mathematical problem to develop task-oriented and structure-conforming deep neural networks? Specifically, inspired by direct sampling methods for inverse problems, the 1D boundary data in different frequencies are preprocessed by a partial differential equation-based feature map to yield 2D harmonic extensions as different input channels. Then, by introducing learnable non-local kernels, the direct sampling is recast to a modified attention mechanism. The new method achieves superior accuracy over its predecessors and contemporary operator learners and shows robustness to noises in benchmarks. This research shall strengthen the insights that, despite being invented for natural language processing tasks, the attention mechanism offers great flexibility to be modified in conformity with the a priori mathematical knowledge, which ultimately leads to the design of more physics-compatible neural architectures.


title: Enumeration of max-pooling responses with generalized permutohedra

abstract: We investigate the combinatorics of max-pooling layers, which are functions that downsample input arrays by taking the maximum over shifted windows of input coordinates, and which are commonly used in convolutional neural networks. We obtain results on the number of linearity regions of these functions by equivalently counting the number of vertices of certain Minkowski sums of simplices. We characterize the faces of such polytopes and obtain generating functions and closed formulas for the number of vertices and facets in a 1D max-pooling layer depending on the size of the pooling windows and stride, and for the number of vertices in a special case of 2D max-pooling.


title: Integral geometry on the octonionic plane

abstract: We describe explicitly the algebra of Spin(9)-invariant, translation-invariant, continuous valuations on the octonionic plane. Namely, we present a basis in terms of invariant differential forms and determine the Bernig-Fu convolution on this space. The main technical ingredient we introduce is an extension of the invariant theory of the Lie group Spin(7) to the isotropy representation of the action of Spin(9) on the 15-dimensional sphere, reflecting the underlying octonionic structure. As an application, we compute the principal kinematic formula on the octonionic plane and express in our basis certain Spin(9)-invariant valuations introduced previously by Alesker.


title: Triangles, Fractales and Spaghetti

abstract: There is well-known problem of geometric probability which can be quote as the Broken Spaghetti Problem. It addresses the following question: A stick of spaghetti breaks into three parts and all points of the stick have the same probability to be a breaking point. What is the probability that the three sticks, putting together, form a triangle? In these notes, we describe a hidden geometric pattern behind the symmetric version of this problem, namely a fractal that parametrizes the sample space of this problem. Using that fractal, we address the question about the probability to obtain a $\delta$-equilateral triangle.


title: Stop Wasting My Time! Saving Days of ImageNet and BERT Training with Latest Weight Averaging

abstract: Training vision or language models on large datasets can take days, if not weeks. We show that averaging the weights of the k latest checkpoints, each collected at the end of an epoch, can speed up the training progression in terms of loss and accuracy by dozens of epochs, corresponding to time savings up to ~68 and ~30 GPU hours when training a ResNet50 on ImageNet and RoBERTa-Base model on WikiText-103, respectively. We also provide the code and model checkpoint trajectory to reproduce the results and facilitate research on reusing historical weights for faster convergence.


title: Continuity of Cost in Borkar Control Topology and Implications on Discrete Space and Time Approximations for Controlled Diffusions under Several Criteria

abstract: We first show that the discounted cost, cost up to an exit time, and ergodic cost involving controlled non-degenerate diffusions are continuous on the space of stationary control policies when the policies are given a topology introduced by Borkar [V. S. Borkar, A topology for Markov controls, Applied Mathematics and Optimization 20 (1989), 55-62]. The same applies for finite horizon problems when the control policies are markov and the topology is revised to include time also as a parameter. We then establish that finite action/piecewise constant stationary policies are dense in the space of stationary Markov policies under this topology. Using the above mentioned continuity and denseness results we establish that finite action/piecewise constant policies approximate optimal stationary policies with arbitrary precision. This gives rise to the applicability of many numerical methods such as policy iteration and stochastic learning methods for discounted cost, cost up to an exit time, and ergodic cost optimal control problems in continuous-time. For the finite-horizon setup, we establish additionally near optimality of time-discretized policies by an analogous argument. We thus present a unified and concise approach for approximations directly applicable under several commonly adopted cost criteria.


title: Determination of Elastic Parameters of Lipid Membranes with Molecular Dynamics: A Review of Approaches and Theoretical Aspects

abstract: Lipid membranes are abundant in living organisms, where they constitute a surrounding shell for cells and their organelles. There are many circumstances in which the deformations of lipid membranes are involved in living cells: fusion and fission, membrane-mediated interaction between membrane inclusions, lipid-protein interaction, formation of pores, etc. In all of these cases, elastic parameters of lipid membranes are important for the description of membrane deformations, as these parameters determine energy barriers and characteristic times of membrane-involved phenomena. Since the development of molecular dynamics (MD), a variety of in silico methods have been proposed for the determination of elastic parameters of simulated lipid membranes. These MD methods allow for the consideration of details unattainable in experimental techniques and represent a distinct scientific field, which is rapidly developing. This work provides a review of these MD approaches with a focus on theoretical aspects. Two main challenges are identified: (i) the ambiguity in the transition from the continuum description of elastic theories to the discrete representation of MD simulations, and (ii) the determination of intrinsic elastic parameters of lipid mixtures, which is complicated due to the composition-curvature coupling effect.


title: CompF5: End User Analysis Topical Group Report

abstract: This report summarizes the work of the Computational Frontier topical group on end user analysis for Snowmass 2021. End User Analysis refers to the extraction of physics results from reconstructed and simulated experimental data. High energy physics experiments produce systems that perform common reconstruction, calibration, and simulation tasks, resulting in shared data samples. These detailed data samples are then reduced to create a range of analysis samples, often optimized for a particular physics topic by a trigger or data object selection. End users (analyzers) then analyze those samples to produce physics results. Community discussions converged on categorizing the end user analysis ensemble into Analysis Ecosystems, Analysis Models, Dataset Bookkeeping and Formats, Collaborative Software, and Training. We present findings and recommendations based on these key areas that impact end user analysis.

categories: physics.comp-ph hep-ex hep-lat hep-ph hep-th


title: Nonprobabilistic typicality with application to quantum mechanics

abstract: In this paper two hypotheses are developed. The first hypothesis is the existence of random phenomena/experiments in which the events cannot generally be assigned a definite probability but that nevertheless admit a class of nearly certain events. These experiments are referred to as \textit{typicalistic} (instead of probabilistic) experiments. As probabilistic experiments are represented by probability spaces, typicalistic experiments can be represented by \textit{typicality spaces}, where a typicality space is basically a probability space in which the probability measure has been replaced by a much less structured typicality measure $T$. The condition $T(A) \approx 1$ defines the typical sets, and a typicality space is related to a typicalistic experiment by associating the typical sets of the former with the nearly certain events of the latter. Some elements of a theory of typicality, including the definition of typicality spaces, are developed in the first part of the paper. The second hypothesis is that the evolution of a quantum particle (or of a system of quantum particles) can be considered a typicalistic phenomenon, so that it can be represented by the combination of typicality theory and quantum mechanics. The result is a novel formulation of quantum mechanics that does not present the measurement problem and that could be a viable alternative to Bohmian mechanics. This subject is developed in the second part of the paper.


title: Two results on the logarithmic cotangent complex

abstract: In this paper we give two results on the logarithmic cotangent complex: we construct a logarithmic analogues to the complex of Lichtenbaum and Schlessinger and to Quillen's fundamental spectral sequence.


title: No Free Lunch in "Privacy for Free: How does Dataset Condensation Help Privacy"

abstract: New methods designed to preserve data privacy require careful scrutiny. Failure to preserve privacy is hard to detect, and yet can lead to catastrophic results when a system implementing a ``privacy-preserving'' method is attacked. A recent work selected for an Outstanding Paper Award at ICML 2022 (Dong et al., 2022) claims that dataset condensation (DC) significantly improves data privacy when training machine learning models. This claim is supported by theoretical analysis of a specific dataset condensation technique and an empirical evaluation of resistance to some existing membership inference attacks. In this note we examine the claims in the work of Dong et al. (2022) and describe major flaws in the empirical evaluation of the method and its theoretical analysis. These flaws imply that their work does not provide statistically significant evidence that DC improves the privacy of training ML models over a naive baseline. Moreover, previously published results show that DP-SGD, the standard approach to privacy preserving ML, simultaneously gives better accuracy and achieves a (provably) lower membership attack success rate.


title: DreamFusion: Text-to-3D using 2D Diffusion

abstract: Recent breakthroughs in text-to-image synthesis have been driven by diffusion models trained on billions of image-text pairs. Adapting this approach to 3D synthesis would require large-scale datasets of labeled 3D data and efficient architectures for denoising 3D data, neither of which currently exist. In this work, we circumvent these limitations by using a pretrained 2D text-to-image diffusion model to perform text-to-3D synthesis. We introduce a loss based on probability density distillation that enables the use of a 2D diffusion model as a prior for optimization of a parametric image generator. Using this loss in a DeepDream-like procedure, we optimize a randomly-initialized 3D model (a Neural Radiance Field, or NeRF) via gradient descent such that its 2D renderings from random angles achieve a low loss. The resulting 3D model of the given text can be viewed from any angle, relit by arbitrary illumination, or composited into any 3D environment. Our approach requires no 3D training data and no modifications to the image diffusion model, demonstrating the effectiveness of pretrained image diffusion models as priors.


title: A subpolynomial-time algorithm for the free energy of one-dimensional quantum systems in the thermodynamic limit

abstract: We introduce a classical algorithm to approximate the free energy of local, translation-invariant, one-dimensional quantum systems in the thermodynamic limit of infinite chain size. While the ground state problem (i.e., the free energy at temperature $T = 0$) for these systems is expected to be computationally hard even for quantum computers, our algorithm runs for any fixed temperature $T > 0$ in subpolynomial time, i.e., in time $O((\frac{1}{\varepsilon})^{c})$ for any constant $c > 0$ where $\varepsilon$ is the additive approximation error. Previously, the best known algorithm had a runtime that is polynomial in $\frac{1}{\varepsilon}$. Our algorithm is also particularly simple as it reduces to the computation of the spectral radius of a linear map. This linear map has an interpretation as a noncommutative transfer matrix and has been studied previously to prove results on the analyticity of the free energy and the decay of correlations. We also show that the corresponding eigenvector of this map gives an approximation of the marginal of the Gibbs state and thereby allows for the computation of various thermodynamic properties of the quantum system.

categories: quant-ph cond-mat.stat-mech math-ph math.MP


title: Partially Observable RL with B-Stability: Unified Structural Condition and Sharp Sample-Efficient Algorithms

abstract: Partial Observability -- where agents can only observe partial information about the true underlying state of the system -- is ubiquitous in real-world applications of Reinforcement Learning (RL). Theoretically, learning a near-optimal policy under partial observability is known to be hard in the worst case due to an exponential sample complexity lower bound. Recent work has identified several tractable subclasses that are learnable with polynomial samples, such as Partially Observable Markov Decision Processes (POMDPs) with certain revealing or decodability conditions. However, this line of research is still in its infancy, where (1) unified structural conditions enabling sample-efficient learning are lacking; (2) existing sample complexities for known tractable subclasses are far from sharp; and (3) fewer sample-efficient algorithms are available than in fully observable RL. This paper advances all three aspects above for Partially Observable RL in the general setting of Predictive State Representations (PSRs). First, we propose a natural and unified structural condition for PSRs called \emph{B-stability}. B-stable PSRs encompasses the vast majority of known tractable subclasses such as weakly revealing POMDPs, low-rank future-sufficient POMDPs, decodable POMDPs, and regular PSRs. Next, we show that any B-stable PSR can be learned with polynomial samples in relevant problem parameters. When instantiated in the aforementioned subclasses, our sample complexities improve substantially over the current best ones. Finally, our results are achieved by three algorithms simultaneously: Optimistic Maximum Likelihood Estimation, Estimation-to-Decisions, and Model-Based Optimistic Posterior Sampling. The latter two algorithms are new for sample-efficient learning of POMDPs/PSRs.


title: Machine learning and invariant theory

abstract: Inspired by constraints from physical law, equivariant machine learning restricts the learning to a hypothesis class where all the functions are equivariant with respect to some group action. Irreducible representations or invariant theory are typically used to parameterize the space of such functions. In this article, we introduce the topic and explain a couple of methods to explicitly parameterize equivariant functions that are being used in machine learning applications. In particular, we explicate a general procedure, attributed to Malgrange, to express all polynomial maps between linear spaces that are equivariant under the action of a group $G$, given a characterization of the invariant polynomials on a bigger space. The method also parametrizes smooth equivariant maps in the case that $G$ is a compact Lie group.


title: How good is your Laplace approximation of the Bayesian posterior? Finite-sample computable error bounds for a variety of useful divergences

abstract: The Laplace approximation is a popular method for providing posterior mean and variance estimates. But can we trust these estimates for practical use? One might consider using rate-of-convergence bounds for the Bayesian Central Limit Theorem (BCLT) to provide quality guarantees for the Laplace approximation. But the bounds in existing versions of the BCLT either: require knowing the true data-generating parameter, are asymptotic in the number of samples, do not control the Bayesian posterior mean, or apply only to narrow classes of models. Our work provides the first closed-form, finite-sample quality bounds for the Laplace approximation that simultaneously (1) do not require knowing the true parameter, (2) control posterior means and variances, and (3) apply generally to models that satisfy the conditions of the asymptotic BCLT. In fact, our bounds work even in the presence of misspecification. We compute exact constants in our bounds for a variety of standard models, including logistic regression, and numerically demonstrate their utility. We provide a framework for analysis of more complex models.


title: Discrete Microlocal Morse Theory

abstract: We establish several results combining discrete Morse theory and microlocal sheaf theory in the setting of finite posets and simplicial complexes. Our primary tool is a computationally tractable description of the bounded derived category of sheaves on a poset with the Alexandrov topology. We prove that each bounded complex of sheaves on a finite poset admits a unique (up to isomorphism of complexes) minimal injective resolution, and we provide algorithms for computing minimal injective resolution of an injective complex, as well as several useful functors between derived categories of sheaves. For the constant sheaf on a simplicial complex, we give asymptotically tight bounds on the complexity of computing the minimal injective resolution using those algorithms. Our main result is a novel definition of the discrete microsupport of a bounded complex of sheaves on a finite poset. We detail several foundational properties of the discrete microsupport, as well as a microlocal generalization of the discrete homological Morse theorem and Morse inequalities.


title: Ferromagnetism on an atom-thick and extended 2D-metal-organic framework

abstract: Ferromagnetism (FM) is the cornerstone of permanent magnets, data storage and other technologies that directly impact our everyday life by their implementation in standard applications and devices. When downscaling bulk materials into their two-dimensional (2D) magnetic isotropic form, the Mermin-Wagner theorem precludes this collective state mediated by short-range exchange interactions at finite temperatures. Interestingly, this prediction fails when significant magnetic anisotropy is present in the material, as recently demonstrated in single layered van der Waals crystals. Before the latter, single layer metal-organic frameworks (MOFs) grown on metallic supports were one of the earliest candidates for achieving 2D-FM. Such high expectations were based on the chemical and spacing control of the 2D-MOF magnetic centers, the tunability of the organic linkers and the rich self-assembled architectures displayed. However, despite many attempts, extended FM in 2D-MOFs has been experimentally elusive. In this work, we demonstrate that extended, cooperative FM takes place in an atom thick 2D-MOF consisting of 9,10-dicyanoanthracene (DCA) molecules and Fe adatoms grown on Au(111). We show this by means of an experimental multitechnique approach that is endorsed by state-of-the art first-principles calculations. Particularly, this 2D ferromagnet follows a first order transition with TC ~ 35 K, which is driven by exchange interactions mainly through the molecular linkers (J=2 meV) and exhibits an out-of-plane square-like hysteresis loop. The strict periodicity of our 2D-MOF allows us to envision the fabrication of ultra-dense single atom magnetic memories and opens the way to explore periodic magnetic 2D-models that could considerably increase the fundamental superparamagnetic limit.


title: Non-segmental Bayesian Detection of Multiple Change-points

abstract: We propose an original and general NOn-SEgmental (NOSE) approach for the detection of multiple change-points. NOSE identifies change-points by the non-negligibility of posterior estimates of the jump heights. Alternatively, under the Bayesian paradigm, NOSE treats the step-wise signal as a global infinite dimensional parameter drawn from a proposed process of atomic representation, where the random jump heights determine the locations and the number of change-points simultaneously. The random jump heights are further modeled by a Gamma-Indian buffet process shrinkage prior under the form of discrete spike-and-slab. The induced maximum a posteriori estimates of the jump heights are consistent and enjoy zerodiminishing false negative rate in discrimination under a 3-sigma rule. The success of NOSE is guaranteed by the posterior inferential results such as the minimaxity of posterior contraction rate, and posterior consistency of both locations and the number of abrupt changes. NOSE is applicable and effective to detect scale shifts, mean shifts, and structural changes in regression coefficients under linear or autoregression models. Comprehensive simulations and several real-world examples demonstrate the superiority of NOSE in detecting abrupt changes under various data settings.


title: Multiple Modes for Continual Learning

abstract: Adapting model parameters to incoming streams of data is a crucial factor to deep learning scalability. Interestingly, prior continual learning strategies in online settings inadvertently anchor their updated parameters to a local parameter subspace to remember old tasks, else drift away from the subspace and forget. From this observation, we formulate a trade-off between constructing multiple parameter modes and allocating tasks per mode. Mode-Optimized Task Allocation (MOTA), our contributed adaptation strategy, trains multiple modes in parallel, then optimizes task allocation per mode. We empirically demonstrate improvements over baseline continual learning strategies and across varying distribution shifts, namely sub-population, domain, and task shift.


title: Optimistic MLE -- A Generic Model-based Algorithm for Partially Observable Sequential Decision Making

abstract: This paper introduces a simple efficient learning algorithms for general sequential decision making. The algorithm combines Optimism for exploration with Maximum Likelihood Estimation for model estimation, which is thus named OMLE. We prove that OMLE learns the near-optimal policies of an enormously rich class of sequential decision making problems in a polynomial number of samples. This rich class includes not only a majority of known tractable model-based Reinforcement Learning (RL) problems (such as tabular MDPs, factored MDPs, low witness rank problems, tabular weakly-revealing/observable POMDPs and multi-step decodable POMDPs), but also many new challenging RL problems especially in the partially observable setting that were not previously known to be tractable. Notably, the new problems addressed by this paper include (1) observable POMDPs with continuous observation and function approximation, where we achieve the first sample complexity that is completely independent of the size of observation space; (2) well-conditioned low-rank sequential decision making problems (also known as Predictive State Representations (PSRs)), which include and generalize all known tractable POMDP examples under a more intrinsic representation; (3) general sequential decision making problems under SAIL condition, which unifies our existing understandings of model-based RL in both fully observable and partially observable settings. SAIL condition is identified by this paper, which can be viewed as a natural generalization of Bellman/witness rank to address partial observability. This paper also presents a reward-free variant of OMLE algorithm, which learns approximate dynamic models that enable the computation of near-optimal policies for all reward functions simultaneously.


title: Mapping the Thermal Condensation of Diffuse H I in the North Celestial Pole Loop

abstract: The North Celestial Pole Loop (NCPL) provides a unique laboratory for studying the early stages of star formation, in particular the condensation of the neutral interstellar medium (ISM). Understanding the physical properties that control the evolution of its contents is key to uncovering the origin of the NCPL. Archival data from the NCPL region of the GHIGLS 21 cm line survey (9'4) are used to map its multiphase content with ${\tt ROHSA}$, a Gaussian decomposition tool that includes spatial regularization. Column density and mass fraction maps of each phase were extracted along with their uncertainties. Archival data from the DHIGLS 21 cm (1') survey are used to further probe the multiphase content of the NCPL. We have identified four spatially (and dynamically) coherent components in the NCPL, one of which is a remarkably well-defined arch moving at about $14\ {\rm km s^{-1}}$ away from us that could be a relic of the large-scale organized dynamical process at the origin of the phase transition. The cold and lukewarm phases together dominate the mass content of the neutral gas along the loop. Using absorption measurements, we find that the cold phase exhibits slightly supersonic turbulence.


title: The Circumgalactic H$\alpha$ Spectrograph (CH$\alpha$S) I. Design, Engineering, and Early Commissioning

abstract: The Circumgalactic H$\alpha$ Spectrograph (CH$\alpha$S) is a ground-based optical integral field spectrograph designed to detect ultra-faint extended emission from diffuse ionized gas in the nearby universe. CH$\alpha$S is particularly well suited for making a direct detection of tenuous H$\alpha$ emission from the circumgalactic medium (CGM) surrounding low-redshift galaxies. It efficiently maps large regions of the CGM in a single exposure, targeting nearby galaxies (d $< 35 $ Mpc) where the CGM is expected to fill the field of view. We are commissioning CH$\alpha$S as a facility instrument at MDM Observatory. CH$\alpha$S is deployed in the focal plane of the Hiltner 2.4-meter telescope, utilizing nearly all of the telescope's unvignetted focal plane (10 arcmin) to conduct wide-field spectroscopic imaging. The catadioptric design provides excellent wide-field imaging performance. CH$\alpha$S is a pupil-imaging spectrograph employing a microlens array to divide the field of view into $> 60,000$ spectra. CH$\alpha$S achieves an angular resolution of $[1.3 - 2.8]$ arcseconds and a resolving power of R$ = [10,000 - 20,000]$. Accordingly, the spectrograph can resolve structure on the scale of $1-5$ kpc (at 10 Mpc) and measure velocities down to 15-30 km/s. CH$\alpha$S intentionally operates over a narrow (30 Angstrom) bandpass; however, it is configured to adjust the central wavelength and target a broad range of optical emission lines individually. A high diffraction efficiency VPH grating ensures high throughput across configurations. CH$\alpha$S maintains a high grasp and moderate spectral resolution, providing an ideal combination for mapping discrete, ultra-low surface brightness emission on the order of a few milli-Raleigh.


title: REST: REtrieve & Self-Train for generative action recognition

abstract: This work is on training a generative action/video recognition model whose output is a free-form action-specific caption describing the video (rather than an action class label). A generative approach has practical advantages like producing more fine-grained and human-readable output, and being naturally open-world. To this end, we propose to adapt a pre-trained generative Vision & Language (V&L) Foundation Model for video/action recognition. While recently there have been a few attempts to adapt V&L models trained with contrastive learning (e.g. CLIP) for video/action, to the best of our knowledge, we propose the very first method that sets outs to accomplish this goal for a generative model. We firstly show that direct fine-tuning of a generative model to produce action classes suffers from severe overfitting. To alleviate this, we introduce REST, a training framework consisting of two key components: an unsupervised method for adapting the generative model to action/video by means of pseudo-caption generation and Self-training, i.e. without using any action-specific labels; (b) a Retrieval approach based on CLIP for discovering a diverse set of pseudo-captions for each video to train the model. Importantly, we show that both components are necessary to obtain high accuracy. We evaluate REST on the problem of zero-shot action recognition where we show that our approach is very competitive when compared to contrastive learning-based methods. Code will be made available.


abstract: Transformers are quickly becoming one of the most heavily applied deep learning architectures across modalities, domains, and tasks. In vision, on top of ongoing efforts into plain transformers, hierarchical transformers have also gained significant attention, thanks to their performance and easy integration into existing frameworks. These models typically employ localized attention mechanisms, such as the sliding-window Neighborhood Attention (NA) or Swin Transformer's Shifted Window Self Attention. While effective at reducing self attention's quadratic complexity, local attention weakens two of the most desirable properties of self attention: long range inter-dependency modeling, and global receptive field. In this paper, we introduce Dilated Neighborhood Attention (DiNA), a natural, flexible and efficient extension to NA that can capture more global context and expand receptive fields exponentially at no additional cost. NA's local attention and DiNA's sparse global attention complement each other, and therefore we introduce Dilated Neighborhood Attention Transformer (DiNAT), a new hierarchical vision transformer built upon both. DiNAT variants enjoy significant improvements over strong baselines such as NAT, Swin, and ConvNeXt. Our large model is faster and ahead of its Swin counterpart by 1.6% box AP in COCO object detection, 1.4% mask AP in COCO instance segmentation, and 1.4% mIoU in ADE20K semantic segmentation. Paired with new frameworks, our large variant is the new state of the art panoptic segmentation model on COCO (58.5 PQ) and ADE20K (49.4 PQ), and instance segmentation model on Cityscapes (45.1 AP) and ADE20K (35.4 AP) (no extra data). It also matches the state of the art specialized semantic segmentation models on ADE20K (58.1 mIoU), and ranks second on Cityscapes (84.5 mIoU) (no extra data).


title: Scheme for single-shot frequency comb absorption sensing on chip

abstract: Frequency comb absorption spectroscopy combined with low-noise, fast homodyne measurements provide a toolbox for ultra-sensitive absorption measurements. Integrating these schemes on photonic platforms to bring them closer to practical applications is challenging. Here, we propose a scheme that can be readily adapted on a photonic platform. We show that each frequency comb tooth can independently sampled, the span of the comb can be tailored, and that our method does not require a careful alignment of the comb centre with any absorption profiles. This allows an asymmetric absorption profile to be reconstructed in full without requiring additional components.


title: Compositional Semantic Parsing with Large Language Models

abstract: Humans can reason compositionally when presented with new tasks. Previous research shows that appropriate prompting techniques enable large language models (LLMs) to solve artificial compositional generalization tasks such as SCAN. In this work, we identify additional challenges in more realistic semantic parsing tasks with larger vocabulary and refine these prompting techniques to address them. Our best method is based on least-to-most prompting: it decomposes the problem using prompting-based syntactic parsing, then uses this decomposition to select appropriate exemplars and to sequentially generate the semantic parse. This method allows us to set a new state of the art for CFQ while requiring only 1% of the training data used by traditional approaches. Due to the general nature of our approach, we expect similar efforts will lead to new results in other tasks and domains, especially for knowledge-intensive applications.


title: Localized Thermal Gradients On-Chip by Radiative Cooling of Silicon Nitride Nanomechanical Resonators

abstract: Small scale renewable energy harvesting is an attractive solution to the growing need for power in remote technological applications. For this purpose, localized thermal gradients on-chip--created via radiative cooling--could be exploited to create microscale renewable heat engines running on environmental heat. This could allow self-powering in small scale portable applications, thus reducing the need for non-renewable sources of electricity and hazardous batteries. In this work, we demonstrate the creation of a local thermal gradient on-chip by radiative cooling of a 90 nm thick freestanding silicon nitride nanomechanical resonator integrated on a silicon substrate that remains at ambient temperature. The reduction in temperature of the thin film is inferred by tracking its mechanical resonance frequency, under high vacuum, using an optical fiber interferometer. Experiments were conducted on 15 different days during fall and summer months, resulting in successful radiative cooling of the membrane in each case. Maximum temperature drops of 9.3 K and 7.1 K are demonstrated during the day and night, respectively, in close correspondence with our heat transfer model. Future improvements to the experimental setup could improve the temperature reduction to 48 K for the same membrane, while emissivity engineering potentially yields a maximum theoretical cooling of 67 K with an ideal emitter.


title: Non-Gaussian Fluctuation Dynamics

abstract: Recent progress of a general deterministic approach to the non-Gaussian fluctuation dynamics is reviewed, with an emphasis on the derivation of the fluctuation evolution equations and their phenomenological implication in heavy-ion collision experiments.

categories: hep-th cond-mat.stat-mech hep-ph nucl-th


title: Effective Vision Transformer Training: A Data-Centric Perspective

abstract: Vision Transformers (ViTs) have shown promising performance compared with Convolutional Neural Networks (CNNs), but the training of ViTs is much harder than CNNs. In this paper, we define several metrics, including Dynamic Data Proportion (DDP) and Knowledge Assimilation Rate (KAR), to investigate the training process, and divide it into three periods accordingly: formation, growth and exploration. In particular, at the last stage of training, we observe that only a tiny portion of training examples is used to optimize the model. Given the data-hungry nature of ViTs, we thus ask a simple but important question: is it possible to provide abundant ``effective'' training examples at EVERY stage of training? To address this issue, we need to address two critical questions, \ie, how to measure the ``effectiveness'' of individual training examples, and how to systematically generate enough number of ``effective'' examples when they are running out. To answer the first question, we find that the ``difficulty'' of training samples can be adopted as an indicator to measure the ``effectiveness'' of training samples. To cope with the second question, we propose to dynamically adjust the ``difficulty'' distribution of the training data in these evolution stages. To achieve these two purposes, we propose a novel data-centric ViT training framework to dynamically measure the ``difficulty'' of training samples and generate ``effective'' samples for models at different training stages. Furthermore, to further enlarge the number of ``effective'' samples and alleviate the overfitting problem in the late training stage of ViTs, we propose a patch-level erasing strategy dubbed PatchErasing. Extensive experiments demonstrate the effectiveness of the proposed data-centric ViT training framework and techniques.


title: Understanding Collapse in Non-Contrastive Siamese Representation Learning

abstract: Contrastive methods have led a recent surge in the performance of self-supervised representation learning (SSL). Recent methods like BYOL or SimSiam purportedly distill these contrastive methods down to their essence, removing bells and whistles, including the negative examples, that do not contribute to downstream performance. These "non-contrastive" methods work surprisingly well without using negatives even though the global minimum lies at trivial collapse. We empirically analyze these non-contrastive methods and find that SimSiam is extraordinarily sensitive to dataset and model size. In particular, SimSiam representations undergo partial dimensional collapse if the model is too small relative to the dataset size. We propose a metric to measure the degree of this collapse and show that it can be used to forecast the downstream task performance without any fine-tuning or labels. We further analyze architectural design choices and their effect on the downstream performance. Finally, we demonstrate that shifting to a continual learning setting acts as a regularizer and prevents collapse, and a hybrid between continual and multi-epoch training can improve linear probe accuracy by as many as 18 percentage points using ResNet-18 on ImageNet. Our project page is at https://alexanderli.com/noncontrastive-ssl/.


title: Effects of leakage on the realization of a discrete time crystal in a chain of singlet-triplet qubits

abstract: We consider the effects of leakage on the ability to realize a discrete time crystal (DTC) in a semiconductor quantum dot linear array being operated as a chain of singlet-triplet (ST) qubits. This system realizes an Ising model with an effective applied magnetic field, plus additional terms that can cause leakage out of the computational subspace. We demonstrate that, in the absence of these leakage terms, this model theoretically realizes a DTC phase over a broad parameter regime for six and eight qubits, with a broader parameter range for the eight-qubit case. We then reintroduce the leakage terms and find that the DTC phase disappears entirely over the same parameter range if the system is only subject to a uniform magnetic field, which does not suppress leakage. However, we find that the DTC phase can be restored if the system is instead subject to a magnetic field that alternates from qubit to qubit, which suppresses leakage. We thus show that leakage is a serious problem for the realization of a DTC phase in a chain of ST qubits, but is by no means insurmountable. Our work suggests that experiments manifesting small-system stable DTC should be feasible with currently existing quantum dot spin qubits.


title: On Symmetric Pseudo-Boolean Functions: Factorization, Kernels and Applications

abstract: A symmetric pseudo-Boolean function is a map from Boolean tuples to real numbers which is invariant under input variable interchange. We prove that any such function can be equivalently expressed as a power series or factorized. The kernel of a pseudo-Boolean function is the set of all inputs that cause the function to vanish identically. Any $n$-variable symmetric pseudo-Boolean function $f(x_1, x_2, \dots, x_n)$ has a kernel corresponding to at least one $n$-affine hyperplane, each hyperplane is given by a constraint $\sum_{l=1}^n x_l = \lambda$ for $\lambda\in \mathbb{C}$ constant. We use these results to analyze symmetric pseudo-Boolean functions appearing in the literature of spin glass energy functions (Ising models), quantum information and tensor networks.


title: A deep learning approach to the probabilistic numerical solution of path-dependent partial differential equations

abstract: Recent work on Path-Dependent Partial Differential Equations (PPDEs) has shown that PPDE solutions can be approximated by a probabilistic representation, implemented in the literature by the estimation of conditional expectations using regression. However, a limitation of this approach is to require the selection of a basis in a function space. In this paper, we overcome this limitation by the use of deep learning methods, and we show that this setting allows for the derivation of error bounds on the approximation of conditional expectations. Numerical examples based on a two-person zero-sum game, as well as on Asian and barrier option pricing, are presented. In comparison with other deep learning approaches, our algorithm appears to be more accurate, especially in large dimensions.

categories: cs.LG cs.NA math.AP math.NA math.PR stat.ML


title: Does Collaborative Editing Help Mitigate Security Vulnerabilities in Crowd-Shared IoT Code Examples?

abstract: Background: With the proliferation of crowd-sourced developer forums, software developers are increasingly sharing more coding solutions to programming problems with others in forums. The decentralized nature of knowledge sharing on sites has raised the concern of sharing security vulnerable code, which then can be reused into mission critical software systems - making those systems vulnerable in the process. Collaborative editing has been introduced in forums like Stack Overflow to improve the quality of the shared contents. Aim: In this paper, we investigate whether code editing can mitigate shared vulnerable code examples by analyzing IoT code snippets and their revisions in three Stack Exchange sites: Stack Overflow, Arduino, and Raspberry Pi. Method:We analyze the vulnerabilities present in shared IoT C/C++ code snippets, as C/C++ is one of the most widely used languages in mission-critical devices and low-powered IoT devices. We further analyse the revisions made to these code snippets, and their effects. Results: We find several vulnerabilities such as CWE 788 - Access of Memory Location After End of Buffer, in 740 code snippets . However, we find the vast majority of posts are not revised, or revisions are not made to the code snippets themselves (598 out of 740). We also find that revisions are most likely to result in no change to the number of vulnerabilities in a code snippet rather than deteriorating or improving the snippet. Conclusions: We conclude that the current collaborative editing system in the forums may be insufficient to help mitigate vulnerabilities in the shared code.


title: Ghost translation

abstract: Artificial intelligence has recently been widely used in computational imaging. The deep neural network (DNN) improves the signal-to-noise ratio of the retrieved images, whose quality is otherwise corrupted due to the low sampling ratio or noisy environments. This work proposes a new computational imaging scheme based on the sequence transduction mechanism with the transformer network. The simulation database assists the network in achieving signal translation ability. The experimental single-pixel detector's signal will be `translated' into a 2D image in an end-to-end manner. High-quality images with no background noise can be retrieved at a sampling ratio as low as 2%. The illumination patterns can be either well-designed speckle patterns for sub-Nyquist imaging or random speckle patterns. Moreover, our method is robust to noise interference. This translation mechanism opens a new direction for DNN-assisted ghost imaging and can be used in various computational imaging scenarios.


title: Wigner 6j symbols for SU(N): Symbols with at least two quark-lines

abstract: We study a class of SU(N) Wigner 6j symbols involving two fundamental representations, and derive explicit formulae for all 6j symbols in this class. Our formulae express the 6j symbols in terms of the dimensions of the involved representations, and they are thereby functions of N. We view these explicit formulae as a first step towards efficiently decomposing SU(N) color structures in terms of group invariants.