title: Meta Knowledge Condensation for Federated Learning

abstract: Existing federated learning paradigms usually extensively exchange distributed models at a central solver to achieve a more powerful model. However, this would incur severe communication burden between a server and multiple clients especially when data distributions are heterogeneous. As a result, current federated learning methods often require a large number of communication rounds in training. Unlike existing paradigms, we introduce an alternative perspective to significantly decrease the communication cost in federate learning. In this work, we first introduce a meta knowledge representation method that extracts meta knowledge from distributed clients. The extracted meta knowledge encodes essential information that can be used to improve the current model. As the training progresses, the contributions of training samples to a federated model also vary. Thus, we introduce a dynamic weight assignment mechanism that enables samples to contribute adaptively to the current model update. Then, informative meta knowledge from all active clients is sent to the server for model update. Training a model on the combined meta knowledge without exposing original data among different clients can significantly mitigate the heterogeneity issues. Moreover, to further ameliorate data heterogeneity, we also exchange meta knowledge among clients as conditional initialization for local meta knowledge extraction. Extensive experiments demonstrate the effectiveness and efficiency of our proposed method. Remarkably, our method outperforms the state-of-the-art by a large margin (from $74.07\%$ to $92.95\%$) on MNIST with a restricted communication budget (i.e. 10 rounds).


title: Protein solutions close to liquid-liquid phase separation exhibit a universal osmotic equation of state and dynamical behavior

abstract: Liquid-liquid phase separation (LLPS) of protein solutions is governed by highly complex protein-protein interactions. Nevertheless, it has been suggested that based on the extended law of corresponding states (ELCS), as proposed for colloids with short-range attractions, one can rationalize not only the thermodynamics, but also the structure and dynamics of such systems. This claim is systematically and comprehensively tested here by static and dynamic light scattering experiments. Spinodal lines, the isothermal osmotic compressibility $\kappa_\text{T}$ and the relaxation rate of concentration fluctuations $\Gamma$ are determined for protein solutions in the vicinity of LLPS. All these quantities are found to exhibit a corresponding-states behavior. This means that, for different solution conditions, these quantities are essentially the same if considered at similar reduced temperature or second virial coefficient. For moderately concentrated solutions, the volume fraction $\phi$ dependence of $\kappa_\text{T}$ and $\Gamma$ can be consistently described by Baxter's model of adhesive hard spheres. The off-critical, asymptotic $T$ behavior of $\kappa_\text{T}$ and $\Gamma$ close to LLPS is consistent with the scaling laws predicted by mean-field theory. Thus, the present work aims at a comprehensive experimental test of the applicability of the ELCS to structural and dynamical properties of concentrated protein solutions.


title: META-STORM: Generalized Fully-Adaptive Variance Reduced SGD for Unbounded Functions

abstract: We study the application of variance reduction (VR) techniques to general non-convex stochastic optimization problems. In this setting, the recent work STORM [Cutkosky-Orabona '19] overcomes the drawback of having to compute gradients of "mega-batches" that earlier VR methods rely on. There, STORM utilizes recursive momentum to achieve the VR effect and is then later made fully adaptive in STORM+ [Levy et al., '21], where full-adaptivity removes the requirement for obtaining certain problem-specific parameters such as the smoothness of the objective and bounds on the variance and norm of the stochastic gradients in order to set the step size. However, STORM+ crucially relies on the assumption that the function values are bounded, excluding a large class of useful functions. In this work, we propose META-STORM, a generalized framework of STORM+ that removes this bounded function values assumption while still attaining the optimal convergence rate for non-convex optimization. META-STORM not only maintains full-adaptivity, removing the need to obtain problem specific parameters, but also improves the convergence rate's dependency on the problem parameters. Furthermore, META-STORM can utilize a large range of parameter settings that subsumes previous methods allowing for more flexibility in a wider range of settings. Finally, we demonstrate the effectiveness of META-STORM through experiments across common deep learning tasks. Our algorithm improves upon the previous work STORM+ and is competitive with widely used algorithms after the addition of per-coordinate update and exponential moving average heuristics.


title: TERMinator: A system for scientific texts processing

abstract: This paper is devoted to the extraction of entities and semantic relations between them from scientific texts, where we consider scientific terms as entities. In this paper, we present a dataset that includes annotations for two tasks and develop a system called TERMinator for the study of the influence of language models on term recognition and comparison of different approaches for relation extraction. Experiments show that language models pre-trained on the target language are not always show the best performance. Also adding some heuristic approaches may improve the overall quality of the particular task. The developed tool and the annotated corpus are publicly available at https://github.com/iis-research-team/terminator and may be useful for other researchers.


title: Continuous PDE Dynamics Forecasting with Implicit Neural Representations

abstract: Effective data-driven PDE forecasting methods often rely on fixed spatial and / or temporal discretizations. This raises limitations in real-world applications like weather prediction where flexible extrapolation at arbitrary spatiotemporal locations is required. We address this problem by introducing a new data-driven approach, DINo, that models a PDE's flow with continuous-time dynamics of spatially continuous functions. This is achieved by embedding spatial observations independently of their discretization via Implicit Neural Representations in a small latent space temporally driven by a learned ODE. This separate and flexible treatment of time and space makes DINo the first data-driven model to combine the following advantages. It extrapolates at arbitrary spatial and temporal locations; it can learn from sparse irregular grids or manifolds; at test time, it generalizes to new grids or resolutions. DINo outperforms alternative neural PDE forecasters in a variety of challenging generalization scenarios on representative PDE systems.


title: Transferring the inhomogeneous wave equation into a homogeneous equation

abstract: The inhomogeneous wave equation, triggered by point sources, forms the basis for the most modern computational techniques of seismic inversion. In this work, we propose to transfer the inhomogeneous wave equation into a homogeneous equation. We show that one can suppress the wavelet-based source term from the inhomogeneous equation in favour of setting the initial time derivative condition of the wavefield as a scaled wavelet of the same type. With the homogeneous wave equation, one can slightly reduce the computational cost of numerical modeling.


title: Acoustic propulsion of nano- and microcones: dependence on the viscosity of the surrounding fluid

abstract: This article investigates how the acoustic propulsion of cone-shaped colloidal particles that are exposed to a traveling ultrasound wave depends on the viscosity of the fluid surrounding the particles. Using acoustofluidic computer simulations, we found that the propulsion of such nano- and microcones decreases strongly and even changes sign for increasing shear viscosity. In contrast, we found only a weak dependence of the propulsion on the bulk viscosity. The obtained results are in line with the findings of previous theoretical and experimental studies.

categories: cond-mat.soft cond-mat.mes-hall physics.comp-ph physics.flu-dyn


title: 4D-StOP: Panoptic Segmentation of 4D LiDAR using Spatio-temporal Object Proposal Generation and Aggregation

abstract: In this work, we present a new paradigm, called 4D-StOP, to tackle the task of 4D Panoptic LiDAR Segmentation. 4D-StOP first generates spatio-temporal proposals using voting-based center predictions, where each point in the 4D volume votes for a corresponding center. These tracklet proposals are further aggregated using learned geometric features. The tracklet aggregation method effectively generates a video-level 4D scene representation over the entire space-time volume. This is in contrast to existing end-to-end trainable state-of-the-art approaches which use spatio-temporal embeddings that are represented by Gaussian probability distributions. Our voting-based tracklet generation method followed by geometric feature-based aggregation generates significantly improved panoptic LiDAR segmentation quality when compared to modeling the entire 4D volume using Gaussian probability distributions. 4D-StOP achieves a new state-of-the-art when applied to the SemanticKITTI test dataset with a score of 63.9 LSTQ, which is a large (+7%) improvement compared to current best-performing end-to-end trainable methods. The code and pre-trained models are available at: https://github.com/LarsKreuzberg/4D-StOP.


title: Exact Recovery of Community Detection in dependent Gaussian Mixture Models

abstract: We study the community detection problem on a Gaussian mixture model, in which (1) vertices are divided into $k\geq 2$ distinct communities that are not necessarily equally-sized; (2) the Gaussian perturbations for different entries in the observation matrix are not necessarily independent or identically distributed. We prove necessary and sufficient conditions for the exact recovery of the maximum likelihood estimation (MLE), and discuss the cases when these necessary and sufficient conditions give sharp threshold. Applications include the community detection on a graph where the Gaussian perturbations of observations on each edge is the sum of i.i.d.~Gaussian random variables on its end vertices, in which we explicitly obtain the threshold for the exact recovery of the MLE.


title: Bridging the Gap to Real-World Object-Centric Learning

abstract: Humans naturally decompose their environment into entities at the appropriate level of abstraction to act in the world. Allowing machine learning algorithms to derive this decomposition in an unsupervised way has become an important line of research. However, current methods are restricted to simulated data or require additional information in the form of motion or depth in order to successfully discover objects. In this work, we overcome this limitation by showing that reconstructing features from models trained in a self-supervised manner is a sufficient training signal for object-centric representations to arise in a fully unsupervised way. Our approach, DINOSAUR, significantly out-performs existing image-based object-centric learning models on simulated data and is the first unsupervised object-centric model that scales to real-world datasets such as COCO and PASCAL VOC. DINOSAUR is conceptually simple and shows competitive performance compared to more involved pipelines from the computer vision literature.


title: Improving Understanding of Biocide Availability in Facades through Immersive Analytics

abstract: The durability of facades is heavily affected by multiple factors like microbial growth and weather conditions among others. Biocides are often used to resist these factors and protect the facades. However, the biocides get washed out due to rains and other factors like geometric structure of the facade, orientation of the building. It is therefore, important to understand how these factors affect the durability of facades, leading to a requirement of expert analysis. In this paper, we propose a technical pipeline and a set of interaction techniques to support data analysis within the immersive environment for our case study. Our technical pipeline mainly consists of three steps: 3D reconstruction, embedding sensor data and visualization and interaction techniques. We made a formative evaluation of our prototype to get insights from microbiology, biology and VR experts. The remarks from the experts and the results of the evaluation suggest that an immersive analytic system in our case study could be beneficial for both experts and non-expert users.


title: Spatial analyticity and exponential decay of Fourier modes for the stochastic Navier-Stokes equation

abstract: We construct a spatially real-analytic solution to the 2D and 3D stochastic Navier-Stokes equation driven by a spatially real-analytic multiplicative and transport noise but emanating from an initial condition that is only required to have bounded enstrophy. Under the condition that the solution is global in time, we also establish the exponential decay of the finite-dimensional Galerkin approximation, with respect to its wavenumber, to the strong pathwise solution of the stochastic Navier-Stokes equation. This decay is uniform in time, uniform with respect to the initial enstropy, and uniform with respect to the noise coefficients.


title: Neural Networks Efficiently Learn Low-Dimensional Representations with SGD

abstract: We study the problem of training a two-layer neural network (NN) of arbitrary width using stochastic gradient descent (SGD) where the input $\boldsymbol{x}\in \mathbb{R}^d$ is Gaussian and the target $y \in \mathbb{R}$ follows a multiple-index model, i.e., $y=g(\langle\boldsymbol{u_1},\boldsymbol{x}\rangle,...,\langle\boldsymbol{u_k},\boldsymbol{x}\rangle)$ with a noisy link function $g$. We prove that the first-layer weights of the NN converge to the $k$-dimensional principal subspace spanned by the vectors $\boldsymbol{u_1},...,\boldsymbol{u_k}$ of the true model, when online SGD with weight decay is used for training. This phenomenon has several important consequences when $k \ll d$. First, by employing uniform convergence on this smaller subspace, we establish a generalization error bound of $O(\sqrt{{kd}/{T}})$ after $T$ iterations of SGD, which is independent of the width of the NN. We further demonstrate that, SGD-trained ReLU NNs can learn a single-index target of the form $y=f(\langle\boldsymbol{u},\boldsymbol{x}\rangle) + \epsilon$ by recovering the principal direction, with a sample complexity linear in $d$ (up to log factors), where $f$ is a monotonic function with at most polynomial growth, and $\epsilon$ is the noise. This is in contrast to the known $d^{\Omega(p)}$ sample requirement to learn any degree $p$ polynomial in the kernel regime, and it shows that NNs trained with SGD can outperform the neural tangent kernel at initialization. Finally, we also provide compressibility guarantees for NNs using the approximate low-rank structure produced by SGD.


title: Overlap quark propagator near the physical pion mass

abstract: The Landau-gauge quark propagator is calculated using overlap fermions on 2+1-flavour dynamical fermion gauge fields from the PACS-CS collaboration with pion mass $m_\pi \sim 156\text{ MeV}$ and spatial volume $\sim (3 \text{ fm})^3.$ The observed features of the mass and renormalisation functions are discussed, including a comparison with recent results using $\mathcal{O}(a)$-improved Wilson fermions on 2-flavour dynamical gauge fields.


title: Accurate global machine learning force fields for molecules with hundreds of atoms

abstract: Global machine learning force fields (MLFFs), that have the capacity to capture collective many-atom interactions in molecular systems, currently only scale up to a few dozen atoms due a considerable growth of the model complexity with system size. For larger molecules, locality assumptions are typically introduced, with the consequence that non-local interactions are poorly or not at all described, even if those interactions are contained within the reference ab initio data. Here, we approach this challenge and develop an exact iterative parameter-free approach to train global symmetric gradient domain machine learning (sGDML) force fields for systems with up to several hundred atoms, without resorting to any localization of atomic interactions or other potentially uncontrolled approximations. This means that all atomic degrees of freedom remain fully correlated in the global sGDML FF, allowing the accurate description of complex molecules and materials that present phenomena with far-reaching characteristic correlation lengths. We assess the accuracy and efficiency of our MLFFs on a newly developed MD22 benchmark dataset containing molecules from 42 to 370 atoms. The robustness of our approach is demonstrated in nanosecond long path-integral molecular dynamics simulations for the supramolecular complexes in the MD22 dataset.


title: A Highly Magnified Star at Redshift 6.2

abstract: Galaxy clusters magnify background objects through strong gravitational lensing. Typical magnifications for lensed galaxies are factors of a few but can also be as high as tens or hundreds, stretching galaxies into giant arcs. Individual stars can attain even higher magnifications given fortuitous alignment with the lensing cluster. Recently, several individual stars at redshift $z \sim 1 - 1.5$ have been discovered, magnified by factors of thousands, temporarily boosted by microlensing. Here we report observations of a more distant and persistent magnified star at redshift $z_{\rm phot} = 6.2 \pm 0.1$, 900 Myr after the Big Bang. This star is magnified by a factor of thousands by the foreground galaxy cluster lens WHL0137--08 ($z = 0.566$), as estimated by four independent lens models. Unlike previous lensed stars, the magnification and observed brightness (AB mag 27.2) have remained roughly constant over 3.5 years of imaging and follow-up. The delensed absolute UV magnitude $M_{UV} = -10 \pm 2$ is consistent with a star of mass $M > 50 M_{\odot}$. Confirmation and spectral classification are forthcoming from approved observations with the James Webb Space Telescope


title: Dilaton Effective Field Theory

abstract: We review and extend recent studies of dilaton effective field theory (dEFT) which provide a framework for the description of the Higgs boson as a composite structure. We first describe the dEFT as applied to lattice data for a class of gauge theories with near-conformal infrared behavior. It includes the dilaton associated with the spontaneous breaking of (approximate) scale invariance, and a set of pseudo-Nambu-Goldstone bosons (pNGBs) associated with the spontaneous breaking of an (approximate) internal global symmetry. The theory contains two small symmetry-breaking parameters. We display the leading-order (LO) Lagrangian, and review its fit to lattice data for the $SU(3)$ gauge theory with $N_f = 8$ Dirac fermions in the fundamental representation. We then develop power-counting rules to identify the corrections emerging at next-to-leading order (NLO) in the dEFT action. We list the NLO operators that appear and provide estimates for the coefficients. We comment on implications for composite-Higgs model building.


title: ConvRNN-T: Convolutional Augmented Recurrent Neural Network Transducers for Streaming Speech Recognition

abstract: The recurrent neural network transducer (RNN-T) is a prominent streaming end-to-end (E2E) ASR technology. In RNN-T, the acoustic encoder commonly consists of stacks of LSTMs. Very recently, as an alternative to LSTM layers, the Conformer architecture was introduced where the encoder of RNN-T is replaced with a modified Transformer encoder composed of convolutional layers at the frontend and between attention layers. In this paper, we introduce a new streaming ASR model, Convolutional Augmented Recurrent Neural Network Transducers (ConvRNN-T) in which we augment the LSTM-based RNN-T with a novel convolutional frontend consisting of local and global context CNN encoders. ConvRNN-T takes advantage of causal 1-D convolutional layers, squeeze-and-excitation, dilation, and residual blocks to provide both global and local audio context representation to LSTM layers. We show ConvRNN-T outperforms RNN-T, Conformer, and ContextNet on Librispeech and in-house data. In addition, ConvRNN-T offers less computational complexity compared to Conformer. ConvRNN-T's superior accuracy along with its low footprint make it a promising candidate for on-device streaming ASR technologies.


title: Improved estimates for the number of non-negative integer matrices with given row and column sums

abstract: The number of non-negative integer matrices with given row and column sums appears in a variety of problems in mathematics and statistics but no closed-form expression for it is known, so we rely on approximations of various kinds. Here we describe a new such approximation, motivated by consideration of the statistics of matrices with non-integer numbers of columns. This estimate can be evaluated in time linear in the size of the matrix and returns results of accuracy as good as or better than existing linear-time approximations across a wide range of settings. We also use this new estimate as the starting point for an improved numerical method for either counting or sampling matrices using sequential importance sampling. Code implementing our methods is provided.


title: Sensitivity of the FACET experiment to Heavy Neutral Leptons and Dark Scalars

abstract: We analyze the potential of the recently proposed experiment FACET (Forward-Aperture CMS ExTension) to search for new physics. As an example, we consider the models of Higgs-like scalars with cubic and quartic interactions and Heavy Neutral Leptons. We compare the sensitivity of FACET with that of other proposed "intensity frontier" experiments, including FASER2, SHiP, etc. and demonstrate that FACET could probe an interesting parameter space between the current constraints and the potential reach of the above mentioned proposals.


title: Particulate suspension coating of capillary tubes

abstract: The displacement of a suspension of particles by an immiscible fluid in a capillary tube or in a porous media is a canonical configuration that finds application in a large number of natural and industrial applications, including water purification, dispersion of colloids and microplastics, coating and functionalization of tubings. The influence of particles dispersed in the fluid on the interfacial dynamics and on the properties of the liquid film left behind remain poorly understood. Here, we study the deposition of a coating film on the walls of a capillary tube induced by the translation of a suspension plug pushed by air. We identify the different deposition regimes as a function of the translation speed of the plug, the particle size, and the volume fraction of the suspension. The thickness of the coating film is characterized, and we show that similarly to dip coating, three coating regimes, liquid only, heterogeneous, and thick films, are observed. We also show that, at first order, the thickness of films thicker than the particle diameter can be predicted using the effective viscosity of the suspension. Nevertheless, we also report that for large particles and concentrated suspensions, a shear-induced migration mechanism leads to local variations in volume fraction and modifies the deposited film thickness and composition.


title: Precision QCD, Hadronic Structure & Forward QCD, Heavy Ions: Report of Energy Frontier Topical Groups 5, 6, 7 submitted to Snowmass 2021

abstract: This report was prepared on behalf of three Energy Frontier Topical Groups of the Snowmass 2021 Community Planning Exercise. It summarizes the status and implications of studies of strong interactions in high-energy experiments and QCD theory. We emphasize the rich landscape and broad impact of these studies in the decade ahead. Hadronic interactions play a central role in the high-luminosity Large Hadron Collider (LHC) physics program, and strong synergies exist between the (HL-)LHC and planned or proposed experiments at the U.S. Electron-Ion Collider, CERN forward physics experiments, high-intensity facilities, and future TeV-range lepton and hadron colliders. Prospects for precision determinations of the strong coupling and a variety of nonperturbative distribution and fragmentation functions are examined. We also review the potential of envisioned tests of new dynamical regimes of QCD in high-energy and high-density scattering processes with nucleon, ion, and photon initial states. The important role of the high-energy heavy-ion program in studies of nuclear structure and the nuclear medium, and its connections with QCD involving nucleons are summarized. We address ongoing and future theoretical advancements in multi-loop QCD computations, lattice QCD, jet substructure, and event generators. Cross-cutting connections between experimental measurements, theoretical predictions, large-scale data analysis, and high-performance computing are emphasized.


title: Light Rings around Five Dimensional Stationary Black Holes and Naked Singularities

abstract: The existence of light rings in a spacetime is closely related to the existence of black hole horizons and observables such as the ringdown and the shadow. Black holes, compared to nonvacuum ultracompact objects, have rather unique environments. To this aim, recently [P.V.P. Cunha and C.A.R. Herdeiro, Phys. Rev. Lett. \textbf{124}, 181101 (2020)] topological arguments, independent of the underlying gravity theory, were developed to prove the existence of unstable light rings outside the Killing horizon of {\it four} dimensional asymptotically flat, stationary, axisymmetric, nonextremal black holes. Here we extend these arguments to five-dimensional stationary black holes. Generically in five dimensions, there are two possible conserved angular momenta, hence the four-dimensional discussion does not extend verbatim to five dimensions; nevertheless, we prove that there is a light ring for each rotation sense for a stationary black hole. We give the static and the Myers-Perry rotating black holes as examples. We also show that when the horizon of the black hole disappears and the singularity becomes naked, only one of the light rings survives; a similar phenomenon also occurs in four dimensions which might allow testing the cosmic censorship hypothesis.


title: Effect of temperature anisotropy on the dynamics of geodesic acoustic modes

abstract: In this work, we revisit the linear gyro-kinetic theory of geodesic acoustic modes (GAMs) and derive a general dispersion relation for an arbitrary equilibrium distribution function of ions. A bi-Maxwellian distribution of ions is then used to study the effects of ion temperature anisotropy on GAM frequency and growth rate. We find that ion temperature anisotropy yields sensible modifications to both the GAM frequency and growth rate as both tend to increase with anisotropy and these results are strongly affected by the electron to ion temperature ratio.


title: Accelerating Laboratory Automation Through Robot Skill Learning For Sample Scraping

abstract: The use of laboratory robotics for autonomous experiments offers an attractive route to alleviate scientists from tedious tasks while accelerating material discovery for topical issues such as climate change and pharmaceuticals. While some experimental workflows can already benefit from automation, sample preparation is still carried out manually due to the high level of motor function and dexterity required when dealing with different tools, chemicals, and glassware. A fundamental workflow in chemical fields is crystallisation, where one application is polymorph screening, i.e., obtaining a three dimensional molecular structure from a crystal. For this process, it is of utmost importance to recover as much of the sample as possible since synthesising molecules is both costly in time and money. To this aim, chemists scrape vials to retrieve sample contents prior to imaging plate transfer. Automating this process is challenging as it goes beyond robotic insertion tasks due to a fundamental requirement of having to execute fine-granular movements within a constrained environment (sample vial). Motivated by how human chemists carry out this process of scraping powder from vials, our work proposes a model-free reinforcement learning method for learning a scraping policy, leading to a fully autonomous sample scraping procedure. We first create a scenario-specific simulation environment with a Panda Franka Emika robot using a laboratory scraper that is inserted into a simulated vial, to demonstrate how a scraping policy can be learned successfully in simulation. We then train and evaluate our method on a real robotic manipulator in laboratory settings, and show that our method can autonomously scrape powder across various setups.


title: Repairing Bugs in Python Assignments Using Large Language Models

abstract: Students often make mistakes on their introductory programming assignments as part of their learning process. Unfortunately, providing custom repairs for these mistakes can require a substantial amount of time and effort from class instructors. Automated program repair (APR) techniques can be used to synthesize such fixes. Prior work has explored the use of symbolic and neural techniques for APR in the education domain. Both types of approaches require either substantial engineering efforts or large amounts of data and training. We propose to use a large language model trained on code, such as Codex, to build an APR system -- MMAPR -- for introductory Python programming assignments. Our system can fix both syntactic and semantic mistakes by combining multi-modal prompts, iterative querying, test-case-based selection of few-shots, and program chunking. We evaluate MMAPR on 286 real student programs and compare to a baseline built by combining a state-of-the-art Python syntax repair engine, BIFI, and state-of-the-art Python semantic repair engine for student assignments, Refactory. We find that MMAPR can fix more programs and produce smaller patches on average.


title: The Nuclear Physics of Neutron Stars

abstract: Neutron stars -- compact objects with masses similar to that of our Sun but radii comparable to the size of a city -- contain the densest form of matter in the universe that can be probed in terrestrial laboratories as well as in earth- and space-based observatories. The historical detection of gravitational waves from a binary neutron star merger has opened the brand new era of multimessenger astronomy and has propelled neutron stars to the center of a variety of disciplines, such as astrophysics, general relativity, nuclear physics, and particle physics. The main input required to study the structure of neutron stars is the pressure support generated by its constituents against gravitational collapse. These include neutrons, protons, electrons, and perhaps even more exotic constituents. As such, nuclear physics plays a prominent role in elucidating the fascinating structure, dynamics, and composition of neutron stars.


title: Enumerating Regular Languages with Bounded Delay

abstract: We study the task, for a given language $L$, of enumerating the (generally infinite) sequence of its words, without repetitions, while bounding the delay between two consecutive words. To allow for delay bounds that do not depend on the current word length, we assume a model where we produce each word by editing the preceding word with a small edit script, rather than writing out the word from scratch. In particular, this witnesses that the language is orderable, i.e., we can write its words as an infinite sequence such that the Levenshtein edit distance between any two consecutive words is bounded by a value that depends only on the language. For instance, $(a+b)^*$ is orderable (with a variant of the Gray code), but $a^* + b^*$ is not. We characterize which regular languages are enumerable in this sense, and show that this can be decided in PTIME in an input deterministic finite automaton (DFA) for the language. In fact, we show that, given a DFA $A$, we can compute in PTIME automata $A_1, \ldots, A_t$ such that $L(A)$ is partitioned as $L(A_1) \sqcup \ldots \sqcup L(A_t)$ and every $L(A_i)$ is orderable in this sense. Further, we show that the value of $t$ obtained is optimal, i.e., we cannot partition $L(A)$ into less than $t$ orderable languages. In the case where $L(A)$ is orderable (i.e., $t=1$), we show that the ordering can be produced by a bounded-delay algorithm: specifically, the algorithm runs in a suitable pointer machine model, and produces a sequence of bounded-length edit scripts to visit the words of $L(A)$ without repetitions, with bounded delay -- exponential in $|A|$ -- between each script. In fact, we show that we can achieve this while only allowing the edit operations push and pop at the beginning and end of the word, which implies that the word can in fact be maintained in a double-ended queue.


title: OpenDSU: Digital Sovereignty in PharmaLedger

abstract: Distributed ledger networks, chiefly those based on blockchain technologies, currently are heralding a next generation of computer systems that aims to suit modern users' demands. Over the recent years, several technologies for blockchains, off-chaining strategies, as well as decentralised and respectively self-sovereign identity systems have shot up so fast that standardisation of the protocols is lagging behind, severely hampering the interoperability of different approaches. Moreover, most of the currently available solutions for distributed ledgers focus on either home users or enterprise use case scenarios, failing to provide integrative solutions addressing the needs of both. Herein we introduce the OpenDSU platform that allows to interoperate generic blockchain technologies, organised - and possibly cascaded in a hierarchical fashion - in domains. To achieve this flexibility, we seamlessly integrated a set of well conceived OpenDSU components to orchestrate off-chain data with granularly resolved and cryptographically secure access levels that are nested with sovereign identities across the different domains. Employing our platform to PharmaLedger, an inter-European network for the standardisation of data handling in the pharmaceutical industry and in healthcare, we demonstrate that OpenDSU can cope with generic demands of heterogeneous use cases in both, performance and handling substantially different business policies. Importantly, whereas available solutions commonly require a pre-defined and fixed set of components, no such vendor lock-in restrictions on the blockchain technology or identity system exist in OpenDSU, making systems built on it flexibly adaptable to new standards evolving in the future.


title: A proof of finite crystallization via stratification

abstract: We devise a new technique to prove two-dimensional crystallization results in the square lattice for finite particle systems. We apply this strategy to energy minimizers of configurational energies featuring two-body short-ranged particle interactions and three-body angular potentials favoring bond-angles of the square lattice. To each configuration, we associate its bond graph which is then suitably modified by identifying chains of successive atoms. This method, called stratification, reduces the crystallization problem to a simple minimization that corresponds to a proof via slicing of the isoperimetric inequality in $\ell^1$. As a byproduct, we also prove a fluctuation estimate for minimizers of the configurational energy, known as the $n^{3/4}$-law.

categories: cond-mat.mes-hall math-ph math.AP math.MP


title: Sequential Attention for Feature Selection

abstract: Feature selection is the problem of selecting a subset of features for a machine learning model that maximizes model quality subject to a budget constraint. For neural networks, prior methods, including those based on $\ell_1$ regularization, attention, and other techniques, typically select the entire feature subset in one evaluation round, ignoring the residual value of features during selection, i.e., the marginal contribution of a feature given that other features have already been selected. We propose a feature selection algorithm called Sequential Attention that achieves state-of-the-art empirical results for neural networks. This algorithm is based on an efficient one-pass implementation of greedy forward selection and uses attention weights at each step as a proxy for feature importance. We give theoretical insights into our algorithm for linear regression by showing that an adaptation to this setting is equivalent to the classical Orthogonal Matching Pursuit (OMP) algorithm, and thus inherits all of its provable guarantees. Our theoretical and empirical analyses offer new explanations towards the effectiveness of attention and its connections to overparameterization, which may be of independent interest.


title: Light thermal relics enabled by a second Higgs

abstract: Sub-GeV thermal relic dark matter typically requires the existence of a light mediator particle. We introduce the light two-Higgs-doublet portal, illustrated by a minimal UV-complete model for sub-GeV dark matter with kinematically forbidden annihilations into leptons. All new physics states in this scenario lie at or below the electroweak scale, affecting Higgs physics, the muon anomalous magnetic moment and potentially neutrino masses. Observation of radiative dark matter annihilation by future MeV gamma-ray telescopes would be key to unambiguously identify the scenario.


title: Stable and unstable perturbations in universal scaling phenomena far from equilibrium

abstract: We study the dynamics of perturbations around nonthermal fixed points associated to universal scaling phenomena in quantum many-body systems far from equilibrium. For an N-component scalar quantum field theory in 3+1 space-time dimensions, we determine the stability scaling exponents using a self-consistent large-N expansion to next-to-leading order. Our analysis reveals the presence of both stable and unstable perturbations, the latter leading to quasi-exponential deviations from the fixed point in the infrared. We identify a tower of far-from-equilibrium quasi-particle states and their dispersion relations by computing the spectral function. With the help of linear response theory, we demonstrate that unstable dynamics arises from a competition between elastic scattering processes among the quasi-particle states. What ultimately renders the fixed point dynamically attractive is the phenomenon of a scaling instability, which is the universal scaling of the unstable regime towards the infrared due to a self-similar quasi-particle cascade. Our results provide ab initio understanding of emergent stability properties in self-organized scaling phenomena.

categories: hep-ph cond-mat.quant-gas hep-th quant-ph


title: Joint Embedding Self-Supervised Learning in the Kernel Regime

abstract: The fundamental goal of self-supervised learning (SSL) is to produce useful representations of data without access to any labels for classifying the data. Modern methods in SSL, which form representations based on known or constructed relationships between samples, have been particularly effective at this task. Here, we aim to extend this framework to incorporate algorithms based on kernel methods where embeddings are constructed by linear maps acting on the feature space of a kernel. In this kernel regime, we derive methods to find the optimal form of the output representations for contrastive and non-contrastive loss functions. This procedure produces a new representation space with an inner product denoted as the induced kernel which generally correlates points which are related by an augmentation in kernel space and de-correlates points otherwise. We analyze our kernel model on small datasets to identify common features of self-supervised learning algorithms and gain theoretical insights into their performance on downstream tasks.


title: Majorana corner modes and flat-band Majorana edge modes in superconductor/topological-insulator/superconductor junctions

abstract: Recently, superconductors with higher-order topology have stimulated extensive attention and research interest. Higher-order topological superconductors exhibit unconventional bulk-boundary correspondence, thus allow exotic lower-dimensional boundary modes, such as Majorana corner and hinge modes. However, higher-order topological superconductivity has yet to be found in naturally occurring materials. In this work, we investigate higher-order topology in a two-dimensional Josephson junction comprised of two $s$-wave superconductors separated by a topological insulator thin film. We found that zero-energy Majorana corner modes, a boundary fingerprint of higher-order topological superconductivity, can be achieved by applying magnetic field. When an in-plane Zeeman field is applied to the system, two corner states appear in the superconducting junction. Furthermore, we also discover a two dimensional nodal superconducting phase which supports flat-band Majorana edge modes connecting the bulk nodes. Importantly, we demonstrate that zero-energy Majorana corner modes are stable when increasing the thickness of topological insulator thin film.


title: The halo mass function and filaments in full cosmological simulations with fuzzy dark matter

abstract: Fuzzy dark matter (FDM) is a dark matter candidate consisting of ultra-light scalar particles with masses around $10^{-22} \mathrm{eV}/c^2$, a regime where cold bosonic matter behaves as a collective wave rather than individual particles. It has increasingly attracted attention due to its rich phenomenology on astrophysical scales, with implications for the small-scale tensions present within the standard cosmological model, $\Lambda$CDM. Although constraints on FDM are accumulating in many different contexts, very few have been verified by self-consistent numerical simulations. We present new large numerical simulations of cosmic structure formation with FDM, solving the full Schr\"odinger-Poisson (SP) equations using the AxiREPO code, which implements a pseudo-spectral numerical method. Combined with our previous simulations, they allow us to draw a four-way comparison of matter clustering, contrasting results (such as power spectra) for each combination of initial conditions (FDM vs. CDM) and dynamics (SP vs. $N$-body). By disentangling the impact of initial conditions and non-linear dynamics, we can gauge the validity of approximate methods used in previous works, such as ordinary $N$-body simulations with an FDM initial power spectrum. Due to the comparatively large volume achieved in our FDM simulations, we are able to measure the FDM halo mass function from full wave simulations for the first time, and compare to previous results obtained using analytic or approximate approaches. We find that, due to the cut-off of small-scale power in the FDM power spectrum, haloes are linked via continuous, smooth, and dense filaments throughout the entire simulation volume (unlike for the standard $\Lambda$CDM power spectrum), posing significant challenges for reliably identifying haloes. We also investigate the density profiles of these filaments and compare to their CDM counterparts.


title: Learning Low-Frequency Motion Control for Robust and Dynamic Robot Locomotion

abstract: Robotic locomotion is often approached with the goal of maximizing robustness and reactivity by increasing motion control frequency. We challenge this intuitive notion by demonstrating robust and dynamic locomotion with a learned motion controller executing at as low as 8 Hz on a real ANYmal C quadruped. The robot is able to robustly and repeatably achieve a high heading velocity of 1.5 m/s, traverse uneven terrain, and resist unexpected external perturbations. We further present a comparative analysis of deep reinforcement learning (RL) based motion control policies trained and executed at frequencies ranging from 5 Hz to 200 Hz. We show that low-frequency policies are less sensitive to actuation latencies and variations in system dynamics. This is to the extent that a successful sim-to-real transfer can be performed even without any dynamics randomization or actuation modeling. We support this claim through a set of rigorous empirical evaluations. Moreover, to assist reproducibility, we provide the training and deployment code along with an extended analysis at https://ori-drs.github.io/lfmc/.


title: A note on Cournot-Nash equilibria and Optimal Transport between unequal dimensions

abstract: This note is devoted to study a class of games with a continuum of players for which Cournot-Nash equilibria can be obtained by minimisation of some cost related to Optimal Transport. In particular we focus on the case of an Optimal Transport term between unequal dimension. We also present several numerical simulations.


title: Simulating structured fluids with tensorial viscoelasticity

abstract: We consider an immersed elastic body that is actively driven through a structured fluid by a motor or an external force. The behavior of such a system generally cannot be solved analytically, necessitating the use of numerical methods. However, current numerical methods omit important details of the microscopic structure and dynamics of the fluid, which can modulate the magnitudes and directions of viscoelastic restoring forces. To address this issue, we develop a simulation platform for modeling viscoelastic media with tensorial elasticity. We build on the lattice Boltzmann algorithm and incorporate viscoelastic forces, elastic immersed objects, a microscopic orientation field, and coupling between viscoelasticity and the orientation field. We demonstrate our method by characterizing how the viscoelastic restoring force on a driven immersed object depends on various key parameters as well as the tensorial character of the elastic response. We find that the restoring force depends non-monotonically on the rate of diffusion of the stress and the size of the object. We further show how the restoring force depends on the relative orientation of the microscopic structure and the pulling direction. These results imply that accounting for previously neglected physical features, such as stress diffusion and the microscopic orientation field, can improve the realism of viscoelastic simulations. We discuss possible applications and extensions to the method.


title: Mask-Guided Image Person Removal with Data Synthesis

abstract: As a special case of common object removal, image person removal is playing an increasingly important role in social media and criminal investigation domains. Due to the integrity of person area and the complexity of human posture, person removal has its own dilemmas. In this paper, we propose a novel idea to tackle these problems from the perspective of data synthesis. Concerning the lack of dedicated dataset for image person removal, two dataset production methods are proposed to automatically generate images, masks and ground truths respectively. Then, a learning framework similar to local image degradation is proposed so that the masks can be used to guide the feature extraction process and more texture information can be gathered for final prediction. A coarse-to-fine training strategy is further applied to refine the details. The data synthesis and learning framework combine well with each other. Experimental results verify the effectiveness of our method quantitatively and qualitatively, and the trained network proves to have good generalization ability either on real or synthetic images.


title: Automatic sparse PCA for high-dimensional data

abstract: Sparse principal component analysis (SPCA) methods have proven to efficiently analyze high-dimensional data. Among them, threshold-based SPCA (TSPCA) is computationally more cost-effective than regularized SPCA, based on L1 penalties. We herein present an investigation of the efficacy of TSPCA for high-dimensional data settings and illustrate that, for a suitable threshold value, TSPCA achieves satisfactory performance for high-dimensional data. Thus, the performance of the TSPCA depends heavily on the selected threshold value. To this end, we propose a novel thresholding estimator to obtain the principal component (PC) directions using a customized noise-reduction methodology. The proposed technique is consistent under mild conditions, unaffected by threshold values, and therefore yields more accurate results quickly at a lower computational cost. Furthermore, we explore the shrinkage PC directions and their application in clustering high-dimensional data. Finally, we evaluate the performance of the estimated shrinkage PC directions in actual data analyses.


title: Shifted boundary polynomial corrections for compressible flows: high order on curved domains using linear meshes

abstract: In this work we propose a simple but effective high order polynomial correction allowing to enhance the consistency of all kind of boundary conditions for the Euler equations (Dirichlet, characteristic far-field and slip-wall), both in 2D and 3D, preserving a high order of accuracy without the need of curved meshes. The method proposed is a simplified reformulation of the Shifted Boundary Method (SBM) and relies on a correction based on the extrapolated value of the in cell polynomial to the true geometry, thus not requiring the explicit evaluation of high order Taylor series. Moreover, this strategy could be easily implemented into any already existing finite element and finite volume code. Several validation tests are presented to prove the convergence properties up to order four for 2D and 3D simulations with curved boundaries, as well as an effective extension to flows with shocks.


title: A New Upper Bound for the d-dimensional Algebraic Connectivity of Arbitrary Graphs

abstract: In this paper we show that the $d$-dimensional algebraic connectivity of an arbitrary graph $G$ is bounded above by its $1$-dimensional algebraic connectivity, i.e., $a_d(G) \leq a_1(G)$, where $a_1(G)$ corresponds the well-studied second smallest eigenvalue of the graph Laplacian.


title: Completeness of the ZX-calculus

abstract: The ZX-calculus is an intuitive but also mathematically strict graphical language for quantum computing, which is especially powerful for the framework of quantum circuits. Completeness of the ZX-calculus means any equality of matrices with size powers of $n$ can be derived purely diagrammatically. In this thesis, we give the first complete axiomatisation the ZX-calculus for the overall pure qubit quantum mechanics, via a translation from the completeness result of another graphical language for quantum computing -- the ZW-calculus. This paves the way for automated pictorial quantum computing, with the aid of some software like Quantomatic. Based on this universal completeness, we directly obtain a complete axiomatisation of the ZX-calculus for the Clifford+T quantum mechanics, which is approximatively universal for quantum computing, by restricting the ring of complex numbers to its subring corresponding to the Clifford+T fragment resting on the completeness theorem of the ZW-calculus for arbitrary commutative ring. Furthermore, we prove the completeness of the ZX-calculus (with just 9 rules) for 2-qubit Clifford+T circuits by verifying the complete set of 17 circuit relations in diagrammatic rewriting. In addition to completeness results within the qubit related formalism, we extend the completeness of the ZX-calculus for qubit stabilizer quantum mechanics to the qutrit stabilizer system. Finally, we show with some examples the application of the ZX-calculus to the proof of generalised supplementarity, the representation of entanglement classification and Toffoli gate, as well as equivalence-checking for the UMA gate.


title: Reinforcement-learning-based actuator selection method for active flow control

abstract: This paper addresses the issue of actuator selection for active flow control by proposing a novel method built on top of a reinforcement learning agent. Starting from a pre-trained agent using numerous actuators, the algorithm estimates the impact of a potential actuator removal on the value function, indicating the agent's performance. It is applied to two test cases, the one-dimensional Kuramoto-Sivashinsky equation and a laminar bi-dimensional flow around an airfoil at Re=1000 for different angles of attack ranging from 12 to 20 degrees, to demonstrate its capabilities and limits. The proposed actuator-sparsification method relies on a sequential elimination of the least relevant action components, starting from a fully developed layout. The relevancy of each component is evaluated using metrics based on the value function. Results show that, while still being limited by this intrinsic elimination paradigm (i.e. the sequential elimination), actuator patterns and obtained policies demonstrate relevant performances and allow to draw an accurate approximation of the Pareto front of performances versus actuator budget.


title: Formation, distribution, and IR emission of dust in the clumpy ejecta of Type II-P core-collapse supernovae, in isotropic and anisotropic scenarios

abstract: Large discrepancies are found between observational estimates and theoretical predictions when exploring the characteristics of dust formed in the ejecta of core-collapse supernovae. We revisit the scenario of dust production in typical supernova ejecta in the first 3000 days after explosion, with an improved understanding of the evolving physical conditions and the distribution of the clumps. The generic, nonuniform distribution of dust within the ejecta was determined and using that, the relevant opacities and fluxes were calculated. The dependence of the emerging fluxes on the viewing angle was estimated for an anisotropic, ellipsoidal geometry of the ejecta that imitate SN 1987A. We model the He-core from the center to its outer edge as 450 stratified, clumpy, annular shells, uniquely identified by their distinct velocities and characterized by their variations in abundances, densities, and gas and dust temperatures. We find that the formation of dust starts between day 450 and day 550 post-explosion, and it continues until about day 2800, although the first 1600 days are the most productive. The total dust mass evolves from about 10^-5 Msun at day 500 to 10^-3 Msun at day 800, finally saturating at about 0.06 Msun. The masses of the O-rich dust (silicates, alumina) dominates the C-rich dust (amorphous carbon, silicon carbide) at all times; the formation of carbon dust is delayed beyond 2000 days post-explosion. We show that the opacities are largest between days 800 and 1600, and the characteristic spectral features of O-rich dust species are suppressed at those times. The fluxes emerging along the smallest axes of the ellipsoidal ejecta are found to be the most obscured, while a viewing angle between 16 and 21 degrees with that axis appears to be in the best agreement with the fluxes from SN 1987A at days 615 and 775.


title: Thermodynamics of the inner heliosheath

abstract: We derive annual skymaps of the proton temperature in the inner heliosheath (IHS), and track their temporal evolution over the years from 2009 to 2016 of Interstellar Boundary Explorer observations. Other associated thermodynamic parameters also determined are the density, kappa, that is, the parameter that characterizes kappa distributions, temperature rate, polytropic index, and entropy. We exploit the theory of kappa distributions and their connection with polytropes, to (i) express a new polytropic quantity {\Pi} that remains invariant along streamlines where temperature and density may vary, (ii) parameterize the proton flux in terms of the {\Pi} invariant and kappa, and (iii) derive the temperature and density, respectively, from the slope and intercept of the linear relationship between kappa and logarithm of {\Pi}. We find the following thermodynamic characteristics: (1) Temperature sky-maps and histograms shifted to their lowest values in 2012 and their highest in 2015; (2) Temperature negatively correlated with density, reflecting the subisothermal polytropic behavior; (3) Temperature positively correlated with kappa, revealing characteristics of the mechanism responsible for generating kappa distributions; (4) Processes in IHS are sub-isothermal tending toward isobaric, consistent with previously published results; (5) Linear relationship between kappa and polytropic indices, revealing characteristics of the particle potential energy; and (6) Entropy positively correlated with polytropic index, aligned with the underlying theory that entropy increases towards the isothermal state where the kappa distribution reduces to the Maxwell Boltzmann description.


title: Cosmogenic activation of sodium iodide

abstract: The production of radioactive isotopes by interactions of cosmic-ray particles with sodium iodide (NaI) crystals can produce radioactive backgrounds in detectors used to search for rare events. Through controlled irradiation of NaI crystals with a neutron beam that matches the cosmic-ray neutron spectrum, followed by direct counting and fitting the resulting spectrum across a broad range of energies, we determined the integrated production rate of several long-lived radioisotopes. The measurements were then extrapolated to determine the sea-level cosmogenic neutron activation rate, including the first experimental determination of the tritium production rate: $(80 \pm 21)$ atoms/kg/day. These results will help constrain background estimates and determine the maximum time that NaI-based detectors can remain unshielded above ground before cosmogenic backgrounds impact the sensitivity of next-generation experiments.


title: Generate-and-Retrieve: use your predictions to improve retrieval for semantic parsing

abstract: A common recent approach to semantic parsing augments sequence-to-sequence models by retrieving and appending a set of training samples, called exemplars. The effectiveness of this recipe is limited by the ability to retrieve informative exemplars that help produce the correct parse, which is especially challenging in low-resource settings. Existing retrieval is commonly based on similarity of query and exemplar inputs. We propose GandR, a retrieval procedure that retrieves exemplars for which outputs are also similar. GandRfirst generates a preliminary prediction with input-based retrieval. Then, it retrieves exemplars with outputs similar to the preliminary prediction which are used to generate a final prediction. GandR sets the state of the art on multiple low-resource semantic parsing tasks.


title: Joint Optimization of Energy Consumption and Completion Time in Federated Learning

abstract: Federated Learning (FL) is an intriguing distributed machine learning approach due to its privacy-preserving characteristics. To balance the trade-off between energy and execution latency, and thus accommodate different demands and application scenarios, we formulate an optimization problem to minimize a weighted sum of total energy consumption and completion time through two weight parameters. The optimization variables include bandwidth, transmission power and CPU frequency of each device in the FL system, where all devices are linked to a base station and train a global model collaboratively. Through decomposing the non-convex optimization problem into two subproblems, we devise a resource allocation algorithm to determine the bandwidth allocation, transmission power, and CPU frequency for each participating device. We further present the convergence analysis and computational complexity of the proposed algorithm. Numerical results show that our proposed algorithm not only has better performance at different weight parameters (i.e., different demands) but also outperforms the state of the art.


title: DR.BENCH: Diagnostic Reasoning Benchmark for Clinical Natural Language Processing

abstract: The meaningful use of electronic health records (EHR) continues to progress in the digital era with clinical decision support systems augmented by artificial intelligence. A priority in improving provider experience is to overcome information overload and reduce the cognitive burden so fewer medical errors and cognitive biases are introduced during patient care. One major type of medical error is diagnostic error due to systematic or predictable errors in judgment that rely on heuristics. The potential for clinical natural language processing (cNLP) to model diagnostic reasoning in humans with forward reasoning from data to diagnosis and potentially reduce the cognitive burden and medical error has not been investigated. Existing tasks to advance the science in cNLP have largely focused on information extraction and named entity recognition through classification tasks. We introduce a novel suite of tasks coined as Diagnostic Reasoning Benchmarks, DR.BENCH, as a new benchmark for developing and evaluating cNLP models with clinical diagnostic reasoning ability. The suite includes six tasks from ten publicly available datasets addressing clinical text understanding, medical knowledge reasoning, and diagnosis generation. DR.BENCH is the first clinical suite of tasks designed to be a natural language generation framework to evaluate pre-trained language models. Experiments with state-of-the-art pre-trained generative language models using large general domain models and models that were continually trained on a medical corpus demonstrate opportunities for improvement when evaluated in DR. BENCH. We share DR. BENCH as a publicly available GitLab repository with a systematic approach to load and evaluate models for the cNLP community.


title: Dynamical maps beyond Markovian regime

abstract: Quantum dynamical maps provide suitable mathematical representation of quantum evolutions. It is the very notion of complete positivity which provides a proper mathematical representation of quantum evolution and gives rise to the powerful generalization of unitary evolution of closed Hamiltonian systems. A prominent example of quantum evolution of an open system is a Markovian semigroup. In what follows, we analyze both the semigroups of positive and completely positive maps. In the latter case the dynamics is governed by the celebrated Gorini-Kossakowski-Lindblad-Sudarshan (GKLS) Master Equation. Markovian semigroups, however, provide only an approximate description of general quantum evolution. The main topic of our analysis are dynamical maps beyond this regime. Non-Markovian quantum evolution attracted a lot of attention in recent years and there is a vast literature dedicated to it. In this report we analyze quantum dynamics governed by time-local generators and/or non-local memory kernels. A special attention is devoted to the concept of {\em divisibility} which is often used as a definition of Markovianity. In particular, the concept of so called CP-divisibility (in contrast to P-divisibility) is widely accepted as a proper definition of quantum Markovianity. We discuss a number of important physical implications of divisibility. We also briefly discuss the notion of Markovianity beyond the dynamical map, that is, when one has an access to the evolution of `system + environment'. The entire exposition is concentrated more on the general concepts and intricate connections between them than on studying particular systems. We illustrate the analyzed concepts by paradigmatic models of open quantum systems like the amplitude damping and phase damping models.


title: Measurement of the polarisation of $W$ bosons produced in top-quark decays using dilepton events at $\sqrt{s} = 13$ TeV with the ATLAS experiment

abstract: A measurement of the polarisation of $W$ bosons produced in top-quark decays is presented, using proton-proton collision data at a centre-of-mass energy of $\sqrt{s} = 13$ TeV. The data were collected by the ATLAS detector at the Large Hadron Collider and correspond to an integrated luminosity of 139 fb$^{-1}$. The measurement is performed selecting $t\bar{t}$ events decaying into final states with two charged leptons (electrons or muons) and at least two $b$-tagged jets. The polarisation is extracted from the differential cross-section distribution of the $\cos{\theta^{*}}$ variable, where $\theta^{*}$ is the angle between the momentum direction of the charged lepton from the $W$ boson decay and the reversed momentum direction of the $b$-quark from the top-quark decay, both calculated in the $W$ boson rest frame. Parton-level results, corrected for the detector acceptance and resolution, are presented for the $\cos{\theta^{*}}$ angle. The measured fractions of longitudinal, left- and right-handed polarisation states are found to be $f_{0} = 0.684 \pm 0.005\,\mathrm{(stat.)} \pm 0.014\,\mathrm{(syst.)}$, $f_{\mathrm{L}} = 0.318 \pm 0.003\,\mathrm{(stat.)} \pm 0.008\,\mathrm{(syst.)}$ and $f_{\mathrm{R}} = -0.002 \pm 0.002\,\mathrm{(stat.)} \pm 0.014\,\mathrm{(syst.)}$, in agreement with the Standard Model prediction.


title: Evaluation of Neel temperatures from fully self-consistent broken-symmetry GW and high-temperature expansion: application to cubic transition-metal oxides

abstract: Using fully self-consistent thermal broken-symmetry GW we construct effective magnetic Heisenberg Hamiltonians for a series of transition metal oxides (NiO, CoO, FeO, MnO), capturing a rigorous but condensed description of the magnetic states. Then applying high-temperature expansion, we find the decomposition coefficients for spin susceptibility and specific heat. The radius of convergence of the found series determine the Neel temperature. The NiO, CoO, and FeO contain a small ferromagnetic interaction between the nearest neighbors (NN) and the dominant antiferromagnetic interaction between the next-nearest neighbors (NNN). For them the derived Neel temperatures are in a good agreement with experiment. The case of MnO is different because both NN and NNN couplings are antiferromagnetic and comparable in magnitude, for which the error in the estimated Neel temperature is larger, which is a signature of additional effects not captured by electronic structure calculations.


title: Variance Covariance Regularization Enforces Pairwise Independence in Self-Supervised Representations

abstract: Self-Supervised Learning (SSL) methods such as VICReg, Barlow Twins or W-MSE avoid collapse of their joint embedding architectures by constraining or regularizing the covariance matrix of their projector's output. This study highlights important properties of such strategy, which we coin Variance-Covariance regularization (VCReg). More precisely, we show that {\em VCReg combined to a MLP projector enforces pairwise independence between the features of the learned representation}. This result emerges by bridging VCReg applied on the projector's output to kernel independence criteria applied on the projector's input. We empirically validate our findings where (i) we put in evidence which projector's characteristics favor pairwise independence, (ii) we demonstrate pairwise independence to be beneficial for out-of-domain generalization, (iii) we demonstrate that the scope of VCReg goes beyond SSL by using it to solve Independent Component Analysis. This provides the first theoretical motivation and explanation of MLP projectors in SSL.


title: Quantum isomorphic strongly regular graphs from the $E_8$ root system

abstract: In this article, we give a first example of a pair of quantum isomorphic, non-isomorphic strongly regular graphs, that is, non-isomorphic strongly regular graphs having the same homomorphism counts from all planar graphs. The pair consists of the orthogonality graph of the $120$ lines spanned by the $E_8$ root system and a rank $4$ graph whose complement was first discovered by Brouwer, Ivanov and Klin. Both graphs are strongly regular with parameters $(120, 63, 30, 36)$. Using Godsil-McKay switching, we obtain more quantum isomorphic, non-isomorphic strongly regular graphs with the same parameters.


title: Patients' Severity States Classification based on Electronic Health Record (EHR) Data using Multiple Machine Learning and Deep Learning Approaches

abstract: This research presents an examination of categorizing the severity states of patients based on their electronic health records during a certain time range using multiple machine learning and deep learning approaches. The suggested method uses an EHR dataset collected from an open-source platform to categorize severity. Some tools were used in this research, such as openRefine was used to pre-process, RapidMiner was used for implementing three algorithms (Fast Large Margin, Generalized Linear Model, Multi-layer Feed-forward Neural Network) and Tableau was used to visualize the data, for implementation of algorithms we used Google Colab. Here we implemented several supervised and unsupervised algorithms along with semi-supervised and deep learning algorithms. The experimental results reveal that hyperparameter-tuned Random Forest outperformed all the other supervised machine learning algorithms with 76% accuracy as well as Generalized Linear algorithm achieved the highest precision score 78%, whereas the hyperparameter-tuned Hierarchical Clustering with 86% precision score and Gaussian Mixture Model with 61% accuracy outperformed other unsupervised approaches. Dimensionality Reduction improved results a lot for most unsupervised techniques. For implementing Deep Learning we employed a feed-forward neural network (multi-layer) and the Fast Large Margin approach for semi-supervised learning. The Fast Large Margin performed really well with a recall score of 84% and an F1 score of 78%. Finally, the Multi-layer Feed-forward Neural Network performed admirably with 75% accuracy, 75% precision, 87% recall, 81% F1 score.


title: Constraints on the scalar-field potential in warm inflation

abstract: We quantify the degree of fine tuning required to achieve an observationally viable period of inflation in the strongly dissipative regime of warm inflation. The ``fine-tuning'' parameter $\lambda$ is taken to be the ratio of the change in the height of the potential $\Delta V$ to the change in the scalar field $(\Delta \phi)^{4}$, i.e. the width of the potential, and therefore measures the requisite degree of flatness in the potential. The best motivated warm inflationary scenarios involve a dissipation rate of the kind $\Gamma\propto T^c$ with $c\geq 0$, and for all such cases, the bounds on $\lambda$ are tighter than those for standard cold inflation by at least 3 orders of magnitude. In other words, these models require an even flatter potential than standard inflation. On the other hand for the case of warm inflation with $c< 0$, we find that in a strongly dissipative regime the bound on $\lambda$ can significantly weaken with respect to cold inflation. Thus, if a warm inflation model can be constructed in a strongly dissipative, negatively temperature-dependent regime, it accommodates steeper potentials otherwise ruled out in standard inflation.


title: Exploring the parameter space of MagLIF implosions using similarity scaling. I. Theoretical framework

abstract: Magneto-inertial fusion (MIF) concepts, such as the Magnetized Liner Inertial Fusion (MagLIF) platform [M. R. Gomez et al., Phys. Rev. Lett. 113, 155003 (2014)], constitute a promising path for achieving ignition and significant fusion yields in the laboratory. The space of experimental input parameters defining a MagLIF load is highly multi-dimensional, and the implosion itself is a complex event involving many physical processes. In the first paper of this series, we develop a simplified analytical model that identifies the main physical processes at play during a MagLIF implosion. Using non-dimensional analysis, we determine the most important dimensionless parameters characterizing MagLIF implosions and provide estimates of such parameters using typical fielded or experimentally observed quantities for MagLIF. We then show that MagLIF loads can be "incompletely" similarity scaled, meaning that the experimental input parameters of MagLIF can be varied such that many (but not all) of the dimensionless quantities are conserved. Based on similarity-scaling arguments, we can explore the parameter space of MagLIF loads and estimate the performance of the scaled loads. In the follow-up papers of this series, we test the similar scaling theory for MagLIF loads against simulations for two different scaling "vectors", which include current scaling and rise-time scaling.


title: Graph Modeling in Computer Assisted Automotive Development

abstract: We consider graph modeling for a knowledge graph for vehicle development, with a focus on crash safety. An organized schema that incorporates information from various structured and unstructured data sources is provided, which includes relevant concepts within the domain. In particular, we propose semantics for crash computer aided engineering (CAE) data, which enables searchability, filtering, recommendation, and prediction for crash CAE data during the development process. This graph modeling considers the CAE data in the context of the R\&D development process and vehicle safety. Consequently, we connect CAE data to the protocols that are used to assess vehicle safety performances. The R\&D process includes CAD engineering and safety attributes, with a focus on multidisciplinary problem-solving. We describe previous efforts in graph modeling in comparison to our proposal, discuss its strengths and limitations, and identify areas for future work.


title: Exploring the parameter space of MagLIF implosions using similarity scaling. II. Current scaling

abstract: Magnetized Liner Inertial Fusion (MagLIF) is a magneto-inertial-fusion (MIF) concept, which is presently being studied on the Z Pulsed Power Facility. The MagLIF platform has achieved interesting plasma conditions at stagnation and produced significant fusion yields in the laboratory. Given the relative success of MagLIF, there is a strong interest to scale the platform to higher peak currents. However, scaling MagLIF is not entirely straightforward due to the large dimensionality of the experimental input parameter space and the large number of distinct physical processes involved in MIF implosions. In this work, we propose a novel method to scale MagLIF loads to higher currents. Our method is based on similarity (or similitude) scaling and attempts to preserve much of the physics regimes already known or being studied on today's Z pulsed-power driver. By avoiding significant deviations into unexplored and/or less well-understood regimes, the risk of unexpected outcomes on future scaled-up experiments is reduced. Using arguments based on similarity scaling, we derive the scaling rules for the experimental input parameters characterizing a MagLIF load (as functions of the characteristic current driving the implosion). We then test the estimated scaling laws for various metrics measuring performance against results of 2D radiation--magneto-hydrodynamic HYDRA simulations. Agreement is found between the scaling theory and the simulation results.


title: Exploring the parameter space of MagLIF implosions using similarity scaling. III. Rise-time scaling

abstract: Magnetized Liner Inertial Fusion (MagLIF) is a z-pinch magneto-inertial-fusion (MIF) concept studied on the Z Machine at Sandia National Laboratories. Two important metrics characterizing current delivery to a z-pinch load are the peak current and the current-rise time, which is roughly the time interval to reach peak current. It is known that, when driving a z-pinch load with a longer current-rise time, the performance of the z-pinch decreases. However, a theory to understand and quantify this effect is still lacking. In this paper, we utilize a framework based on similarity scaling to analytically investigate the variations in performance of MagLIF loads when varying the current-rise time, or equivalently, the implosion timescale. To maintain similarity between the implosions, we provide the scaling prescriptions of the experimental input parameters defining a MagLIF load and derive the scaling laws for the stagnation conditions and for various performance metrics. We compare predictions of the theory to 2D numerical simulations using the radiation, magneto-hydrodynamic code HYDRA. For several metrics, we find acceptable agreement between the theory and simulations. Our results show that the voltage near the MagLIF load follows a weak scaling law $\smash{\varphi_{\rm load} \propto t_\varphi^{-0.12}}$ with respect to the characteristic timescale $t_\varphi$ of the voltage source, instead of the ideal $\smash{\varphi_{\rm load} \propto t_\varphi^{-1}}$ scaling. This occurs because the imploding height of the MagLIF load must increase to preserve end losses. As a consequence of the longer imploding liners, the required total laser preheat energy and delivered electric energy increase. Overall, this study may help understand the trade-offs of the MagLIF design space when considering future pulsed-power generators with shorter and longer current-rise times.


title: Variational quantitative phase-field modeling of nonisothermal sintering process

abstract: In this work, we present a variational and quantitative phase-field model for non-isothermal sintering processes. The model is derived via an extended non-diagonal phase-field model. The model evolution equations have naturally cross-coupling terms between the conserved kinetics (i.e., mass and thermal transfer) and the non-conserved one (grain growth). These terms are shown via asymptotic analysis to be instrumental in ensuring the elimination of interface artefacts, while also examined to not modify the thermodynamic equilibrium condition (characterized by dihedral angle). Moreover, we demonstrate that the trapping effects and existence of surface diffusion in conservation laws are direction-dependent. An anisotropic interpolation scheme of the kinetic mobilities which differentiates the normal and the tangential directions along the interface is discussed. Numerically, we demonstrate the importance of the cross-couplings and the anisotropic interpolation via presenting thermal-microstructural evolutions.


title: Quantum invariants for the graph isomorphism problem

abstract: Graph Isomorphism is such an important problem in computer science, that it has been widely studied over the last decades. It is well known that it belongs to NP class, but is not NP-complete. It is thought to be of comparable difficulty to integer factorisation. The best known proved algorithm to solve this problem in general, was proposed by L\'aszl\'o Babai and Eugene Luks in 1983. Recently, there has been some research in the topic by using quantum computing, that also leads the present piece of research. In fact, we present a quantum computing algorithm that defines an invariant over Graph Isomorphism characterisation. This quantum algorithm is able to distinguish more non-isomorphic graphs than most of the known invariants so far. The proof of correctness and some hints illustrating the extent and reason of the improvement are also included in this paper.


title: Spiking Neural Networks for event-based action recognition: A new task to understand their advantage

abstract: Spiking Neural Networks (SNN) are characterised by their unique temporal dynamics, but the properties and advantages of such computations are still not well understood. In order to provide answers, in this work we demonstrate how Spiking neurons can enable temporal feature extraction in feed-forward neural networks without the need for recurrent synapses, and how recurrent SNNs can achieve comparable results to LSTM with a smaller number of parameters. This shows how their bio-inspired computing principles can be successfully exploited beyond energy efficiency gains and evidences their differences with respect to conventional artificial neural networks. These results are obtained through a new task, DVS-Gesture-Chain (DVS-GC), which allows, for the first time, to evaluate the perception of temporal dependencies in a real event-based action recognition dataset. Our study proves how the widely used DVS Gesture benchmark can be solved by networks without temporal feature extraction when its events are accumulated in frames, unlike the new DVS-GC which demands an understanding of the order in which events happen. Furthermore, this setup allowed us to reveal the role of the leakage rate in spiking neurons for temporal processing tasks and demonstrated the benefits of "hard reset" mechanisms. Additionally, we also show how time-dependent weights and normalization can lead to understanding order by means of temporal attention.


title: Human Motion Diffusion Model

abstract: Natural and expressive human motion generation is the holy grail of computer animation. It is a challenging task, due to the diversity of possible motion, human perceptual sensitivity to it, and the difficulty of accurately describing it. Therefore, current generative solutions are either low-quality or limited in expressiveness. Diffusion models, which have already shown remarkable generative capabilities in other domains, are promising candidates for human motion due to their many-to-many nature, but they tend to be resource hungry and hard to control. In this paper, we introduce Motion Diffusion Model (MDM), a carefully adapted classifier-free diffusion-based generative model for the human motion domain. MDM is transformer-based, combining insights from motion generation literature. A notable design-choice is the prediction of the sample, rather than the noise, in each diffusion step. This facilitates the use of established geometric losses on the locations and velocities of the motion, such as the foot contact loss. As we demonstrate, MDM is a generic approach, enabling different modes of conditioning, and different generation tasks. We show that our model is trained with lightweight resources and yet achieves state-of-the-art results on leading benchmarks for text-to-motion and action-to-motion. https://guytevet.github.io/mdm-page/ .


title: Investigating 2M1155-7919B: a Nearby, Young, Low-Mass Star Actively Accreting from a Nearly Edge-on, Dusty Disk

abstract: We investigate the nature of an unusually faint member of the $\epsilon$ Cha Association ($D\sim100$ pc, age $\sim5$ Myr), the nearest region of star formation of age $<$8 Myr. This object, 2MASS J11550336-7919147 (2M1155$-$79B), is a wide ($\sim$580 AU) separation, comoving companion to low-mass (M3) $\epsilon$ Cha Association member 2MASS J11550485-7919108 (2M1155$-$79A). We present near-infrared spectra of both components, along with analysis of photometry from Gaia EDR3, 2MASS, VHS, and WISE. The near-IR spectrum of 2M1155$-$79B displays strong He I 1.083 emission, a sign of active accretion and/or accretion-driven winds from a circumstellar disk. Analysis of WISE archival data reveals that the mid-infrared excess previously associated with 2M1155$-$79A instead originates from the disk surrounding 2M1155$-$79B. Based on these results, as well as radiative transfer modeling of its optical/IR spectral energy distribution, we conclude that 2M1155$-$79B is most likely a young, late-M, star that is partially obscured by, and actively accreting from, a nearly edge-on circumstellar disk. This would place 2M1155$-$79B among the rare group of nearby ($D\lesssim100$ pc), young (age $<$10 Myr) mid-M stars that are orbited by and accreting from highly inclined protoplanetary disks. Like these systems, the 2M1155$-$79B system is a particularly promising subject for studies of star and planet formation around low-mass stars.


title: Dipole Cosmology: The Copernican Paradigm Beyond FLRW

abstract: We introduce the $dipole$ $cosmological$ $principle$, the idea that the Universe is a maximally Copernican cosmology, compatible with a cosmic flow. It serves as the most symmetric paradigm that generalizes the FLRW ansatz, in light of the increasingly numerous (but still tentative) hints that have emerged in the last two decades for a non-kinematic component in the CMB dipole. Einstein equations in our "dipole cosmology" are still ordinary differential equations -- but instead of the two Friedmann equations, now we have four. The two new functions can be viewed as an anisotropic scale factor that breaks the isotropy group from $SO(3)$ to $U(1)$, and a "tilt" that captures the cosmic flow velocity. The result is an axially isotropic, tilted Bianchi V/VII$_h$ cosmology. We assess the possibility of model building within the dipole cosmology paradigm, and discuss the dynamics of expansion rate, anisotropic shear and tilt, in various examples. A key observation is that the cosmic flow (tilt) can grow even while the anisotropy (shear) dies down. Remarkably, this can happen even in an era of late time acceleration.


title: Helix string fragmentation and charged particle correlations with ATLAS

abstract: Correlations between charged particles provide important insight into the hadronization process. The analysis of the momentum difference between charged hadrons in $pp$, $p$-lead, and lead-lead collisions at LHC is performed by the ATLAS Collaboration in order to study the dynamics of hadron formation. The spectra of correlated hadron chains are explored and compared to the predictions based on the quantized fragmentation of a three dimensional QCD helix string. This provides an alternative view of the two-particle correlation phenomenon typically attributed to the Bose-Einstein interference.


title: Isometric Timelike Surfaces in 4--Dimensional Minkowski Space

abstract: In this paper, first we study on Bour's theorem for four kinds of timelike helicoidal surfaces in 4-dimensional Minkowski space. Secondly, we analyse the geometric properties of these isometric surfaces having same Gauss map. Also, we present the parametrizations of such isometric pair of surfaces. Finally, we introduce some examples and draw the corresponding graphs by using Wolfram Mathematica 10.4.


title: IvySyn: Automated Vulnerability Discovery in Deep Learning Frameworks

abstract: We present IvySyn, the first fully-automated framework for discovering memory error vulnerabilities in Deep Learning (DL) frameworks. IvySyn leverages the statically-typed nature of native APIs in order to automatically perform type-aware mutation-based fuzzing on low-level kernel code. Given a set of offending inputs that trigger memory safety (and runtime) errors in low-level, native DL (C/C++) code, IvySyn automatically synthesizes code snippets in high-level languages (e.g., in Python), which propagate error-triggering input via high(er)-level APIs. Such code snippets essentially act as "Proof of Vulnerability", as they demonstrate the existence of bugs in native code that an attacker can target through various high-level APIs. Our evaluation shows that IvySyn significantly outperforms past approaches, both in terms of efficiency and effectiveness, in finding vulnerabilities in popular DL frameworks. Specifically, we used IvySyn to test TensorFlow and PyTorch. Although still an early prototype, IvySyn has already helped the TensorFlow and PyTorch framework developers to identify and fix 61 previously-unknown security vulnerabilities, and assign 39 unique CVEs.


title: GDIP: Gated Differentiable Image Processing for Object-Detection in Adverse Conditions

abstract: Detecting objects under adverse weather and lighting conditions is crucial for the safe and continuous operation of an autonomous vehicle, and remains an unsolved problem. We present a Gated Differentiable Image Processing (GDIP) block, a domain-agnostic network architecture, which can be plugged into existing object detection networks (e.g., Yolo) and trained end-to-end with adverse condition images such as those captured under fog and low lighting. Our proposed GDIP block learns to enhance images directly through the downstream object detection loss. This is achieved by learning parameters of multiple image pre-processing (IP) techniques that operate concurrently, with their outputs combined using weights learned through a novel gating mechanism. We further improve GDIP through a multi-stage guidance procedure for progressive image enhancement. Finally, trading off accuracy for speed, we propose a variant of GDIP that can be used as a regularizer for training Yolo, which eliminates the need for GDIP-based image enhancement during inference, resulting in higher throughput and plausible real-world deployment. We demonstrate significant improvement in detection performance over several state-of-the-art methods through quantitative and qualitative studies on synthetic datasets such as PascalVOC, and real-world foggy (RTTS) and low-lighting (ExDark) datasets.


title: Joint Convexity of Error Probability in Blocklength and Transmit Power in the Finite Blocklength Regime

abstract: To support ultra-reliable and low-latency services for mission-critical applications, transmissions are usually carried via short blocklength codes, i.e., in the so-called finite blocklength (FBL) regime. Different from the infinite blocklength regime where transmissions are assumed to be arbitrarily reliable at the Shannon's capacity, the reliability and capacity performances of an FBL transmission are impacted by the coding blocklength. The relationship among reliability, coding rate, blocklength and channel quality has recently been characterized in the literature, considering the FBL performance model. In this paper, we follow this model, and prove the joint convexity of the FBL error probability with respect to blocklength and transmit power within a region of interest, as a key enabler for designing systems to achieve globally optimal performance levels. Moreover, we apply the joint convexity to general use cases and efficiently solve the joint optimization problem in the setting with multiple users. We also extend the applicability of the proposed approach by proving that the joint convexity still holds in fading channels, as well as in relaying networks. Via simulations, we validate our analytical results and demonstrate the advantage of leveraging the joint convexity compared to other commonly-applied approaches.


title: Chandojnanam: A Sanskrit Meter Identification and Utilization System

abstract: We present Chandoj\~n\=anam, a web-based Sanskrit meter (Chanda) identification and utilization system. In addition to the core functionality of identifying meters, it sports a friendly user interface to display the scansion, which is a graphical representation of the metrical pattern. The system supports identification of meters from uploaded images by using optical character recognition (OCR) engines in the backend. It is also able to process entire text files at a time. The text can be processed in two modes, either by treating it as a list of individual lines, or as a collection of verses. When a line or a verse does not correspond exactly to a known meter, Chandoj\~n\=anam is capable of finding fuzzy (i.e., approximate and close) matches based on sequence matching. This opens up the scope of a meter-based correction of erroneous digital corpora. The system is available for use at https://sanskrit.iitk.ac.in/jnanasangraha/chanda/, and the source code in the form of a Python library is made available at https://github.com/hrishikeshrt/chanda/.


title: Virtual homology of limit groups and profinite rigidity of direct products

abstract: We show that the virtual second Betti number of a finitely generated, residually free group $G$ is finite if and only if $G$ is either free, free abelian or the fundamental group of a closed surface. We also prove a similar statement in higher dimensions. We then develop techniques involving rank gradients of pro-$p$ groups, which allow us to recognise direct product decompositions. Combining these ideas, we show that direct products of free and surface groups are profinitely rigid among finitely presented, residually free groups, partially resolving a conjecture of Bridson's. Other corollaries that we obtain include a confirmation of Mel'nikov's surface group conjecture in the residually free case, and a description of closed aspherical manifolds of dimension at least $5$ with a residually free fundamental group.


title: Domain-Unified Prompt Representations for Source-Free Domain Generalization

abstract: Domain generalization (DG), aiming to make models work on unseen domains, is a surefire way toward general artificial intelligence. Limited by the scale and diversity of current DG datasets, it is difficult for existing methods to scale to diverse domains in open-world scenarios (e.g., science fiction and pixelate style). Therefore, the source-free domain generalization (SFDG) task is necessary and challenging. To address this issue, we propose an approach based on large-scale vision-language pretraining models (e.g., CLIP), which exploits the extensive domain information embedded in it. The proposed scheme generates diverse prompts from a domain bank that contains many more diverse domains than existing DG datasets. Furthermore, our method yields domain-unified representations from these prompts, thus being able to cope with samples from open-world domains. Extensive experiments on mainstream DG datasets, namely PACS, VLCS, OfficeHome, and DomainNet, show that the proposed method achieves competitive performance compared to state-of-the-art (SOTA) DG methods that require source domain data for training. Besides, we collect a small datasets consists of two domains to evaluate the open-world domain generalization ability of the proposed method. The source code and the dataset will be made publicly available at https://github.com/muse1998/Source-Free-Domain-Generalization


title: Spotlight: Mobile UI Understanding using Vision-Language Models with a Focus

abstract: Mobile UI understanding is important for enabling various interaction tasks such as UI automation and accessibility. Previous mobile UI modeling often depends on the view hierarchy information of a screen, which directly provides the structural data of the UI, with the hope to bypass challenging tasks of visual modeling from screen pixels. However, view hierarchies are not always available, and are often corrupted with missing object descriptions or misaligned structure information. As a result, despite the use of view hierarchies could offer short-term gains, it may ultimately hinder the applicability and performance of the model. In this paper, we propose Spotlight, a vision-only approach for mobile UI understanding. Specifically, we enhance a vision-language model that only takes the screenshot of the UI and a region of interest on the screen -- the focus -- as the input. This general architecture of Spotlight is easily scalable and capable of performing a range of UI modeling tasks. Our experiments show that our model establishes SoTA results on several representative UI tasks and outperforms previous methods that use both screenshots and view hierarchies as inputs. Furthermore, we explore multi-task learning and few-shot prompting capacities of the proposed models, demonstrating promising results in the multi-task learning direction.


title: Modifications to a classic BFGS library for use with SIMD-equipped hardware and an AAD library

abstract: We introduce certain modifications of the BFGS method for functions that are not parallelizable by nature (having consecutive operations only) taking advantage of SIMD. We also provide a modified LBFGS\texttt{++} library that takes advantage of these modifications, and the use of AAD, and give an interface for AAD users that takes advantage of the modified library automatically. We give two examples to illustrate the performance. The modified library is up to 3.8 times faster for European Swaption curve calibration in ORE (not parallelizable) and 1.4 times faster for calibrating the LMM model by a set of European options.


title: The Mittag-Leffler condition descents via pure monomorphisms

abstract: This notes aims to clarify the proof given by Raynaud and Gruson that the Mittag-Leffler property descents via pure rings monomorphism of commutative rings. A consequence of that is that projectivity dencents via such ring homomorphisms, a revision of the proof also allows to prove that the property of being pure-projective also descents via pure monomorphisms between commutative rings}.


title: Graph Anomaly Detection with Graph Neural Networks: Current Status and Challenges

abstract: Graphs are used widely to model complex systems, and detecting anomalies in a graph is an important task in the analysis of complex systems. Graph anomalies are patterns in a graph that do not conform to normal patterns expected of the attributes and/or structures of the graph. In recent years, graph neural networks (GNNs) have been studied extensively and have successfully performed difficult machine learning tasks in node classification, link prediction, and graph classification thanks to the highly expressive capability via message passing in effectively learning graph representations. To solve the graph anomaly detection problem, GNN-based methods leverage information about the graph attributes (or features) and/or structures to learn to score anomalies appropriately. In this survey, we review the recent advances made in detecting graph anomalies using GNN models. Specifically, we summarize GNN-based methods according to the graph type (i.e., static and dynamic), the anomaly type (i.e., node, edge, subgraph, and whole graph), and the network architecture (e.g., graph autoencoder, graph convolutional network). To the best of our knowledge, this survey is the first comprehensive review of graph anomaly detection methods based on GNNs.