title: Study of nonlocality effects in direct capture reactions with Lagrange-mesh $R$-matrix method

abstract: We apply the Lagrange-mesh $R$-matrix method to calculate the $S$-factor for the $^{13}$C$(p,\gamma)^{14}$N and $^{16}$O$(p,\gamma)^{17}$F direct radiative capture reactions. By comparing the astrophysical $S$-factors calculated with nonlocal and local potentials, we investigate the nonlocality effects coming from the nuclear potentials in the direct capture reactions. Our calculations are in good agreement with the experimental data and indicate a nonnegligible difference in the results of local and nonlocal potentials. The use of small diffuseness narrow potentials also provides a remarkably good fit in the case with multiple broad resonances. Our findings suggest that the nonlocal potential improves the calculated results although the difference between the local and nonlocal potentials is smaller than uncertainties from other sources. We propose the nonlocality potential should be used in the potential model calculation of future astrophysics rates evaluation.


title: Ultrafast element- and depth-resolved magnetization dynamics probed by transverse magneto-optical Kerr effect spectroscopy in the soft x-ray range

abstract: We report on time- and angle-resolved transverse magneto-optical Kerr effect spectroscopy in the soft x-ray range that, by analysis via polarization-dependent magnetic scattering simulations, allows us to determine the spatio-temporal and element-specific evolution of femtosecond laser-induced spin dynamics in nanostructured magnetic materials. In a ferrimagnetic GdFe thin film system, we correlate a reshaping spectrum of the magneto-optical Kerr signal to depth-dependent magnetization dynamics and disentangle contributions due to non-equilibrium electron transport and nanoscale heat diffusion on their intrinsic time scales. Our work provides a quantitative insight into light-driven spin dynamics occurring at buried interfaces of complex magnetic heterostructures, which can be tailored and functionalized for future opto-spintronic devices.


title: Fair distributions for more participants than allocations

abstract: We study the existence of fair distributions when we have more guests than pieces to allocate, focusing on envy-free distributions among those who receive a piece. The conditions on the demand from the guests can be weakened from those of classic cake-cutting and rent-splitting results of Stromquist, Woodall, and Su. We extend existing variations of the cake-cutting problem with secretive guests and those that resist the removal of any sufficiently small set of guests.


title: Anomalous Cosmic Ray Oxygen Observations in to 0.1 au

abstract: The Integrated Science Investigation of the Sun instrument suite onboard NASA's Parker Solar Probe mission continues to measure solar energetic particles and cosmic rays closer to the Sun than ever before. Here, we present the first observations of cosmic rays into 0.1 au (21.5 solar radii), focusing specifically on oxygen from ~2018.7 to ~2021.2. Our energy spectra reveal an anomalous cosmic ray-dominated profile that is comparable to that at 1 au, across multiple solar cycle minima. The galactic cosmic ray-dominated component is similar to that of the previous solar minimum (Solar Cycle 24/25 compared to 23/24) but elevated compared to the past (Solar Cycle 20/21). The findings are generally consistent with the current trend of unusually weak solar modulation that originated during the previous solar minimum and continues today. We also find a strong radial intensity gradient: 49.4 +/- 8.0 %/au from 0.1 to 0.94 au, for energies of 6.9 to 27 MeV/nuc. This value agrees with that measured by Helios nearly 45 years ago from 0.3 to 1.0 au (48 +/- 12 %/au; 9 to 29 MeV/nuc) and is larger than predicted by models. The large ACR gradients observed close to the Sun by the Parker Solar Probe Integrated Science Investigation of the Sun instrument suite found here suggest that intermediate-scale variations in the magnetic field's structure strongly influences cosmic ray drifts, well inside 1 au.


abstract: Geometric and holonomic quantum computation utilizes intrinsic geometric properties of quantum-mechanical state spaces to realize quantum logic gates. Since both geometric phases and quantum holonomies are global quantities depending only on the evolution paths of quantum systems, quantum gates based on them possess built-in resilience to certain kinds of errors. This review provides an introduction to the topic as well as gives an overview of the theoretical and experimental progress for constructing geometric and holonomic quantum gates and how to combine them with other error-resistant techniques.


title: Revisiting the Classification of Homogeneous 3-Sasakian and Quaternionic K\"ahler Manifolds

abstract: We provide a new, self-contained proof of the classification of homogeneous 3-Sasakian manifolds, which was originally obtained by Boyer, Galicki and Mann. In doing so, we construct an explicit one-to-one correspondence between simply connected homogeneous 3-Sasakian manifolds and simple complex Lie algebras via the theory of root systems. We also discuss why the real projective spaces are the only non-simply connected homogeneous 3-Sasakian manifolds and derive the famous classification of homogeneous positive quaternionic K\"ahler manifolds due to Wolf and Alekseevskii from our results.


title: Online Markov Decision Processes with Non-oblivious Strategic Adversary

abstract: We study a novel setting in Online Markov Decision Processes (OMDPs) where the loss function is chosen by a non-oblivious strategic adversary who follows a no-external regret algorithm. In this setting, we first demonstrate that MDP-Expert, an existing algorithm that works well with oblivious adversaries can still apply and achieve a policy regret bound of $\mathcal{O}(\sqrt{T \log(L)}+\tau^2\sqrt{ T \log(|A|)})$ where $L$ is the size of adversary's pure strategy set and $|A|$ denotes the size of agent's action space. Considering real-world games where the support size of a NE is small, we further propose a new algorithm: MDP-Online Oracle Expert (MDP-OOE), that achieves a policy regret bound of $\mathcal{O}(\sqrt{T\log(L)}+\tau^2\sqrt{ T k \log(k)})$ where $k$ depends only on the support size of the NE. MDP-OOE leverages the key benefit of Double Oracle in game theory and thus can solve games with prohibitively large action space. Finally, to better understand the learning dynamics of no-regret methods, under the same setting of no-external regret adversary in OMDPs, we introduce an algorithm that achieves last-round convergence result to a NE. To our best knowledge, this is first work leading to the last iteration result in OMDPs.


title: Robust Feature-Level Adversaries are Interpretability Tools

abstract: The literature on adversarial attacks in computer vision typically focuses on pixel-level perturbations. These tend to be very difficult to interpret. Recent work that manipulates the latent representations of image generators to create "feature-level" adversarial perturbations gives us an opportunity to explore perceptible, interpretable adversarial attacks. We make three contributions. First, we observe that feature-level attacks provide useful classes of inputs for studying representations in models. Second, we show that these adversaries are uniquely versatile and highly robust. We demonstrate that they can be used to produce targeted, universal, disguised, physically-realizable, and black-box attacks at the ImageNet scale. Third, we show how these adversarial images can be used as a practical interpretability tool for identifying bugs in networks. We use these adversaries to make predictions about spurious associations between features and classes which we then test by designing "copy/paste" attacks in which one natural image is pasted into another to cause a targeted misclassification. Our results suggest that feature-level attacks are a promising approach for rigorous interpretability research. They support the design of tools to better understand what a model has learned and diagnose brittle feature associations. Code is available at https://github.com/thestephencasper/feature_level_adv


title: Update on (2+1+1)-flavor QCD equation of state

abstract: We report on preliminary results from the calculations of the QCD equation of state for 2+1+1 flavors using HISQ action. The calculations are performed on lattices with temporal extents $N_{\tau}=6,~8,~10$, and $12$ and aspect ratio $N_{\sigma}/N_{\tau}=4$. We find that there is a significant contribution to the pressure from charm quarks at temperatures $T> 300$ MeV.


title: A Parallel Computing Method for the Higher Order Tensor Renormalization Group

abstract: In this paper, we propose a parallel computing method for the Higher Order Tensor Renormalization Group (HOTRG) applied to a $d$-dimensional $( d \geq 2 )$ simple lattice model. Sequential computation of the HOTRG requires $O ( \chi^{4 d - 1} )$ computational cost, where $\chi$ is bond dimension, in a step to contract indices of tensors. When we simply distribute elements of a local tensor to each process in parallel computing of the HOTRG, frequent communication between processes occurs. The simplest way to avoid such communication is to hold all the tensor elements in each process, however, it requires $O ( \chi^{2d} )$ memory space. In the presented method, placement of a local tensor element to more than one process is accepted and sufficient local tensor elements are distributed to each process to avoid communication between processes during considering computation step. For the bottleneck part of computational cost, such distribution is achieved by distributing elements of two local tensors to $\chi^2$ processes according to one of the indices of each local tensor which are not contracted during considering computation. In the case of $d \geq 3$, computational cost in each process is reduced to $O ( \chi^{4 d - 3} )$ and memory space requirement in each process is kept to be $O ( \chi^{2d - 1} )$.


title: How to Sense the World: Leveraging Hierarchy in Multimodal Perception for Robust Reinforcement Learning Agents

abstract: This work addresses the problem of sensing the world: how to learn a multimodal representation of a reinforcement learning agent's environment that allows the execution of tasks under incomplete perceptual conditions. To address such problem, we argue for hierarchy in the design of representation models and contribute with a novel multimodal representation model, MUSE. The proposed model learns hierarchical representations: low-level modality-specific representations, encoded from raw observation data, and a high-level multimodal representation, encoding joint-modality information to allow robust state estimation. We employ MUSE as the sensory representation model of deep reinforcement learning agents provided with multimodal observations in Atari games. We perform a comparative study over different designs of reinforcement learning agents, showing that MUSE allows agents to perform tasks under incomplete perceptual experience with minimal performance loss. Finally, we evaluate the performance of MUSE in literature-standard multimodal scenarios with higher number and more complex modalities, showing that it outperforms state-of-the-art multimodal variational autoencoders in single and cross-modality generation.


title: Applying Phonological Features in Multilingual Text-To-Speech

abstract: This study investigates whether phonological features can be applied in text-to-speech systems to generate native and non-native speech in English and Mandarin. We present a mapping of ARPABET/pinyin to SAMPA/SAMPA-SC and then to phonological features. We tested whether this mapping could lead to the successful generation of native, non-native, and code-switched speech in the two languages. We ran two experiments, one with a small dataset and one with a larger dataset. The results proved that phonological features could be used as a feasible input system, although further investigation is needed to improve model performance. The accented output generated by the TTS models also helps with understanding human second language acquisition processes.


title: Relational Quantum Mechanics is about Facts, not States: A reply to Pienaar and Brukner

abstract: In recent works, \v{C}aslav Brukner and Jacques Pienaar have raised interesting objections to the relational interpretation of quantum mechanics. We answer these objections in detail and show that, far from questioning the viability of the interpretation, they sharpen and clarify it.


title: Adversarial Retriever-Ranker for dense text retrieval

abstract: Current dense text retrieval models face two typical challenges. First, they adopt a siamese dual-encoder architecture to encode queries and documents independently for fast indexing and searching, while neglecting the finer-grained term-wise interactions. This results in a sub-optimal recall performance. Second, their model training highly relies on a negative sampling technique to build up the negative documents in their contrastive losses. To address these challenges, we present Adversarial Retriever-Ranker (AR2), which consists of a dual-encoder retriever plus a cross-encoder ranker. The two models are jointly optimized according to a minimax adversarial objective: the retriever learns to retrieve negative documents to cheat the ranker, while the ranker learns to rank a collection of candidates including both the ground-truth and the retrieved ones, as well as providing progressive direct feedback to the dual-encoder retriever. Through this adversarial game, the retriever gradually produces harder negative documents to train a better ranker, whereas the cross-encoder ranker provides progressive feedback to improve retriever. We evaluate AR2 on three benchmarks. Experimental results show that AR2 consistently and significantly outperforms existing dense retriever methods and achieves new state-of-the-art results on all of them. This includes the improvements on Natural Questions R@5 to 77.9%(+2.1%), TriviaQA R@5 to 78.2%(+1.4), and MS-MARCO MRR@10 to 39.5%(+1.3%). Code and models are available at https://github.com/microsoft/AR2.


title: Target-wavelength-trimmed second harmonic generation with gallium phosphide-on-nitride ring resonators

abstract: We demonstrate post-fabrication target-wavelength trimming with a gallium phosphide on silicon nitride integrated photonic platform using controlled electron-beam exposure of hydrogen silsesquioxane cladding. A linear relationship between the electron-beam exposure dose and resonant wavelength red-shift enables deterministic, individual trimming of multiple devices on the same chip to within 30 pm of a single target wavelength. Second harmonic generation from telecom to near infrared at a target wavelength is shown in multiple devices with quality factors on the order of $10^4$. Post-fabrication tuning is an essential tool for targeted wavelength applications including quantum frequency conversion


title: A Data-Centric Approach for Training Deep Neural Networks with Less Data

abstract: While the availability of large datasets is perceived to be a key requirement for training deep neural networks, it is possible to train such models with relatively little data. However, compensating for the absence of large datasets demands a series of actions to enhance the quality of the existing samples and to generate new ones. This paper summarizes our winning submission to the "Data-Centric AI" competition. We discuss some of the challenges that arise while training with a small dataset, offer a principled approach for systematic data quality enhancement, and propose a GAN-based solution for synthesizing new data points. Our evaluations indicate that the dataset generated by the proposed pipeline offers 5% accuracy improvement while being significantly smaller than the baseline.


title: Exploring the tropical Pacific manifold in models and observations

abstract: The threat of global warming and the demand for reliable climate predictions pose a formidable challenge being the climate system multiscale, high-dimensional and nonlinear. Spatiotemporal recurrences of the system hint to the presence of a low-dimensional manifold containing the high-dimensional climate trajectory that could make the problem more tractable. Here we argue that reproducing the geometrical and topological properties of the low-dimensional attractor should be a key target for models used in climate projections. In doing so, we propose a general data-driven framework to characterize the climate attractor and showcase it in the tropical Pacific ocean using a reanalysis as observational proxy and two state-of-the-art models. The analysis spans four variables simultaneously over the periods 1979-2019 and 2060-2100. At each time t, the system can be uniquely described by a state space vector parameterized by N variables and their spatial variability. The dynamics is confined on a manifold with dimension lower than the full state space that we characterize through manifold learning algorithms, both linear and nonlinear. The local geometry and local stability of the high-dimensional, multi-variable climate attractor are quantified through the local dimension and persistence metrics. Model biases that hamper climate predictability are identified and found to be similar in the multivariate attractor of the two models during the historical period while diverging under the warming scenario considered. Finally, the relationships between different sub-spaces (univariate fields), and therefore among climate variables, are evaluated. The proposed framework provides a comprehensive, physically based, test for assessing climate feedbacks and opens new avenues for improving their model representation.


title: School Virus Infection Simulator for Customizing School Schedules During COVID-19

abstract: During the Coronavirus 2019 (the covid-19) pandemic, schools continuously strive to provide consistent education to their students. Teachers and education policymakers are seeking ways to re-open schools, as it is necessary for community and economic development. However, in light of the pandemic, schools require customized schedules that can address the health concerns and safety of the students considering classroom sizes, air conditioning equipment, classroom systems, e.g., self-contained or compartmentalized. To solve this issue, we developed the School-Virus-Infection-Simulator (SVIS) for teachers and education policymakers. SVIS simulates the spread of infection at a school considering the students' lesson schedules, classroom volume, air circulation rates in classrooms, and infectability of the students. Thus, teachers and education policymakers can simulate how their school schedules can impact current health concerns. We then demonstrate the impact of several school schedules in self-contained and departmentalized classrooms and evaluate them in terms of the maximum number of students infected simultaneously and the percentage of face-to-face lessons. The results show that increasing classroom ventilation rate is effective, however, the impact is not stable compared to customizing school schedules, in addition, school schedules can differently impact the maximum number of students infected depending on whether classrooms are self-contained or compartmentalized. It was found that one of school schedules had a higher maximum number of students infected, compared to schedules with a higher percentage of face-to-face lessons. SVIS and the simulation results can help teachers and education policymakers plan school schedules appropriately in order to reduce the maximum number of students infected, while also maintaining a certain percentage of face-to-face lessons.


title: Cyclotomic expansions for the colored HOMFLY-PT invariants of double twist knots

abstract: In this short note, we prove the cyclotomic expansion formula for the colored HOMFLY-PT invariant of double twist knots, it confirms the cyclotomic expansion conjecture for $SU(N)$-invariants proposed in \cite{CLZ}.


title: Universal microscopic spectrum of the unquenched QCD Dirac operator at finite temperature

abstract: In the $\varepsilon$-regime of chiral perturbation theory the spectral correlations of the Euclidean QCD Dirac operator close to the origin can be computed using random matrix theory. To incorporate the effect of temperature, a random matrix ensemble has been proposed, where a constant, deterministic matrix is added to the Dirac operator. Its eigenvalue correlation functions can be written as the determinant of a kernel that depends on temperature. Due to recent progress in this specific class of random matrix ensembles, featuring a deterministic, additive shift, we can determine the limiting kernel and correlation functions in this class, which is the class of polynomial ensembles. We prove the equivalence between this new determinantal representation of the microscopic eigenvalue correlation functions and existing results in terms of determinants of different sizes, for an arbitrary number of quark flavours, with and without temperature, and extend them to non-zero topology. These results all agree and are thus universal when measured in units of the temperature dependent chiral condensate, as long as we stay below the chiral phase transition.


title: Causal Direction of Data Collection Matters: Implications of Causal and Anticausal Learning for NLP

abstract: The principle of independent causal mechanisms (ICM) states that generative processes of real world data consist of independent modules which do not influence or inform each other. While this idea has led to fruitful developments in the field of causal inference, it is not widely-known in the NLP community. In this work, we argue that the causal direction of the data collection process bears nontrivial implications that can explain a number of published NLP findings, such as differences in semi-supervised learning (SSL) and domain adaptation (DA) performance across different settings. We categorize common NLP tasks according to their causal direction and empirically assay the validity of the ICM principle for text data using minimum description length. We conduct an extensive meta-analysis of over 100 published SSL and 30 DA studies, and find that the results are consistent with our expectations based on causal insights. This work presents the first attempt to analyze the ICM principle in NLP, and provides constructive suggestions for future modeling choices. Code available at https://github.com/zhijing-jin/icm4nlp


title: The traditional approximation of rotation for rapidly rotating stars and planets. II. Deformation and differential rotation

abstract: We examine the dynamics of low-frequency gravito-inertial waves (GIWs) in differentially rotating deformed radiation zones in stars and planets by generalising the traditional approximation of rotation (TAR). The TAR treatment was built on the assumptions that the star is spherical and uniformly rotating. However, it has been generalised in our previous work by including the effects of the centrifugal deformation using a non-perturbative approach in the uniformly rotating case. We aim to carry out a new generalisation of the TAR treatment to account for the differential rotation and the strong centrifugal deformation simultaneously. We generalise our previous work by taking into account the differential rotation in the derivation of our complete analytical formalism that allows the study of the dynamics of GIWs in differentially and rapidly rotating stars. We derived the complete set of equations that generalises the TAR, simultaneously taking the full centrifugal acceleration and the differential rotation into account. Within the validity domain of the TAR, we derived a generalised Laplace tidal equation for the horizontal eigenfunctions and asymptotic wave periods of the GIWs, which can be used to probe the structure and dynamics of differentially rotating deformed stars with asteroseismology. A new generalisation of the TAR, which simultaneously takes into account the differential rotation and the centrifugal acceleration in a non-perturbative way, was derived. This generalisation allowed us to study the detectability and the signature of the differential rotation on GIWs in rapidly rotating deformed stars and planets. We found that the effects of the differential rotation in early-type deformed stars on GIWs is theoretically largely detectable in modern space photometry using observations from $\textit{Kepler}$ and TESS.

categories: astro-ph.SR astro-ph.EP physics.ao-ph physics.flu-dyn


title: Hyperparameter Tuning with Renyi Differential Privacy

abstract: For many differentially private algorithms, such as the prominent noisy stochastic gradient descent (DP-SGD), the analysis needed to bound the privacy leakage of a single training run is well understood. However, few studies have reasoned about the privacy leakage resulting from the multiple training runs needed to fine tune the value of the training algorithm's hyperparameters. In this work, we first illustrate how simply setting hyperparameters based on non-private training runs can leak private information. Motivated by this observation, we then provide privacy guarantees for hyperparameter search procedures within the framework of Renyi Differential Privacy. Our results improve and extend the work of Liu and Talwar (STOC 2019). Our analysis supports our previous observation that tuning hyperparameters does indeed leak private information, but we prove that, under certain assumptions, this leakage is modest, as long as each candidate training run needed to select hyperparameters is itself differentially private.


title: Nikolay Konstantinov and the Konstantinov System

abstract: The 'Konstantinov System' was a non-standard educational institution created by the great mathematical educator Nikolay Konstantinov (1932-2021), this 'System' worked (mainly in Moscow) in 1960-80s. We discuss some sides of technologies of the 'System': methods of teaching, organization, approaches to personal growth. In Russian.


title: A perspective on integrated atomo-photonic waveguide circuits

abstract: Integrated photonic circuits based on suspended photonic rib waveguides, which can be used for coherent trapping, guiding, and splitting of ultra-cold neutral atoms in two-colour evanescent light fields near their surfaces, are described. Configurations of quantum inertial sensors based on such integrated atomo-photonic waveguides, which are simultaneously guiding photons and atoms along the same paths, are presented. The difference between free-space and guided atom interferometers in the presence of external forces is explained. The theoretical and technological challenges, to be overcome on the way to the realization of such a novel platform for quantum technologies, are discussed.


title: From Contraction Theory to Fixed Point Algorithms on Riemannian and Non-Euclidean Spaces

abstract: The design of fixed point algorithms is at the heart of monotone operator theory, convex analysis, and of many modern optimization problems arising in machine learning and control. This tutorial reviews recent advances in understanding the relationship between Demidovich conditions, one-sided Lipschitz conditions, and contractivity theorems. We review the standard contraction theory on Euclidean spaces as well as little-known results for Riemannian manifolds. Special emphasis is placed on the setting of non-Euclidean norms and the recently introduced weak pairings for the $\ell_1$ and $\ell_\infty$ norms. We highlight recent results on explicit and implicit fixed point schemes for non-Euclidean contracting systems.


title: On the Complexity of Inductively Learning Guarded Rules

abstract: We investigate the computational complexity of mining guarded clauses from clausal datasets through the framework of inductive logic programming (ILP). We show that learning guarded clauses is NP-complete and thus one step below the $\sigma^P_2$-complete task of learning Horn clauses on the polynomial hierarchy. Motivated by practical applications on large datasets we identify a natural tractable fragment of the problem. Finally, we also generalise all of our results to $k$-guarded clauses for constant $k$.


title: Time Series Forecasting Using Manifold Learning

abstract: We address a three-tier numerical framework based on manifold learning for the forecasting of high-dimensional time series. At the first step, we embed the time series into a reduced low-dimensional space using a nonlinear manifold learning algorithm such as Locally Linear Embedding and Diffusion Maps. At the second step, we construct reduced-order regression models on the manifold, in particular Multivariate Autoregressive (MVAR) and Gaussian Process Regression (GPR) models, to forecast the embedded dynamics. At the final step, we lift the embedded time series back to the original high-dimensional space using Radial Basis Functions interpolation and Geometric Harmonics. For our illustrations, we test the forecasting performance of the proposed numerical scheme with four sets of time series: three synthetic stochastic ones resembling EEG signals produced from linear and nonlinear stochastic models with different model orders, and one real-world data set containing daily time series of 10 key foreign exchange rates (FOREX) spanning the time period 03/09/2001-29/10/2020. The forecasting performance of the proposed numerical scheme is assessed using the combinations of manifold learning, modelling and lifting approaches. We also provide a comparison with the Principal Component Analysis algorithm as well as with the naive random walk model and the MVAR and GPR models trained and implemented directly in the high-dimensional space.


title: Tracking the national and regional COVID-19 epidemic status in the UK using directed Principal Component Analysis

abstract: One of the difficulties in monitoring an ongoing pandemic is deciding on the metric that best describes its status when multiple intercorrelated measurements are available. Having a single measure, such as the effective reproduction number R, has been a simple and useful metric for tracking the epidemic and for imposing policy interventions to curb the increase when R >1. While R is easy to interpret in a fully susceptible population, it is more difficult to interpret for a population with heterogeneous prior immunity, e.g., from vaccination and prior infection. We propose an additional metric for tracking the UK epidemic which can capture the different spatial scales. These are the principal scores (PCs) from a weighted Principal Component Analysis. In this paper, we have used the methodology across the four UK nations and across the first two epidemic waves (January 2020-March 2021) to show that first principal score across nations and epidemic waves is a representative indicator of the state of the pandemic and are correlated with the trend in R. Hospitalisations are shown to be consistently representative, however, the precise dominant indicator, i.e. the principal loading(s) of the analysis, can vary geographically and across epidemic waves.


title: Phase-separation during sedimentation of dilute bacterial suspensions

abstract: Numerous natural systems depend on the sedimentation of passive particles in presence of swimming microorganisms. Here, we investigate the dynamics of the sedimentation of spherical colloids at various E. coli concentration within the dilute regime. Results show the appearance of two sedimentation fronts, a spherical particle front and the bacteria front. We find that the bacteria front behave diffusive at short times, whereas at long times decays linearly. The sedimentation speed of passive particles decays at a constant speed and decreases as bacteria concentration ($\phi_b$) is increased. As $\phi_b$ is increased further, the sedimentation speed becomes independent of $\phi_b$. The timescales of the bacteria front is associated with the particle settling speeds. Remarkably, all experiments collapse onto a single master line by using the bacteria front timescale. A phenomenological model is proposed that captures the sedimentation of passive particles in active fluids.


title: Boxhead: A Dataset for Learning Hierarchical Representations

abstract: Disentanglement is hypothesized to be beneficial towards a number of downstream tasks. However, a common assumption in learning disentangled representations is that the data generative factors are statistically independent. As current methods are almost solely evaluated on toy datasets where this ideal assumption holds, we investigate their performance in hierarchical settings, a relevant feature of real-world data. In this work, we introduce Boxhead, a dataset with hierarchically structured ground-truth generative factors. We use this novel dataset to evaluate the performance of state-of-the-art autoencoder-based disentanglement models and observe that hierarchical models generally outperform single-layer VAEs in terms of disentanglement of hierarchically arranged factors.


title: Shadow process tomography of quantum channels

abstract: Quantum process tomography is a critical capability for building quantum computers, enabling quantum networks, and understanding quantum sensors. Like quantum state tomography, the process tomography of an arbitrary quantum channel requires a number of measurements that scale exponentially in the number of quantum bits affected. However, the recent field of shadow tomography, applied to quantum states, has demonstrated the ability to extract key information about a state with only polynomially many measurements. In this work, we apply the concepts of shadow state tomography to the challenge of characterizing quantum processes. We make use of the Choi isomorphism to directly apply rigorous bounds from shadow state tomography to shadow process tomography, and we find additional bounds on the number of measurements that are unique to process tomography. Our results, which include algorithms for implementing shadow process tomography enable new techniques including evaluation of channel concatenation and the application of channels to shadows of quantum states. This provides a dramatic improvement for understanding large-scale quantum systems.


title: Towards Faster Continuous Multi-Channel HRTF Measurements Based on Learning System Models

abstract: Measuring personal head-related transfer functions (HRTFs) is essential in binaural audio. Personal HRTFs are not only required for binaural rendering and for loudspeaker-based binaural reproduction using crosstalk cancellation, but they also serve as a basis for data-driven HRTF individualization techniques and psychoacoustic experiments. Although many attempts have been made to expedite HRTF measurements, the rotational velocities in today's measurement systems remain lower than those in natural head movements. To cope with faster rotations, we present a novel continuous HRTF measurement method. This method estimates the HRTFs offline using a Kalman smoother and learns state-space parameters, including the system model, on short signal segments, utilizing the expectation maximization algorithm. We evaluated our method in simulated single-channel and multi-channel measurements using a rigid sphere HRTF model. Comparing with conventional methods, we found that the system distances are improved by up to 30 dB.


title: Virtual pullbacks in Donaldson-Thomas theory of Calabi-Yau 4-folds

abstract: Recently, Oh and Thomas constructed algebraic virtual cycles for moduli spaces of sheaves on Calabi-Yau 4-folds. The purpose of this paper is to provide a virtual pullback formula between these Oh-Thomas virtual cycles. We find a natural compatibility condition between 3-term symmetric obstruction theories that induces a virtual pullback formula. There are two types of applications. Firstly, we introduce a Lefschetz principle in Donaldson-Thomas theory, which relates the tautological DT4 invariants of a Calabi-Yau 4-fold with the DT3 invariants of its divisor. As corollaries, we prove the Cao-Kool conjecture on the tautological Hilbert scheme invariants for very ample line bundles and the Cao-Kool-Monavari conjecture on the tautological DT/PT correspondence for line bundles with Calabi-Yau divisors when the tautological complexes are vector bundles. Secondly, we present a correspondence between the Oh-Thomas virtual cycles on the moduli spaces of pairs and the moduli spaces of sheaves by combining the virtual pullback formula and a pushforward formula for virtual projective bundles. As corollaries, we prove the Cao-Maulik-Toda conjecture on the primary PT/GV correspondence for irreducible curve classes and the Cao-Toda conjecture on the primary JS/GV correspondence under the coprime condition, assuming the Cao-Maulik-Toda conjecture on the primary Katz/GV correspondence. Moreover, we also prove tautological versions of these two correspondences.


title: Species isomorphisms of fibered Burnside rings

abstract: In this note, we present a notion of species isomorphism for fibered Burnside rings. We prove that a species isomorphism can be restricted to an isomorphism of mark tables, that it can be extended to an isomorphism between the ghost rings and we provide three additional characterizations of this concept.


title: Regression markets and application to energy forecasting

abstract: Energy forecasting has attracted enormous attention over the last few decades, with novel proposals related to the use of heterogeneous data sources, probabilistic forecasting, online learn-ing, etc. A key aspect that emerged is that learning and forecasting may highly benefit from distributed data, though not only in the geographical sense. That is, various agents collect and own data that may be useful to others. In contrast to recent proposals that look into distributed and privacy-preserving learning (incentive-free), we explore here a framework called regression markets. There, agents aiming to improve their forecasts post a regression task, for which other agents may contribute by sharing their data for their features and get monetarily rewarded for it.The market design is for regression models that are linear in their parameters, and possibly sep-arable, with estimation performed based on either batch or online learning. Both in-sample and out-of-sample aspects are considered, with markets for fitting models in-sample, and then for improving genuine forecasts out-of-sample. Such regression markets rely on recent concepts within interpretability of machine learning approaches and cooperative game theory, with Shapley additive explanations. Besides introducing the market design and proving its desirable properties, application results are shown based on simulation studies (to highlight the salient features of the proposal) and with real-world case studies.


title: Enabling On-Device Training of Speech Recognition Models with Federated Dropout

abstract: Federated learning can be used to train machine learning models on the edge on local data that never leave devices, providing privacy by default. This presents a challenge pertaining to the communication and computation costs associated with clients' devices. These costs are strongly correlated with the size of the model being trained, and are significant for state-of-the-art automatic speech recognition models. We propose using federated dropout to reduce the size of client models while training a full-size model server-side. We provide empirical evidence of the effectiveness of federated dropout, and propose a novel approach to vary the dropout rate applied at each layer. Furthermore, we find that federated dropout enables a set of smaller sub-models within the larger model to independently have low word error rates, making it easier to dynamically adjust the size of the model deployed for inference.


title: Asteroid 16 Psyche: Shape, Features, and Global Map

abstract: We develop a shape model of asteroid 16 Psyche using observations acquired in a wide range of wavelengths: Arecibo S-band delay-Doppler imaging, Atacama Large Millimeter Array (ALMA) plane-of-sky imaging, adaptive optics (AO) images from Keck and the Very Large Telescope (VLT), and a recent stellar occultation. Our shape model has dimensions 278 (-4/+8) km x 238 (-4/+6) km x 171 (-1/+5) km, an effective spherical diameter Deff = 222 -1/+4 km, and a spin axis (ecliptic lon, lat) of (36 deg, -8 deg) +/- 2 deg. We survey all the features previously reported to exist, tentatively identify several new features, and produce a global map of Psyche. Using 30 calibrated radar echoes, we find Psyche's overall radar albedo to be 0.34 +/- 0.08 suggesting that the upper meter of regolith has a significant metal (i.e., Fe-Ni) content. We find four regions of enhanced or complex radar albedo, one of which correlates well with a previously identified feature on Psyche, and all of which appear to correlate with patches of relatively high optical albedo. Based on these findings, we cannot rule out a model of Psyche as a remnant core, but our preferred interpretation is that Psyche is a differentiated world with a regolith composition analogous to enstatite or CH/CB chondrites and peppered with localized regions of high metal concentrations. The most credible formation mechanism for these regions is ferrovolcanism as proposed by Johnson et al. (Nature Astronomy vol 4, January 2020, 41-44).


title: A Hybrid Direct-Iterative Method for Solving KKT Linear Systems

abstract: We propose a solution strategy for linear systems arising in interior method optimization, which is suitable for implementation on hardware accelerators such as graphical processing units (GPUs). The current gold standard for solving these systems is the LDL^T factorization. However, LDL^T requires pivoting during factorization, which substantially increases communication cost and degrades performance on GPUs. Our novel approach solves a large indefinite system by solving multiple smaller positive definite systems, using an iterative solve for the Schur complement and an inner direct solve (via Cholesky factorization) within each iteration. Cholesky is stable without pivoting, thereby reducing communication and allowing reuse of the symbolic factorization. We demonstrate the practicality of our approach and show that on large systems it can efficiently utilize GPUs and outperform LDL^T factorization of the full system.


title: Experimental estimates of the photon background in a potential light-by-light scattering study

abstract: High power short pulse lasers provide a promising route to study the strong field effects of the quantum vacuum, for example by direct photon-photon scattering in the all-optical regime. Theoretical predictions based on realistic laser parameters achievable today or in the near future predict scattering of a few photons with colliding Petawatt laser pulses, requiring single photon sensitive detection schemes and very good spatio-temporal filtering and background suppression. In this article, we present experimental investigations of this photon background by employing only a single high power laser pulse tightly focused in residual gas of a vacuum chamber. The focal region was imaged onto a single-photon sensitive, time gated camera. As no detectable quantum vacuum signature was expected in our case, the setup allowed for characterization and first mitigation of background contributions. For the setup employed, scattering off surfaces of imperfect optics dominated below residual gas pressures of $1\times 10^{-4}$ mbar. Extrapolation of the findings to intensities relevant for photon-photon scattering studies is discussed.


title: Massive Star Cluster Formation and Destruction in Luminous Infrared Galaxies in GOALS II: An ACS/WFC3 Survey of Nearby LIRGs

abstract: We present the results of a Hubble Space Telescope WFC3 near-UV and ACS/WFC optical study into the star cluster populations of 10 luminous and ultra-luminous infrared galaxies (U/LIRGs) in the Great Observatories All-Sky LIRG Survey (GOALS). Through integrated broadband photometry we have derived ages, masses, and extinctions for a total of 1027 star clusters in galaxies with $d_{L} <$ 110 Mpc in order to avoid issues related to cluster blending. The measured cluster age distribution slope of $dN/d\tau \propto \tau^{-0.5 +/- 0.2}$ is steeper than what has been observed in lower-luminosity star-forming galaxies. Further, differences in the slope of the observed cluster age distribution between inner- ($dN/d\tau \propto \tau^{-1.07 +/- 0.12}$) and outer-disk ($dN/d\tau \propto \tau^{-0.37 +/- 0.09}$) star clusters provides evidence of mass-dependent cluster destruction in the central regions of LIRGs driven primarily by the combined effect of strong tidal shocks and encounters with massive GMCs. Excluding the nuclear ring surrounding the Seyfert 1 nucleus in NGC 7469, the derived cluster mass function (CMF: $dN/dM \propto M^{\alpha}$) has marginal evidence for a truncation in the power-law (PL) at $M_{t} \sim 2$x$10^{6} M_{\odot}$ for our three most cluster-rich galaxies, which are all classified as early-stage mergers. Finally, we find evidence of a flattening of the CMF slope of $dN/dM \propto M^{-1.42 \pm 0.1}$ for clusters in late-stage mergers relative to early-stage ($\alpha = -1.65 \pm 0.02$), which we attribute to an increase in the formation of massive clusters over the course of the interaction.


title: Using Contrastive Learning and Pseudolabels to learn representations for Retail Product Image Classification

abstract: Retail product Image classification problems are often few shot classification problems, given retail product classes cannot have the type of variations across images like a cat or dog or tree could have. Previous works have shown different methods to finetune Convolutional Neural Networks to achieve better classification accuracy on such datasets. In this work, we try to address the problem statement : Can we pretrain a Convolutional Neural Network backbone which yields good enough representations for retail product images, so that training a simple logistic regression on these representations gives us good classifiers ? We use contrastive learning and pseudolabel based noisy student training to learn representations that get accuracy in order of finetuning the entire Convnet backbone for retail product image classification.


title: Local atomic configuration control of superconductivity in the undoped pnictide parent compound BaFe2As2

abstract: Emergent superconductivity is strongly correlated with the symmetry of local atomic configuration in the parent compounds of iron-based superconductors. While chemical doping or hydrostatic pressure can change the local geometry, these conventional approaches do not provide a clear pathway in tuning the detailed atomic arrangement predictably, due to the parent compounds complicated structural deformation in the presence of the tetragonal-to-orthorhombic phase transition. Here, we demonstrate a systematic approach to manipulate the local structural configurations in BaFe2As2 epitaxial thin films by controlling two independent structural factors orthorhombicity (in-plane anisotropy) and tetragonality (out-of-plane/in-plane balance) from lattice parameters. We tune superconductivity without chemical doping utilizing both structural factors separately, controlling local tetrahedral coordination in designed thin film heterostructures with substrate clamping and bi-axial strain. We further show that this allows quantitative control of both the structural phase transition, associated magnetism, and superconductivity in the parent material BaFe2As2. This approach will advance the development of tunable thin film superconductors in reduced dimension.


title: Transport-majorization to analytic and geometric inequalities

abstract: We introduce a transport-majorization argument that establishes a majorization in the convex order between two densities, based on control of the gradient of a transportation map between them. As applications, we give elementary derivations of some delicate Fourier analytic inequalities, which in turn yield geometric "slicing-inequalities" in both continuous and discrete settings. As a further consequence of our investigation we prove that any strongly log-concave probability density majorizes the Gaussian density and thus the Gaussian density maximizes the R\'enyi and Tsallis entropies of all orders among all strongly log-concave densities.


title: Spatiotemporal evolution of a self-excited dust density wave in a nanodusty plasma under strong Havnes effect

abstract: A broad-spectrum self-excited dust density wave is experimentally studied in a vertically extended nanodusty plasma consisting of in situ grown carbonaceous nanometer sized particles. The nanodusty plasma having high particle density (of the order of 10^12-10^13 m^(-3)) is created with vertical extension up to (40+-0.1) cm and radial extension up to (5+-0.1) cm. The propagation of the self-excited dust density wave under strong Havnes effect is examined over a large axial distance (19+-0.1) cm. Time-resolved Hilbert transformation and Fast Fourier transformation techniques are used to study the spatiotemporal evolution of frequency and wave numbers along three directions from the dust void viz. axial, radial and oblique. The propagation is found to be inhomogeneous throughout the dust cloud. The phase velocity of the wave is estimated to be quite low and decreasing along the direction of propagation. This effect is attributed to the strong reduction of particle charge due to a high Havnes parameter along the propagation direction. By the estimation of average particle charge, ion density and the finite electric field throughout the nanodust cloud, a quantitative analysis of the void formation in nanodusty plasma is presented. New insights are also made regarding wave merging phenomena using time-resolved Hilbert transformation.


title: From Weighted Conditionals of Multilayer Perceptrons to Gradual Argumentation and Back

abstract: A fuzzy multipreference semantics has been recently proposed for weighted conditional knowledge bases, and used to develop a logical semantics for Multilayer Perceptrons, by regarding a deep neural network (after training) as a weighted conditional knowledge base. This semantics, in its different variants, suggests some gradual argumentation semantics, which are related to the family of the gradual semantics studied by Amgoud and Doder. The relationships between weighted conditional knowledge bases and MLPs extend to the proposed gradual semantics to capture the stationary states of MPs, in agreement with previous results on the relationship between argumentation frameworks and neural networks. The paper also suggests a simple way to extend the proposed semantics to deal attacks/supports by a boolean combination of arguments, based on the fuzzy semantics of weighted conditionals, as well as an approach for defeasible reasoning over a weighted argumentation graph, building on the proposed gradual semantics.


title: Computing associators of endomorphism fusion categories

abstract: Many applications of fusion categories, particularly in physics, require the associators or $F$-symbols to be known explicitly. Finding these matrices typically involves solving vast systems of coupled polynomial equations in large numbers of variables. In this work, we present an algorithm that allows associator data for some category with unknown associator to be computed from a Morita equivalent category with known data. Given a module category over the latter, we utilize the representation theory of a module tube category, built from the known data, to compute this unknown associator data. When the input category is unitary, we discuss how to ensure the obtained data is also unitary. We provide several worked examples to illustrate this algorithm. In addition, we include several Mathematica files showing how the algorithm can be used to compute the data for the Haagerup category $\mathcal{H}_1$, whose data was previously unknown.


title: Dzyaloshinskii-Moriya interaction as a fast quantum information scrambler

abstract: Black holes are conjectured to be the fastest information scramblers, and within holographic duality, the speed of quantum information scrambling of thermal states of quantum systems is at the heart of studies of chaos and black hole dynamics. Here, considering the Ising interaction on the thermal state of spin chains with Dzyaloshinskii-Moriya (DM) interaction and measuring the out-of-time-order correlation functions, we study the effect of DM interaction on the speed of scrambling the quantum information. On the contrary to its advantages in quantum information and metrology such as exciting entanglement and quantum Fisher information, we show that DM interaction speeds up the information scrambling. We also show that the increasing temperature slows down the scrambling process due to vanishing quantum correlations.


title: Using Keypoint Matching and Interactive Self Attention Network to verify Retail POSMs

abstract: Point of Sale Materials(POSM) are the merchandising and decoration items that are used by companies to communicate product information and offers in retail stores. POSMs are part of companies' retail marketing strategy and are often applied as stylized window displays around retail shelves. In this work, we apply computer vision techniques to the task of verification of POSMs in supermarkets by telling if all desired components of window display are present in a shelf image. We use Convolutional Neural Network based unsupervised keypoint matching as a baseline to verify POSM components and propose a supervised Neural Network based method to enhance the accuracy of baseline by a large margin. We also show that the supervised pipeline is not restricted to the POSM material it is trained on and can generalize. We train and evaluate our model on a private dataset composed of retail shelf images.


title: A criterion for critical junctions in elastic-plastic adhesive wear

abstract: We investigate elastic-plastic adhesive wear via a continuum variational phase-field approach. The model seamlessly captures the transition from perfectly brittle, over quasi-brittle to elastic-plastic wear regimes, as the ductility of the contacting material increases. Simulation results highlight the existence of a critical condition that morphological features and material ductility need to satisfy for the adhesive junction to detach a wear debris. We propose a new criterion to discriminate between non-critical and critical asperity contacts, where the former produce negligible wear while the latter lead to significant debris formation.


title: Distributivity and Minimality in Perfect Tree Forcings for Singular Cardinals

abstract: Dobrinen, Hathaway and Prikry studied a forcing $\mathbb{P}_\kappa$ consisting of perfect trees of height $\lambda$ and width $\kappa$ where $\kappa$ is a singular $\omega$-strong limit of cofinality $\lambda$. They showed that if $\kappa$ is singular of countable cofinality, then $\mathbb{P}_\kappa$ is minimal for $\omega$-sequences assuming that $\kappa$ is a supremum of a sequence of measurable cardinals. We obtain this result without the measurability assumption. Prikry proved that $\mathbb{P}_\kappa$ is $(\omega,\nu)$-distributive for all $\nu<\kappa$ given a singular $\omega$-strong limit cardinal $\kappa$ of countable cofinality, and Dobrinen et al$.$ asked whether this result generalizes if $\kappa$ has uncountable cofinality. We answer their question in the negative by showing that $\mathbb{P}_\kappa$ is not $(\lambda,2)$-distributive if $\kappa$ is a $\lambda$-strong limit of uncountable cofinality $\lambda$ and we obtain the same result for a range of similar forcings, including one that Dobrinen et al$.$ consider that consists of pre-perfect trees. We also show that $\mathbb{P}_\kappa$ in particular is not $(\omega,\cdot,\lambda^+)$-distributive under these assumptions. While developing these ideas, we address natural questions regarding minimality and collapses of cardinals.


title: Neural Networks, Inside Out: Solving for Inputs Given Parameters (A Preliminary Investigation)

abstract: Artificial neural network (ANN) is a supervised learning algorithm, where parameters are learned by several back-and-forth iterations of passing the inputs through the network, comparing the output with the expected labels, and correcting the parameters. Inspired by a recent work of Boer and Kramer (2020), we investigate a different problem: Suppose an observer can view how the ANN parameters evolve over many iterations, but the dataset is oblivious to him. For instance, this can be an adversary eavesdropping on a multi-party computation of an ANN parameters (where intermediate parameters are leaked). Can he form a system of equations, and solve it to recover the dataset?


title: Torsors over the Rational Double Points in Characteristic $\mathbf{p}$

abstract: We study torsors under finite group schemes over the punctured spectrum of a singularity $x\in X$ in positive characteristic. We show that the Dieudonn\'e module of the (loc,loc)-part $\mathrm{Picloc}^{\mathrm{loc},\mathrm{loc}}_{X/k}$ of the local Picard sheaf can be described in terms of local Witt vector cohomology, making $\mathrm{Picloc}^{\mathrm{loc},\mathrm{loc}}_{X/k}$ computable. Together with the class group and the abelianised local \'etale fundamental group, $\mathrm{Picloc}^{\mathrm{loc},\mathrm{loc}}_{X/k}$ completely describes the finite abelian torsors over $X\setminus\{x\}$. We compute $\mathrm{Picloc}^{\mathrm{loc},\mathrm{loc}}_{X/k}$ for every rational double point singularity, which complements results of Artin and Lipman, who determined ${\pi_{\mathrm{loc}}^{\mathrm{et}}}(X)$ and ${\rm Cl}(X)$. All three objects turn out to be finite. We extend the Flenner--Mumford criterion for smoothness of a normal surface germ $x \in X$ to perfect fields of positive characteristic, generalising work of Esnault and Viehweg: If $k$ is algebraically closed, then $X$ is smooth if and only if $\mathrm{Picloc}^{\mathrm{loc},\mathrm{loc}}_{X/k}$, ${\pi_{\mathrm{loc}}^{\mathrm{et}}}(X)$, and ${\rm Cl}(X)$ are trivial. Finally, we study the question whether rational double point singularities are quotient singularities by group schemes and if so, whether the group scheme is uniquely determined by the singularity. We give complete answers to both questions, except for some $D_n^r$-singularities in characteristic $2$. In particular, we will give examples of (F-injective) rational double points that are not quotient singularities.


title: New type series for powers of $\pi$

abstract: Motivated by Ramanujan-type series and Zeilberger-type series, in this paper we investigate two new types of series for powers of $\pi$. For example, we prove that $$\sum_{k=0}^\infty(198k^2-425k+210)\frac{k^3\binom{2k}k^3}{4096^k}=-\frac1{21\pi}$$ and $$\sum_{k=0}^\infty\frac{198k^2-227k+47}{\binom{2k}k^3}=\frac{3264-4\pi^2}{63}.$$ We also pose many conjectures in this new direction.


title: Neural Estimation of Statistical Divergences

abstract: Statistical divergences (SDs), which quantify the dissimilarity between probability distributions, are a basic constituent of statistical inference and machine learning. A modern method for estimating those divergences relies on parametrizing an empirical variational form by a neural network (NN) and optimizing over parameter space. Such neural estimators are abundantly used in practice, but corresponding performance guarantees are partial and call for further exploration. We establish non-asymptotic absolute error bounds for a neural estimator realized by a shallow NN, focusing on four popular $\mathsf{f}$-divergences -- Kullback-Leibler, chi-squared, squared Hellinger, and total variation. Our analysis relies on non-asymptotic function approximation theorems and tools from empirical process theory to bound the two sources of error involved: function approximation and empirical estimation. The bounds characterize the effective error in terms of NN size and the number of samples, and reveal scaling rates that ensure consistency. For compactly supported distributions, we further show that neural estimators of the first three divergences above with appropriate NN growth-rate are minimax rate-optimal, achieving the parametric convergence rate.


title: Utilizing Time-Reversibility for Shock Capturing in Nonlinear Hyperbolic Conservation Laws

abstract: In this work, we introduce a novel approach to formulating an artificial viscosity for shock capturing in nonlinear hyperbolic systems by utilizing the property that the solutions of hyperbolic conservation laws are not reversible in time in the vicinity of shocks. The proposed approach does not require any additional governing equations or a priori knowledge of the hyperbolic system in question, is independent of the mesh and approximation order, and requires the use of only one tunable parameter. The primary novelty is that the resulting artificial viscosity is unique for each component of the conservation law which is advantageous for systems in which some components exhibit discontinuities while others do not. The efficacy of the method is shown in numerical experiments of multi-dimensional hyperbolic conservation laws such as nonlinear transport, Euler equations, and ideal magnetohydrodynamics using a high-order discontinuous spectral element method on unstructured grids.


title: The complexity of bidirected reachability in valence systems

abstract: Reachability problems in infinite-state systems are often subject to extremely high complexity. This motivates the investigation of efficient overapproximations, where we add transitions to obtain a system in which reachability can be decided more efficiently. We consider bidirected infinite-state systems, where for every transition there is a transition with opposite effect. We study bidirected reachability in the framework of valence systems, an abstract model featuring finitely many control states and an infinite-state storage that is specified by a finite graph. By picking suitable graphs, valence systems can uniformly model counters as in vector addition systems, pushdowns, integer counters, and combinations thereof. We provide a comprehensive complexity landscape for bidirected reachability and show that the complexity drops (often to polynomial time) from that of general reachability, for almost every storage mechanism where reachability is known to be decidable.


title: Augmenting Reinforcement Learning with Behavior Primitives for Diverse Manipulation Tasks

abstract: Realistic manipulation tasks require a robot to interact with an environment with a prolonged sequence of motor actions. While deep reinforcement learning methods have recently emerged as a promising paradigm for automating manipulation behaviors, they usually fall short in long-horizon tasks due to the exploration burden. This work introduces Manipulation Primitive-augmented reinforcement Learning (MAPLE), a learning framework that augments standard reinforcement learning algorithms with a pre-defined library of behavior primitives. These behavior primitives are robust functional modules specialized in achieving manipulation goals, such as grasping and pushing. To use these heterogeneous primitives, we develop a hierarchical policy that involves the primitives and instantiates their executions with input parameters. We demonstrate that MAPLE outperforms baseline approaches by a significant margin on a suite of simulated manipulation tasks. We also quantify the compositional structure of the learned behaviors and highlight our method's ability to transfer policies to new task variants and to physical hardware. Videos and code are available at https://ut-austin-rpl.github.io/maple


title: Boundary renormalisation of SPDEs

abstract: We consider the continuum parabolic Anderson model (PAM) and the dynamical $\Phi^4$ equation on the $3$-dimensional cube with boundary conditions. While the Dirichlet solution theories are relatively standard, the case of Neumann/Robin boundary conditions gives rise to a divergent boundary renormalisation. Furthermore for $\Phi^4_3$ a `boundary triviality' result is obtained: if one approximates the equation with Neumann boundary conditions and the usual bulk renormalisation, then the limiting process coincides with the one obtained using Dirichlet boundary conditions.


title: Individual- and pair-based models of epidemic spreading: master equations and analysis of their forecasting capabilities

abstract: Mathematical modeling of disease spreading plays a crucial role in understanding, controlling and preventing epidemic outbreaks. In a microscopic description of the propagation of a disease over the complex network of human contacts, the probability that an individual is in a given state (susceptible, infectious, recovered etc) depends on the state of its neighbors in the network. Thus it depends on the state of pairs of nodes, which in turns depends on triples, in a hierarchy of dynamical dependencies. In order to produce models that are at the same time reliable and manageable, one has to understand how to truncate such a hierarchy, and how the chosen order of approximation affects the ability of the model to forecast the real temporal evolution of an epidemics. In this paper we provide a systematic analysis of the reliability (under different hypotheses on the quantity and quality of available data) of the predictions obtained by truncating the hierarchy either at the level of individuals or at the level of pairs. We find that pair-based models are reliable tools both for estimating the epidemiological parameters and for forecasting the temporal evolution of the epidemics, under all conditions taken into account in our work. However, a pair-based approach provides a much better prediction of an individual-based one, only if better data, namely information on the state of node pairs, are available. Overall, our results suggest that more refined mathematical models need to be informed by improved contact tracing techniques to better support decision on policies and containment measures to adopt.


title: The Milky Way's middle-aged inner ring

abstract: We investigate the metallicity, age, and orbital anatomy of the inner Milky Way, specifically focussing on the outer bar region. We integrated a sample of APOGEE DR16 inner Galaxy stars in a state of the art bar-bulge potential with a slow pattern speed and investigated the link between the resulting orbits and their [Fe/H] and ages. By superimposing the orbits, we built density, [Fe/H], and age maps of the inner Milky Way, which we divided further using the orbital parameters eccentricity, |Xmax|, and |Zmax|. We find that at low heights from the Galactic plane, the Galactic bar gradually transitions into a radially thick, vertically thin, elongated inner ring with average solar [Fe/H]. This inner ring is mainly composed of stars with AstroNN ages between 4 and 9 Gyr with a peak in age between 6 and 8 Gyr, making the average age of the ring ~6 Gyr. The vertical thickness of the ring decreases markedly towards younger ages. We also find very large L4 Lagrange orbits that have average solar to super-solar metallicities and intermediate ages. Lastly, we confirm a clear X-shape in the [Fe/H] and density distributions at large Galactic heights. The orbital structure obtained for the APOGEE stars reveals that the Milky Way hosts an inner ring-like structure between the planar bar and corotation. This structure is on average metal rich, intermediately aged, and enhances the horizontal metallicity gradient along the bar's major axis.


title: Transform2Act: Learning a Transform-and-Control Policy for Efficient Agent Design

abstract: An agent's functionality is largely determined by its design, i.e., skeletal structure and joint attributes (e.g., length, size, strength). However, finding the optimal agent design for a given function is extremely challenging since the problem is inherently combinatorial and the design space is prohibitively large. Additionally, it can be costly to evaluate each candidate design which requires solving for its optimal controller. To tackle these problems, our key idea is to incorporate the design procedure of an agent into its decision-making process. Specifically, we learn a conditional policy that, in an episode, first applies a sequence of transform actions to modify an agent's skeletal structure and joint attributes, and then applies control actions under the new design. To handle a variable number of joints across designs, we use a graph-based policy where each graph node represents a joint and uses message passing with its neighbors to output joint-specific actions. Using policy gradient methods, our approach enables joint optimization of agent design and control as well as experience sharing across different designs, which improves sample efficiency substantially. Experiments show that our approach, Transform2Act, outperforms prior methods significantly in terms of convergence speed and final performance. Notably, Transform2Act can automatically discover plausible designs similar to giraffes, squids, and spiders. Code and videos are available at https://sites.google.com/view/transform2act.


title: Developing Medical AI : a cloud-native audio-visual data collection study

abstract: Designing Artificial Intelligence (AI) solutions that can operate in real-world situations is a highly complex task. Deploying such solutions in the medical domain is even more challenging. The promise of using AI to improve patient care and reduce cost has encouraged many companies to undertake such endeavours. For our team, the goal has been to improve early identification of deteriorating patients in the hospital. Identifying patient deterioration in lower acuity wards relies, to a large degree on the attention and intuition of clinicians, rather than on the presence of physiological monitoring devices. In these care areas, an automated tool which could continuously observe patients and notify the clinical staff of suspected deterioration, would be extremely valuable. In order to develop such an AI-enabled tool, a large collection of patient images and audio correlated with corresponding vital signs, past medical history and clinical outcome would be indispensable. To the best of our knowledge, no such public or for-pay data set currently exists. This lack of audio-visual data led to the decision to conduct exactly such study. The main contributions of this paper are, the description of a protocol for audio-visual data collection study, a cloud-architecture for efficiently processing and consuming such data, and the design of a specific data collection device.


title: Constraining Localized Vote Tampering in the 2020 US Presidential Election

abstract: Voter fraud in the United States is rare and the vote-counting system is robust against tampering, but there remains widespread distrust in the security of election infrastructure among the public. We consider statistical means of detecting anomalous election results that would be indicative of large-scale fraud, focusing on scenarios in which votes are modified in in a localized setting. The technique we develop, based on standard regression analysis, makes use of the fact that vote share is correlated with demographics. We apply our method to the results of the 2020 US presidential election as a proof-of-concept, resulting in uncertainties at the few-percent level. We are able to readily detect an artificial signal of such fraud in some cases, ruling out some scenarios of localized fraud and placing constraints on other scenarios.


title: FlowMapper.org: A web-based framework for designing origin-destination flow maps

abstract: FlowMapper.org is a web-based framework for automated production and design of origin-destination flow maps (https://flowmapper.org). FlowMapper has four major features that contribute to the advancement of existing flow mapping systems. First, users can upload and process their own data to design and share customized flow maps. The ability to save data, cartographic design and map elements in a project file allows users to easily share their data and cartographic design with others. Second, users can customize the flow line symbology by including options to change the flow line style, width, and coloring. FlowMapper includes algorithms for drawing curved line styles with varying thickness along a flow line, which reduces the visual cluttering and overlapping by tapering flow lines at origin and destination points. The ability to customize flow symbology supports different flow map reading tasks such as comparing flow magnitudes and directions and identifying flow and location clusters that are strongly connected with each other. Third, FlowMapper supports supplementary layers such as node symbol, choropleth, and base maps to contextualize flow patterns with location references and characteristics such as net-flow, gross flow, net-flow ratio, or a locational attribute such as population density. FlowMapper also supports user interactions to zoom, filter, and obtain details-on-demand functions to support visual information seeking about nodes, flows and regions. Finally, the web-based architecture of FlowMapper supports server side computational capabilities to process, normalize and summarize large flow data to reveal natural patterns of flows.


title: Quantifying the Suicidal Tendency on Social Media: A Survey

abstract: Amid lockdown period more people express their feelings over social media platforms due to closed third-place and academic researchers have witnessed strong associations between the mental healthcare and social media posts. The stress for a brief period may lead to clinical depressions and the long-lasting traits of prevailing depressions can be life threatening with suicidal ideation as the possible outcome. The increasing concern towards the rise in number of suicide cases is because it is one of the leading cause of premature but preventable death. Recent studies have shown that mining social media data has helped in quantifying the suicidal tendency of users at risk. This potential manuscript elucidates the taxonomy of mental healthcare and highlights some recent attempts in examining the potential of quantifying suicidal tendency on social media data. This manuscript presents the classification of heterogeneous features from social media data and handling feature vector representation. Aiming to identify the new research directions and advances in the development of Machine Learning (ML) and Deep Learning (DL) based models, a quantitative synthesis and a qualitative review was carried out with corpus of over 77 potential research articles related to stress, depression and suicide risk from 2013 to 2021.


title: TBCOV: Two Billion Multilingual COVID-19 Tweets with Sentiment, Entity, Geo, and Gender Labels

abstract: The widespread usage of social networks during mass convergence events, such as health emergencies and disease outbreaks, provides instant access to citizen-generated data that carry rich information about public opinions, sentiments, urgent needs, and situational reports. Such information can help authorities understand the emergent situation and react accordingly. Moreover, social media plays a vital role in tackling misinformation and disinformation. This work presents TBCOV, a large-scale Twitter dataset comprising more than two billion multilingual tweets related to the COVID-19 pandemic collected worldwide over a continuous period of more than one year. More importantly, several state-of-the-art deep learning models are used to enrich the data with important attributes, including sentiment labels, named-entities (e.g., mentions of persons, organizations, locations), user types, and gender information. Last but not least, a geotagging method is proposed to assign country, state, county, and city information to tweets, enabling a myriad of data analysis tasks to understand real-world issues. Our sentiment and trend analyses reveal interesting insights and confirm TBCOV's broad coverage of important topics.


title: Revisiting SVD to generate powerful Node Embeddings for Recommendation Systems

abstract: Graph Representation Learning (GRL) is an upcoming and promising area in recommendation systems. In this paper, we revisit the Singular Value Decomposition (SVD) of adjacency matrix for embedding generation of users and items and use a two-layer neural network on top of these embeddings to learn relevance between user-item pairs. Inspired by the success of higher-order learning in GRL, we further propose an extension of this method to include two-hop neighbors for SVD through the second order of the adjacency matrix and demonstrate improved performance compared with the simple SVD method which only uses one-hop neighbors. Empirical validation on three publicly available datasets of recommendation system demonstrates that the proposed methods, despite being simple, beat many state-of-the-art methods and for two of three datasets beats all of them up to a margin of 10%. Through our research, we want to shed light on the effectiveness of matrix factorization approaches, specifically SVD, in the deep learning era and show that these methods still contribute as important baselines in recommendation systems.


title: Joint inference of multiple graphs with hidden variables from stationary graph signals

abstract: Learning graphs from sets of nodal observations represents a prominent problem formally known as graph topology inference. However, current approaches are limited by typically focusing on inferring single networks, and they assume that observations from all nodes are available. First, many contemporary setups involve multiple related networks, and second, it is often the case that only a subset of nodes is observed while the rest remain hidden. Motivated by these facts, we introduce a joint graph topology inference method that models the influence of the hidden variables. Under the assumptions that the observed signals are stationary on the sought graphs and the graphs are closely related, the joint estimation of multiple networks allows us to exploit such relationships to improve the quality of the learned graphs. Moreover, we confront the challenging problem of modeling the influence of the hidden nodes to minimize their detrimental effect. To obtain an amenable approach, we take advantage of the particular structure of the setup at hand and leverage the similarity between the different graphs, which affects both the observed and the hidden nodes. To test the proposed method, numerical simulations over synthetic and real-world graphs are provided.


title: Instability of QBC systems to Topological Anderson Insulating phases

abstract: Here we study the instabilities of a quadratic band crossing system to Chern insulating states and uncorrelated disorder. We determined the phase diagram in the plane of topological mass versus disorder strength, characterizing the system with respect to spectral, localization and topological properties. In the clean limit, the system has two gapped Chern insulating phases with Chern numbers C=\pm2, and a trivial phase with C=0. For finite disorder, the quadratic band crossing points are unstable to emergent gapless Chern insulating phases with C=\pm1, not present in the clean limit. These phases occupy a considerable region of the phase diagram for intermediate disorder and show features of topological Anderson insulators: it is possible to reach them through disorder-driven transitions from trivial phases.


title: From Classical to quantum stochastic process

abstract: In this paper for the first time, we construct quantum analogs starting from classical stochastic processes, by replacing random which path decisions with superpositions of all paths. This procedure typically leads to non-unitary quantum evolution, where coherences are continuously generated and destroyed. In spite of their transient nature, these coherences can change the scaling behavior of classical observables. Using the zero temperature Glauber dynamics in a linear Ising spin chain, we find quantum analogs with different domain growth exponents. In some cases, this exponent is even smaller than for the original classical process, which means that coherence can play an important role to speed up the relaxation process.


title: Adams spectral sequences and Franke's algebraicity conjecture

abstract: To any well-behaved homology theory we associate a derived $\infty$-category which encodes its Adams spectral sequence. As applications, we prove a conjecture of Franke on algebraicity of certain homotopy categories and establish homotopy-coherent monoidality of the Adams filtration.


title: Category decomposition of Rep_k(SL_n(F))

abstract: Let F be a non-archimedean local field with residual characteristic p, and k an algebraically closed field of characteristic l different from p. We establish a category decomposition of Rep_k(SL_n(F) according to the GL_n(F)-inertially equivalent supercuspidal classes of SL_n(F), and we give a block decomposition of the supercuspidal sub-category of Rep_k(SL_n(F)). Finally we give an example to show that in general a block of SL_n(F) is not defined according to a unique inertially equivalent supercuspidal classes of SL_n(F), which is different from the case when l=0.


title: Variability in Quasar Light Curves: using quasars as standard candles

abstract: A relation between the variational slope, $s_F$ , and the mean absolute magnitude, $\langle M \rangle$, in the light curves of 58 spectroscopically confirmed quasars is measured with a dispersion of 0.15dex. Assuming it holds for quasars in general, not only does this relation add to our working knowledge of quasar variability but it also shows great promise at accurately measuring luminosity distance to a quasar in a model independent way. An accurate, model independent measure of the luminosity distance would allow quasars to be added to the cosmic distance ladder, easily extending the ladder out far beyond the redshifts accessible to type Ia supernovae where cosmological parameters can be better constrained.


title: Improved upper bounds for the Hot Spots constant of Lipschitz domains

abstract: The Hot Spots constant for bounded smooth domains was recently introduced by Steinerberger (2021) as a means to control the global extrema of the first nontrivial eigenfunction of the Neumann Laplacian by its boundary extrema. We generalize the Hot Spots constant to bounded Lipschitz domains and show that it leads to an if and only if condition for the weak Hot Spots conjecture HS2 from Ba\~{n}uelos and Burdzy (1999). We also derive a new general formula for a dimension-dependent upper bound that can be tailored to any specific class of domains. This formula is then used to compute upper bounds for the Hot Spots constant of the class of all bounded Lipschitz domains in $\mathbb{R}^d$ for both small $d$ and for asymptotically large $d$ that significantly improve upon the existing results.


title: Tighter Sparse Approximation Bounds for ReLU Neural Networks

abstract: A well-known line of work (Barron, 1993; Breiman, 1993; Klusowski & Barron, 2018) provides bounds on the width $n$ of a ReLU two-layer neural network needed to approximate a function $f$ over the ball $\mathcal{B}_R(\mathbb{R}^d)$ up to error $\epsilon$, when the Fourier based quantity $C_f = \frac{1}{(2\pi)^{d/2}} \int_{\mathbb{R}^d} \|\xi\|^2 |\hat{f}(\xi)| \ d\xi$ is finite. More recently Ongie et al. (2019) used the Radon transform as a tool for analysis of infinite-width ReLU two-layer networks. In particular, they introduce the concept of Radon-based $\mathcal{R}$-norms and show that a function defined on $\mathbb{R}^d$ can be represented as an infinite-width two-layer neural network if and only if its $\mathcal{R}$-norm is finite. In this work, we extend the framework of Ongie et al. (2019) and define similar Radon-based semi-norms ($\mathcal{R}, \mathcal{U}$-norms) such that a function admits an infinite-width neural network representation on a bounded open set $\mathcal{U} \subseteq \mathbb{R}^d$ when its $\mathcal{R}, \mathcal{U}$-norm is finite. Building on this, we derive sparse (finite-width) neural network approximation bounds that refine those of Breiman (1993); Klusowski & Barron (2018). Finally, we show that infinite-width neural network representations on bounded open sets are not unique and study their structure, providing a functional view of mode connectivity.


title: Dense Gaussian Processes for Few-Shot Segmentation

abstract: Few-shot segmentation is a challenging dense prediction task, which entails segmenting a novel query image given only a small annotated support set. The key problem is thus to design a method that aggregates detailed information from the support set, while being robust to large variations in appearance and context. To this end, we propose a few-shot segmentation method based on dense Gaussian process (GP) regression. Given the support set, our dense GP learns the mapping from local deep image features to mask values, capable of capturing complex appearance distributions. Furthermore, it provides a principled means of capturing uncertainty, which serves as another powerful cue for the final segmentation, obtained by a CNN decoder. Instead of a one-dimensional mask output, we further exploit the end-to-end learning capabilities of our approach to learn a high-dimensional output space for the GP. Our approach sets a new state-of-the-art on the PASCAL-5$^i$ and COCO-20$^i$ benchmarks, achieving an absolute gain of $+8.4$ mIoU in the COCO-20$^i$ 5-shot setting. Furthermore, the segmentation quality of our approach scales gracefully when increasing the support set size, while achieving robust cross-dataset transfer. Code and trained models are available at \url{https://github.com/joakimjohnander/dgpnet}.


title: ATISS: Autoregressive Transformers for Indoor Scene Synthesis

abstract: The ability to synthesize realistic and diverse indoor furniture layouts automatically or based on partial input, unlocks many applications, from better interactive 3D tools to data synthesis for training and simulation. In this paper, we present ATISS, a novel autoregressive transformer architecture for creating diverse and plausible synthetic indoor environments, given only the room type and its floor plan. In contrast to prior work, which poses scene synthesis as sequence generation, our model generates rooms as unordered sets of objects. We argue that this formulation is more natural, as it makes ATISS generally useful beyond fully automatic room layout synthesis. For example, the same trained model can be used in interactive applications for general scene completion, partial room re-arrangement with any objects specified by the user, as well as object suggestions for any partial room. To enable this, our model leverages the permutation equivariance of the transformer when conditioning on the partial scene, and is trained to be permutation-invariant across object orderings. Our model is trained end-to-end as an autoregressive generative model using only labeled 3D bounding boxes as supervision. Evaluations on four room types in the 3D-FRONT dataset demonstrate that our model consistently generates plausible room layouts that are more realistic than existing methods. In addition, it has fewer parameters, is simpler to implement and train and runs up to 8 times faster than existing methods.


title: Pruning a restricted Boltzmann machine for quantum state reconstruction

abstract: Restricted Boltzmann machines (RBMs) have proven to be a powerful tool for learning quantum wavefunction representations from qubit projective measurement data. Since the number of classical parameters needed to encode a quantum wavefunction scales rapidly with the number of qubits, the ability to learn efficient representations is of critical importance. In this paper we study magnitude-based pruning as a way to compress the wavefunction representation in an RBM, focusing on RBMs trained on data from the transverse-field Ising model in one dimension. We find that pruning can reduce the total number of RBM weights, but the threshold at which the reconstruction accuracy starts to degrade varies significantly depending on the phase of the model. In a gapped region of the phase diagram, the RBM admits pruning over half of the weights while still accurately reproducing relevant physical observables. At the quantum critical point however, even a small amount of pruning can lead to significant loss of accuracy in the physical properties of the reconstructed quantum state. Our results highlight the importance of tracking all relevant observables as their sensitivity varies strongly with pruning. Finally, we find that sparse RBMs are trainable and discuss how a successful sparsity pattern can be created without pruning.


title: Large Learning Rate Tames Homogeneity: Convergence and Balancing Effect

abstract: Recent empirical advances show that training deep models with large learning rate often improves generalization performance. However, theoretical justifications on the benefits of large learning rate are highly limited, due to challenges in analysis. In this paper, we consider using Gradient Descent (GD) with a large learning rate on a homogeneous matrix factorization problem, i.e., $\min_{X, Y} \|A - XY^\top\|_{\sf F}^2$. We prove a convergence theory for constant large learning rates well beyond $2/L$, where $L$ is the largest eigenvalue of Hessian at the initialization. Moreover, we rigorously establish an implicit bias of GD induced by such a large learning rate, termed 'balancing', meaning that magnitudes of $X$ and $Y$ at the limit of GD iterations will be close even if their initialization is significantly unbalanced. Numerical experiments are provided to support our theory.


title: D'Atri spaces and the total scalar curvature of hemispheres, tubes and cylinders

abstract: B. Csik\'os and M. Horv\'ath proved that if a connected Riemannian manifold of dimension at least $4$ is harmonic, then the total scalar curvatures of tubes of small radius about a regular curve depend only on the length of the curve and the radius of the tube, and conversely, if the latter condition holds for cylinders, i.e., for tubes about geodesic segments, then the manifold is harmonic. In the present paper, we show that in contrast to the higher dimensional case, a connected 3-dimensional Riemannian manifold has the above mentioned property of tubes if and only if the manifold is a D'Atri space, furthermore, if the space has bounded sectional curvature, then it is enough to require the total scalar curvature condition just for cylinders to imply that the space is D'Atri. This result gives a negative answer to a question posed by L. Gheysens and L. Vanhecke. To prove these statements, we give a characterization of D'Atri spaces in terms of the total scalar curvature of geodesic hemispheres in any dimension.


title: 3D template-based $Fermi$-LAT constraints on the diffuse supernova axion-like particle background

abstract: Axion-like particles (ALPs) may be abundantly produced in core-collapse (CC) supernovae (SNe), hence the cumulative signal from all past SN events can create a diffuse flux peaked at energies of about 25~MeV. We improve upon the modeling of the ALPs flux by including a set of CC SN models with different progenitor masses, as well as the effects of failed CC SNe -- which yield the formation of black holes instead of explosions. Relying on the coupling strength of ALPs to photons and the related Primakoff process, the diffuse SN ALP flux is converted into gamma rays while traversing the magnetic field of the Milky Way. The spatial morphology of this signal is expected to follow the shape of the Galactic magnetic field lines. We make use of this via a template-based analysis that utilizes 12 years of $Fermi$-LAT data in the energy range from 50 MeV to 500 GeV. In our benchmark case of the realization of astrophysical and cosmological parameters, we find an upper limit of $g_{a\gamma} \lesssim 3.76\times10^{-11}\;\mathrm{GeV}^{-1}$ at 95$\%$ confidence level for $m_a \ll 10^{-11}$ eV, while we find that systematic deviations from this benchmark scenario induce an uncertainty as large as about a factor of two. Our result slightly improves the CAST bound, while still being a factor of six (baseline scenario) weaker than the SN1987A gamma-ray burst limit.


title: Burst Image Restoration and Enhancement

abstract: Modern handheld devices can acquire burst image sequence in a quick succession. However, the individual acquired frames suffer from multiple degradations and are misaligned due to camera shake and object motions. The goal of Burst Image Restoration is to effectively combine complimentary cues across multiple burst frames to generate high-quality outputs. Towards this goal, we develop a novel approach by solely focusing on the effective information exchange between burst frames, such that the degradations get filtered out while the actual scene details are preserved and enhanced. Our central idea is to create a set of pseudo-burst features that combine complementary information from all the input burst frames to seamlessly exchange information. However, the pseudo-burst cannot be successfully created unless the individual burst frames are properly aligned to discount inter-frame movements. Therefore, our approach initially extracts pre-processed features from each burst frame and matches them using an edge-boosting burst alignment module. The pseudo-burst features are then created and enriched using multi-scale contextual information. Our final step is to adaptively aggregate information from the pseudo-burst features to progressively increase resolution in multiple stages while merging the pseudo-burst features. In comparison to existing works that usually follow a late fusion scheme with single-stage upsampling, our approach performs favorably, delivering state-of-the-art performance on burst superresolution, burst low-light image enhancement, and burst denoising tasks. The source code and pre-trained models are available at \url{https://github.com/akshaydudhane16/BIPNet}.


title: Neural Tangent Kernel Empowered Federated Learning

abstract: Federated learning (FL) is a privacy-preserving paradigm where multiple participants jointly solve a machine learning problem without sharing raw data. Unlike traditional distributed learning, a unique characteristic of FL is statistical heterogeneity, namely, data distributions across participants are different from each other. Meanwhile, recent advances in the interpretation of neural networks have seen a wide use of neural tangent kernels (NTKs) for convergence analyses. In this paper, we propose a novel FL paradigm empowered by the NTK framework. The paradigm addresses the challenge of statistical heterogeneity by transmitting update data that are more expressive than those of the conventional FL paradigms. Specifically, sample-wise Jacobian matrices, rather than model weights/gradients, are uploaded by participants. The server then constructs an empirical kernel matrix to update a global model without explicitly performing gradient descent. We further develop a variant with improved communication efficiency and enhanced privacy. Numerical results show that the proposed paradigm can achieve the same accuracy while reducing the number of communication rounds by an order of magnitude compared to federated averaging.


title: Learning invariance preserving moment closure model for Boltzmann-BGK equation

abstract: As one of the main governing equations in kinetic theory, the Boltzmann equation is widely utilized in aerospace, microscopic flow, etc. Its high-resolution simulation is crucial in these related areas. However, due to the high dimensionality of the Boltzmann equation, high-resolution simulations are often difficult to achieve numerically. The moment method which was first proposed by Grad is among the popular numerical methods to achieve efficient high-resolution simulations. We can derive the governing equations in the moment method by taking moments on both sides of the Boltzmann equation, which effectively reduces the dimensionality of the problem. However, one of the main challenges is that it leads to an unclosed moment system, and closure is needed to obtain a closed moment system. It is truly an art in designing closures for moment systems and has been a significant research field in kinetic theory. Other than the traditional human designs of closures, the machine learning-based approach has attracted much attention lately in Han et al. and Huang et al. In this work, we propose a machine learning-based method to derive a moment closure model for the Boltzmann-BGK equation. In particular, the closure relation is approximated by a carefully designed deep neural network that possesses desirable physical invariances, i.e., the Galilean invariance, reflecting invariance, and scaling invariance, inherited from the original Boltzmann-BGK equation and playing an important role in the correct simulation of the Boltzmann equation. Numerical simulations on the 1D-1D examples including the smooth and discontinuous initial condition problems, Sod shock tube problem, the shock structure problems, and the 1D-3D examples including the smooth and discontinuous problems demonstrate satisfactory numerical performances of the proposed invariance preserving neural closure method.


title: Transfer design between neighborhoods of planetary moons in the circular restricted three-body problem

abstract: Given the interest in future space missions devoted to the exploration of key moons in the solar system and that may involve libration point orbits, an efficient design strategy for transfers between moons is introduced that leverages the dynamics in these multi-body systems. The moon-to-moon analytical transfer (MMAT) method is introduced, comprised of a general methodology for transfer design between the vicinities of the moons in any given system within the context of the circular restricted three-body problem, useful regardless of the orbital planes in which the moons reside. A simplified model enables analytical constraints to efficiently determine the feasibility of a transfer between two different moons moving in the vicinity of a common planet. In particular, connections between the periodic orbits of such two different moons are achieved. The strategy is applicable for any type of direct transfers that satisfy the analytical constraints. Case studies are presented for the Jovian and Uranian systems. The transition of the transfers into higher-fidelity ephemeris models confirms the validity of the MMAT method as a fast tool to provide possible transfer options between two consecutive moons.