title: Superharmonic Instability of Stokes Waves

abstract: A stability of nearly limiting Stokes waves to superharmonic perturbations is considered numerically. The new, previously inaccessible branches of superharmonic instability were investigated. Our numerical simulations suggest that eigenvalues of linearized dynamical equations, corresponding to the unstable modes, appear as a result of a collision of a pair of purely imaginary eigenvalues at the origin, and a subsequent appearance of a pair of purely real eigenvalues: a positive and a negative one that are symmetric with respect to zero. Complex conjugate pairs of purely imaginary eigenvalues correspond to stable modes, and as the steepness of the underlying Stokes wave grows, the pairs move toward the origin along the imaginary axis. Moreover, when studying the eigenvalues of linearized dynamical we find that as the steepness of the Stokes wave grows, the real eigenvalues follow a universal scaling law, that can be approximated by a power law. The asymptotic power law behaviour of this dependence for instability of Stokes waves close to the limiting one is proposed. Surface elevation profiles for several unstable eigenmodes are made available through http://stokeswave.org website.


title: Cooperative Multi-Agent Trajectory Generation with Modular Bayesian Optimization

abstract: We present a modular Bayesian optimization framework that efficiently generates time-optimal trajectories for a cooperative multi-agent system, such as a team of UAVs. Existing methods for multi-agent trajectory generation often rely on overly conservative constraints to reduce the complexity of this high-dimensional planning problem, leading to suboptimal solutions. We propose a novel modular structure for the Bayesian optimization model that consists of multiple Gaussian process surrogate models that represent the dynamic feasibility and collision avoidance constraints. This modular structure alleviates the stark increase in computational cost with problem dimensionality and enables the use of minimal constraints in the joint optimization of the multi-agent trajectories. The efficiency of the algorithm is further improved by introducing a scheme for simultaneous evaluation of the Bayesian optimization acquisition function and random sampling. The modular BayesOpt algorithm was applied to optimize multi-agent trajectories through six unique environments using multi-fidelity evaluations from various data sources. It was found that the resulting trajectories are faster than those obtained from two baseline methods. The optimized trajectories were validated in real-world experiments using four quadcopters that fly within centimeters of each other at speeds up to 7.4 m/s.


title: (Machine) Learning What Policies Value

abstract: When a policy prioritizes one person over another, is it because they benefit more, or because they are preferred? This paper develops a method to uncover the values consistent with observed allocation decisions. We use machine learning methods to estimate how much each individual benefits from an intervention, and then reconcile its allocation with (i) the welfare weights assigned to different people; (ii) heterogeneous treatment effects of the intervention; and (iii) weights on different outcomes. We demonstrate this approach by analyzing Mexico's PROGRESA anti-poverty program. The analysis reveals that while the program prioritized certain subgroups -- such as indigenous households -- the fact that those groups benefited more implies that they were in fact assigned a lower welfare weight. The PROGRESA case illustrates how the method makes it possible to audit existing policies, and to design future policies that better align with values.


title: Uniqueness and non-uniqueness of the Gaussian free field evolution under the two-dimensional Wick ordered cubic wave equation

abstract: We study the nonlinear wave equation (NLW) on the two-dimensional torus $\mathbb T^2$ with Gaussian random initial data on $H^s(\mathbb T^2) \times H^{s-1}(\mathbb T^2)$, $s < 0$, distributed according to the base Gaussian free field $\mu$ associated with the invariant Gibbs measure studied by Thomann and the first author (2020). In particular, we investigate the approximation property of the corresponding solution by smooth (random) solutions. Our main results in this paper are two-fold. (i) We show that the solution map for the renormalized cubic NLW defined on the Gaussian free field $\mu$ is the unique extension of the solution map defined for smoothed Gaussian initial data obtained by mollification, independent of mollification kernels. (ii) We also show that there is a regularization of the Gaussian initial data so that the corresponding smooth solutions almost surely have no limit in the natural topology. This second result in particular states that one can not use arbitrary smooth approximation for the renormalized cubic NLW dynamics. As a preliminary step for proving (ii), we establish a (deterministic) norm inflation result at general initial data for the (unrenormalized) cubic NLW on $\mathbb T^d$ and $\mathbb R^d$ in negative Sobolev spaces, extending the norm inflation result by Christ, Colliander, and Tao (2003).


title: Error Cancellation in Diffusion Monte Carlo Calculations of Surface Chemistry

abstract: Diffusion Monte Carlo (DMC) is being recognized as a higher-accuracy, albeit more computationally expensive, alternative to Density Functional Theory (DFT) for energy predictions of catalytic systems. A major computational bottleneck in the use of DMC for catalysis is the need to perform finite-size extrapolations by simulating increasingly large periodic cells (supercells) to eliminate many-body finite-size effects and obtain energies in the thermodynamic limit. Here, we show that this computational cost can be significantly reduced by leveraging the cancellation of many-body finite-size errors that accompanies the evaluation of energy differences when calculating quantities like binding energies and mapping potential energy surfaces. We test the error cancellation and convergence in two well-known adsorbate/slab systems, H2O/LiH(001) and CO/Pt(111). Based on this, we identify strategies for obtaining binding energies in the thermodynamic limit that optimize error cancellation to balance accuracy and computational efficiency. We then predict the correct order of adsorption site preference on CO/Pt(111), a challenging problem for DFT. Our accurate, inexpensive DMC calculations recover the top > bridge > hollow site order, in agreement with experimental observations. We proceed to map the potential energy surface of CO hopping between Pt(111) adsorption sites. This reveals the existence of an L-shaped top-bridge-hollow diffusion trajectory characterized by energy barriers that provide an additional kinetic justification for experimental observations of CO/Pt(111) adsorption. Overall, this work demonstrates that it is routinely possible to achieve order-of-magnitude speedups and memory savings in DMC calculations by taking advantage of error cancellation in the calculation of energy differences that are ubiquitous in heterogeneous catalysis and surface chemistry more broadly.


title: The Phenomenon of Policy Churn

abstract: We identify and study the phenomenon of policy churn, that is, the rapid change of the greedy policy in value-based reinforcement learning. Policy churn operates at a surprisingly rapid pace, changing the greedy action in a large fraction of states within a handful of learning updates (in a typical deep RL set-up such as DQN on Atari). We characterise the phenomenon empirically, verifying that it is not limited to specific algorithm or environment properties. A number of ablations help whittle down the plausible explanations on why churn occurs to just a handful, all related to deep learning. Finally, we hypothesise that policy churn is a beneficial but overlooked form of implicit exploration that casts $\epsilon$-greedy exploration in a fresh light, namely that $\epsilon$-noise plays a much smaller role than expected.


title: Constraining CMB physical processes using Planck 2018 data

abstract: This paper aims to perform a phenomenological parametrisation of the standard cosmological model, $\Lambda$CDM, to weigh the different physical processes that define the pattern of the angular power spectra of the Cosmic Microwave Background (CMB) anisotropies. We use six phenomenological amplitudes to account for the Sachs-Wolfe, early and late Integrated Sachs-Wolfe, polarization contribution, Doppler and lensing effects. To do so, we have adapted the CLASS Boltzmann code and used the Markov Chain Monte Carlo (MCMC) sampler of Cobaya to explore the Planck 2018 likelihood to constrain different combinations of cosmological and phenomenological parameters. Observing deviations of the mean values of the phenomenological amplitudes from the predictions of the $\Lambda$CDM model could be useful to resolve existing cosmological tensions. For the first time, a comprehensive analysis of the physical processes of the CMB has been performed using the Planck 2018 temperature, polarization and lensing power spectra. In a previous work, the phenomenological amplitudes were constrained using only the TT data, however, by including the polarization and lensing data we find that the constraints on these physical contributions are tighter. In addition, some degeneracies that appear only when considering TT data are completely broken by taking into account all Planck 2018 data. Consequently, models with more than three phenomenological amplitudes can be studied, which is prohibitive when only the temperature power spectrum is used. The results presented in this paper show that the Planck experiment can constrain all phenomenological amplitudes except the late Integrated Sachs-Wolfe effect. No inconsistencies were found with the $\Lambda$CDM model, and the largest improvements were obtained for the models that include the lensing parameter, $A_L$.


title: Energetic constraints on ocean circulations of icy ocean worlds

abstract: Globally ice-covered oceans have been found on multiple moons in the solar system and may also have been a feature of Earth's past. However, relatively little is understood about the dynamics of these ice-covered oceans, which affect not only the physical environment but also any potential life and its detectability. A number of studies have simulated the circulation of icy-world oceans, but have come to seemingly widely different conclusions. To better understand and narrow down these diverging results, we discuss energetic constraints for the circulation on ice-covered oceans, focusing in particular on Snowball Earth, Europa, and Enceladus. Energy input that can drive ocean circulation on ice-covered bodies can be associated with heat and salt fluxes at the boundaries as well as ocean tides and librations. We show that heating from the solid core balanced by heat loss through the ice sheet can drive an ocean circulation, but the resulting flows would be relatively weak and strongly affected by rotation. Salt fluxes associated with freezing and melting at the ice sheet boundary are unlikely to energetically drive a circulation, although they can shape the large-scale circulation when combined with turbulent mixing. Ocean tides and librations may provide an energy source for such turbulence, but the magnitude of this energy source remains highly uncertain for the icy moons, which poses a major obstacle to predicting the ocean dynamics of icy worlds and remains as an important topic for future research.


title: Photoionization cross sections of ultracold $^{88}$Sr in $^1$P$_1$ and $^3$S$_1$ states at 390 nm and the resulting blue-detuned magic wavelength optical lattice clock constraints

abstract: We present the measurements of the photoionisation cross sections of the excited $^1$P$_1$ and $^3$S$_1$ states of ultracold $^{88}$Sr atoms at 389.889 nm wavelength, which is the magic wavelength of the $^{1}$S$_{0}$-${}^{3}$P${}_{0}$ clock transition. The photoionisation cross section of the $^1$P$_1$ state is determined from the measured ionisation rates of $^{88}$Sr in the magneto-optical trap in the $^1$P$_1$ state to be 2.20(50)$\times$10$^{-20}$ m$^2$, while the photoionisation cross section of $^{88}$Sr in the $^3$S$_1$ state is inferred from the photoionisation-induced reduction in the number of atoms transferred through the $^3\text{S}_1$ state in an operating optical lattice clock to be $1.38(66)\times$10$^{-18}$ m$^2$. Furthermore, the resulting limitations of employing a blue-detuned magic wavelength optical lattice in strontium optical lattice clocks are evaluated. We estimated photoionisation induced loss rates of atoms at 389.889 nm wavelength under typical experimental conditions and made several suggestions on how to mitigate these losses. In particular, the large photoionisation induced losses for the $^3$S$_1$ state would make the use of the $^3$S$_1$ state in the optical cycle in a blue-detuned optical lattice unfeasible and would instead require the less commonly used $^3$D$_{1,2}$ states during the detection part of the optical clock cycle.


title: Measuring Discrimination Abilities of Monk Parakeets Between Discreet and Continuous Quantities Through a Digital Life Enrichment Application

abstract: Ain et al. measured three African Grey (Psittacus erithacus) parrot's discrimination abilities between discreet and continuous quantities. Some features of their experimental protocol make it difficult to apply to other subjects and/or species without introducing a risk for some bias, as subjects could read cues from the experimenter (even though the study's subjects probably did not). Can digital life enrichment techniques permit us to replicate their results with other species with less risk for experimental bias, with a better precision, and at lower cost? Inspired by previous informal digital life enrichment experiments with parrots, we designed and tested a web application to digitally replicate and extend Ain et al.'s experimental setup. We were able to obtain similar results to theirs for two individuals from a distinct species, Monk Parakeets (Myiopsitta Monachus), with increased guarantees against potential experimental biases, in a way which should allow to replicate such experiments at larger scale and at a much lower cost.


title: Cascaded Video Generation for Videos In-the-Wild

abstract: Videos can be created by first outlining a global view of the scene and then adding local details. Inspired by this idea we propose a cascaded model for video generation which follows a coarse to fine approach. First our model generates a low resolution video, establishing the global scene structure, which is then refined by subsequent cascade levels operating at larger resolutions. We train each cascade level sequentially on partial views of the videos, which reduces the computational complexity of our model and makes it scalable to high-resolution videos with many frames. We empirically validate our approach on UCF101 and Kinetics-600, for which our model is competitive with the state-of-the-art. We further demonstrate the scaling capabilities of our model and train a three-level model on the BDD100K dataset which generates 256x256 pixels videos with 48 frames.


title: Modified Galton-Watson processes with immigration under an alternative offspring mechanism

abstract: We propose a novel class of count time series models alternative to the classic Galton-Watson process with immigration (GWI) and Bernoulli offspring. A new offspring mechanism is developed and its properties are explored. This novel mechanism, called geometric thinning operator, is used to define a class of modified GWI (MGWI) processes, which induces a certain non-linearity to the models. We show that this non-linearity can produce better results in terms of prediction when compared to the linear case commonly considered in the literature. We explore both stationary and non-stationary versions of our MGWI processes. Inference on the model parameters is addressed and the finite-sample behavior of the estimators investigated through Monte Carlo simulations. Two real data sets are analyzed to illustrate the stationary and non-stationary cases and the gain of the non-linearity induced for our method over the existing linear methods. A generalization of the geometric thinning operator and an associated MGWI process are also proposed and motivated for dealing with zero-inflated or zero-deflated count time series data.


title: Walk for Learning: A Random Walk Approach for Federated Learning from Heterogeneous Data

abstract: We consider the problem of a Parameter Server (PS) that wishes to learn a model that fits data distributed on the nodes of a graph. We focus on Federated Learning (FL) as a canonical application. One of the main challenges of FL is the communication bottleneck between the nodes and the parameter server. A popular solution in the literature is to allow each node to do several local updates on the model in each iteration before sending it back to the PS. While this mitigates the communication bottleneck, the statistical heterogeneity of the data owned by the different nodes has proven to delay convergence and bias the model. In this work, we study random walk (RW) learning algorithms for tackling the communication and data heterogeneity problems. The main idea is to leverage available direct connections among the nodes themselves, which are typically "cheaper" than the communication to the PS. In a random walk, the model is thought of as a "baton" that is passed from a node to one of its neighbors after being updated in each iteration. The challenge in designing the RW is the data heterogeneity and the uncertainty about the data distributions. Ideally, we would want to visit more often nodes that hold more informative data. We cast this problem as a sleeping multi-armed bandit (MAB) to design a near-optimal node sampling strategy that achieves variance-reduced gradient estimates and approaches sub-linearly the optimal sampling strategy. Based on this framework, we present an adaptive random walk learning algorithm. We provide theoretical guarantees on its convergence. Our numerical results validate our theoretical findings and show that our algorithm outperforms existing random walk algorithms.


title: Composition of Relational Features with an Application to Explaining Black-Box Predictors

abstract: Relational machine learning programs like those developed in Inductive Logic Programming (ILP) offer several advantages: (1) The ability to model complex relationships amongst data instances; (2) The use of domain-specific relations during model construction; and (3) The models constructed are human-readable, which is often one step closer to being human-understandable. However, these ILP-like methods have not been able to capitalise fully on the rapid hardware, software and algorithmic developments fuelling current developments in deep neural networks. In this paper, we treat relational features as functions and use the notion of generalised composition of functions to derive complex functions from simpler ones. We formulate the notion of a set of $\text{M}$-simple features in a mode language $\text{M}$ and identify two composition operators ($\rho_1$ and $\rho_2$) from which all possible complex features can be derived. We use these results to implement a form of "explainable neural network" called Compositional Relational Machines, or CRMs, which are labelled directed-acyclic graphs. The vertex-label for any vertex $j$ in the CRM contains a feature-function $f_j$ and a continuous activation function $g_j$. If $j$ is a "non-input" vertex, then $f_j$ is the composition of features associated with vertices in the direct predecessors of $j$. Our focus is on CRMs in which input vertices (those without any direct predecessors) all have $\text{M}$-simple features in their vertex-labels. We provide a randomised procedure for constructing and learning such CRMs. Using a notion of explanations based on the compositional structure of features in a CRM, we provide empirical evidence on synthetic data of the ability to identify appropriate explanations; and demonstrate the use of CRMs as 'explanation machines' for black-box models that do not provide explanations for their predictions.


title: Asymptotic Study for Stokes-Brinkman model with jump embedded transmission conditions

abstract: In this paper, one considers the coupling of a Brinkman model and Stokes equations with jump embedded transmission conditions. In this model, one assumes that the viscosity in the porous region is very small. Then we derive a Wentzel--Kramers--Brillouin (WKB) expansion in power series of the square root of this small parameter for the velocity and the pressure which are solution of the transmission problem. This WKB expansion is justified rigorously by proving uniform errors estimates.


title: Experimental Study of Forced Synchronization and Cross-coupling in a Liquid-Fuelled Gas Turbine Combustor at Elevated Pressure

abstract: The effects of external forcing on a turbulent, liquid-fuelled, swirl-stabilized gas turbine combustor operating at a pressure of approximately 1 MPa are explored experimentally. In particular, the dynamics and coupling between the hydrodynamics, heat release rate and acoustics are compared for various forcing amplitudes at a fixed forcing frequency $f_f$. The hydrodynamics were characterized via laser Mie scattering from droplets in the fuel spray, while the heat release rate was qualitatively measured using chemiluminescence (CL) emissions in the 312 $\pm$ 12.5 nm wavelength range, both at 10 kHz. The dynamics at the frequencies of interest were extracted using spectral proper orthogonal decomposition (SPOD). In the unforced case, the spray and CL oscillations exhibited similar dynamics, dominated by oscillations at frequency $f_0$, whereas the pressure fluctuations were predominantly at $f_P$. As the forcing amplitude was increased from zero, the spray and CL exhibited changes in their power spectra characteristic of the suppression route to synchronization. The pressure fluctuations, however, were observed to follow the phase-locking route to synchronization. In contrast with expectations from synchronization theory, the amplitude of the pressure fluctuations increased significantly not only after lock-on, but also as the frequency detuning with $f_f$ decreased. It is shown that this increase in amplitude is not due to intermittency in the frequency of the pressure oscillations. The simultaneous occurrence of phase-locking and suppression illustrates the rich variety of dynamics that can occur in practical combustor systems. In addition, the amplification of the pressure oscillations based on the frequency detuning with the forcing suggests that classical reasoning based on the Rayleigh Index may not be sufficient to understand the high amplitude behaviour of multimodal systems.


abstract: This paper describes the X-ray and gamma-ray imaging spectroscopy capabilities of the Ramaty High Energy Solar Spectroscopic Imager (RHESSI). It also outlines RHESSI's major scientific accomplishments during the 16 years of operations from 2002 to 2018. These include unique contributions to solar flare research and to other aspects of solar physics (oblateness), astrophysics (magnetars), and Earth sciences (terrestrial gamma-ray flashes).


title: $\beta$-nuclear-recoil correlation from $^6$He decay in a laser trap

abstract: We report the first precise measurement of a $\beta$-recoil correlation from a radioactive noble gas ($^6{\rm He}$) confined via a magneto-optical trap. The measurement is motivated by the search for exotic tensor-type contributions to the charged weak current. Interpreted as tensor currents with right-handed neutrinos, the measurements yield: $|C_T/C_A|^2\le 0.022$ (90\% C.L.). On the other hand, for left-handed neutrinos the limits are $0.007< C_T/C_A <0.111$~(90\%\ C.L.). The sensitivity of the present measurement is mainly limited by experimental uncertainties in determining the time response properties and the distance between the atom cloud and the micro-channel plate used for recoil ion detection.


title: Nest Your Adaptive Algorithm for Parameter-Agnostic Nonconvex Minimax Optimization

abstract: Adaptive algorithms like AdaGrad and AMSGrad are successful in nonconvex optimization owing to their parameter-agnostic ability -- requiring no a priori knowledge about problem-specific parameters nor tuning of learning rates. However, when it comes to nonconvex minimax optimization, direct extensions of such adaptive optimizers without proper time-scale separation may fail to work in practice. We provide such an example proving that the simple combination of Gradient Descent Ascent (GDA) with adaptive stepsizes can diverge if the primal-dual stepsize ratio is not carefully chosen; hence, a fortiori, such adaptive extensions are not parameter-agnostic. To address the issue, we formally introduce a Nested Adaptive framework, NeAda for short, that carries an inner loop for adaptively maximizing the dual variable with controllable stopping criteria and an outer loop for adaptively minimizing the primal variable. Such mechanism can be equipped with off-the-shelf adaptive optimizers and automatically balance the progress in the primal and dual variables. Theoretically, for nonconvex-strongly-concave minimax problems, we show that NeAda can achieve the near-optimal $\tilde{O}(\epsilon^{-2})$ and $\tilde{O}(\epsilon^{-4})$ gradient complexities respectively in the deterministic and stochastic settings, without prior information on the problem's smoothness and strong concavity parameters. To the best of our knowledge, this is the first algorithm that simultaneously achieves near-optimal convergence rates and parameter-agnostic adaptation in the nonconvex minimax setting. Numerically, we further illustrate the robustness of the NeAda family with experiments on simple test functions and a real-world application.


title: A Log-Linear Time Sequential Optimal Calibration Algorithm for Quantized Isotonic L2 Regression

abstract: We study the sequential calibration of estimations in a quantized isotonic L2 regression setting. We start by showing that the optimal calibrated quantized estimations can be acquired from the traditional isotonic L2 regression solution. We modify the traditional PAVA algorithm to create calibrators for both batch and sequential optimization of the quantized isotonic regression problem. Our algorithm can update the optimal quantized monotone mapping for the samples observed so far in linear space and logarithmic time per new unordered sample.


title: NPointFunctions: a calculator of amplitudes and observables in FlexibleSUSY

abstract: We present $\texttt{NPointFunctions}$, a package to incorporate desired amplitudes and observables for an arbitrary BSM model in $\texttt{FlexibleSUSY}$. The package relies on the $\texttt{SARAH}$-generated output used with $\texttt{FeynArts}/\texttt{FormCalc}$, embedded in an appropriate way, thus allowing calculations up to one-loop level. The resulting tool is an extension to $\texttt{FlexibleSUSY}$, a generator of spectrum generator programs. $\texttt{NPointFunctions}$ was designed to be customizable, modular and extensible with additional process- or amplitude- dependent contributions. We explain, how these goals are achieved, and discuss modifications to the default $\texttt{FlexibleSUSY}$ workflow.


title: Residual Multiplicative Filter Networks for Multiscale Reconstruction

abstract: Coordinate networks like Multiplicative Filter Networks (MFNs) and BACON offer some control over the frequency spectrum used to represent continuous signals such as images or 3D volumes. Yet, they are not readily applicable to problems for which coarse-to-fine estimation is required, including various inverse problems in which coarse-to-fine optimization plays a key role in avoiding poor local minima. We introduce a new coordinate network architecture and training scheme that enables coarse-to-fine optimization with fine-grained control over the frequency support of learned reconstructions. This is achieved with two key innovations. First, we incorporate skip connections so that structure at one scale is preserved when fitting finer-scale structure. Second, we propose a novel initialization scheme to provide control over the model frequency spectrum at each stage of optimization. We demonstrate how these modifications enable multiscale optimization for coarse-to-fine fitting to natural images. We then evaluate our model on synthetically generated datasets for the the problem of single-particle cryo-EM reconstruction. We learn high resolution multiscale structures, on par with the state-of-the art.


title: SolarGAN: Synthetic Annual Solar Irradiance Time Series on Urban Building Facades via Deep Generative Networks

abstract: Building Integrated Photovoltaics (BIPV) is a promising technology to decarbonize urban energy systems via harnessing solar energy available on building envelopes. While methods to assess solar irradiation, especially on rooftops, are well established, the assessment on building facades usually involves a higher effort due to more complex urban features and obstructions. The drawback of existing physics-based simulation programs is that they require significant manual modelling effort and computing time for generating time resolved deterministic results. Yet, solar irradiation is highly intermittent and representing its inherent uncertainty may be required for designing robust BIPV energy systems. Targeting on these drawbacks, this paper proposes a data-driven model based on Deep Generative Networks (DGN) to efficiently generate high-fidelity stochastic ensembles of annual hourly solar irradiance time series on building facades with uncompromised spatiotemporal resolution at the urban scale. The only input required is easily obtainable, simple fisheye images as categorical shading masks captured from 3D models. In principle, even actual photographs of urban contexts can be utilized, given they are semantically segmented. Our validations exemplify the high fidelity of the generated time series when compared to the physics-based simulator. To demonstrate the model's relevance for urban energy planning, we showcase its potential for generative design by parametrically altering characteristic features of the urban environment and producing corresponding time series on building facades under different climatic contexts in real-time.


title: Hybrid photometric redshifts for sources in the COSMOS and XMM-LSS fields

abstract: In this paper we present photometric redshifts for 2.7 million galaxies in the XMM-LSS and COSMOS fields, both with rich optical and near-infrared data from VISTA and HyperSuprimeCam. Both template fitting (using galaxy and Active Galactic Nuclei templates within LePhare) and machine learning (using GPz) methods are run on the aperture photometry of sources selected in the Ks-band. The resulting predictions are then combined using a Hierarchical Bayesian model, to produce consensus photometric redshift point estimates and probability distribution functions that outperform each method individually. Our point estimates have a root mean square error of ~0.08-0.09, and an outlier fraction of ~3-4 percent when compared to spectroscopic redshifts. We also compare our results to the COSMOS2020 photometric redshifts, which contains fewer sources, but had access to a larger number of bands and greater wavelength coverage, finding that comparable photo-z quality can be achieved (for bright and intermediate luminosity sources where a direct comparison can be made). Our resulting redshifts represent the most accurate set of photometric redshifts (for a catalogue this large) for these deep multi-square degree multi-wavelength fields to date.


title: Polarization properties of weakly magnetized Neutron Stars in Low Mass X-ray Binaries

abstract: X-ray polarimetry missions like IXPE will be able to measure for the first time the polarization properties of accreting, weakly magnetized neutron stars in Low Mass X-ray Binaries. In this work we present simulations of the expected X-ray polarized signal including the coronal emission for different geometries of the corona itself, i.e. a slab above the accretion disc and a spherical shell around the neutron star. The simulations are performed with the fully relativistic Monte Carlo code monk capable of computing the X-ray polarization degree and angle for various physical input parameters of the neutron star, disc and corona. Different coronal geometries result in significantly different X-ray polarization properties, which can therefore be used to constrain the geometry of the systems.


title: A hidden signal in Hofstadter's $H$ sequence

abstract: The Hofstadter $H$ sequence is defined by $H(1) = 1$ and $H(n) = n-H(H(H(n-1)))$ for $n > 1$. If $\alpha$ is the real root of $x^3+x=1$ we show that the numbers $\alpha H(n) \mod 1$ are not uniformly distributed on $[0,1]$, but converge to a distribution we believe is continuous but not differentiable. This is motivated by a discovery of Steinerberger, who found a real number with similar behavior for the Ulam sequence. Our result is related with the fact that a certain sequence defined from the linear recurrence $h_n=h_{n-1}+h_{n-3}$ has the property $\|x h_n\| \rightarrow 0$ precisely for $x \in \mathbb{Z}[\alpha]$, a phenomenon we inquire for general linear recurrent sequences of integers.


title: Disturbance Observer Based Frequency & Voltage Regulation for RES Integrated Uncertain Power Systems

abstract: This paper proposes a disturbance-observer-based control (DOBC) scheme for frequency and voltage regulation for a renewable energy sources (RES) integrated power systems. The proposed approach acts a feed-forward control which improves the dynamic performance of the conventional proportional-integral-derivative (PID) controller. Robustness of the proposed control scheme has been validated through simulations under worst-case and stochastic uncertainties to mitigate real-time variability in RES output and load. The performance of the proposed control technique is compared to well established technique in presence of communication delay and white noise.


title: Algorithmic Applications of Tree-Cut Width

abstract: The recently introduced graph parameter tree-cut width plays a similar role with respect to immersions as the graph parameter treewidth plays with respect to minors. In this paper, we provide the first algorithmic applications of tree-cut width to hard combinatorial problems. Tree-cut width is known to be lower-bounded by a function of treewidth, but it can be much larger and hence has the potential to facilitate the efficient solution of problems that are not known to be fixed-parameter tractable (FPT) when parameterized by treewidth. We introduce the notion of nice tree-cut decompositions and provide FPT algorithms for the showcase problems Capacitated Vertex Cover, Capacitated Dominating Set, and Imbalance parameterized by the tree-cut width of an input graph. On the other hand, we show that List Coloring, Precoloring Extension, and Boolean CSP (the latter parameterized by the tree-cut width of the incidence graph) are W[1]-hard and hence unlikely to be fixed-parameter tractable when parameterized by tree-cut width.


title: Remarks on the effects of the quintessence on regular black holes

abstract: We present the generalization of a regular black hole surrounded by quintessence, considering Bardeen-like solutions added with this fluid. We also compare our solution particularized to the Bardeen one with those found in the recent literature, showing that some of them are inconsistent since they add quintessence "by hand", neglecting also the interesting behavior of the complete solution nearby the origin. Then, we present the correct way to implement the quintessential fluid in more general four-dimensional regular black hole geometries and explore some of its consequences, such as removing the black hole regularity at the origin.


title: Deferred Norlund statistical convergence in probability, mean and distribution for sequences of random variables

abstract: We introduce and study deferred N\"{o}rlund statistical convergence in probability, mean of order $r,$ distribution, and study the interrelation among them. Based upon the proposed method to illustrate the findings, we present new Korovkin type theorems for the sequence of random variables via deferred N\"{o}rlund statistically convergence and present compelling examples to demonstrate the effectiveness of the results.


title: Bayesian sample size determination for causal discovery

abstract: Graphical models based on Directed Acyclic Graphs (DAGs) are widely used to answer causal questions across a variety of scientific and social disciplines. However, observational data alone cannot distinguish in general between DAGs representing the same conditional independence assertions (Markov equivalent DAGs); as a consequence the orientation of some edges in the graph remains indeterminate. Interventional data, produced by exogenous manipulations of variables in the network, enhance the process of structure learning because they allow to distinguish among equivalent DAGs, thus sharpening causal inference. Starting from an equivalence class of DAGs, a few procedures have been devised to produce a collection of variables to be manipulated in order to identify a causal DAG. Yet, these algorithmic approaches do not determine the sample size of the interventional data required to obtain a desired level of statistical accuracy. We tackle this problem from a Bayesian experimental design perspective, taking as input a sequence of target variables to be manipulated to identify edge orientation. We then propose a method to determine, at each intervention, the optimal sample size capable of producing a successful experiment based on a pre-experimental evaluation of the overall probability of substantial correct evidence.


title: Energy-Efficient Hybrid Offloading for Backscatter-Assisted Wirelessly Powered MEC with Reconfigurable Intelligent Surfaces

abstract: We investigate a wireless power transfer (WPT)-based backscatter-mobile edge computing (MEC) network with a {reconfigurable intelligent surface (RIS)}.In this network, wireless devices (WDs) offload task bits and harvest energy, and they can switch between backscatter communication (BC) and active transmission (AT) modes. We exploit the RIS to maximize energy efficiency (EE). To this end, we optimize the time/power allocations, local computing frequencies, execution times, backscattering coefficients, and RIS phase shifts.} This goal results in a multi-objective optimization problem (MOOP) with conflicting objectives. Thus, we simultaneously maximize system throughput and minimize energy consumption via the Tchebycheff method, transforming into two single-objective optimization problems (SOOPs). For throughput maximization, we exploit alternating optimization (AO) to yield two sub-problems. For the first one, we derive closed-form resource allocations. For the second one, we design the RIS phase shifts via semi-definite relaxation, a difference of convex functions programming, majorization minimization techniques, and a penalty function for enforcing a rank-one solution. For energy minimization, we derive closed-form resource allocations. We demonstrate the gains over several benchmarks. For instance, with a $20$-element RIS, EE can be as high as 3 (Mbits/Joule), a 150\% improvement over the no-RIS case (achieving only 2 (Mbits/Joule)).


title: A technical note for a Shor's algorithm by phase estimation

abstract: The objective of this paper concerns at first the motivation and the method of Shor's algorithm including an excursion into quantum mechanics and quantum computing introducing an algorithmic description of the method. The corner stone of the Shor's algorithm is the modular exponentiation that is the most computational component (in time and space). Second, a linear depth unit based on phase estimation is introduced and a description of a generic version of a modular multiplier based on phases is introduced to build block of a modular exponentiation circuit. Our proposal includes numerical experiments achieved on both the IBM simulator using the Qiskit library and on quantum physical optimizers provided by IBM.


title: Compact Groups in GDM Cosmological Simulations

abstract: In this work, we study some properties of the Hickson Compact Groups (HCGs) using N-body simulations for the Generalized Dark Matter (GDM) model, described by three free functions, the sound speed, the viscosity and the equation of state. We consider three GDM models associated with different values of the free functions to neglect collisional effects. We constructed the initial seeds of our simulations according to the matter power spectrum of GDM linear perturbations, which hold a cut-off at small scales, and explored their effects on the non-linear structure formation at small and intermediate scales. We generated mock catalogues of galaxies for different models and classify HCGs by implementing an algorithm that adapts the original selection method for mock catalogues. Once the HCGs samples are classified, we analyzed their properties and compared them between models. We found that a larger amount of HCGs are counted in GDM simulations in comparison to CDM counts. This difference suggests that HCGs can proliferate within GDM despite the suppressed substructure, which indicates a possible modification in the HCG formation process within models where DM is not perfectly like CDM. Additionally, we identified different mechanisms of clustering, for models with a large amount of galaxy-halos self-agglomerate because of their abundance while models with fewer galaxy-halos need massive halos acting as a dominant potential well. Finally, by comparing distributions of different observables of simulated HCGs against observations, we found a good agreement in the intrinsic properties. However, a discrepancy in the velocity dispersion remains unsolved.


title: Interpretability Guarantees with Merlin-Arthur Classifiers

abstract: We propose an interactive multi-agent classifier that provides provable interpretability guarantees even for complex agents such as neural networks. These guarantees consist of lower bounds on the mutual information between selected features and the classification decision. Our results are inspired by the Merlin-Arthur protocol from Interactive Proof Systems and express these bounds in terms of measurable metrics such as soundness and completeness. Compared to existing interactive setups, we rely neither on optimal agents nor on the assumption that features are distributed independently. Instead, we use the relative strength of the agents as well as the new concept of Asymmetric Feature Correlation which captures the precise kind of correlations that make interpretability guarantees difficult. We evaluate our results on two small-scale datasets where high mutual information can be verified explicitly.


title: Xavier-Enabled Extreme Reservoir Machine for Millimeter-Wave Beamspace Channel Tracking

abstract: In this paper, we propose an accurate two-phase millimeter-Wave (mmWave) beamspace channel tracking mechanism. Particularly in the first phase, we train an extreme reservoir machine (ERM) for tracking the historical features of the mmWave beamspace channel and predicting them in upcoming time steps. Towards a more accurate prediction, we further fine-tune the ERM by means of Xavier initializer technique, whereby the input weights in ERM are initially derived from a zero mean and finite variance Gaussian distribution, leading to 49% degradation in prediction variance of the conventional ERM. The proposed method numerically improves the achievable spectral efficiency (SE) of the existing counterparts, by 13%, when signal-to-noise-ratio (SNR) is 15dB. We further investigate an ensemble learning technique in the second phase by sequentially incorporating multiple ERMs to form an ensembled model, namely adaptive boosting (AdaBoost), which further reduces the prediction variance in conventional ERM by 56%, and concludes in 21% enhancement of achievable SE upon the existing schemes at SNR=15dB.


title: On Reinforcement Learning and Distribution Matching for Fine-Tuning Language Models with no Catastrophic Forgetting

abstract: The availability of large pre-trained models is changing the landscape of Machine Learning research and practice, moving from a training-from-scratch to a fine-tuning paradigm. While in some applications the goal is to "nudge" the pre-trained distribution towards preferred outputs, in others it is to steer it towards a different distribution over the sample space. Two main paradigms have emerged to tackle this challenge: Reward Maximization (RM) and, more recently, Distribution Matching (DM). RM applies standard Reinforcement Learning (RL) techniques, such as Policy Gradients, to gradually increase the reward signal. DM prescribes to first make explicit the target distribution that the model is fine-tuned to approximate. Here we explore the theoretical connections between the two paradigms, and show that methods such as KL-control developed for RM can also be construed as belonging to DM. We further observe that while DM differs from RM, it can suffer from similar training difficulties, such as high gradient variance. We leverage connections between the two paradigms to import the concept of baseline into DM methods. We empirically validate the benefits of adding a baseline on an array of controllable language generation tasks such as constraining topic, sentiment, and gender distributions in texts sampled from a language model. We observe superior performance in terms of constraint satisfaction, stability and sample efficiency.


title: On Some Properties of the Beta Normal Distribution

abstract: The beta normal distribution is a generalization of both the normal distribution and the normal order statistics. Some of its mathematical properties and a few applications have been studied in the literature. We provide a better foundation for some properties and an analytical study of its bimodality. The hazard rate function and the limiting behavior are examined. We derive explicit expressions for moments, generating function, mean deviations using a power series expansion for the quantile function, and Shannon entropy.


title: The McDonald Normal Distribution

abstract: A five-parameter distribution called the McDonald normal distribution is defined and studied. The new distribution contains, as special cases, several important distributions discussed in the literature, such as the normal, skew-normal, exponentiated normal, beta normal and Kumaraswamy normal distributions, among others. We obtain its ordinary moments, moment generating function and mean deviations. We also derive the ordinary moments of the order statistics. We use the method of maximum likelihood to fit the new distribution and illustrate its potentiality with three applications to real data.


title: Stretch formulations and the Poynting effect in nonlinear elasticity

abstract: The second invariant of the left Cauchy-Green deformation tensor $\mathbf{B}$ (or right $\mathbf{C}$) has been argued to play a fundamental role in nonlinear elasticity. Generalized neo-Hookean materials, which depend only on the first invariant, lead to universal relations that conflict with experimental data, fail to display important mechanical behaviors (such as the Poynting effect in simple shear), and may not provide a satisfactory link with the mesoscale. However, the second invariant term is not a higher order strain contribution to the energy, which lead us to reflect on what is incomplete about neo-Hookean materials. Instead of the usual Cauchy-Green elastic formulation, we investigate this matter from the perspective of left stretch $\mathbf{V}= \sqrt{\mathbf{B}}$ and Bell strain $\mathbf{E}_{\text{Bell}} = \mathbf{V}-\mathbf{I}$ formulations. Invariants of these tensors offer a different interpretation than those of $\mathbf{B}$ and are linked to different classes of materials. The main example we adopt is a general isotropic energy quadratic in Bell strains, the quadratic-Biot material. Despite being quadratic in stretch like neo-Hookean, this material presents both the classic and reverse Poynting effect in simple shear, whose direction switches as a function of the constant conjugate to the second invariant of $\mathbf{E}_{\text{Bell}}$. Its second normal stress also presents a local maximum as a function of the amount of shear, a transition that is not observed in a Mooney-Rivlin solid. Moreover, even the Varga model, linear in Bell strains, presents Poynting in simple shear, which poses the question of why this is not true for a model linear in Green-Lagrange strains. Pure torsion of a solid cylinder is also discussed, particularly how the behavior of the resultant axial force contrasts between the different formulations.


title: Positional uncertainty and quality assurance of digital elevation change detection (DECD)

abstract: Studies on rapid change detection of large area urgently need to be extended from 2D image to digital elevation model (DEM) due to the challenge of changes caused by disasters. This research investigates positional uncertainty of digital elevation change detection (DECD) caused by different degrees of DEM complexity and DEM misregistration. Unfortunately, using three-sigma rule (3{\sigma}R) for DECD is disturbed by accuracy of parameter estimation, which is affected by the outliers (i.e., varied DEM) from DEM differencing samples. Hence, to reduce the aforementioned uncertainty of DECD, we propose a new strategy of quality assurance, adaptively censored three-sigma rule (AC3{\sigma}R), in which with the samples censored, outliers of global DEM differencing samples outside the standard deviations of the mean calculated by moment estimation are iteratively removed. Compared with the 3{\sigma}R and censored three-sigma rule (C3{\sigma}R) that is similar to AC3{\sigma}R but without iteration for both simulation and real-world data experiments, the proposed global AC3{\sigma}R method always exhibits the highest accuracies of DECD in terms of both the overall accuracies 0.99967, 0.98740 and kappa coefficients 0.99598, 0.81803 respectively, and the strongest robustness with a large convergence interval [0, 0.30010] under the simulated maximum registration error and most complex terrain complexity conditions.


title: Simulating the 1976 Teton Dam Failure using Geoclaw and HEC-RAS and comparing with Historical Observations

abstract: Dam failures occur worldwide, often from factors including aging structures, extreme hydrologic loading, and design oversights related to the changing climate. Understanding and mitigating risk to downstream inhabited areas require developing and improving low-cost high-fidelity tools, such as numerical models, which allow emergency managers to predict the consequences of dam failures better. Two-dimensional (2D) depth-averaged hydraulic models can provide valuable insights into the importance of breach parameters or downstream flow characteristics, but historical studies considering historic failures using real topographies are less common in literature. This study compares Geoclaw, a 2D hydraulic model with adaptive mesh refinement capabilities, to an industry-standard software HEC-RAS (Hydrologic Engineering Center - River Analysis System) using the 1976 Teton Dam failure as a case study. The suitability of Geoclaw for dam failure modeling is determined based on its capability to resolve inundation extent and flood wave arrival times. This study performs sensitivity analyses of the HEC-RAS model to compare an instantaneous dam breach assumption with a time-dependent breach formation for quantifying the model uncertainty. We find the 2D Geoclaw dam-break model results compare reasonably with historical gauge and field observational data and HEC-RAS results. The model demonstrates stability and relatively low computational costs. Our findings highlight opportunities for future work, with the Geoclaw software performance supporting continued studies to evaluate performance. Outcomes of this study will assist dam owners, floodplain managers, and emergency managers by providing an additional tool for estimating the impacts of dam failures to protect lives and infrastructure downstream.


title: Different Bootstrap Matrices in Many QM Systems

abstract: The bootstrap is a technique recently developed to get energy eigenvalues of bound states and correlation functions. There are three crucial steps - recursive equations, positivity constraints, search space. We calculate recursive equations of many representative quantum mechanics systems, such as polynomial potential, exponential potential, Yukawa potential and electromagnetic potential. Two kinds of bootstrap matrices, which are about the coordinate and coupling of the coordinate with the momentum, and their ability of constraining equations are displayed. Nextly, we analyze possible questions in numerical search, including the importance of constraints and step length, eigen-energy level and the degeneracy of energy. Finally, we try to explain why the bootstrap work well by analyzing positivity constraints of creation operator and annihilation operator in harmonic oscillator. This article summarizes most knowledge of bootstrapping quantum mechanics (QM), and displays specific bootstrap equations and bootstrap matrices of different QM systems.


title: Unruh quantum Otto engine in the presence of a reflecting boundary

abstract: We introduce a new model of relativistic quantum analogue of the classical Otto engine in the presence of a perfectly reflecting boundary. A single qubit acts as the working substance interacting with a massless quantum scalar field, with the boundary obeying the Dirichlet condition. The quantum vacuum serves as a thermal bath through the Unruh effect. We observe that the response function of the qubit gets significantly modified by the presence of the reflecting boundary. From the structure of the correlation function, we find that three different cases emerge, namely, the intermediate boundary regime, the near boundary regime, and the far boundary regime. As expected, the correlation in the far boundary regime approaches that of the Unruh quantum Otto engine (UQOE) when the reflecting boundary goes to infinity. The effect of the reflecting boundary is manifested through the reduction of the critical excitation probability of the qubit and the work output of the engine. In spite of the reduced work output, the efficiency of the engine remains unaltered even in the presence of the boundary.


title: Defense Against Gradient Leakage Attacks via Learning to Obscure Data

abstract: Federated learning is considered as an effective privacy-preserving learning mechanism that separates the client's data and model training process. However, federated learning is still under the risk of privacy leakage because of the existence of attackers who deliberately conduct gradient leakage attacks to reconstruct the client data. Recently, popular strategies such as gradient perturbation methods and input encryption methods have been proposed to defend against gradient leakage attacks. Nevertheless, these defenses can either greatly sacrifice the model performance, or be evaded by more advanced attacks. In this paper, we propose a new defense method to protect the privacy of clients' data by learning to obscure data. Our defense method can generate synthetic samples that are totally distinct from the original samples, but they can also maximally preserve their predictive features and guarantee the model performance. Furthermore, our defense strategy makes the gradient leakage attack and its variants extremely difficult to reconstruct the client data. Through extensive experiments, we show that our proposed defense method obtains better privacy protection while preserving high accuracy compared with state-of-the-art methods.


title: Winning the 3rd Japan Automotive AI Challenge -- Autonomous Racing with the Autoware.Auto Open Source Software Stack

abstract: The 3rd Japan Automotive AI Challenge was an international online autonomous racing challenge where 164 teams competed in December 2021. This paper outlines the winning strategy to this competition, and the advantages and challenges of using the Autoware.Auto open source autonomous driving platform for multi-agent racing. Our winning approach includes a lane-switching opponent overtaking strategy, a global raceline optimization, and the integration of various tools from Autoware.Auto including a Model-Predictive Controller. We describe the use of perception, planning and control modules for high-speed racing applications and provide experience-based insights on working with Autoware.Auto. While our approach is a rule-based strategy that is suitable for non-interactive opponents, it provides a good reference and benchmark for learning-enabled approaches.


title: Dynamic Linear Transformer for 3D Biomedical Image Segmentation

abstract: Transformer-based neural networks have surpassed promising performance on many biomedical image segmentation tasks due to a better global information modeling from the self-attention mechanism. However, most methods are still designed for 2D medical images while ignoring the essential 3D volume information. The main challenge for 3D transformer-based segmentation methods is the quadratic complexity introduced by the self-attention mechanism \cite{vaswani2017attention}. In this paper, we propose a novel transformer architecture for 3D medical image segmentation using an encoder-decoder style architecture with linear complexity. Furthermore, we newly introduce a dynamic token concept to further reduce the token numbers for self-attention calculation. Taking advantage of the global information modeling, we provide uncertainty maps from different hierarchy stages. We evaluate this method on multiple challenging CT pancreas segmentation datasets. Our promising results show that our novel 3D Transformer-based segmentor could provide promising highly feasible segmentation performance and accurate uncertainty quantification using single annotation. Code is available https://github.com/freshman97/LinTransUNet.


title: On the reversibility of adversarial attacks

abstract: Adversarial attacks modify images with perturbations that change the prediction of classifiers. These modified images, known as adversarial examples, expose the vulnerabilities of deep neural network classifiers. In this paper, we investigate the predictability of the mapping between the classes predicted for original images and for their corresponding adversarial examples. This predictability relates to the possibility of retrieving the original predictions and hence reversing the induced misclassification. We refer to this property as the reversibility of an adversarial attack, and quantify reversibility as the accuracy in retrieving the original class or the true class of an adversarial example. We present an approach that reverses the effect of an adversarial attack on a classifier using a prior set of classification results. We analyse the reversibility of state-of-the-art adversarial attacks on benchmark classifiers and discuss the factors that affect the reversibility.


title: Assessing the trade-off between prediction accuracy and interpretability for topic modeling on energetic materials corpora

abstract: As the amount and variety of energetics research increases, machine aware topic identification is necessary to streamline future research pipelines. The makeup of an automatic topic identification process consists of creating document representations and performing classification. However, the implementation of these processes on energetics research imposes new challenges. Energetics datasets contain many scientific terms that are necessary to understand the context of a document but may require more complex document representations. Secondly, the predictions from classification must be understandable and trusted by the chemists within the pipeline. In this work, we study the trade-off between prediction accuracy and interpretability by implementing three document embedding methods that vary in computational complexity. With our accuracy results, we also introduce local interpretability model-agnostic explanations (LIME) of each prediction to provide a localized understanding of each prediction and to validate classifier decisions with our team of energetics experts. This study was carried out on a novel labeled energetics dataset created and validated by our team of energetics experts.


title: Distributed Training for Deep Learning Models On An Edge Computing Network Using ShieldedReinforcement Learning

abstract: Edge devices with local computation capability has made distributed deep learning training on edges possible. In such method, the cluster head of a cluster of edges schedules DL training jobs from the edges. Using such centralized scheduling method, the cluster head knows all loads of edges, which can avoid overloading the cluster edges, but the head itself may become overloaded. To handle this problem, we propose a multi-agent RL (MARL) system that enables each edge to schedule its jobs using RL. However, without coordination among edges, action collision may occur, in which multiple edges schedule tasks to the same edge and make it overloaded. For this reason, we propose a system called Shielded ReinfOrcement learning (RL) based DL training on Edges (SROLE). In SROLE, the shield deployed in an edge checks action collisions and provides alternative actions to avoid collisions. As the central shield for entire cluster may become a bottleneck, we further propose a decentralized shielding method, where different shields are responsible for different regions in the cluster and they coordinate to avoid action collisions on the region boundaries. Our emulation and real device experiments show SROLE reduces training time by 59% compared to MARL and centralized RL.


title: Adaptive Local Neighborhood-based Neural Networks for MR Image Reconstruction from Undersampled Data

abstract: Recent medical image reconstruction techniques focus on generating high-quality medical images suitable for clinical use at the lowest possible cost and with the fewest possible adverse effects on patients. Recent works have shown significant promise for reconstructing MR images from sparsely sampled k-space data using deep learning. In this work, we propose a technique that rapidly estimates deep neural networks directly at reconstruction time by fitting them on small adaptively estimated neighborhoods of a training set. In brief, our algorithm alternates between searching for neighbors in a data set that are similar to the test reconstruction, and training a local network on these neighbors followed by updating the test reconstruction. Because our reconstruction model is learned on a dataset that is in some sense similar to the image being reconstructed rather than being fit on a large, diverse training set, it is more adaptive to new scans. It can also handle changes in training sets and flexible scan settings, while being relatively fast. Our approach, dubbed LONDN-MRI, was validated on multiple data sets using deep unrolled reconstruction networks. Reconstructions were performed at four fold and eight fold undersampling of k-space with 1D variable-density random phase-encode undersampling masks. Our results demonstrate that our proposed locally-trained method produces higher-quality reconstructions compared to models trained globally on larger datasets as well as other scan-adaptive methods.


title: Robots in healthcare as envisioned by care professionals

abstract: As AI-enabled robots enter the realm of healthcare and caregiving, it is important to consider how they will address the dimensions of care and how they will interact not just with the direct receivers of assistance, but also with those who provide it (e.g., caregivers, healthcare providers etc.). Caregiving in its best form addresses challenges in a multitude of dimensions of a person's life: from physical, to social-emotional and sometimes even existential dimensions (such as issues surrounding life and death). In this study we use semi-structured qualitative interviews administered to healthcare professions with multidisciplinary backgrounds (physicians, public health professionals, social workers, and chaplains) to understand their expectations regarding the possible roles robots may play in the healthcare ecosystem in the future. We found that participants drew inspiration in their mental models of robots from both works of science fiction but also from existing commercial robots. Participants envisioned roles for robots in the full spectrum of care, from physical to social-emotional and even existential-spiritual dimensions, but also pointed out numerous limitations that robots have in being able to provide comprehensive humanistic care. While no dimension of care was deemed as exclusively the realm of humans, participants stressed the importance of caregiving humans as the primary providers of comprehensive care, with robots assisting with more narrowly focused tasks. Throughout the paper we point out the encouraging confluence of ideas between the expectations of healthcare providers and research trends in the human-robot interaction (HRI) literature.


title: Visual Navigation for Autonomous Vehicles: An Open-source Hands-on Robotics Course at MIT

abstract: This paper reports on the development, execution, and open-sourcing of a new robotics course at MIT. The course is a modern take on "Visual Navigation for Autonomous Vehicles" (VNAV) and targets first-year graduate students and senior undergraduates with prior exposure to robotics. VNAV has the goal of preparing the students to perform research in robotics and vision-based navigation, with emphasis on drones and self-driving cars. The course spans the entire autonomous navigation pipeline; as such, it covers a broad set of topics, including geometric control and trajectory optimization, 2D and 3D computer vision, visual and visual-inertial odometry, place recognition, simultaneous localization and mapping, and geometric deep learning for perception. VNAV has three key features. First, it bridges traditional computer vision and robotics courses by exposing the challenges that are specific to embodied intelligence, e.g., limited computation and need for just-in-time and robust perception to close the loop over control and decision making. Second, it strikes a balance between depth and breadth by combining rigorous technical notes (including topics that are less explored in typical robotics courses, e.g., on-manifold optimization) with slides and videos showcasing the latest research results. Third, it provides a compelling approach to hands-on robotics education by leveraging a physical drone platform (mostly suitable for small residential courses) and a photo-realistic Unity-based simulator (open-source and scalable to large online courses). VNAV has been offered at MIT in the Falls of 2018-2021 and is now publicly available on MIT OpenCourseWare (OCW).


title: Efficient and Self-Recursive Delay Vandermonde Algorithm for Multi-Beam Antenna Arrays

abstract: This paper presents a self-contained factorization for the delay Vandermonde matrix (DVM), which is the super class of the discrete Fourier transform, using sparse and companion matrices. An efficient DVM algorithm is proposed to reduce the complexity of radio-frequency (RF) $N$-beam analog beamforming systems. There exist applications for wideband multi-beam beamformers in wireless communication networks such as 5G/6G systems, system capacity can be improved by exploiting the improvement of the signal to noise ratio (SNR) using coherent summation of propagating waves based on their directions of propagation. The presence of a multitude of RF beams allows multiple independent wireless links to be established at high SNR, or used in conjunction with multiple-input multiple-output (MIMO) wireless systems, with the overall goal of improving system SNR and therefore capacity. To realize such multi-beam beamformers at acceptable analog circuit complexities, we use sparse factorization of the DVM in order to derive a low arithmetic complexity DVM algorithm. The paper also establishes an error bound and stability analysis of the proposed DVM algorithm. The proposed efficient DVM algorithm is aimed at implementation using analog realizations. For purposes of evaluation, the algorithm can be realized using both digital hardware as well as software defined radio platforms.


title: Radix-2 Self-Recursive Sparse Factorizations of Delay Vandermonde Matrices for Wideband Multi-Beam Antenna Arrays

abstract: This paper presents a self-contained factorization for the Vandermonde matrices associated with true-time delay based wideband analog multi-beam beamforming using antenna arrays. The proposed factorization contains sparse and orthogonal matrices. Novel self-recursive radix-2 algorithms for Vandermonde matrices associated with true time delay based delay-sum filterbanks are presented to reduce the circuit complexity of multi-beam analog beamforming systems. The proposed algorithms for Vandermonde matrices by a vector attain $\mathcal{O}(N \log N)$ delay-amplifier circuit counts. Error bounds for the Vandermode matrices associated with true-time delay are established and then analyzed for numerical stability. The potential for real-world circuit implementation of the proposed algorithms will be shown through signal flow graphs that are the starting point for high-frequency analog circuit realizations.


title: The BRST Double Complex for the Coupling of Gravity to Gauge Theories

abstract: We consider (effective) Quantum General Relativity coupled to the Standard Model (QGR-SM) and study the corresponding BRST double complex. This double complex is generated by infinitesimal diffeomorphisms and infinitesimal gauge transformations. To this end, we define the respective BRST differentials $P$ and $Q$ and their corresponding anti-BRST differentials $\overline{P}$ and $\overline{Q}$. Then we show that all differentials mutually anticommute, which allows us to introduce the total BRST differential $D := P + Q$ and the total anti-BRST differential $\overline{D} := \overline{P} + \overline{Q}$. Furthermore, we characterize all non-constant Lagrange densities that are essentially closed with respect to the diffeomorphism differentials $P$ and $\overline{P}$ as scalar tensor densities of weight $w = 1$. As a consequence thereof, we obtain that graviton-ghosts decouple from matter if the Yang--Mills theory gauge fixing and ghost Lagrange densities are tensor densities of weight $w = 1$. In particular, we show that every such Lagrange density can be modified uniquely to satisfy said condition. Finally, we introduce a total gauge fixing fermion $\Upsilon$ and show that we can generate the complete gauge fixing and ghost Lagrange densities of QGR-SM via $D \Upsilon$.


title: Near-Optimal Search Time in $\delta$-Optimal Space, and Vice Versa

abstract: Two recent lower bounds on the compressibility of repetitive sequences, $\delta \le \gamma$, have received much attention. It has been shown that a length-$n$ string $S$ over an alphabet of size $\sigma$ can be represented within the optimal $O(\delta\log\tfrac{n\log \sigma}{\delta \log n})$ space, and further, that within that space one can find all the $occ$ occurrences in $S$ of any length-$m$ pattern in time $O(m\log n + occ \log^\epsilon n)$ for any constant $\epsilon>0$. Instead, the near-optimal search time $O(m+({occ+1})\log^\epsilon n)$ has been achieved only within $O(\gamma\log\frac{n}{\gamma})$ space. Both results are based on considerably different locally consistent parsing techniques. The question of whether the better search time could be supported within the $\delta$-optimal space remained open. In this paper, we prove that both techniques can indeed be combined to obtain the best of both worlds: $O(m+({occ+1})\log^\epsilon n)$ search time within $O(\delta\log\tfrac{n\log \sigma}{\delta \log n})$ space. Moreover, the number of occurrences can be computed in $O(m+\log^{2+\epsilon}n)$ time within $O(\delta\log\tfrac{n\log \sigma}{\delta \log n})$ space. We also show that an extra sublogarithmic factor on top of this space enables optimal $O(m+occ)$ search time, whereas an extra logarithmic factor enables optimal $O(m)$ counting time.


title: ALMA imaging of the cold molecular and dusty disk in the type 2 active nucleus of the Circinus galaxy

abstract: We aim to shed light on the physical properties and kinematics of the molecular material in the nucleus of one of the closest type 2 active galaxies. To this end, we obtained high angular resolution ALMA observations of the nucleus of the Circinus galaxy. The observations map the emission at 350GHz and 690GHz with spatial resolutions of ~3.8pc and ~2.2pc, respectively. The continuum emission traces cold ($T\lesssim100$K) dust in a circumnuclear disk with spiral arms on scales of 25pc, plus a marginally resolved nuclear emission peak. The latter is not extended in polar direction as claimed based on earlier ALMA observations. A significant amount (of the order of 40%) of the 350GHz emission is not related to dust, but most likely free-free emission instead. We detect CO(3-2) and CO(6-5) as well as HCO$^+$(4-3), HCN(4-3), and CS(4-3). The CO emission is extended, showing a spiral pattern, similar to the extended dust emission. Towards the nucleus, CO is excited to higher transitions and its emission is self-absorbed, leading to an apparent hole in the CO(3-2) but not the CO(6-5) emission. On the other hand, the high gas density tracers HCO$^+$, HCN, and CS show a strong, yet unresolved (($\lesssim4$pc) concentration of the emission at the nucleus, pointing at a very small 'torus'. The kinematics are dominated by rotation and point at a geometrically thin disk down to the resolution limit of our observations. In contrast to several other AGNs, no HCN enhancement is found towards the nucleus. The Circinus nucleus is therefore composed of at least two distinct components: (1) an optically thin, warm outflow of ionised gas containing clouds of dust; and (2) a cold molecular and dusty disk. These findings support the most recent radiative transfer calculations of the obscuring structures in AGNs, which find a similar two-component structure. (Abridged)


title: Core-periphery Models for Hypergraphs

abstract: We introduce a random hypergraph model for core-periphery structure. By leveraging our model's sufficient statistics, we develop a novel statistical inference algorithm that is able to scale to large hypergraphs with runtime that is practically linear wrt. the number of nodes in the graph after a preprocessing step that is almost linear in the number of hyperedges, as well as a scalable sampling algorithm. Our inference algorithm is capable of learning embeddings that correspond to the reputation (rank) of a node within the hypergraph. We also give theoretical bounds on the size of the core of hypergraphs generated by our model. We experiment with hypergraph data that range to $\sim 10^5$ hyperedges mined from the Microsoft Academic Graph, Stack Exchange, and GitHub and show that our model outperforms baselines wrt. producing good fits.


title: Substrate Effects on Spin Relaxation in Two-Dimensional Dirac Materials with Strong Spin-Orbit Coupling

abstract: Understanding substrate effects on spin dynamics and relaxation in two-dimensional (2D) materials is of key importance for spintronics and quantum information applications. However, the key factors that determine the substrate effect on spin relaxation, in particular for materials with strong spin-orbit coupling, have not been well understood. Here we performed first-principles real-time density-matrix dynamics simulations with spin-orbit coupling (SOC) and quantum descriptions of electron-phonon and electron-impurity scattering for the spin lifetimes of supported/free-standing germanene, a prototypical strong SOC 2D Dirac material. We show that the effects of different substrates on spin lifetime can surprisingly differ by two orders of magnitude. We find that substrate effects on $\tau_s$ are closely related to substrate-induced modifications of the SOC-field anisotropy, which changes the spin-flip scattering matrix elements. We propose a new electronic quantity, named spin-flip angle $\theta^{\uparrow\downarrow}$, to characterize spin relaxation caused by intervalley spin-flip scattering. We find that the spin relaxation rate is approximately proportional to the averaged value of $\mathrm{sin}^{2}\left(\theta^{\uparrow\downarrow}/2\right)$, which can be used as a guiding parameter of controlling spin relaxation.


title: Delivering Document Conversion as a Cloud Service with High Throughput and Responsiveness

abstract: Document understanding is a key business process in the data-driven economy since documents are central to knowledge discovery and business insights. Converting documents into a machine-processable format is a particular challenge here due to their huge variability in formats and complex structure. Accordingly, many algorithms and machine-learning methods emerged to solve particular tasks such as Optical Character Recognition (OCR), layout analysis, table-structure recovery, figure understanding, etc. We observe the adoption of such methods in document understanding solutions offered by all major cloud providers. Yet, publications outlining how such services are designed and optimized to scale in the cloud are scarce. In this paper, we focus on the case of document conversion to illustrate the particular challenges of scaling a complex data processing pipeline with a strong reliance on machine-learning methods on cloud infrastructure. Our key objective is to achieve high scalability and responsiveness for different workload profiles in a well-defined resource budget. We outline the requirements, design, and implementation choices of our document conversion service and reflect on the challenges we faced. Evidence for the scaling behavior and resource efficiency is provided for two alternative workload distribution strategies and deployment configurations. Our best-performing method achieves sustained throughput of over one million PDF pages per hour on 3072 CPU cores across 192 nodes.


title: Neural Decoding with Optimization of Node Activations

abstract: The problem of maximum likelihood decoding with a neural decoder for error-correcting code is considered. It is shown that the neural decoder can be improved with two novel loss terms on the node's activations. The first loss term imposes a sparse constraint on the node's activations. Whereas, the second loss term tried to mimic the node's activations from a teacher decoder which has better performance. The proposed method has the same run time complexity and model size as the neural Belief Propagation decoder, while improving the decoding performance by up to $1.1dB$ on BCH codes.


title: On the Generalization of Neural Combinatorial Optimization Heuristics

abstract: Neural Combinatorial Optimization approaches have recently leveraged the expressiveness and flexibility of deep neural networks to learn efficient heuristics for hard Combinatorial Optimization (CO) problems. However, most of the current methods lack generalization: for a given CO problem, heuristics which are trained on instances with certain characteristics underperform when tested on instances with different characteristics. While some previous works have focused on varying the training instances properties, we postulate that a one-size-fit-all model is out of reach. Instead, we formalize solving a CO problem over a given instance distribution as a separate learning task and investigate meta-learning techniques to learn a model on a variety of tasks, in order to optimize its capacity to adapt to new tasks. Through extensive experiments, on two CO problems, using both synthetic and realistic instances, we show that our proposed meta-learning approach significantly improves the generalization of two state-of-the-art models.


title: Information-based matching explains the diversity of cooperation among different populations

abstract: This paper introduces a bilateral matching mechanism to explain why different populations have different levels of cooperation. The traditional game theory assumes that individuals can acquire their neighbor's information without cost after generating information. In fact, the environment and cognition of populations often limit the magnitude of information received by individuals. Our model divides information dynamics into two processes: generation and dissemination. After generating, information starts to disseminate in the population. Individuals match and interact with each other based on the information received and then confirm partnerships, which differs from traditional research's unilateral partner selection process. Specifically, we find a function to simulate two constraints of information acquisition in different populations: information dissemination cost and cognition competence. These two kinds of constraints affect the choice of partnership and then the evolution of cooperation. The game evolved under the condition of information constraints. Through large-scale Monte Carlo simulations, we find that information dissemination and cognition underlie the evolution of cooperation. The lower cost of information dissemination and the more valid cognition of information, the higher level of cooperation. Moreover, deviations in cognition among individuals more sensitively determine the equilibrium cooperation density. As the deviations increase, cooperation density decreases significantly. This paper provides a new explanation for the diversity of cooperation among populations with different information dissemination costs and cognition competence.


title: Unikernel Linux (UKL)

abstract: This paper presents Unikernel Linux (UKL), a path toward integrating unikernel optimization techniques in Linux, a general purpose operating system. UKL adds a configuration option to Linux allowing for a single, optimized process to link with the kernel directly, and run at supervisor privilege. This UKL process does not require application source code modification, only a re-link with our, slightly modified, Linux kernel and glibc. Unmodified applications show modest performance gains out of the box, and developers can further optimize applications for more significant gains (e.g. 26% throughput improvement for Redis). UKL retains support for co-running multiple user level processes capable of communicating with the UKL process using standard IPC. UKL preserves Linux's battle-tested codebase, community, and ecosystem of tools, applications, and hardware support. UKL runs both on bare-metal and virtual servers and supports multi-core execution. The changes to the Linux kernel are modest (1250 LOC).


title: Efficient Self-supervised Vision Pretraining with Local Masked Reconstruction

abstract: Self-supervised learning for computer vision has achieved tremendous progress and improved many downstream vision tasks such as image classification, semantic segmentation, and object detection. Among these, generative self-supervised vision learning approaches such as MAE and BEiT show promising performance. However, their global masked reconstruction mechanism is computationally demanding. To address this issue, we propose local masked reconstruction (LoMaR), a simple yet effective approach that performs masked reconstruction within a small window of 7$\times$7 patches on a simple Transformer encoder, improving the trade-off between efficiency and accuracy compared to global masked reconstruction over the entire image. Extensive experiments show that LoMaR reaches 84.1% top-1 accuracy on ImageNet-1K classification, outperforming MAE by 0.5%. After finetuning the pretrained LoMaR on 384$\times$384 images, it can reach 85.4% top-1 accuracy, surpassing MAE by 0.6%. On MS COCO, LoMaR outperforms MAE by 0.5 $\text{AP}^\text{box}$ on object detection and 0.5 $\text{AP}^\text{mask}$ on instance segmentation. LoMaR is especially more computation-efficient on pretraining high-resolution images, e.g., it is 3.1$\times$ faster than MAE with 0.2% higher classification accuracy on pretraining 448$\times$448 images. This local masked reconstruction learning mechanism can be easily integrated into any other generative self-supervised learning approach. Our code is publicly available in https://github.com/junchen14/LoMaR.


title: Enhanced thermally-activated skyrmion diffusion with tunable effective gyrotropic force

abstract: Magnetic skyrmions, topologically-stabilized spin textures that emerge in magnetic systems, have garnered considerable interest due to a variety of electromagnetic responses that are governed by the topology. The topology that creates a microscopic gyrotropic force also causes detrimental effects, such as the skyrmion Hall effect, which is a well-studied phenomenon highlighting the influence of topology on the deterministic dynamics and drift motion. Furthermore, the gyrotropic force is anticipated to have a substantial impact on stochastic diffusive motion; however, the predicted repercussions have yet to be demonstrated, even qualitatively. Here we demonstrate enhanced thermally-activated diffusive motion of skyrmions in a specifically designed synthetic antiferromagnet. Suppressing the effective gyrotropic force by tuning the angular momentum compensation leads to a more than 10 times enhanced diffusion coefficient compared to that of ferromagnetic skyrmions. Consequently, our findings not only demonstrate the gyro-force dependence of the diffusion coefficient but also enable ultimately energy-efficient unconventional stochastic computing.


title: Channel Codes for Relayless Networks with General Message Access Structure

abstract: Channel codes for relayless networks with the general message access structure is introduced. It is shown that the multi-letter characterized capacity region of this network is achievable with this code. The capacity region is characterized in terms of entropy functions and provides an alternative to the regions introduced by [Somekh-Baruch and Verd\'u, ISIT2006][Muramatsu and Miyake, ISITA2018].


title: Piezomagnetic switching of anomalous Hall effect in an antiferromagnet at room temperature

abstract: Piezomagnetism couples strain linearly to magnetic order producing magnetization. Thus, unlike magnetostriction, it enables bidirectional control of a net magnetic moment. If this effect becomes large at room temperature, it may be technologically relevant, similar to its electric analogue, piezoelectricity. To date, however, the studies of the piezomagnetic effect have been primarily restricted to antiferromagnetic (AF) insulators at cryogenic temperatures. Here we report the discovery of a large piezomagnetism in a metal at room temperature. Strikingly, by using the AF Weyl semimetal Mn$_3$Sn, known for its nearly magnetization-free anomalous Hall effect (AHE), we find that an application of small uniaxial strain of the order of 0.1 % can control both the sign and size of the AHE. Our experiment and theory show that the piezomagnetism can control the AHE distinctly from the magnetization, which will be useful for spintronics applications.


title: Sequential Bayesian Neural Subnetwork Ensembles

abstract: Deep neural network ensembles that appeal to model diversity have been used successfully to improve predictive performance and model robustness in several applications. Whereas, it has recently been shown that sparse subnetworks of dense models can match the performance of their dense counterparts and increase their robustness while effectively decreasing the model complexity. However, most ensembling techniques require multiple parallel and costly evaluations and have been proposed primarily with deterministic models, whereas sparsity induction has been mostly done through ad-hoc pruning. We propose sequential ensembling of dynamic Bayesian neural subnetworks that systematically reduce model complexity through sparsity-inducing priors and generate diverse ensembles in a single forward pass of the model. The ensembling strategy consists of an exploration phase that finds high-performing regions of the parameter space and multiple exploitation phases that effectively exploit the compactness of the sparse model to quickly converge to different minima in the energy landscape corresponding to high-performing subnetworks yielding diverse ensembles. We empirically demonstrate that our proposed approach surpasses the baselines of the dense frequentist and Bayesian ensemble models in prediction accuracy, uncertainty estimation, and out-of-distribution (OoD) robustness on CIFAR10, CIFAR100 datasets, and their out-of-distribution variants: CIFAR10-C, CIFAR100-C induced by corruptions. Furthermore, we found that our approach produced the most diverse ensembles compared to the approaches with a single forward pass and even compared to the approaches with multiple forward passes in some cases.


title: Adaptive Sampling-based Motion Planning with Control Barrier Functions

abstract: Sampling-based algorithms, such as Rapidly Exploring Random Trees (RRT) and its variants, have been used extensively for motion planning. Control barrier functions (CBFs) have been recently proposed to synthesize controllers for safety-critical systems. In this paper, we combine the effectiveness of RRT-based algorithms with the safety guarantees provided by CBFs in a method called CBF-RRT$^\ast$. CBFs are used for local trajectory planning for RRT$^\ast$, avoiding explicit collision checking of the extended paths. We prove that CBF-RRT$^\ast$ preserves the probabilistic completeness of RRT$^\ast$. Furthermore, in order to improve the sampling efficiency of the algorithm, we equip the algorithm with an adaptive sampling procedure, which is based on the cross-entropy method (CEM) for importance sampling (IS). The procedure exploits the tree of samples to focus the sampling in promising regions of the configuration space. We demonstrate the efficacy of the proposed algorithms through simulation examples.


title: Stabilizing Q-learning with Linear Architectures for Provably Efficient Learning

abstract: The $Q$-learning algorithm is a simple and widely-used stochastic approximation scheme for reinforcement learning, but the basic protocol can exhibit instability in conjunction with function approximation. Such instability can be observed even with linear function approximation. In practice, tools such as target networks and experience replay appear to be essential, but the individual contribution of each of these mechanisms is not well understood theoretically. This work proposes an exploration variant of the basic $Q$-learning protocol with linear function approximation. Our modular analysis illustrates the role played by each algorithmic tool that we adopt: a second order update rule, a set of target networks, and a mechanism akin to experience replay. Together, they enable state of the art regret bounds on linear MDPs while preserving the most prominent feature of the algorithm, namely a space complexity independent of the number of step elapsed. We show that the performance of the algorithm degrades very gracefully under a novel and more permissive notion of approximation error. The algorithm also exhibits a form of instance-dependence, in that its performance depends on the "effective" feature dimension.


title: Adiabatic Floquet-Wave Solutions of Temporally Modulated Anisotropic Leaky-Wave Holograms

abstract: In this paper, the aperture field estimation technique and generalized adiabatic Floquet-wave expansion method is developed for two-dimensional temporally modulated anisotropic holograms. The determinant equations for propagation eigenstates in the presence of space-time modulation are obtained, and the behaviors of the corresponding dispersion curves are investigated. Injecting temporal modulation causes asymmetrical displacement of the dispersion curve, which is studied in detail in this paper. The consequence of temporal modulation is the Doppler-shift effect and nonreciprocal response observed in these structures. Results show that its nonreciprocity can be controlled by varying the modulation frequency injected to the hologram. The proposed method significantly expands the range of applications of leaky-wave holograms. The main advantage of leaky-type modulated metasurfaces over the transmissive/reflective counterparts is their non-protruding feeds making them suitable for integrated structures. As an example, a nonreciprocal circularly polarized hologram is designed. Tensorial impedance surface is exploited to achieve high polarization purity.


title: Multi-scale frequency separation network for image deblurring

abstract: Image deblurring aims to restore the detailed texture information or structures from blurry images, which has become an indispensable step in many computer vision tasks. Although various methods have been proposed to deal with the image deblurring problem, most of them treated the blurry image as a whole and neglected the characteristics of different image frequencies. In this paper, we present a new method called multi-scale frequency separation network (MSFS-Net) for image deblurring. MSFS-Net introduces the frequency separation module (FSM) into an encoder-decoder network architecture to capture the low- and high-frequency information of image at multiple scales. Then, a cycle-consistency strategy and a contrastive learning module (CLM) are respectively designed to retain the low-frequency information and recover the high-frequency information during deblurring. At last, the features of different scales are fused by a cross-scale feature fusion module (CSFFM). Extensive experiments on benchmark datasets show that the proposed network achieves state-of-the-art performance.


title: Federated Learning under Distributed Concept Drift

abstract: Federated Learning (FL) under distributed concept drift is a largely unexplored area. Although concept drift is itself a well-studied phenomenon, it poses particular challenges for FL, because drifts arise staggered in time and space (across clients). To the best of our knowledge, this work is the first to explicitly study data heterogeneity in both dimensions. We first demonstrate that prior solutions to drift adaptation that use a single global model are ill-suited to staggered drifts, necessitating multiple-model solutions. We identify the problem of drift adaptation as a time-varying clustering problem, and we propose two new clustering algorithms for reacting to drifts based on local drift detection and hierarchical clustering. Empirical evaluation shows that our solutions achieve significantly higher accuracy than existing baselines, and are comparable to an idealized algorithm with oracle knowledge of the ground-truth clustering of clients to concepts at each time step.


title: CcHarmony: Color-checker based Image Harmonization Dataset

abstract: Image harmonization targets at adjusting the foreground in a composite image to make it compatible with the background, producing a more realistic and harmonious image. Training deep image harmonization network requires abundant training data, but it is extremely difficult to acquire training pairs of composite images and ground-truth harmonious images. Therefore, existing works turn to adjust the foreground appearance in a real image to create a synthetic composite image. However, such adjustment may not faithfully reflect the natural illumination change of foreground. In this work, we explore a novel transitive way to construct image harmonization dataset. Specifically, based on the existing datasets with recorded illumination information, we first convert the foreground in a real image to the standard illumination condition, and then convert it to another illumination condition, which is combined with the original background to form a synthetic composite image. In this manner, we construct an image harmonization dataset called ccHarmony, which is named after color checker (cc). The dataset is available at https://github.com/bcmi/Image-Harmonization-Dataset-ccHarmony.


title: Indeterminacy in Generative Models: Characterization and Strong Identifiability

abstract: Most modern probabilistic generative models, such as the variational autoencoder (VAE), have certain indeterminacies that are unresolvable even with an infinite amount of data. Different tasks tolerate different indeterminacies, however recent applications have indicated the need for strongly identifiable models, in which an observation corresponds to a unique latent code. Progress has been made towards reducing model indeterminacies while maintaining flexibility, and recent work excludes many--but not all--indeterminacies. In this work, we motivate model-identifiability in terms of task-identifiability, then construct a theoretical framework for analyzing the indeterminacies of latent variable models, which enables their precise characterization in terms of the generator function and prior distribution spaces. We reveal that strong identifiability is possible even with highly flexible nonlinear generators, and give two such examples. One is a straightforward modification of iVAE (arXiv:1907.04809 [stat.ML]); the other uses triangular monotonic maps, leading to novel connections between optimal transport and identifiability.