title: Radii of Young Star Clusters in Nearby Galaxies

abstract: We measure the projected half-light radii of young star clusters in 31 galaxies from the Legacy Extragalactic UV Survey (LEGUS). We implement a custom pipeline specifically designed to be robust against contamination, which allows us to measure radii for 6097 clusters. This is the largest sample of young star cluster radii currently available. We find that most (but not all) galaxies share a common cluster radius distribution, with the peak at around 3 pc. We find a clear mass-radius relation of the form $R_{\mathrm{eff}} \propto M^{0.24}$. This relation is present at all cluster ages younger than 1 Gyr, but with a shallower slope for clusters younger than 10 Myr. We present simple toy models to interpret these age trends, finding that high-mass clusters are more likely to be not tidally limited and expand. We also find that most clusters in LEGUS are gravitationally bound, especially at older ages or higher masses. Lastly, we present the cluster density and surface density distributions, finding a large scatter that appears to decrease with cluster age. The youngest clusters have a typical surface density of 100 $M_\odot$ pc$^{-2}$.


title: On the self-similar behaviour of coagulation systems with injection

abstract: In this paper we prove the existence of a family of self-similar solutions for a class of coagulation equations with a constant flux of particles from the origin. These solutions are expected to describe the longtime asymptotics of Smoluchowski's coagulation equations with a time independent source of clusters concentrated in small sizes. The self-similar profiles are shown to be smooth, provided the coagulation kernel is also smooth. Moreover, the self-similar profiles are estimated from above and from below by $x^{-(\gamma+3)/2}$ as $x \to 0$, where $\gamma <1 $ is the homogeneity of the kernel, and are proven to decay at least exponentially as $x \to \infty$.


title: Inflation with $R_{(\alpha\beta)}$ terms in the Palatini formulation

abstract: We study inflation with the most general non-degenerate gravitational action that depends on the symmetric part of the Ricci tensor coupled to a scalar field in the Palatini formulation of gravity. We use field redefinitions to shift the effect of the Ricci terms from gravity to the scalar field, and apply the result to slow-roll inflation. As examples, we consider actions quadratic and cubic in the Ricci tensor. In the quadratic case the results are similar to the case $R+\alpha R^2$ that has been studied earlier: the tensor-to-scalar ratio $r$ can be suppressed by an arbitrary amount, while the scalar spectrum is unaffected. In the cubic case, $r$ can be suppressed by at most a factor of $2/9$, and the change in the scalar spectral index $n_s$ can be large.


title: Alias-Free Generative Adversarial Networks

abstract: We observe that despite their hierarchical convolutional nature, the synthesis process of typical generative adversarial networks depends on absolute pixel coordinates in an unhealthy manner. This manifests itself as, e.g., detail appearing to be glued to image coordinates instead of the surfaces of depicted objects. We trace the root cause to careless signal processing that causes aliasing in the generator network. Interpreting all signals in the network as continuous, we derive generally applicable, small architectural changes that guarantee that unwanted information cannot leak into the hierarchical synthesis process. The resulting networks match the FID of StyleGAN2 but differ dramatically in their internal representations, and they are fully equivariant to translation and rotation even at subpixel scales. Our results pave the way for generative models better suited for video and animation.


title: Spacetime effects on wavepackets of coherent light

abstract: We investigate the interplay between gravity and the quantum coherence present in the state of a pulse of light propagating in curved spacetime. We first introduce an operational way to distinguish between the overall shift in the pulse wavepacket and its genuine deformation after propagation. We then apply our technique to quantum states of photons that are coherent in the frequency degree of freedom, as well as to states of completely incoherent light. We focus on Gaussian profiles and frequency combs and find that the quantum coherence initially present can enhance the deformation induced by propagation in a curved background. These results further supports the claim that genuine quantum features, such as quantum coherence, can be used to probe the gravitational properties of physical systems. We specialize our techniques to Earth-to-satellite communication setups, where the effects of gravity are weak but can be tested with current satellite technologies.


title: Portfolio Allocation under Asymmetric Dependence in Asset Returns using Local Gaussian Correlations

abstract: It is well known that there are asymmetric dependence structures between financial returns. In this paper we use a new nonparametric measure of local dependence, the local Gaussian correlation, to improve portfolio allocation. We extend the classical mean-variance framework, and show that the portfolio optimization is straightforward using our new approach, only relying on a tuning parameter (the bandwidth). The new method is shown to outperform the equally weighted (1/N) portfolio and the classical Markowitz portfolio for monthly asset returns data.


title: Spreading dynamics of an infection in a growing population

abstract: Bacteriophages spreading through populations of bacteria offer relatively simple, tuneable systems for testing mathematical models of range expansion. However, such models typically assume a static state into which to expand, which is not generally valid for bacterial-bacteriophage populations, where both the host (bacteria) and the infectious agent (bacteriophage) have similar growth rates. Here, we build on the classical FKPP theory of expanding fronts to study an infectious bacteriophage front propagating into an exponentially growing population of bacteria, focusing on the situation where the hosts are also mobile, e.g., swimming bacteria. In this case, both the infectious agent and the infected host populations take on the form of self-similar travelling waves with a fixed wave speed, as in FKPP theory, but the infected host wave also grows exponentially. Depending on the population under consideration, wave speeds are either advanced or retarded compared to the non-growing case. We identify a novel speed selection mechanism in which the shape of the bacteriophage wave controls these various wave speeds. We propose experiments to test our predictions.


title: Spitzer's Last Look at Extragalactic Explosions: Long-Term Evolution of Interacting Supernovae

abstract: Here we present new - and, nevertheless, last - mid-infrared (mid-IR) data for supernovae (SNe) based on measurements with the Spitzer Space Telescope. Comparing our recent 3.6 and 4.5 $\mu$m photometry with previously published mid-IR and further multiwavelength datasets, we were able to draw some conclusions about the origin and heating mechanism of the dust in these SNe or in their environments, as well as on possible connection with circumstellar matter (CSM) originating from pre-explosion mass-loss events in the progenitor stars. We also present new results regarding both certain SN classes and single objects. We highlight the mid-IR homogeneity of SNe Ia-CSM, which may be a hint of their common progenitor type and of their basically uniform circumstellar environments. Regarding single objects, it is worth highlighting the late-time interacting Type Ib SNe 2003gk and 2004dk, for which we present the first-ever mid-IR data, which seem to be consistent with clues of ongoing CSM interaction detected in other wavelength ranges. Our current study suggests that long-term mid-IR follow-up observations play a key role in a better understanding of both pre- and post-explosion processes in SNe and their environments. While Spitzer is not available any more, the expected unique data from the James Webb Space Telescope, as well as long-term near-IR follow-up observations of dusty SNe, can bring us closer to the hidden details of this topic.


title: An entropic method for discrete systems with Gibbs entropy

abstract: We consider general systems of ordinary differential equations with monotonic Gibbs entropy, and introduce an entropic scheme that simply imposes an entropy fix after every time step of any existing time integrator. It is proved that in the general case, our entropy fix has only infinitesimal influence on the numerical order of the original scheme, and in many circumstances, it can be shown that the scheme does not affect the numerical order. Numerical experiments on the linear Fokker-Planck equation and nonlinear Boltzmann equation are carried out to support our numerical analysis.


title: TCEP: Transitions in Operator Placement to Adapt to Dynamic Network Environments

abstract: Distributed Complex Event Processing (DCEP) is a commonly used paradigm to detect and act on situational changes of many applications, including the Internet of Things (IoT). DCEP achieves this using a simple specification of analytical tasks on data streams called operators and their distributed execution on a set of infrastructure. The adaptivity of DCEP to the dynamics of IoT applications is essential and very challenging in the face of changing demands concerning Quality of Service. In our previous work, we addressed this issue by enabling transitions, which allow for the adaptive use of multiple operator placement mechanisms. In this article, we extend the transition methodology by optimizing the costs of transition and analyzing the behaviour using multiple operator placement mechanisms. Furthermore, we provide an extensive evaluation on the costs of transition imposed by operator migrations and learning, as it can inflict overhead on the performance if operated uncoordinatedly.


title: Beyond Predictions in Neural ODEs: Identification and Interventions

abstract: Spurred by tremendous success in pattern matching and prediction tasks, researchers increasingly resort to machine learning to aid original scientific discovery. Given large amounts of observational data about a system, can we uncover the rules that govern its evolution? Solving this task holds the great promise of fully understanding the causal interactions and being able to make reliable predictions about the system's behavior under interventions. We take a step towards answering this question for time-series data generated from systems of ordinary differential equations (ODEs). While the governing ODEs might not be identifiable from data alone, we show that combining simple regularization schemes with flexible neural ODEs can robustly recover the dynamics and causal structures from time-series data. Our results on a variety of (non)-linear first and second order systems as well as real data validate our method. We conclude by showing that we can also make accurate predictions under interventions on variables or the system itself.


title: Chebyshev Greeks: Smoothing Gamma without Bias

abstract: The computation of Greeks is a fundamental task for risk managing of financial instruments. The standard approach to their numerical evaluation is via finite differences. Most exotic derivatives are priced via Monte Carlo simulation: in these cases, it is hard to find a fast and accurate approximation of Greeks, mainly because of the need of a tradeoff between bias and variance. Recent improvements in Greeks computation, such as Adjoint Algorithmic Differentiation, are unfortunately uneffective on second order Greeks (such as Gamma), which are plagued by the most significant instabilities, so that a viable alternative to standard finite differences is still lacking. We apply Chebyshev interpolation techniques to the computation of spot Greeks, showing how to improve the stability of finite difference Greeks of arbitrary order, in a simple and general way. The increased performance of the proposed technique is analyzed for a number of real payoffs commonly traded by financial institutions.


title: Core Noise Requirements, and GW Sensitivities of AMIGO

abstract: AMIGO - The Astrodynamical Middle-frequency Interferometric GW (Gravitation-Wave) Observatory is a first-generation mid-frequency GW mission bridging the sensitivity gap between the high-frequency GW detectors and low-frequency space GW detectors. In our previous works, we have obtained appropriate heliocentric orbit formations of nominal arm length 10,000 km with their first-generation time-delay configurations satisfying frequency noise reduction requirement, and we have also worked out thrust-fuel friendly constant-arm heliocentric orbit formations. In this paper, we review and study noise requirements and present the corresponding GW sensitivities. From the design white position noises and acceleration noises, we obtain the GW sensitivities for the first-generation Michelson X TDI configuration of b-AMIGO (baseline AMIGO), AMIGO, and e-AMIGO (enhanced AMIGO). In view of the current technology development, we study and indicate steps to implement the AMIGO mission concept.


title: On Symmetric Positive Definite Preconditioners for Multiple Saddle-Point Systems

abstract: We consider symmetric positive definite preconditioners for multiple saddle-point systems of block tridiagonal form, which can be applied within the MINRES algorithm. We describe such a preconditioner for which the preconditioned matrix has only two distinct eigenvalues, 1 and -1, when the preconditioner is applied exactly. We discuss the relative merits of such an approach compared to a more widely studied block diagonal preconditioner, specify the computational work associated with applying the new preconditioner inexactly, and survey a number of theoretical results for the block diagonal case. Numerical results validate our theoretical findings.


title: Fuel: A Compiler Framework for Safe Memory Management

abstract: Flow-sensitive type systems offer an elegant way to ensure memory-safety in programming languages. Unfortunately, their adoption in new or existing languages is often hindered by a painful effort to implement or integrate them into compilers. This paper presents early results in our effort to alleviate this task. We introduce Fuel, a type capability-based library that can be plugged onto a compiler toolchain to check for memory-safety properties. Fuel builds upon well-established ideas in the domain of capability-based system, and adds a mechanism leveraging dynamic checks to recover capabilities where static reasoning is either too difficult or impossible. This approach allows the analysis to potentially cover situations where a typical type system might not be expressive enough to statically reason about memory safety.


title: Existence of dissipative solutions to the compressible Navier-Stokes system with potential temperature transport

abstract: We introduce dissipative solutions to the compressible Navier-Stokes system with potential temperature transport motivated by the concept of Young measures. We prove their global-in-time existence by means of convergence analysis of a mixed finite element-finite volume method. If a classical solution to the compressible Navier-Stokes system with potential temperature transport exists, we prove the strong convergence of numerical solutions. Our results hold for the full range of adiabatic indices including the physically relevant cases in which the existence of global-in-time weak solutions is open.


title: Parameter symmetries of neutrino oscillations in vacuum, matter, and approximation schemes

abstract: Expressions for neutrino oscillations contain a high degree of symmetry, but typical forms for the oscillation probabilities mask these symmetries of the oscillation parameters. We elucidate the $2^7$ parameter symmetries of the vacuum parameters and draw connections to the choice of definitions of the parameters as well as interesting degeneracies. We also show that in the presence of matter an \emph{additional} set of $2^7$ parameter symmetries exist of the matter parameters. Due to the complexity of the exact expressions for neutrino oscillations in matter, numerous approximations have been developed; we show that under certain assumptions, approximate expressions have at most $2^6$ additional parameter symmetries of the matter parameters. We also include one parameter symmetry related to the LMA-Dark degeneracy that holds under the assumption of CPT invariance; this adds one additional factor of two to all of the above cases. Explicit, non-trivial examples are given of how physical observables in neutrino oscillations, such as the probabilities, CP violation, the position of the solar and atmospheric resonance, and the effective $\Delta m^2$'s for disappearance probabilities, are invariant under all of the above symmetries. We investigate which of these parameter symmetries apply to numerous approximate expressions in the literature and show that a more careful consideration of symmetries improves the precision of approximations.


title: Q-system completion is a 3-functor

abstract: Q-systems are unitary versions of Frobenius algebra objects which appeared in the theory of subfactors. In recent joint work with R. Hern\'andez Palomares and C. Jones, the authors defined a notion of Q-system completion for C*/W* 2-categories, which is a unitary version of a higher idempotent completion in the spirit of Douglas--Reutter and Gaiotto--Johnson-Freyd. In this article, we prove that Q-system completion is a dagger 3-functor on the dagger 3-category of C*/W* 2-categories. We also prove that Q-system completion satisfies a universal property analogous to the universal property satisfied by idempotent completion for 1-categories.


title: Modular Ordinary Differential Equations on ${\rm SL}(2,\mathbb{Z})$ of Third Order and Applications

abstract: In this paper, we study third-order modular ordinary differential equations (MODE for short) of the following form $y'''+Q_2(z)y'+Q_3(z)y=0$, $z\in\mathbb{H}=\{z\in\mathbb{C} \,|\,\operatorname{Im}z>0 \}$, where $Q_2(z)$ and $Q_3(z)-\frac12 Q_2'(z)$ are meromorphic modular forms on ${\rm SL}(2,\mathbb{Z})$ of weight $4$ and $6$, respectively. We show that any quasimodular form of depth $2$ on ${\rm SL}(2,\mathbb{Z})$ leads to such a MODE. Conversely, we introduce the so-called Bol representation $\hat{\rho}\colon {\rm SL}(2,\mathbb{Z})\to{\rm SL}(3,\mathbb{C})$ for this MODE and give the necessary and sufficient condition for the irreducibility (resp. reducibility) of the representation. We show that the irreducibility yields the quasimodularity of some solution of this MODE, while the reducibility yields the modularity of all solutions and leads to solutions of certain ${\rm SU}(3)$ Toda systems. Note that the ${\rm SU}(N+1)$ Toda systems are the classical Pl\"ucker infinitesimal formulas for holomorphic maps from a Riemann surface to $\mathbb{CP}^N$.


title: Optimal Gevrey regularity for supercritical quasi-geostrophic equations

abstract: We consider the two dimensional surface quasi-geostrophic equations with super-critical dissipation. For large initial data in critical Sobolev and Besov spaces, we prove optimal Gevrey regularity with the same decay exponent as the linear part. This settles several open problems in \cite{Bis14, BMS15}.


title: Influences of Dielectric Constant and Scan Rate to Hysteresis Effect in Perovskite Solar Cell: Simulation and Experimental Analyses

abstract: In this work, perovskite solar cells (PSCs) with different transport layers were fabricated to understand the hysteresis phenomenon under a series of scan rates. The experimental results show that the hysteresis phenomenon would be affected by the dielectric constant of transport layers and scan rate significantly. To explain this, a modified Poisson and drift-diffusion solver coupled with a fully time-dependent ion migration model is developed to analyze how the ion migration affects the performance and hysteresis of PSCs. The simulation model was optimized for carrier transportation of organic materials, which can simulate the organic transport layer correctly without using heavy doping in simulating the organic transport layer. The modeling results show that the most crucial factor in the hysteresis behavior is the built-in electric field of the perovskite. The non-linear hysteresis curves are demonstrated under different scan rates, and the mechanism of the hysteresis behavior is explained. The findings reveal why the change in hysteresis degree with scan rate is Gaussian shaped rather than monotonic. Additionally, other factors contributing to the degree of hysteresis are determined to be the degree of degradation in the perovskite material, the quality of the perovskite crystal, and the materials of the transport layer, which corresponds to the total ion density, carrier lifetime of perovskite, and the dielectric constant of the transport layer, respectively. Finally, it was found that the dielectric constant of the transport layer is a key factor affecting hysteresis in perovskite solar cells; a lower dielectric constant corresponds to a higher electric field of the transport layer. Hence, if the electric field of the perovskite material is small, the degree of hysteresis is small and vice versa.


title: A Triple AGN in the NGC 7733-7734 Merging Group

abstract: Context: Galaxy interactions and mergers can lead to supermassive black hole (SMBH) binaries which become active galactic nuclei (AGN) pairs when the SMBHs start accreting mass. If there is a third galaxy involved in the interaction, then a triple AGN system can form. Aims: Our goal is to investigate the nature of the nuclear emission from the galaxies in the interacting pair NGC\,7733--NGC\,7734 using archival VLT/MUSE Integral field spectrograph data and study its relation to the stellar mass distribution traced by near-infrared (NIR) observations from the South African Astronomical Observatory (SAAO). Methods:We conducted near-infrared observations using the SAAO and identified the morphological properties of bulges in each galaxy. We used MUSE data to obtain a set of ionized emission lines from each galaxy and studied the ionization mechanism. We also examined the relation of the galaxy pair with any nearby companions with Far-UV observations using the UVIT. Conclusions: The emission line analysis from the central regions of NGC\,7733 and NGC\,7734 show Seyfert and LINER type AGN activity. The galaxy pair NGC\,7733--34 also shows evidence of a third component, which has Seyfert-like emission. Hence, the galaxy pair NGC\,7733--34 forms a triple AGN system. We also detected an Extended Narrow-line region (ENLR) associated with the nucleus of NGC\,7733.


title: Euro-PVI: Pedestrian Vehicle Interactions in Dense Urban Centers

abstract: Accurate prediction of pedestrian and bicyclist paths is integral to the development of reliable autonomous vehicles in dense urban environments. The interactions between vehicle and pedestrian or bicyclist have a significant impact on the trajectories of traffic participants e.g. stopping or turning to avoid collisions. Although recent datasets and trajectory prediction approaches have fostered the development of autonomous vehicles yet the amount of vehicle-pedestrian (bicyclist) interactions modeled are sparse. In this work, we propose Euro-PVI, a dataset of pedestrian and bicyclist trajectories. In particular, our dataset caters more diverse and complex interactions in dense urban scenarios compared to the existing datasets. To address the challenges in predicting future trajectories with dense interactions, we develop a joint inference model that learns an expressive multi-modal shared latent space across agents in the urban scene. This enables our Joint-$\beta$-cVAE approach to better model the distribution of future trajectories. We achieve state of the art results on the nuScenes and Euro-PVI datasets demonstrating the importance of capturing interactions between ego-vehicle and pedestrians (bicyclists) for accurate predictions.


title: Bona fide stochastic resonance under nonGaussian active fluctuations

abstract: We report on the experimental observation of stochastic resonance (SR) in a nonGaussian active bath without any periodic modulation. A Brownian particle hopping in a nanoscale double-well potential under the influence of nonGaussian correlated noise, with mean interval ${{\tau }_{P}}$ and correlation time ${{\tau }_{c}}$, shows a series of equally-spaced peaks in the residence time distribution at integral multiples of ${{\tau }_{P}}$. The strength of the first peak is found to be maximum when the mean residence time ${{\bar{\tau }}_{d}}$ matches the double condition, $4{{\tau }_{c}}\approx {{\tau }_{P}}\approx {{\bar{\tau }}_{d}}\text{/}2$, demonstrating a new type of bona fide SR. The experimental findings agree with a simple model that explains the emergence of SR without periodic modulation of the double-well potential. Additionally, we show that generic SR under periodic modulation, known to degrade in strongly correlated continuous noise, is recovered by the discrete nonGaussian kicks.


title: Prospects for Analog Circuits in Deep Networks

abstract: Operations typically used in machine learning al-gorithms (e.g. adds and soft max) can be implemented bycompact analog circuits. Analog Application-Specific Integrated Circuit (ASIC) designs that implement these algorithms using techniques such as charge sharing circuits and subthreshold transistors, achieve very high power efficiencies. With the recent advances in deep learning algorithms, focus has shifted to hardware digital accelerator designs that implement the prevalent matrix-vector multiplication operations. Power in these designs is usually dominated by the memory access power of off-chip DRAM needed for storing the network weights and activations. Emerging dense non-volatile memory technologies can help to provide on-chip memory and analog circuits can be well suited to implement the needed multiplication-vector operations coupled with in-computing memory approaches. This paper presents abrief review of analog designs that implement various machine learning algorithms. It then presents an outlook for the use ofanalog circuits in low-power deep network accelerators suitable for edge or tiny machine learning applications.


title: Fine-Tuning StyleGAN2 For Cartoon Face Generation

abstract: Recent studies have shown remarkable success in the unsupervised image to image (I2I) translation. However, due to the imbalance in the data, learning joint distribution for various domains is still very challenging. Although existing models can generate realistic target images, it's difficult to maintain the structure of the source image. In addition, training a generative model on large data in multiple domains requires a lot of time and computer resources. To address these limitations, we propose a novel image-to-image translation method that generates images of the target domain by finetuning a stylegan2 pretrained model. The stylegan2 model is suitable for unsupervised I2I translation on unbalanced datasets; it is highly stable, produces realistic images, and even learns properly from limited data when applied with simple fine-tuning techniques. Thus, in this paper, we propose new methods to preserve the structure of the source images and generate realistic images in the target domain. The code and results are available at https://github.com/happy-jihye/Cartoon-StyleGan2


title: INTEGRAL reloaded: spacecraft, instruments and ground system

abstract: ESA's INTErnational Gamma-Ray Astrophysics Laboratory (INTEGRAL) was launched on 17 Oct 2002 at 06:41 CEST. Since then, it has been providing long, uninterrupted observations (up to about 47 hr, or 170 ksec, per satellite orbit of 2.7 days) with a large field-of-view (fully coded: 100 deg^2), msec time resolution, keV energy resolution, polarization measurements, as well as additional coverage in the optical. This is realized by two main instruments in the 15 keV to 10 MeV range, the spectrometer SPI (spectral resolution 3 keV at 1.8 MeV) and the imager IBIS (angular resolution 12 arcmin FWHM), complemented by X-ray (JEM-X; 3-35 keV) and optical (OMC; Johnson V-band) monitors. All instruments are co-aligned to simultaneously observe the target region. A particle radiation monitor (IREM) measures charged particle fluxes near the spacecraft. The Anti-coincidence subsystems of the main instruments are also efficient all-sky gamma-ray detectors, which provide omni-directional monitoring above ~75 keV. INTEGRAL can also rapidly (within a couple of hours) re-point and conduct Target of Opportunity observations. INTEGRAL has build an impressive legacy: e.g. discovery of >600 new high-energy sources; first-ever direct detection of 56Ni and 56Co radio-active decay lines from a Type Ia supernova; new insights on positron annihilation in the Galactic bulge and disk; pioneering gamma-ray polarization studies. INTEGRAL is also a successful in multi-messenger astronomy: INTEGRAL found the first prompt electromagnetic radiation in coincidence with a binary neutron star merger. More than 1750 papers based on INTEGRAL data have been published in refereed journals. Here we give a comprehensive update of the satellite status after more than 18 years of operations in a harsh space environment, and an account of the successful Ground Segment.


title: How Well do Feature Visualizations Support Causal Understanding of CNN Activations?

abstract: A precise understanding of why units in an artificial network respond to certain stimuli would constitute a big step towards explainable artificial intelligence. One widely used approach towards this goal is to visualize unit responses via activation maximization. These synthetic feature visualizations are purported to provide humans with precise information about the image features that cause a unit to be activated - an advantage over other alternatives like strongly activating natural dataset samples. If humans indeed gain causal insight from visualizations, this should enable them to predict the effect of an intervention, such as how occluding a certain patch of the image (say, a dog's head) changes a unit's activation. Here, we test this hypothesis by asking humans to decide which of two square occlusions causes a larger change to a unit's activation. Both a large-scale crowdsourced experiment and measurements with experts show that on average the extremely activating feature visualizations by Olah et al. (2017) indeed help humans on this task ($68 \pm 4$% accuracy; baseline performance without any visualizations is $60 \pm 3$%). However, they do not provide any substantial advantage over other visualizations (such as e.g. dataset samples), which yield similar performance ($66\pm3$% to $67 \pm3$% accuracy). Taken together, we propose an objective psychophysical task to quantify the benefit of unit-level interpretability methods for humans, and find no evidence that a widely-used feature visualization method provides humans with better "causal understanding" of unit activations than simple alternative visualizations.


title: Radiative Rayleigh-Taylor Instability and the structure of clouds in planetary atmospheres

abstract: Clouds are expected to form in a wide range of conditions in the atmosphere of exoplanets given the large range of possible condensible species. However this diversity might lead to very different small-scale dynamics depending on radiative transfer in various thermal conditions: we aim at providing some insights into these dynamical regimes. We perform an analytical linear stability analysis of a compositional discontinuity with a heating source term that depends on composition. We also perform idealized two-dimensional (2D) simulations of an opacity discontinuity in a stratified medium with the code ARK. We use a two-stream grey model for radiative transfer and explore the brown-dwarf and earth-like regimes. We reveal the existence of a Radiative Rayleigh-Taylor Instability (RRTI hereafter, a particular case of diabatic Rayleigh-Taylor instability) when an opacity discontinuity is present in a stratified medium. This instability is similar in nature to diabatic convection and relies only on buoyancy with radiative transfer heating and cooling. When the temperature is decreasing with height in the atmosphere, a lower-opacity medium on top of a higher-opacity medium is dynamically unstable while a higher-opacity medium on top of a lower-opacity medium is stable. This stability/instability behavior is reversed if the temperature is increasing with height. The existence of the RRTI could have important implications for the stability of the cloud cover of a wide range of planetary atmospheres. In our solar system, it could help explain the formation of mammatus cloud in Earth atmospheres and the existence of Venus cloud deck. Likewise, it suggests that stable and large scale cloud covers could be ubiquitous in strongly irradiated exoplanets but might be more patchy in low-irradiated or isolated objects like brown dwarfs and directly imaged exoplanets.


title: FusionPainting: Multimodal Fusion with Adaptive Attention for 3D Object Detection

abstract: Accurate detection of obstacles in 3D is an essential task for autonomous driving and intelligent transportation. In this work, we propose a general multimodal fusion framework FusionPainting to fuse the 2D RGB image and 3D point clouds at a semantic level for boosting the 3D object detection task. Especially, the FusionPainting framework consists of three main modules: a multi-modal semantic segmentation module, an adaptive attention-based semantic fusion module, and a 3D object detector. First, semantic information is obtained for 2D images and 3D Lidar point clouds based on 2D and 3D segmentation approaches. Then the segmentation results from different sensors are adaptively fused based on the proposed attention-based semantic fusion module. Finally, the point clouds painted with the fused semantic label are sent to the 3D detector for obtaining the 3D objection results. The effectiveness of the proposed framework has been verified on the large-scale nuScenes detection benchmark by comparing it with three different baselines. The experimental results show that the fusion strategy can significantly improve the detection performance compared to the methods using only point clouds, and the methods using point clouds only painted with 2D segmentation information. Furthermore, the proposed approach outperforms other state-of-the-art methods on the nuScenes testing benchmark.


title: A Circular-Structured Representation for Visual Emotion Distribution Learning

abstract: Visual Emotion Analysis (VEA) has attracted increasing attention recently with the prevalence of sharing images on social networks. Since human emotions are ambiguous and subjective, it is more reasonable to address VEA in a label distribution learning (LDL) paradigm rather than a single-label classification task. Different from other LDL tasks, there exist intrinsic relationships between emotions and unique characteristics within them, as demonstrated in psychological theories. Inspired by this, we propose a well-grounded circular-structured representation to utilize the prior knowledge for visual emotion distribution learning. To be specific, we first construct an Emotion Circle to unify any emotional state within it. On the proposed Emotion Circle, each emotion distribution is represented with an emotion vector, which is defined with three attributes (i.e., emotion polarity, emotion type, emotion intensity) as well as two properties (i.e., similarity, additivity). Besides, we design a novel Progressive Circular (PC) loss to penalize the dissimilarities between predicted emotion vector and labeled one in a coarse-to-fine manner, which further boosts the learning process in an emotion-specific way. Extensive experiments and comparisons are conducted on public visual emotion distribution datasets, and the results demonstrate that the proposed method outperforms the state-of-the-art methods.


title: Field-Induced Spin Excitations in the Spin-1/2 Triangular-Lattice Antiferromagnet CsYbSe$_2$

abstract: A layered triangular lattice with spin-1/2 ions is an ideal platform to explore highly entangled exotic states like quantum spin liquid (QSL). Here, we report a systematic in-field neutron scattering study on a perfect two-dimensional triangular-lattice antiferromagnet, CsYbSe$_2$, a member of the large QSL candidate family rare-earth chalcogenides. The elastic neutron scattering measured down to 70 mK shows that there is a short-range 120$^{\circ}$ magnetic order at zero field. In the field-induced ordered states, the spin-spin correlation lengths along the $c$ axis are relatively short, although the heat capacity results indicate long-range magnetic orders at 3 T $-$ 5 T. The inelastic neutron scattering spectra evolve from highly damped continuum-like excitations at zero field to relatively sharp spin wave modes at the plateau phase. Our extensive large-cluster density-matrix renormalization group calculations with a Heisenberg triangular-lattice nearest-neighbor antiferromagnetic model reproduce the essential features of the experimental spectra, including continuum-like excitations at zero field, series of sharp magnons at the plateau phase as well as two-magnon excitations at high energy. This work presents comprehensive experimental and theoretical overview of the unconventional field-induced spin dynamics in triangular-lattice Heisenberg antiferromagnet and thus provides valuable insight into quantum many-body phenomena.


title: Electrical low-frequency $1/f^{\gamma}$ noise due to surface diffusion of scatterers on an ultra low noise graphene platform

abstract: Low-frequency $1/f^{\gamma}$ noise is ubiquitous, even in high-end electronic devices. For qubits such noise results in decrease of their coherence times. Recently, it was found that adsorbed O$_2$ molecules provide the dominant contribution to flux noise in superconducting quantum interference devices. To clarify the basic principles of such adsorbant noise, we have investigated the formation of low-frequency noise while the mobility of surface adsorbants is varied by temperature. In our experiments, we measured low-frequency current noise in suspended monolayer graphene samples under the influence of adsorbed Ne atoms. Owing to the extremely small intrinsic noise of graphene in suspended Corbino geometry, we could resolve a combination of $1/f^{\gamma}$ and Lorentzian noise spectra induced by the presence of Ne. We find that the $1/f^{\gamma}$ noise is caused by surface diffusion of Ne atoms and by temporary formation of few-Ne-atom clusters. Our results support the idea that clustering dynamics of defects is relevant for understanding of $1/f$ noise in general metallic systems.


title: Extended formulations for matroid polytopes through randomized protocols

abstract: Let $P$ be a polytope. The hitting number of $P$ is the smallest size of a hitting set of the facets of $P$, i.e., a subset of vertices of $P$ such that every facet of $P$ has a vertex in the subset. An extended formulation of $P$ is the description of a polyhedron that linearly projects to $P$. We show that, if $P$ is the base polytope of any matroid, then $P$ admits an extended formulation whose size depends linearly on the hitting number of $P$. Our extended formulations generalize those of the spanning tree polytope given by Martin and Wong. Our proof is simple and short, and it goes through the deep connection between extended formulations and communication protocols.


title: Advancing Protocol Diversity in Network Security Monitoring

abstract: With information technology entering new fields and levels of deployment, e.g., in areas of energy, mobility, and production, network security monitoring needs to be able to cope with those environments and their evolution. However, state-of-the-art Network Security Monitors (NSMs) typically lack the necessary flexibility to handle the diversity of the packet-oriented layers below the abstraction of TCP/IP connections. In this work, we advance the software architecture of a network security monitor to facilitate the flexible integration of lower-layer protocol dissectors while maintaining required performance levels. We proceed in three steps: First, we identify the challenges for modular packet-level analysis, present a refined NSM architecture to address them and specify requirements for its implementation. Second, we evaluate the performance of data structures to be used for protocol dispatching, implement the proposed design into the popular open-source NSM Zeek and assess its impact on the monitor performance. Our experiments show that hash-based data structures for dispatching introduce a significant overhead while array-based approaches qualify for practical application. Finally, we demonstrate the benefits of the proposed architecture and implementation by migrating Zeek's previously hard-coded stack of link and internet layer protocols to the new interface. Furthermore, we implement dissectors for non-IP based industrial communication protocols and leverage them to realize attack detection strategies from recent applied research. We integrate the proposed architecture into the Zeek open-source project and publish the implementation to support the scientific community as well as practitioners, promoting the transfer of research into practice.


title: Superfield equations in the Berezin-Kostant-Leites category

abstract: Using the functor of points, we prove that the Wess-Zumino equations for massive chiral superfields in dimension 4|4 can be represented by supersymmetric equations in terms of superfunctions in the Berezin-Kostant-Leites sense (involving ordinary fields, with real and complex valued components). Then, after introducing an appropriate supersymmetric extension of the Fourier transform, we prove explicitly that these supersymmetric equations provide a realization of the irreducible unitary representations with positive mass and zero superspin of the super Poincar\'e group in dimension 4|4.


title: Gradient solitons on doubly warped product manifolds

abstract: Firstly we provide new characterizations for doubly warped product manifolds. Then we consider several types of gradient solitons on them such as Riemann, Ricci, Yamabe and conformal and examine the effect of a gradient soliton on a doubly warped product to its factor manifolds. Finally we investigate the concircularly flat and conharmonically flat cases of doubly warped products.


title: Switched server systems whose parameters are normal numbers in base 4

abstract: Switched server systems are mathematical models of manufacturing, traffic and queueing systems. Recently, it was proved in (Eur. J. Appl. Math. 31(4) (2020), pp. 682-708) that there exist switched server systems with $3$ buffers (tanks), a server, filling rates $\rho_1=\rho_2=\rho_3=\frac13$ and parameters $d_1, d_2, d_3>0$ whose global attractor is a fractal set. In this article, we prove that if $x_1$ in $(0,\frac13)$, $x_2$ in $(\frac13,\frac23)$ and $x_3$ in $(\frac23,1)$ are rational numbers or normal numbers in base $4$ (or more generally, rich numbers to base $4$) and $(d_1,d_2,d_3)$ is the vector with positive entries satisfying $$d_1=\frac{1}{3x_1}-1,\quad d_2=\frac{2-3x_2}{3x_2-1}, \quad d_3=\frac{3-3x_3}{3x_3-2},$$ then the corresponding switched server has no fractal attractor. More precisely, the Poincar\'e map of the system has a finite global attractor. The approach we use is to study the topological dynamics of a family of piecewise $\lambda$-affine contractions that includes the Poincar\'e map of the switched server system as a particular case.


title: Is Downloading this App Consistent with my Values? Conceptualizing a Value-Centered Privacy Assistant

abstract: Digital privacy notices aim to provide users with information to make informed decisions. They are, however, fraught with difficulties. Instead, I propose that data privacy decisions can be understood as an expression of user values. To optimize this value expression, I further propose the creation of a value-centered privacy assistant (VcPA). Here, I preliminary explore how a VcPA could enhance user value expression by utilizing three user scenarios in the context of considering whether or not to download an environmental application, the OpenLitterMap app. These scenarios are conceptually constructed from established privacy user groups - the privacy fundamentalists; the privacy pragmatists; and the privacy unconcerned. I conclude that the VcPA best facilitates user value expression of the privacy fundamentalists. In contrast, the value expression of the privacy pragmatists and the privacy unconcerned could be enhanced or hindered depending on the context and their internal states. Possible implications for optimal VcPA design are also discussed. Following this initial conceptual exploration of VcPAs, further empirical research will be required to demonstrate the effectiveness of the VcPA system in real-world settings.


title: Polarization in Geometric Opinion Dynamics

abstract: In light of increasing recent attention to political polarization, understanding how polarization can arise poses an important theoretical question. While more classical models of opinion dynamics seem poorly equipped to study this phenomenon, a recent novel approach by H\k{a}z{\l}a, Jin, Mossel, and Ramnarayan (HJMR) proposes a simple geometric model of opinion evolution that provably exhibits strong polarization in specialized cases. Moreover, polarization arises quite organically in their model: in each time step, each agent updates opinions according to their correlation/response with an issue drawn at random. However, their techniques do not seem to extend beyond a set of special cases they identify, which benefit from fragile symmetry or contractiveness assumptions, leaving open how general this phenomenon really is. In this paper, we further the study of polarization in related geometric models. We show that the exact form of polarization in such models is quite nuanced: even when strong polarization does not hold, it is possible for weaker notions of polarization to nonetheless attain. We provide a concrete example where weak polarization holds, but strong polarization provably fails. However, we show that strong polarization provably holds in many variants of the HJMR model, which are also robust to a wider array of distributions of random issues -- this indicates that the form of polarization introduced by HJMR is more universal than suggested by their special cases. We also show that the weaker notions connect more readily to the theory of Markov chains on general state spaces.


title: Extractive Explanations for Interpretable Text Ranking

abstract: Neural document ranking models perform impressively well due to superior language understanding gained from pre-training tasks. However, due to their complexity and large number of parameters, these (typically transformer-based) models are often non-interpretable in that ranking decisions can not be clearly attributed to specific parts of the input documents. In this paper we propose ranking models that are inherently interpretable by generating explanations as a by-product of the prediction decision. We introduce the Select-and-Rank paradigm for document ranking, where we first output an explanation as a selected subset of sentences in a document. Thereafter, we solely use the explanation or selection to make the prediction, making explanations first-class citizens in the ranking process. Technically, we treat sentence selection as a latent variable trained jointly with the ranker from the final output. To that end, we propose an end-to-end training technique for Select-and-Rank models utilizing reparameterizable subset sampling using the Gumbel-max trick. We conduct extensive experiments to demonstrate that our approach is competitive to state-of-the-art methods. Our approach is broadly applicable to numerous ranking tasks and furthers the goal of building models that are interpretable by design. Finally, we present real-world applications that benefit from our sentence selection method.


title: Parameter dependent finite element analysis for ferronematics solutions

abstract: This paper focuses on the analysis of a free energy functional, that models a dilute suspension of magnetic nanoparticles in a two-dimensional nematic well. The {\it first part} of the article is devoted to the asymptotic analysis of global energy minimizers in the limit of vanishing elastic constant, $\ell \rightarrow 0$ where the re-scaled elastic constant $\ell$ is inversely proportional to the domain area. The first results concern the strong $H^1$-convergence and a $\ell$-independent $H^2$-bound for the global minimizers on smooth bounded 2D domains, with smooth boundary and topologically trivial Dirichlet conditions. The {\it second part} focuses on the discrete approximation of regular solutions of the corresponding non-linear system of partial differential equations with cubic non-linearity and non-homogeneous Dirichlet boundary conditions. We establish (i) the existence and local uniqueness of the discrete solutions using fixed point argument, (ii) a best approximation result in energy norm, (iii) error estimates in the energy and $L^2$ norms with $\ell $- discretization parameter dependency for the conforming finite element method. Finally, the theoretical results are complemented by numerical experiments on the discrete solution profiles, the numerical convergence rates that corroborates the theoretical estimates, followed by plots that illustrate the dependence of the discretization parameter on $\ell$.


title: Spin dynamics of itinerant electrons: local magnetic moment formation and Berry phase

abstract: The state-of-the-art theoretical description of magnetic materials relies on solving effective Heisenberg spin problems or their generalizations to relativistic or multi-spin-interaction cases that explicitly assume the presence of local magnetic moments in the system. We start with a general interacting fermionic model that is often obtained in ab initio electronic structure calculations and show that the corresponding spin problem can be introduced even in the paramagnetic regime, which is characterized by a zero average value of the magnetization. Further, we derive a physical criterion for the formation of the local magnetic moment and confirm that the latter exists already at high temperatures well above the transition to the ordered magnetic state. The use of path-integral techniques allows us to disentangle spin and electronic degrees of freedom and to carefully separate rotational dynamics of the local magnetic moment from Higgs fluctuations of its absolute value. It also allows us to accurately derive the topological Berry phase and relate it to a physical bosonic variable that describes dynamics of the spin degrees of freedom. As the result, we demonstrate that the equation of motion in the case of a large magnetic moment takes a conventional Landau-Lifshitz form that explicitly accounts for the Gilbert damping due to itinerant nature of the original electronic model.


title: Universal control of quantum processes using sector-preserving channels

abstract: No quantum circuit can turn a completely unknown unitary gate into its coherently controlled version. Yet, coherent control of unknown gates has been realised in experiments, making use of a different type of initial resources. Here, we formalise the task achieved by these experiments, extending it to the control of arbitrary noisy channels, and to more general types of control involving higher dimensional control systems. For the standard notion of coherent control, we identify the information-theoretic resource for controlling an arbitrary quantum channel on a $d$-dimensional system: specifically, the resource is an extended quantum channel acting as the original channel on a $d$-dimensional sector of a $(d+1)$-dimensional system. Using this resource, arbitrary controlled channels can be built with a universal circuit architecture. We then extend the standard notion of control to more general notions, including control of multiple channels with possibly different input and output systems. Finally, we develop a theoretical framework, called supermaps on routed channels, which provides a compact representation of coherent control as an operation performed on the extended channels, and highlights the way the operation acts on different sectors.


title: Magnetic anisotropy in uranium monosulfide, probed by the magnetic torque measurements

abstract: We have studied the magnetic torque in uranium monosulfide (US) single crystals to explore the magnetic anisotropy in this material. Uranium monosulfide crystallizes in cubic, NaCl-type of crystal structure and exhibits the largest magneto-crystalline anisotropy observed in cubic systems. By performing detailed torque measurements we observe a strongly anisotropic behavior in the paramagnetic phase due to crystal defects and quadrupolar pair interactions. Our studies also confirm the presence of a large anisotropy in the ferromagnetic state of the US system with the <100>, <111>, and <110> directions being hard, easy, and intermediate axis, respectively. Furthermore, the anisotropy in the paramagnetic phase shows similar characteristics to the anisotropy observed in the ferromagnetic phase, as characterized by second and fourth rank susceptibility terms. The similarity of the anisotropic behaviors in paramagnetic and ferromagnetic phases is the consequence of strong magneto-elastic properties in this system, which possibly lead to the rhombohedral structural distortion, not only in the ferromagnetic phase but also in the paramagnetic phase (induced by applied magnetic fiield).


title: Linear Cutting Blocking Sets and Minimal Codes in the Rank Metric

abstract: This work investigates the structure of rank-metric codes in connection with concepts from finite geometry, most notably the $q$-analogues of projective systems and blocking sets. We also illustrate how to associate a classical Hamming-metric code to a rank-metric one, in such a way that various rank-metric properties naturally translate into the homonymous Hamming-metric notions under this correspondence. The most interesting applications of our results lie in the theory of minimal rank-metric codes, which we introduce and study from several angles. Our main contributions are bounds for the parameters of a minimal rank-metric codes, a general existence result based on a combinatorial argument, and an explicit code construction for some parameter sets that uses the notion of a scattered linear set. Throughout the paper we also show and comment on curious analogies/divergences between the theories of error-correcting codes in the rank and in the Hamming metric.


title: Rapid Identification of Strongly Lensed Gravitational-Wave Events with Machine Learning

abstract: A small fraction of the gravitational-wave (GW) signals that will be detected by second and third generation detectors are expected to be strongly lensed by galaxies and clusters, producing multiple observable copies. While optimal Bayesian model selection methods are developed to identify lensed signals, processing tens of thousands (billions) of possible pairs of events detected with second (third) generation detectors is both computationally intensive and time consuming. To mitigate this problem, we propose to use machine learning to rapidly rule out a vast majority of candidate lensed pairs. As a proof of principle, we simulate non-spinning binary black hole events added to Gaussian noise, and train the machine on their time-frequency maps (Q-transforms) and localisation skymaps (using Bayestar), both of which can be generated in seconds. We show that the trained machine is able to accurately identify lensed pairs with efficiencies comparable to existing Bayesian methods.


title: Constraining CMB temperature evolution with Sunyaev-Zel'dovich galaxy clusters from the Atacama Cosmology Telescope

abstract: The Sunyaev-Zel'dovich (SZ) effect introduces a specific distortion of the blackbody spectrum of the cosmic microwave background (CMB) radiation when it scatters off hot gas in clusters of galaxies. The frequency dependence of the distortion is only independent of the cluster redshift when the evolution of the CMB radiation is adiabatic. Using 370 clusters within the redshift range $0.07\lesssim z\lesssim1.4$ from the largest SZ-selected cluster sample to date from the Atacama Cosmology Telescope, we provide new constraints on the deviation of CMB temperature evolution from the standard model $\alpha=0.017^{+0.029}_{-0.032}$, where $T(z)=T_0(1+z)^{1-\alpha}$. This result is consistent with no deviation from the standard adiabatic model. Combining it with previous, independent datasets we obtain a joint constraint of $\alpha=-0.001\pm0.012$. Attributing deviation from adiabaticity to the decay of dark energy, this result constrains its effective equation of state $w_\mathrm{eff}=-0.998^{+0.008}_{-0.010}$.


title: State- and molecule-selective rotational control in gas mixtures with a shaped optical centrifuge

abstract: We demonstrate experimentally a method of all-optical selective rotational control in gas mixtures. Using an optical centrifuge - an intense laser pulse whose linear polarization rotates at an accelerated rate, we simultaneously excite two different molecular species to two different rotational frequencies of choice. The new level of control is achieved by shaping the centrifuge spectrum according to the rotational spectra of the centrifuged molecules. The shaped optical centrifuge releases one molecular species earlier than the other, therefore separating their target rotational frequencies and corresponding rotational states. The technique will expand the utility of rotational control in the studies of the effects of molecular rotation on collisions and chemical reactions.


title: Motion of a gyroscope on a closed timelike curve

abstract: We consider the motion of a gyroscope on a closed timelike curve (CTC). A gyroscope is identified with a unit-length spacelike vector - a spin-vector - orthogonal to the tangent to the CTC, and satisfying the equations of Fermi-Walker transport along the curve. We investigate the consequences of the periodicity of the coefficients of the transport equations, which arise from the periodicty of the CTC, which is assumed to be piecewise $C^2$. We show that every CTC with period $T$ admits at least one $T-$periodic spin-vector. Further, either every other spin-vector is $T-$periodic, or no others are. It follows that gyroscopes carried by CTCs are either all $T-$periodic, or are generically not $T-$periodic. We consider examples of spacetimes admitting CTCs, and address the question of whether $T-$periodicity of gyroscopic motion occurs generically or only on a negligible set for these CTCs. We discuss these results from the perspective of principles of consistency in spacetimes admitting CTCs.


title: Bilateral Control of Teleoperators with Closed Architecture and Time-Varying Delay

abstract: This paper investigates bilateral control of teleoperators with closed architecture and subjected to arbitrary bounded time-varying delay. A prominent challenge for bilateral control of such teleoperators lies in the closed architecture, especially in the context not involving interaction force/torque measurement. This yields the long-standing situation that most bilateral control rigorously developed in the literature is hard to be justified as applied to teleoperators with closed architecture. With a new class of dynamic feedback, we propose kinematic and adaptive dynamic controllers for teleoperators with closed architecture, and we show that the proposed kinematic and dynamic controllers are robust with respect to arbitrary bounded time-varying delay. In addition, by exploiting the input-output properties of an inverted form of the dynamics of robot manipulators with closed architecture, we remove the assumption of uniform exponential stability of a linear time-varying system due to the adaptation to the gains of the inner controller in demonstrating stability of the presented adaptive dynamic control. The application of the proposed approach is illustrated by the experimental results using a Phantom Omni and a UR10 robot.


title: Spatiotemporal Isotropic-to-Anisotropic Meta-Atoms

abstract: Metamaterials and metasurfaces are designed by periodically arranged subwavelength geometries, allowing a tailored manipulation of the electromagnetic response of matter. Here, we exploit temporal variations of permittivity inside subwavelength geometries to propose the concept of spatiotemporal meta-atoms having time-dependent properties. We exploit isotropic-to-anisotropic temporal boundaries within spatially subwavelength regions where their permittivity is rapidly changed in time. In so doing, it is shown how resulting scattered waves travel in directions that are different from the direction of the impinging wave, and depend on the values of the chosen anisotropic permittivity tensor. To provide a full physical insight of their performance, multiple scenarios are studied numerically such as the effect of using different values of permittivity tensor, different geometries of the spatiotemporal meta-atom and time duration of the induced isotropic-to-anisotropic temporal boundary. The intrinsic asymmetric response of the proposed spatiotemporal meta-atoms is also studied demonstrating, both theoretically and numerically, its potential for an at-will manipulation of scattered waves in real time. These results may open new paradigms for controlling wave-matter interactions and may pave the way for the next generation of metamaterials and metasurfaces by unleashing their potential using four-dimensional (4D) unit cells.


title: Finding simplicity: unsupervised discovery of features, patterns, and order parameters via shift-invariant variational autoencoders

abstract: Recent advances in scanning tunneling and transmission electron microscopies (STM and STEM) have allowed routine generation of large volumes of imaging data containing information on the structure and functionality of materials. The experimental data sets contain signatures of long-range phenomena such as physical order parameter fields, polarization and strain gradients in STEM, or standing electronic waves and carrier-mediated exchange interactions in STM, all superimposed onto scanning system distortions and gradual changes of contrast due to drift and/or mis-tilt effects. Correspondingly, while the human eye can readily identify certain patterns in the images such as lattice periodicities, repeating structural elements, or microstructures, their automatic extraction and classification are highly non-trivial and universal pathways to accomplish such analyses are absent. We pose that the most distinctive elements of the patterns observed in STM and (S)TEM images are similarity and (almost-) periodicity, behaviors stemming directly from the parsimony of elementary atomic structures, superimposed on the gradual changes reflective of order parameter distributions. However, the discovery of these elements via global Fourier methods is non-trivial due to variability and lack of ideal discrete translation symmetry. To address this problem, we develop shift-invariant variational autoencoders (shift-VAE) that allow disentangling characteristic repeating features in the images, their variations, and shifts inevitable for random sampling of image space. Shift-VAEs balance the uncertainty in the position of the object of interest with the uncertainty in shape reconstruction. This approach is illustrated for model 1D data, and further extended to synthetic and experimental STM and STEM 2D data.


title: High-temperature Majorana zero modes

abstract: We employ general arguments and numerical simulations to show that unpaired Majorana zero modes can occur in cores of Abrikosov vortices at the interface between a three-dimensional topological insulator, such as Bi$_2$Se$_3$, and a twisted bilayer of high-$T_c$ cuprate superconductor, such as Bi$_2$Sr$_2$CaCu$_2$O$_{8+\delta}$. When the twist angle is close to $45^{\rm o}$ the latter forms a fully gapped topological superconductor up to temperatures approaching its native $T_c\simeq 90$K. Majorana zero modes in these structures will persist up to unprecedented high temperatures and, depending on the quality of the interface, may be protected by gaps with larger magnitudes than other candidate systems.


title: Formalizing the Execution Context of Behavior Trees for Runtime Verification of Deliberative Policies

abstract: In this paper, we enable automated property verification of deliberative components in robot control architectures. We focus on formalizing the execution context of Behavior Trees (BTs) to provide a scalable, yet formally grounded, methodology to enable runtime verification and prevent unexpected robot behaviors. To this end, we consider a message-passing model that accommodates both synchronous and asynchronous composition of parallel components, in which BTs and other components execute and interact according to the communication patterns commonly adopted in robotic software architectures. We introduce a formal property specification language to encode requirements and build runtime monitors. We performed a set of experiments, both on simulations and on the real robot, demonstrating the feasibility of our approach in a realistic application and its integration in a typical robot software architecture. We also provide an OS-level virtualization environment to reproduce the experiments in the simulated scenario.


title: Mixtures of Deep Neural Experts for Automated Speech Scoring

abstract: The paper copes with the task of automatic assessment of second language proficiency from the language learners' spoken responses to test prompts. The task has significant relevance to the field of computer assisted language learning. The approach presented in the paper relies on two separate modules: (1) an automatic speech recognition system that yields text transcripts of the spoken interactions involved, and (2) a multiple classifier system based on deep learners that ranks the transcripts into proficiency classes. Different deep neural network architectures (both feed-forward and recurrent) are specialized over diverse representations of the texts in terms of: a reference grammar, the outcome of probabilistic language models, several word embeddings, and two bag-of-word models. Combination of the individual classifiers is realized either via a probabilistic pseudo-joint model, or via a neural mixture of experts. Using the data of the third Spoken CALL Shared Task challenge, the highest values to date were obtained in terms of three popular evaluation metrics.


title: A comparison of exact and model exchange-correlation potentials for molecules

abstract: Accurate exchange-correlation (XC) potentials for 3-dimensional systems -- via solution of the \emph{inverse} density functional theory (DFT) problem -- are now available to test the quality of DFT approximations. Herein, the \emph{exact} XC potential for six molecules -- hydrogen molecule at three different bond-lengths, lithium hydride, water, and ortho-benzyne -- are computed using accurate ground-state densities from full configuration interaction (CI) calculations. These potentials are then compared to model XC potentials obtained from DFT calculations with commonly used non-local (B3LYP, HSE06, SCAN0, and M08-HX) and local/semi-local (SCAN, PBE, PW92) XC functionals. While relative errors in the ground-state densities from these models are order $\mathcal{O}(10^{-3}-10^{-2})$, much larger errors in the model XC potentials are found, $\mathcal{O}(10^{-1}-10^0)$, in both the $L_2$ norm of the potential as well as its gradients. These errors are exacerbated in strongly correlated situations, such as the stretched $\text{H}_2$ molecule. Among the model XC functionals under consideration, SCAN0 offers the best quantitative and qualitative agreement with the exact XC potential, underlining the significance of satisfying the exact conditions as well as the incorporation of non-local effects in the construction of XC functionals. Overall, this work indicates that tests against the exact XC potential will provide a promising new direction for building more accurate XC functionals for DFT.


title: Analysis of a Casimir-driven Parametric Amplifier with Resilience to Casimir Pull-in for MEMS Single-Point Magnetic Gradiometry

abstract: The Casimir Force, a quantum mechanical effect, has been observed in several microelectromechanical systems (MEMS) platforms. Due to its extreme sensitivity to the separation of two objects, the Casimir Force has been proposed as an excellent avenue for quantum metrology. Practical application, however, is challenging due to attractive forces leading to stiction and failure of the device, called Casimir pull-in. In this work, we design and simulate a Casimir-driven metrology platform, where a time-delay based parametric amplification technique is developed to achieve a steady state and avoid pull-in. We apply the design to the detection of weak, low frequency, gradient magnetic fields, similar to those emanating from ionic currents in the heart and brain. Simulation parameters are selected from recent experimental platforms developed for Casimir metrology and magnetic gradiometry, both on MEMS platforms. While MEMS offer many advantages to such an application, the detected signal must typically be at the resonant frequency of the device, with diminished sensitivity in the low frequency regime of biomagnetic fields. Using a Casimir-drive parametric amplifier, we report a 10,000 fold improvement in the best-case resolution of MEMS single-point gradiometers, with a maximum sensitivity of 6 Hz/(pT/cm) at 1 Hz. The development of the proposed design has the potential to revolutionize metrology, and specifically may enable unshielded monitoring of biomagnetic fields in ambient conditions.


title: Teacher Model Fingerprinting Attacks Against Transfer Learning

abstract: Transfer learning has become a common solution to address training data scarcity in practice. It trains a specified student model by reusing or fine-tuning early layers of a well-trained teacher model that is usually publicly available. However, besides utility improvement, the transferred public knowledge also brings potential threats to model confidentiality, and even further raises other security and privacy issues. In this paper, we present the first comprehensive investigation of the teacher model exposure threat in the transfer learning context, aiming to gain a deeper insight into the tension between public knowledge and model confidentiality. To this end, we propose a teacher model fingerprinting attack to infer the origin of a student model, i.e., the teacher model it transfers from. Specifically, we propose a novel optimization-based method to carefully generate queries to probe the student model to realize our attack. Unlike existing model reverse engineering approaches, our proposed fingerprinting method neither relies on fine-grained model outputs, e.g., posteriors, nor auxiliary information of the model architecture or training dataset. We systematically evaluate the effectiveness of our proposed attack. The empirical results demonstrate that our attack can accurately identify the model origin with few probing queries. Moreover, we show that the proposed attack can serve as a stepping stone to facilitating other attacks against machine learning models, such as model stealing.


title: Classifying Textual Data with Pre-trained Vision Models through Transfer Learning and Data Transformations

abstract: Knowledge is acquired by humans through experience, and no boundary is set between the kinds of knowledge or skill levels we can achieve on different tasks at the same time. When it comes to Neural Networks, that is not the case. The breakthroughs in the field are extremely task and domain-specific. Vision and language are dealt with in separate manners, using separate methods and different datasets. Current text classification methods, mostly rely on obtaining contextual embeddings for input text samples, then training a classifier on the embedded dataset. Transfer learning in Language-related tasks in general, is heavily used in obtaining the contextual text embeddings for the input samples. In this work, we propose to use the knowledge acquired by benchmark Vision Models which are trained on ImageNet to help a much smaller architecture learn to classify text. A data transformation technique is used to create a new image dataset, where each image represents a sentence embedding from the last six layers of BERT, projected on a 2D plane using a t-SNE based method. We trained five models containing early layers sliced from vision models which are pretrained on ImageNet, on the created image dataset for the IMDB dataset embedded with the last six layers of BERT. Despite the challenges posed by the very different datasets, experimental results achieved by this approach which links large pretrained models on both language and vision, are very promising, without employing compute resources. Specifically, Sentiment Analysis is achieved by five different models on the same image dataset obtained after BERT embeddings are transformed into gray scale images. Index Terms: BERT, Convolutional Neural Networks, Domain Adaptation, image classification, Natural Language Processing, t-SNE, text classification, Transfer Learning


title: On the placement of an obstacle so as to optimize the Dirichlet heat content

abstract: We prove that among all doubly connected domains of R^n (n>=2) bounded by two spheres of given radii, the Dirichlet heat content at any fixed time achieves its minimum when the spheres are concentric. This is shown to be a special case of a more general theorem concerning the optimal placement of a convex obstacle inside some larger domain so as to maximize or minimize the Dirichlet heat content.


title: Decentralized Spatial-Temporal Trajectory Planning for Multicopter Swarms

abstract: Multicopter swarms with decentralized structure possess the nature of flexibility and robustness, while efficient spatial-temporal trajectory planning still remains a challenge. This report introduces decentralized spatial-temporal trajectory planning, which puts a well-formed trajectory representation named MINCO into multi-agent scenarios. Our method ensures high-quality local planning for each agent subject to any constraint from either the coordination of the swarm or safety requirements in cluttered environments. Then, the local trajectory generation is formulated as an unconstrained optimization problem that is efficiently solved in milliseconds. Moreover, a decentralized asynchronous mechanism is designed to trigger the local planning for each agent. A systematic solution is presented with detailed descriptions of careful engineering considerations. Extensive benchmarks and indoor/outdoor experiments validate its wide applicability and high quality. Our software will be released for the reference of the community.


title: $\eta^{(')}\to\pi^+\pi^-\gamma^{(\ast)}$ in large-$N_c$ chiral perturbation theory

abstract: We present a calculation of the decays $\eta^{(')}\to\pi^+\pi^-\gamma^{(\ast)}$ at the one-loop level up to and including next-to-next-to-leading order (NNLO) in large-$N_c$ chiral perturbation theory. The numerical evaluation of the results is performed successively at LO, NLO, and NNLO, fitting the relevant low-energy constants to the available experimental data. We discuss the widths and decay spectra of $\eta^{(')}\to\pi^+\pi^-\gamma$ as well as $\eta^{(')}\to\pi^+\pi^-l^+l^-$, with $l=e,\ \mu$.


title: Hadronic loop effects on the radiative decays of the first radial excitations of $\eta$ and $\eta'$

abstract: Based on the one state assumption of $\eta(1405)$ and $\eta(1475)$, thus, $\eta(1295)$ and $\eta(1405/1475)$ are organized as the first radial excitations of $\eta$ and $\eta'$, respectively, we investigate the productions and radiative decays of these two states in $J/\psi\to \gamma\eta_X\to \gamma\gamma V$, where $\eta_X$ stands for $\eta(1295)$ and $\eta(1405/1475)$ and $V$ for vector mesons $\rho^0, \ \omega, \ \phi$. As we have learned from previous studies that the hadronic decays of these two states receive important contributions from the intermediate $\bar{K}K^*+c.c.$ meson loops due to the triangle singularity mechanism, we show that some measurable effects can also arise from the $\bar{K}K^*+c.c.$ meson loops in their radiative decays. Our calculation shows that the impact of the $\bar{K}K^*+c.c.$ meson loops on the $\eta(1405/1475)$ radiative decays is relatively smaller than on $\eta(1295)$ since the latter has a much larger coupling to $\bar{K}K^*+c.c.$ However, the production of $\eta(1295)$ in the $J/\psi$ radiative decays will be strongly suppressed. As a consequence of the $\bar{K}K^*+c.c.$ meson loop contributions, we find that the mixing angle extracted in the radiative decays of $\eta(1295)$ and $\eta(1405/1475)$ will be different from each other, and both are different from the one determined in other processes.


title: From Canonical Correlation Analysis to Self-supervised Graph Neural Networks

abstract: We introduce a conceptually simple yet effective model for self-supervised representation learning with graph data. It follows the previous methods that generate two views of an input graph through data augmentation. However, unlike contrastive methods that focus on instance-level discrimination, we optimize an innovative feature-level objective inspired by classical Canonical Correlation Analysis. Compared with other works, our approach requires none of the parameterized mutual information estimator, additional projector, asymmetric structures, and most importantly, negative samples which can be costly. We show that the new objective essentially 1) aims at discarding augmentation-variant information by learning invariant representations, and 2) can prevent degenerated solutions by decorrelating features in different dimensions. Our theoretical analysis further provides an understanding for the new objective which can be equivalently seen as an instantiation of the Information Bottleneck Principle under the self-supervised setting. Despite its simplicity, our method performs competitively on seven public graph datasets. The code is available at: https://github.com/hengruizhang98/CCA-SSG.


title: Particle-In-Cell Simulation using Asynchronous Tasking

abstract: Recently, task-based programming models have emerged as a prominent alternative among shared-memory parallel programming paradigms. Inherently asynchronous, these models provide native support for dynamic load balancing and incorporate data flow concepts to selectively synchronize the tasks. However, tasking models are yet to be widely adopted by the HPC community and their effective advantages when applied to non-trivial, real-world HPC applications are still not well comprehended. In this paper, we study the parallelization of a production electromagnetic particle-in-cell (EM-PIC) code for kinetic plasma simulations exploring different strategies using asynchronous task-based models. Our fully asynchronous implementation not only significantly outperforms a conventional, synchronous approach but also achieves near perfect scaling for 48 cores.


title: Absent thermal equilibration on fractional quantum Hall edges over macroscopic scale

abstract: Two-dimensional topological insulators, and in particular quantum Hall states, are characterized by an insulating bulk and a conducting edge. Fractional states may host both downstream (dictated by the magnetic field) and upstream propagating edge modes, which leads to complex transport behavior. Here, we combine two measurement techniques, local noise thermometry and thermal conductance, to study thermal properties of states with counter-propagating edge modes. We find that, while charge equilibration between counter-propagating edge modes is very fast, the equilibration of heat is extremely inefficient, leading to an almost ballistic heat transport over macroscopic distances. Moreover, we observe an emergent quantization of the heat conductance associated with a strong interaction fixed point of the edge modes. This new understanding of the thermal equilibration on edges with counter-propagating modes is a natural route towards extracting the topological order of the exotic 5/2 state.


title: An FFT-based approach for Bloch wave analysis: application to polycrystals

abstract: A method based on the Fast Fourier Transform is proposed to obtain the dispersion relation of acoustic waves in heterogeneous periodic media with arbitrary microstructures. The microstructure is explicitly considered using a voxelized Representative Volume Element (RVE). The dispersion diagram is obtained solving an eigenvalue problem for Bloch waves in Fourier space. To this aim, two linear operators representing stiffness and mass are defined through the use of differential operators in Fourier space. The smallest eigenvalues are obtained using the implicitly restarted Lanczos and the subspace iteration methods, and the required inverse of the stiffness operator is done using the conjugate gradient with a preconditioner. The method is used to study the propagation of acoustic waves in elastic polycrystals, showing the strong effect of crystal anistropy and polycrystaline texture on the propagation. It is shown that the method combines the simplicity of classical Fourier series analysis with the versatility of Finite Elements to account for complex geometries proving an efficient and general approach which allows the use of large RVEs in 3D.


title: Deep Multi-Task Model for Sarcasm Detection and Sentiment Analysis in Arabic Language

abstract: The prominence of figurative language devices, such as sarcasm and irony, poses serious challenges for Arabic Sentiment Analysis (SA). While previous research works tackle SA and sarcasm detection separately, this paper introduces an end-to-end deep Multi-Task Learning (MTL) model, allowing knowledge interaction between the two tasks. Our MTL model's architecture consists of a Bidirectional Encoder Representation from Transformers (BERT) model, a multi-task attention interaction module, and two task classifiers. The overall obtained results show that our proposed model outperforms its single-task counterparts on both SA and sarcasm detection sub-tasks.


title: Multi-modal and frequency-weighted tensor nuclear norm for hyperspectral image denoising

abstract: Low-rankness is important in the hyperspectral image (HSI) denoising tasks. The tensor nuclear norm (TNN), defined based on the tensor singular value decomposition, is a state-of-the-art method to describe the low-rankness of HSI. However, TNN ignores some physical meanings of HSI in tackling denoising tasks, leading to suboptimal denoising performance. In this paper, we propose the multi-modal and frequency-weighted tensor nuclear norm (MFWTNN) and the non-convex MFWTNN for HSI denoising tasks. Firstly, we investigate the physical meaning of frequency slices and reconsider their weights to improve the low-rank representation ability of TNN. Secondly, we consider the correlation among two spatial dimensions and the spectral dimension of HSI and combine the above improvements to TNN to propose MFWTNN. Thirdly, we use non-convex functions to approximate the rank function of the frequency tensor and propose the NonMFWTNN to relax the MFWTNN better. Besides, we adaptively choose bigger weights for slices mainly containing noise information and smaller weights for slices containing profile information. Finally, we develop the efficient alternating direction method of multiplier (ADMM) based algorithm to solve the proposed models, and the effectiveness of our models are substantiated in simulated and real HSI datasets.


title: 2-Representations and Associated Coalgebra 1-Morphisms for Locally Wide Finitary 2-Categories

abstract: We define locally wide finitary 2-categories by relaxing the definition of finitary 2-categories to allow infinitely many objects and isomorphism classes of 1-morphisms and infinite dimensional hom-spaces of 2-morphisms. After defining related concepts including transitive 2-representations in this setting, we provide a new method of constructing coalgebra 1-morphisms associated to transitive 2-representations of locally wide weakly fiat 2-categories, and demonstrate that any such transitive 2-representation is equivalent to a certain subcategory of the category of comodule 1-morphisms over the coalgebra 1-morphism. We finish the paper by examining two classes of examples of locally wide weakly fiat 2-categories: 2-categories associated to certain classes of infinite quivers, and singular Soergel bimodules associated to Coxeter groups with finitely many simple reflections.


title: Training Data Subset Selection for Regression with Controlled Generalization Error

abstract: Data subset selection from a large number of training instances has been a successful approach toward efficient and cost-effective machine learning. However, models trained on a smaller subset may show poor generalization ability. In this paper, our goal is to design an algorithm for selecting a subset of the training data, so that the model can be trained quickly, without significantly sacrificing on accuracy. More specifically, we focus on data subset selection for L2 regularized regression problems and provide a novel problem formulation which seeks to minimize the training loss with respect to both the trainable parameters and the subset of training data, subject to error bounds on the validation set. We tackle this problem using several technical innovations. First, we represent this problem with simplified constraints using the dual of the original training problem and show that the objective of this new representation is a monotone and alpha-submodular function, for a wide variety of modeling choices. Such properties lead us to develop SELCON, an efficient majorization-minimization algorithm for data subset selection, that admits an approximation guarantee even when the training provides an imperfect estimate of the trained model. Finally, our experiments on several datasets show that SELCON trades off accuracy and efficiency more effectively than the current state-of-the-art.


title: Salt-in-Ionic-Liquid Electrolytes: Ion Network Formation and Negative Effective Charges of Alkali Metal Cations

abstract: Salt-in-ionic liquid electrolytes have attracted significant attention as potential electrolytes for next generation batteries largely due to their safety enhancements over typical organic electrolytes. However, recent experimental and computational studies have shown that under certain conditions alkali cations can migrate in electric fields as if they carried a net negative effective charge. In particular, alkali cations were observed to have negative transference numbers at small mole fractions of alkali metal salt that revert to the expected net positive transference numbers at large mole fractions. Simulations have provided some insights into these observations, where the formation of asymmetric ionic clusters, as well as a percolating ion network could largely explain the anomalous transport of alkali cations. However, a thermodynamic theory that captures such phenomena has not been developed, as ionic associations were typically treated via the formation of ion pairs. The theory presented herein, based on the classical polymer theories, describes thermoreversible associations between alkali cations and anions, where the formation of large, asymmetric ionic clusters and a percolating ionic network are a natural result of the theory. Furthermore, we present several general methods to calculate the effective charge of alkali cations in ionic liquids. We note that the negative effective charge is a robust prediction with respect to the parameters of the theory, and that the formation of a percolating ionic network leads to the restoration of net positive charges of the cations at large mole fractions of alkali metal salt. Overall, we find excellent qualitative agreement between our theory and molecular simulations in terms of ionic cluster statistics and the effective charges of the alkali cations.


title: Large Deviations For Randomly Weighted Sums of Random Measures

abstract: Let $\{{\bf \mathcal{Z}}_n:n\geq 1\}$ be a sequence of i.i.d. random probability measures. Independently, for each $n\geq 1$, let $(X_{n1},\ldots, X_{nn})$ be a random vector of positive random variables that add up to one. This paper studies the large deviation principles for the randomly weighted sum $\sum_{i=1}^{n} X_{ni} \mathcal{Z}_i$. In the case of finite Dirichlet weighted sum of Dirac measures, we obtain an explicit form for the rate function. It provides a new measurement of divergence between probabilities. As applications, we obtain the large deviation principles for a class of randomly weighted means including the Dirichlet mean and the corresponding posterior mean. We also identify the minima of relative entropy with mean constraint in both forward and reverse directions.


title: On the density of foliations without algebraic solutions on weighted projective planes

abstract: We prove that a generic holomorphic foliation on a weighted projective plane has no algebraic solutions when the degree is big enough. We also prove an analogous result for foliations on Hirzebruch surfaces.


title: BERT-based Multi-Task Model for Country and Province Level Modern Standard Arabic and Dialectal Arabic Identification

abstract: Dialect and standard language identification are crucial tasks for many Arabic natural language processing applications. In this paper, we present our deep learning-based system, submitted to the second NADI shared task for country-level and province-level identification of Modern Standard Arabic (MSA) and Dialectal Arabic (DA). The system is based on an end-to-end deep Multi-Task Learning (MTL) model to tackle both country-level and province-level MSA/DA identification. The latter MTL model consists of a shared Bidirectional Encoder Representation Transformers (BERT) encoder, two task-specific attention layers, and two classifiers. Our key idea is to leverage both the task-discriminative and the inter-task shared features for country and province MSA/DA identification. The obtained results show that our MTL model outperforms single-task models on most subtasks.


title: Threaded Code Generation with a Meta-Tracing JIT Compiler

abstract: Language implementation frameworks, e.g., RPython and Truffle/Graal, are practical tools for creating efficient virtual machines, including a well-functioning just-in-time (JIT) compiler. It is demanding to support multitier JIT compilation in such a framework for language developers. This paper presents an idea to generate threaded code by reusing an existing meta-tracing JIT compiler, as well as an interpreter design for it. Our approach does not largely modify RPython itself but constructs an effective interpreter definition to enable threaded code generation in RPython. We expect our system to be extended to support multilevel JIT compilation in the RPython framework. We measured the potential performance of our threaded code generation by simulating its behavior in PyPy. We confirmed that our approach reduced code sizes by 80 \% and compilation times by 60 \% compared to PyPy's JIT compiler on average, and ran about 7 \% faster than the interpreter-only execution.


title: Adapting Off-the-Shelf Source Segmenter for Target Medical Image Segmentation

abstract: Unsupervised domain adaptation (UDA) aims to transfer knowledge learned from a labeled source domain to an unlabeled and unseen target domain, which is usually trained on data from both domains. Access to the source domain data at the adaptation stage, however, is often limited, due to data storage or privacy issues. To alleviate this, in this work, we target source free UDA for segmentation, and propose to adapt an ``off-the-shelf" segmentation model pre-trained in the source domain to the target domain, with an adaptive batch-wise normalization statistics adaptation framework. Specifically, the domain-specific low-order batch statistics, i.e., mean and variance, are gradually adapted with an exponential momentum decay scheme, while the consistency of domain shareable high-order batch statistics, i.e., scaling and shifting parameters, is explicitly enforced by our optimization objective. The transferability of each channel is adaptively measured first from which to balance the contribution of each channel. Moreover, the proposed source free UDA framework is orthogonal to unsupervised learning methods, e.g., self-entropy minimization, which can thus be simply added on top of our framework. Extensive experiments on the BraTS 2018 database show that our source free UDA framework outperformed existing source-relaxed UDA methods for the cross-subtype UDA segmentation task and yielded comparable results for the cross-modality UDA segmentation task, compared with a supervised UDA methods with the source data.


title: Universal Consistency of Deep Convolutional Neural Networks

abstract: Compared with avid research activities of deep convolutional neural networks (DCNNs) in practice, the study of theoretical behaviors of DCNNs lags heavily behind. In particular, the universal consistency of DCNNs remains open. In this paper, we prove that implementing empirical risk minimization on DCNNs with expansive convolution (with zero-padding) is strongly universally consistent. Motivated by the universal consistency, we conduct a series of experiments to show that without any fully connected layers, DCNNs with expansive convolution perform not worse than the widely used deep neural networks with hybrid structure containing contracting (without zero-padding) convolution layers and several fully connected layers.


title: Generative Self-training for Cross-domain Unsupervised Tagged-to-Cine MRI Synthesis

abstract: Self-training based unsupervised domain adaptation (UDA) has shown great potential to address the problem of domain shift, when applying a trained deep learning model in a source domain to unlabeled target domains. However, while the self-training UDA has demonstrated its effectiveness on discriminative tasks, such as classification and segmentation, via the reliable pseudo-label selection based on the softmax discrete histogram, the self-training UDA for generative tasks, such as image synthesis, is not fully investigated. In this work, we propose a novel generative self-training (GST) UDA framework with continuous value prediction and regression objective for cross-domain image synthesis. Specifically, we propose to filter the pseudo-label with an uncertainty mask, and quantify the predictive confidence of generated images with practical variational Bayes learning. The fast test-time adaptation is achieved by a round-based alternative optimization scheme. We validated our framework on the tagged-to-cine magnetic resonance imaging (MRI) synthesis problem, where datasets in the source and target domains were acquired from different scanners or centers. Extensive validations were carried out to verify our framework against popular adversarial training UDA methods. Results show that our GST, with tagged MRI of test subjects in new target domains, improved the synthesis quality by a large margin, compared with the adversarial training UDA methods.


title: A tale of parahoric--Hecke algebras, Bernstein and Satake homomorphisms

abstract: Let $\mathbf{G}$ be a connected reductive group over a {non-archimedean local field} $F$. Let $K_\mathcal{F}$ be the parahoric subgroup attached to a facet $\mathcal{F}$ in the Bruhat--Tits building of $\mathbf{G}$. The ultimate goal of the present paper is to describe the center of the parahoric--Hecke algebra $\mathcal{H}(\mathbf{G}(F)//K_{\mathcal{F}}, \mathbb{Z}[q^{-1}])$ with level $K_{\mathcal{F}}$ and prove the compatibility of generalized (twisted) Bernstein and Satake homomorphisms.


title: Self-similarity in the breakup of very dilute viscoelastic solutions

abstract: When pushed out of a syringe, polymer solutions form droplets attached by long and slender cylindrical filaments whose diameter decreases exponentially with time before eventually breaking. In the last stages of this process, a striking feature is the self-similarity of the solution shape near the end of the filament. This means that shapes at different times, if properly rescaled, collapse onto one universal shape. A theoretical description inspired by this similarity observation and based on the Oldroyd-B model was recently shown to disagree with existing experimental results. By revisiting these measurements and analysing the interface profiles of very diluted polyethylene oxide solutions at high temporal and spatial resolution, we show that they are very well described by the model.


title: Pushing the limits in real-time measurements of quantum dynamics

abstract: Time-resolved studies of quantum systems are the key to understand quantum dynamics at its core. The real-time measurement of individual quantum numbers as they switch between certain discrete values, well known as random telegraph signal, is expected to yield maximal physical insight. However, the signal suffers from both systematic errors, such as a limited time resolution and noise from the measurement apparatus, as well as statistical errors due to a limited amount of data. Here we demonstrate that an evaluation scheme based on factorial cumulants can reduce the influence of such errors by orders of magnitude. The error resilience is supported by a general theory for the detection errors as well as experimental data of single-electron tunnelling through a self-assembled quantum dot. Thus, factorial cumulants push the limits in the analysis of random telegraph data which represent a wide class of experiments in physics, chemistry, engineering and life sciences.